What is Hydrosphere Mist?

Hydrosphere Mist is a serverless proxy for Spark. It provides a better way to write, deploy, run, and manage spark applications.

Features:

  • Spark Function as a Service. Deploy Spark functions rather than notebooks or scripts.
  • Typeful library api for scala and java + python dsl.
  • Spark contexts managing. Decoupling of user API from Spark settings, cluster provisioning, resource isolation, sharing and auto-scaling.
  • Support several interfaces for communication:
    • HTTP API
    • KAFKA
    • MQTT