Mist is a multi-user and multi-tenancy Spark job server.
It acts as a middleware between Apache Spark and your microservices.

Scroll Down


Mist Icon
Turn Analytics into Products

Increase the return on investment of big data analytics by building end user products on top of those.

Mist Icon
Expose data science and algorithms to enterprise apps

Makes it easier for developers to tap into big data models from web apps by addressing those as APIs.

Mist Icon
Simplify the handoff between business and data scientists

Deliver forecasting apps, smart alerts, and prescriptive insights that business can understand instead of statistical reports and raw algorithms.

Mist Icon
Lets business interact with big data

Write a simple web app that lets business users type input into the model and provide feedback. Then the data scientist tunes the model based on that. Provides an easy interface that does not require coding.

Mist Icon
Hide complex big data details

Regular, non-big-data web programmers can run complicated big data algorithms and models without having to understand machine learning, statistics, and advanced mathematics.

Mist Icon
Build productivity tools for data scientists

he advanced Mist user can use Mist to develop their own hosted notebooks, ETL builder, or write other productivity tools for data analysts.

The Mist Technology

Scala, Python and SQL

Run Spark jobs implemented in Scala, Python, HiveQL and Spark SQL contexts by passing parameters and retrieving results.

Synchronous and Asynchronous mode

Supports either HTTP or MQTT/AMQP for communication with Spark.

Orchestrates Spark Contexts

Mist instantiates and maintains the Spark context pool automatically for instant job execution.

High availability and fault tolerant

Mist is built on the Akka resilient, distributed messaging framework. It can also be deployed on Mesos for high availability and efficient resource utilization.

Self healing

Mist persists job information so they can recover after program failure.

Multiple JVMs and Spark versions

Mist manages multiple Spark contexts in multiple JVMs. This allows running jobs in different versions of Spark or on different Spark clusters, i.e, prod and QA, in parallel.

Open Source

Mist is open source softwares available under the Apache 2 License on GitHub

Hosted Version

Start from Hydrosphere Hosted and then move on premise any time