You can setup Serving instance in 2 differents ways:

  1. Setup on Docker Environment
  2. Setup on Kubernetes Cluster

Serving works along with the cli-tool. Make sure, you’ve installed it too.



Docker installation doesn’t differ much except that from where you’re taking your source files.

From Releases

Download and unpack the latest released version from releases page.

From Source

Clone serving repository.

$ git clone

Once you’ve obtained Serving files, you can deploy one of the 2 versions:

  1. The lightweight version lets you manage your models in a continuous manner, version them, create applications that use your models and deploy all of this into production. To do that, just execute the following:

     $ cd hydro-serving/
     $ docker-compose up -d 
  2. The integrations version extends the lightweight version and lets you also integrate kafka, grafana and influxdb.

     $ cd hydro-serving/integrations/
     $ docker-compose up -d

To check that everything works fine, open http://localhost/. By default UI is available at port 80.


There’s already a pre-built Helm charts for installing and maintaining Serving on Kubernetes clusters.


Installation can be performed in a few ways:

From Repo

Add Serving to the repo.

$ helm repo add hydrosphere

Install the chart from repo to the cluster.

$ helm install --name serving hydrosphere/serving

From Release

Choose a release from the releases page and install it as usual.

$ helm install --name serving

From Source

Clone the repository.

$ git clone
$ cd hydro-serving-helm

Build dependencies.

$ helm dependency build serving

Install the chart.

$ helm install --name serving

After chart was installed to the cluster, you have to expose a sidecar deployment outside of the cluster in order to access it. For the simplicity, I will just port-forward sidecar locally.

$ kubectl port-forward deployment/serving-sidecar 8080:80

To check that everything works fine, open http://localhost/. By default UI is available at port 80.

For more information about configuring serving release refer to the chart’s repository.



To install cli-tool, run:

$ pip install hs

What’s Next?