Command Line Interface

To work with Serving from the command line we’ve created hs. It allows you to apply various resource configurations to the platform.

hs cluster

Cluster is a space, where you deploy your models. Simply put, it points where to apply your configurations and where to upload your models. It stores all the clusters in ~/.hs-home/config.yaml file.

# Example configuration

kind: Config
  - cluster: 
      server: ""
    name: local
current-cluster: local

To look up, which cluster you’re using, execute:

$ hs cluster

To add a new cluster, use:

$ hs cluster add --name new_local --server http://localhost:16000/

To switch to the new cluster, use:

$ hs cluster use new_local

To remove the new cluster, use:

$ hs cluster rm new_local

hs upload

When you upload a model, the tool looks for serving.yaml file in the current directory. serving.yaml defines model’s metadata and it’s contract. For more information, check out model’s manifest.

hs apply

You can apply custom resources on Serving. These resources are detected by kind key in the manifest files.

  • Model defines the model files, and it’s contract;
  • Runtime defines which runtimes to use by Serving;
  • Application defines an endpoint to reach your models.

What’s next?