Metis Machine's Skafos

Machine Learning Delivered. A Machine Learning deployment platform built to unite Data Scientist, DevOps and Engineering.

Welcome to the Metis Machine documentation hub. You'll find comprehensive guides and documentation to help you start working with Metis Machine's Skafos platform as quickly as possible, as well as support if you get stuck. Fire it up!

Get Started    

Jupyter Integration

Skafos integrates with JupyterLab as a way to interactively build and test your ML pipelines.

Skafos + Jupyter = Better Together

Jupyter hosted on Skafos gives you the full power of the Skafos platform powering JupyterLab.

Introduction

Project Jupyter is a non-profit, open-source project to support interactive data science and scientific computing. JupyterLab is an interactive development environment that has full support for Jupyter Notebooks, is highly customizable, and provides integration between notebooks and code.

Skafos provisions a JupyterLab instance for every Skafos Project you create. Using JupyterLab is not required, but it can be an incredibly powerful tool for writing machine learning models.

When you create a new Project, a fresh lab instance is automatically provisioned for you to begin your development. To access this lab instance, navigate to the Dashboard and click on the Launch JupyterLab button next to the project of interest. Once inside your lab workspace, you can:

  • write and test new code for jobs within your project
  • easily install your favorite packages or dependencies in the terminal
  • interact with the Skafos SDK and Data Engine
  • track changes using git

This allows you to leverage the power of Skafos while working in a familiar development environment synced up to your personal code repository.

Jupyter Lab Features

Jupyter Lab has many features that many users are familiar with, and are well documented in the JupyterLab Documentation. These include:

Skafos Features within Jupyter Lab

Because each of the Jupyter Lab instances provisioned by Skafos is built on our infrastructure, you have full access to the Skafos SDK, including Data & ML Model Handling through the Skafos Data Engine. This is an excellent way to prototype data access and handling prior to delivering into a production pipeline.

Deployment

When you're ready to deploy your project from a notebook session, you have two options:
1) Use the terminal to push your code changes to the master branch on github. (You will need to add the Skafos App to your github repository first).
2) Download your notebook files locally and deploy using the CLI.

Coming Soon -- Deployment from JLabs

As part of ongoing Skafos development, we are working on a Skafos extension to make deployment even simpler and easier from Jupyter Labs.