December 2017
Advanced
24m
English
on-demand course
Deploying Machine Learning Models as Microservices Using Docker
with Jason Slepicka, Mikhail Semeniuk
Closed Captioning available in German, English, Spanish, French, Japanese, Korean, Portuguese (Portugal, Brazil), Chinese (Simplified), Chinese (Traditional)
Overview
Modern applications running in the cloud often rely on REST-based microservices architectures by using Docker containers. Docker enables your applications to communicate between one another and to compose and scale various components. Data scientists use these techniques to efficiently scale their machine learning models to production applications. This video teaches you how to deploy machine learning models behind a REST API—to serve low latency requests from applications—without using a Spark cluster. In the process, you'll learn how to export models trained in SparkML; how to work with Docker, a convenient way to build, deploy, and ship application code for microservices; and how a model scoring service should support single on-demand predictions and bulk predictions. Learners should have basic familiarity with the following: Scala or Python; Hadoop, Spark, or Pandas; SBT or Maven; cloud platforms like Amazon Web Services; Bash, Docker, and REST.
- Understand how to deploy machine learning models behind a REST API
- Learn to utilize Docker containers for REST-based microservices architectures
- Explore methods for exporting models trained in SparkML using a library like Combust MLeap
- See how Docker builds, deploys, and ships application code for microservices
- Discover how to deploy a model using exported PMML with a REST API in a Docker container
- Learn to use the AWS elastic container service to deploy a model hosting server in Docker
- Pick up techniques that enable a model hosting server to read a model
Mikhail Semeniuk is a data engineer with Shift Technologies. Mikhail worked for six years as a senior level statistician for UnitedHealth Group, the largest health insurance provider in the United States. He holds a BS in Economics and Financial Math from the University of Minnesota.
Jason Slepicka is a senior data engineer with DataScience. Jason is working on his PhD in Computer Science at the University of Southern California Information Sciences Institute.
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Watch now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.