Learn Python by Building Data Science Applications

Kubernetes

Kubernetes (also known as K8S) is an orchestrating engine that operates over a pool of machines—physical or virtual—and can spawn and wind off containers dynamically. Technically, any container technology can be used, but Docker is by far the most popular one. 

For example, it is typical to use Dask on Kubernetes—in this case, Kubernetes will spawn more worker machines when you need them, and can either shut them down or switch to other users, once you're done—all without your intervention. Similarly, it can preserve a composition of containers performing different roles—for example, a load balancer for a web API, which then will redirect requests to different workers, who might operate on one or many database servers—all under ...