Chapter 7. Scaling Up Your Platform
In this chapter, we're going to extend what we saw in Chapter 6, Deploy Real Applications on Swarm. Our goal is to deploy a realistic production-grade Spark cluster on top of Swarm, add storage capacity, launch some Spark jobs and setup monitoring for the underlying infrastructure.
In order to do that, this chapter is mostly infrastructure-oriented. In fact, we'll see how to coalesce Libnetwork, Flocker, and Prometheus with Swarm.
For network, we'll use the basic Docker Network overlay system, based on Libnetwork. There are a few great networking plugins out there, such as Weave and others, but either they are not compatible with the new Docker Swarm Mode yet, or they are made obsolete by Swarm-integrated routing ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access