book

Docker Orchestration

Name: Docker Orchestration
Author: Randall Smith
ISBN: 9781787122123

by Randall Smith

January 2017

Intermediate to advanced

284 pages

6h 8m

English

Packt Publishing

Read now

Unlock full access

Docker Orchestration
Docker Orchestration
Credits
About the Author
About the Reviewer
www.PacktPub.com
Why subscribe?
Customer Feedback
Preface
What this book covers
What you need for this book
Who this book is for

Conventions
Reader feedback
Customer support
Downloading the example codeDownloading the color images of this bookErrataPiracyQuestions
1. Getting Started with Docker Orchestration
Installing Docker Engine
Installing with Docker Machine
Starting a host on AWSStarting a host on GCEStarting a host on Microsoft AzureInstalling on a running Linux host
Introducing Docker-specific distributions
CoreOSRancherOSProject Atomic / RHEL Atomic
Running single container applications
What is running?
Inspecting your container
Summary
2. Building Multi-Container Applications with Docker Compose
Building an image with Docker EngineBuilding from a DockerfileTagging the imageSkipping the build cacheRunning the image
Installing Docker Compose
Writing a Docker Compose file
Multi-container applications
Using environment files
Extending compose files
Controlling start order
Using Docker networks
Keeping your data safe in volumes
Summary
3. Cluster Building Blocks – Registry, Overlay Networks, and Shared Storage
Creating a Docker RegistryUsing the Docker HubLogging inWorking with a repositoryAutomating image builds with Docker HubIntegration with Docker CloudUsing the GitLab Container RegistryInstalling GitLab on UbuntuEnabling Docker Registry on a projectIntroducing the Docker Trusted Registry and Docker DatacenterBuilding it yourself
Connecting containers with overlay networks
Using Docker native overlaysWorking with DNS-SDPublishing services with mesh routing modeUsing WeaveInstalling WeaveConnecting containers to WeaveUsing FlannelConfiguring etcd and FlannelStarting a CoreOS cluster with FlannelConnecting to Flannel
Using shared network storage for Docker volumes
Introducing CephUsing Ceph with DockerCreating a Docker volumeOther shared storage plugins
Summary
4. Orchestration with Docker Swarm
Setting up a swarmInitializing a swarm
Managing a swarm
Adding a nodePromoting and demoting nodesChanging node availabilityPausing a nodeDraining a nodeActivating a nodeRemoving nodes
Recovering from a disaster
Restarting the full clusterBackup and recoveryBacking up the swarmRecovering a swarmBacking up servicesGrouping nodes with labels
Managing services
Running servicesCreating replicasRunning global servicesSetting constraintsStopping servicesUpgrading a service with rolling updatesUsing Docker Compose with swarmBuilding imagesStarting an applicationBundling an applicationDeploying a stack
Introducing Docker Datacenter
Summary
5. Deploying and Managing Services with Kubernetes
Getting to know KubernetesCommand-line toolsMaster componentsNode components
Installing Kubernetes
Installing with kubeadmInstalling with kube-up.shInstalling add-ons
Managing resources
Creating resourcesDeleting resources
Running pods
Defining a podViewing podsEnvironmentMulti-container podsUsing secretsCreating secretsUsing secrets in environment variablesUsing secrets in filesLogging into a containerDeleting a podUsing deploymentsCreating a single container deploymentCreating a multi-container deploymentScaling a deploymentRolling updatesUpdating a deploymentGetting the rollout historyRolling back an updateDeleting a deploymentRunning pods on every node with DaemonSetsIntroducing scheduled jobsUsing labelsUsing selectors to find resourcesUsing namespacesViewing namespacesCreating namespacesSwitching namespacesDeleting a namespace
Networking
ServicesCreating a serviceListing servicesIntroducing DNS-SD
Using volumes
Using plain volumesStoring long-lived data in persistent volumesCreating a PersistentVolumeCreating the PersistentVolumeClaim resourceUsing a PersistentVolumeClaim as a volume
Further reading
Summary
6. Working with Mesosphere
Getting started with DC/OSLogging into the web interfaceInstalling the DC/OS client
Managing applications
Running a simple applicationStopping an applicationRemoving an applicationForcing Marathon to pull imagesUsing environment variablesScaling applicationsChecking application healthUsing TCP and HTTP checksUsing command checksDeploying rolling updatesSetting an upgrade strategyTesting updates with blue-green deploymentsIntroducing pods
Using network services and load balancing
Discovering services with DNSConnecting to the overlay networkUsing virtual IPsUsing the Marathon load balancer
Providing persistent storage
Using local volumesUsing external volumes
Using a private registry
Summary
7. Using Simpler Orchestration Tools – Fleet and Cattle
Using FleetStarting FleetVerifying the clusterStarting a containerMonitoring servicesViewing service logsStopping a serviceUsing environment variablesScheduling services with affinitySetting positive affinityUsing negative affinityHigh availabilitySidekick servicesStarting global units
Using Rancher Cattle
Installing RancherInstalling Rancher serverInstalling Rancher agentsInstalling Rancher ComposeIntroducing environmentsManaging servicesStarting a stackStopping a stackRemoving a stackUpgrading a stackRolling back and confirming upgradesChecking service healthScheduling and affinityUsing networking servicesDiscovering servicesLoad balancer
Further reading
Summary
8. Monitoring Your Cluster
Logging with containersUsing Docker logging pluginsLogging containers that do not play by the rulesLogging with the ELK stackStarting ElasticsearchStarting LogstashViewing the logs with KibanaRemote logging in Docker DatacenterLogging from KubernetesLogging from MesosphereLogging your Docker hosts
Collecting and graphing performance data
Collecting data with collectdRunning collectdConfiguring collectdStoring performance data in ElasticsearchStoring performance data in InfluxDBGraphing data with KibanaCreating a new chartAdding charts to a dashboardGraphing data with GrafanaInstalling GrafanaAdding data sourceCreating a new dashboardCreating a graphUsing Heapster in Kubernetes
Considerations for monitoring system health
Monitor servicesWatching services in real time with Sysdig
Summary
9. Using Continuous Integration to Build, Test, and Deploy Containers
The importance of using CI
Using GitLab for CI
Setting up GitLab for CIInstalling the GitLab Runner on UbuntuRegistering a runnerEnabling a Docker RepositoryAdding the project to the repositoryCreating .gitlab-ci.ymlTesting the imageCleanup jobsReleasing the imageDeploying the imageDeploying the image manuallyDeploying to KubernetesBuilding DAB files
Using Docker Cloud for CI
Enabling autobuildsTesting the image
Summary
10. Why Stop at Containers? Automating Your Infrastructure
Configuring Docker hostsUsing configuration managementConfiguring a server on bootUsing a custom imageBuilding a new image with PackerPreparing the Ubuntu Cloud ImageBuilding the imageUsing Puppet with PackerTreating infrastructure like codePost-build configuration
Automating host deployment
Deploying hosts with TerraformCreating a Terraform configurationRunning TerraformShowing the cluster stateDeploying hosts with Docker CloudIntroducing Docker for AWS and Docker for Azure
Scaling down nodes
Summary

Content preview from Docker Orchestration

Extending compose files

We have already talked about using environment files to change your application's behavior. Another way that you can do that is to use multiple Docker Compose files. Each file builds on the previous one, extending it and possibly overriding options. This can give you great flexibility in developing your application or adjusting it to fit different environments. This can be done in one of the following two ways:

The first way is to put your overrides in a file named docker-compose.override.yml. This file is read automatically by docker-compose. The options in docker-compose.yml are applied first and then the options in docker-compose.override.yml are applied.
The second option is to use the -f flag to docker-compose. You may ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.

Julian F.

Head of Cybersecurity

I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.

Addison B.

Field Engineer

I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.

Amir M.

Data Platform Tech Lead

I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.

Mark W.

Embedded Software Engineer

Publisher Resources

ISBN: 9781787122123

Cloud Computing

Data Engineering

Data Science

AI & ML

Programming Languages

Software Architecture

IT/Ops

Security

Design

Business

Soft Skills

Docker Orchestration

by Randall Smith

Extending compose files

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.