book

Cloud Native DevOps with Kubernetes

by John Arundel, Justin Domingus

March 2019

Intermediate to advanced

346 pages

8h 17m

English

O'Reilly Media, Inc.

Read now

Unlock full access

What Will I Learn?Who Is This Book For?What Questions Does This Book Answer?Conventions Used in This BookUsing Code ExamplesO’Reilly Online Learning PlatformHow to Contact UsAcknowledgments
The Creation of the CloudBuying TimeInfrastructure as a ServiceThe Dawn of DevOpsNobody Understands DevOpsThe Business AdvantageInfrastructure as CodeLearning TogetherThe Coming of ContainersThe State of the ArtThinking Inside the BoxPutting Software in ContainersPlug and Play ApplicationsConducting the Container OrchestraKubernetesFrom Borg to KubernetesWhat Makes Kubernetes So Valuable?Will Kubernetes Disappear?Kubernetes Doesn’t Do It AllCloud NativeThe Future of OperationsDistributed DevOpsSome Things Will Remain CentralizedDeveloper Productivity EngineeringYou Are the FutureSummary
Running Your First ContainerInstalling Docker DesktopWhat Is Docker?Running a Container ImageThe Demo ApplicationLooking at the Source CodeIntroducing GoHow the Demo App WorksBuilding a ContainerUnderstanding DockerfilesMinimal Container ImagesRunning docker image buildNaming Your ImagesPort ForwardingContainer RegistriesAuthenticating to the RegistryNaming and Pushing Your ImageRunning Your ImageHello, KubernetesRunning the Demo AppIf the Container Doesn’t StartMinikubeSummary
Cluster ArchitectureThe Control PlaneNode ComponentsHigh AvailabilityThe Costs of Self-Hosting KubernetesIt’s More Work Than You ThinkIt’s Not Just About the Initial SetupTools Don’t Do All the Work for YouKubernetes Is HardAdministration OverheadStart with Managed ServicesManaged Kubernetes ServicesGoogle Kubernetes Engine (GKE)Cluster AutoscalingAmazon Elastic Container Service for Kubernetes (EKS)Azure Kubernetes Service (AKS)OpenShiftIBM Cloud Kubernetes ServiceTurnkey Kubernetes SolutionsContainership Kubernetes Engine (CKE)Kubernetes InstallerskopsKubesprayTK8Kubernetes The Hard WaykubeadmTarmakRancher Kubernetes Engine (RKE)Puppet Kubernetes ModuleKubeformationBuy or Build: Our RecommendationsRun Less SoftwareUse Managed Kubernetes if You CanBut What About Vendor Lock-in?Use Standard Kubernetes Self-Hosting Tools if You MustWhen Your Choices Are LimitedBare-Metal and On-PremClusterless Container ServicesAmazon FargateAzure Container Instances (ACI)Summary
DeploymentsSupervising and SchedulingRestarting ContainersQuerying DeploymentsPodsReplicaSetsMaintaining Desired StateThe Kubernetes SchedulerResource Manifests in YAML FormatResources Are DataDeployment ManifestsUsing kubectl applyService ResourcesQuerying the Cluster with kubectlTaking Resources to the Next LevelHelm: A Kubernetes Package ManagerInstalling HelmInstalling a Helm ChartCharts, Repositories, and ReleasesListing Helm ReleasesSummary
Understanding ResourcesResource UnitsResource RequestsResource LimitsKeep Your Containers SmallManaging the Container Life CycleLiveness ProbesProbe Delay and FrequencyOther Types of ProbesgRPC ProbesReadiness ProbesFile-Based Readiness ProbesminReadySecondsPod Disruption BudgetsUsing NamespacesWorking with NamespacesWhat Namespaces Should I Use?Service AddressesResource QuotasDefault Resource Requests and LimitsOptimizing Cluster CostsOptimizing DeploymentsOptimizing PodsVertical Pod AutoscalerOptimizing NodesOptimizing StorageCleaning Up Unused ResourcesChecking Spare CapacityUsing Reserved InstancesUsing Preemptible (Spot) InstancesKeeping Your Workloads BalancedSummary
Cluster Sizing and ScalingCapacity PlanningNodes and InstancesScaling the ClusterConformance CheckingCNCF CertificationConformance Testing with SonobuoyValidation and AuditingK8GuardCopperkube-benchKubernetes Audit LoggingChaos TestingOnly Production Is Productionchaoskubekube-monkeyPowerfulSealSummary
Mastering kubectlShell AliasesUsing Short FlagsAbbreviating Resource TypesAuto-Completing kubectl CommandsGetting HelpGetting Help on Kubernetes ResourcesShowing More Detailed OutputWorking with JSON Data and jqWatching ObjectsDescribing ObjectsWorking with ResourcesImperative kubectl CommandsWhen Not to Use Imperative CommandsGenerating Resource ManifestsExporting ResourcesDiffing ResourcesWorking with ContainersViewing a Container’s LogsAttaching to a ContainerWatching Kubernetes Resources with kubespyForwarding a Container PortExecuting Commands on ContainersRunning Containers for TroubleshootingUsing BusyBox CommandsAdding BusyBox to Your ContainersInstalling Programs on a ContainerLive Debugging with kubesquashContexts and Namespaceskubectx and kubenskube-ps1Kubernetes Shells and Toolskube-shellClickkubed-shSternBuilding Your Own Kubernetes ToolsSummary
Containers and PodsWhat Is a Container?What Belongs in a Container?What Belongs in a Pod?Container ManifestsImage IdentifiersThe latest TagContainer DigestsBase Image TagsPortsResource Requests and LimitsImage Pull PolicyEnvironment VariablesContainer SecurityRunning Containers as a Non-Root UserBlocking Root ContainersSetting a Read-Only FilesystemDisabling Privilege EscalationCapabilitiesPod Security ContextsPod Security PoliciesPod Service AccountsVolumesemptyDir VolumesPersistent VolumesRestart PoliciesImage Pull SecretsSummary

LabelsWhat Are Labels?SelectorsMore Advanced SelectorsOther Uses for LabelsLabels and AnnotationsNode AffinitiesHard AffinitiesSoft AffinitiesPod Affinities and Anti-AffinitiesKeeping Pods TogetherKeeping Pods ApartSoft Anti-AffinitiesWhen to Use Pod AffinitiesTaints and TolerationsPod ControllersDaemonSetsStatefulSetsJobsCronjobsHorizontal Pod AutoscalersPodPresetsOperators and Custom Resource Definitions (CRDs)Ingress ResourcesIngress RulesTerminating TLS with IngressIngress ControllersIstioEnvoySummary
ConfigMapsCreating ConfigMapsSetting Environment Variables from ConfigMapsSetting the Whole Environment from a ConfigMapUsing Environment Variables in Command ArgumentsCreating Config Files from ConfigMapsUpdating Pods on a Config ChangeKubernetes SecretsUsing Secrets as Environment VariablesWriting Secrets to FilesReading SecretsAccess to SecretsEncryption at RestKeeping SecretsSecrets Management StrategiesEncrypt Secrets in Version ControlStore Secrets RemotelyUse a Dedicated Secrets Management ToolRecommendationsEncrypting Secrets with SopsIntroducing SopsEncrypting a File with SopsUsing a KMS BackendSummary
Access Control and PermissionsManaging Access by ClusterIntroducing Role-Based Access Control (RBAC)Understanding RolesBinding Roles to UsersWhat Roles Do I Need?Guard Access to Cluster-AdminApplications and DeploymentRBAC TroubleshootingSecurity ScanningClairAquaAnchore EngineBackupsDo I Need to Back Up Kubernetes?Backing Up etcdBacking Up Resource StateBacking Up Cluster StateLarge and Small DisastersVeleroMonitoring Cluster StatuskubectlCPU and Memory UtilizationCloud Provider ConsoleKubernetes DashboardWeave Scopekube-ops-viewnode-problem-detectorFurther ReadingSummary
Building Manifests with HelmWhat’s Inside a Helm Chart?Helm TemplatesInterpolating VariablesQuoting Values in TemplatesSpecifying DependenciesDeploying Helm ChartsSetting VariablesSpecifying Values in a Helm ReleaseUpdating an App with HelmRolling Back to Previous VersionsCreating a Helm Chart RepoManaging Helm Chart Secrets with SopsManaging Multiple Charts with HelmfileWhat’s in a Helmfile?Chart MetadataApplying the HelmfileAdvanced Manifest Management ToolsTankaKapitankustomizekomposeAnsiblekubevalSummary
Development ToolsSkaffoldDraftTelepresenceKnativeDeployment StrategiesRolling UpdatesRecreatemaxSurge and maxUnavailableBlue/Green DeploymentsRainbow DeploymentsCanary DeploymentsHandling Migrations with HelmHelm HooksHandling Failed HooksOther HooksChaining HooksSummary
What Is Continuous Deployment?Which CD Tool Should I Use?JenkinsDroneGoogle Cloud BuildConcourseSpinnakerGitLab CICodefreshAzure PipelinesCD ComponentsDocker HubGitkubeFluxKeelA CD Pipeline with Cloud BuildSetting Up Google Cloud and GKEForking the Demo RepositoryIntroducing Cloud BuildBuilding the Test ContainerRunning the TestsBuilding the Application ContainerValidating the Kubernetes ManifestsPublishing the ImageGit SHA TagsCreating the First Build TriggerTesting the TriggerDeploying from a CD PipelineCreating a Deploy TriggerOptimizing Your Build PipelineAdapting the Example PipelineSummary
What Is Observability?What Is Monitoring?Black-Box MonitoringWhat Does “Up” Mean?LoggingIntroducing MetricsTracingObservabilityThe Observability PipelineMonitoring in KubernetesExternal Black-Box ChecksInternal Health ChecksSummary
What Are Metrics, Really?Time Series DataCounters and GaugesWhat Can Metrics Tell Us?Choosing Good MetricsServices: The RED PatternResources: The USE PatternBusiness MetricsKubernetes MetricsAnalyzing MetricsWhat’s Wrong with a Simple Average?Means, Medians, and OutliersDiscovering PercentilesApplying Percentiles to Metrics DataWe Usually Want to Know the WorstBeyond PercentilesGraphing Metrics with DashboardsUse a Standard Layout for All ServicesBuild an Information Radiator with Master DashboardsDashboard Things That BreakAlerting on MetricsWhat’s Wrong with Alerts?On-call Should Not Be HellUrgent, Important, and Actionable AlertsTrack Your Alerts, Out-of-Hours Pages, and Wake-upsMetrics Tools and ServicesPrometheusGoogle StackdriverAWS CloudwatchAzure MonitorDatadogNew RelicSummary
Where to Go NextWelcome Aboard

Content preview from Cloud Native DevOps with Kubernetes

Foreword

Welcome to Cloud Native DevOps with Kubernetes.

Kubernetes is a real industry revolution. Just a brief look at the Cloud Native Computing Foundation’s Landscape, which contains data about more than 600 projects that exist in the cloud native world today, highlights the importance of Kubernetes these days. Not all these tools were developed for Kubernetes, not all of them can even be used with Kubernetes, but all of them are part of the huge ecosystem where Kubernetes is one of the flagship technologies.

Kubernetes changed the way applications are developed and operated. It’s a core component in the DevOps world today. Kubernetes brings flexibility to developers and freedom to operations. Today you can use Kubernetes on any major cloud provider, on bare-metal on-premises environments, as well as on a local developer’s machine. Stability, flexibility, a powerful API, open code, and an open developer community are a few reasons why Kubernetes became an industry standard, just as Linux is a standard in the world of operating systems.

Cloud Native DevOps with Kubernetes is a great handbook for people who are performing their day-to-day activities with Kubernetes or are just starting their Kubernetes journey. John and Justin cover all the major aspects of deploying, configuring, and operating Kubernetes and the best practices for developing and running applications on it. They also give a great overview of the related technologies, including Prometheus, Helm, and continuous ...