book

Pipeline as Code

Name: Pipeline as Code
Author: Mohamed Labouardy
ISBN: 9781617297540

by Mohamed Labouardy

October 2021

Intermediate to advanced

528 pages

12h 44m

English

Manning Publications

Read now

Unlock full access

inside front cover
Pipeline as Code
Copyright
brief contents
contents
front matter
prefaceacknowledgmentsabout this bookWho should read this bookHow this book is organizedAbout the codeliveBook discussion forumOther online resourcesabout the authorabout the cover illustration
Part 1. Getting started with Jenkins
1 What’s CI/CD?
1.1 Going cloud native1.1.1 Monolithic1.1.2 Microservices1.1.3 Cloud native1.1.4 Serverless1.2 Defining continuous integration1.3 Defining continuous deployment1.4 Defining continuous delivery1.5 Embracing CI/CD practices1.6 Using essential CI/CD tools1.6.1 Choosing a CI/CD tool1.6.2 Introducing JenkinsSummary
2 Pipeline as code with Jenkins
2.1 Introducing the Jenkinsfile2.1.1 Blue Ocean plugin2.1.2 Scripted pipeline2.1.3 Declarative pipeline2.2 Understanding multibranch pipelines2.3 Exploring the GitFlow branch model2.4 Test-driven development with Jenkins2.4.1 The Jenkins Replay button2.4.2 Command-line pipeline linter2.4.3 IDE integrationsSummary
Part 2. Operating a self-healing Jenkins cluster

3 Defining Jenkins architecture
3.1 Understanding master-worker architecture3.2 Managing Jenkins workers3.2.1 SSH3.2.2 Command line3.2.3 JNLP3.2.4 Windows service3.3 Architecting Jenkins for scale in AWS3.3.1 Preparing the AWS environment3.3.2 Configuring the AWS CLI3.3.3 Creating and managing the IAM userSummary
4 Baking machine images with Packer
4.1 Immutable infrastructure4.2 Introducing Packer4.2.1 How does it work?4.2.2 Installation and configuration4.2.3 Baking a machine image4.3 Baking the Jenkins master AMI4.3.1 Configuring Jenkins upon startup4.3.2 Discovering Jenkins plugins4.4 Baking the Jenkins worker AMISummary
5 Discovering Jenkins as code with Terraform
5.1 Introducing infrastructure as code5.1.1 Terraform usage5.2 Provisioning an AWS VPC5.2.1 AWS VPC5.2.2 VPC subnets5.2.3 VPC route tables5.2.4 VPC bastion host5.3 Setting up a self-healing Jenkins master5.4 Running Jenkins with native SSL/HTTPS5.5 Dynamically autoscaling the Jenkins worker pool5.5.1 Launch configuration5.5.2 Auto Scaling group5.5.3 Autoscaling scaling policies5.5.4 Workers CPU utilization loadSummary
6 Deploying HA Jenkins on multiple cloud providers
6.1 Google Cloud Platform6.1.1 Building Jenkins VM images6.1.2 Configuring a GCP network with Terraform6.1.3 Deploying Jenkins on Google Compute Engine6.1.4 Launching automanaged workers on GCP6.2 Microsoft Azure6.2.1 Building golden Jenkins VM images in Azure6.2.2 Deploying a private virtual network6.2.3 Deploying a Jenkins master virtual machine6.2.4 Applying autoscaling to Jenkins workers6.3 DigitalOcean6.3.1 Creating Jenkins DigitalOcean Snapshots6.3.2 Deploying a Jenkins master Droplet6.3.3 Building Jenkins worker DropletsSummary
Part 3. Hands-on CI/CD pipelines
7 Defining a pipeline as code for microservices
7.1 Introducing microservices-based applications7.2 Defining multibranch pipeline jobs7.3 Git and GitHub integration7.4 Discovering Jenkins jobs’ XML configuration7.5 Configuring SSH authentication with Jenkins7.6 Triggering Jenkins builds with GitHub webhooksSummary
8 Running automated tests with Jenkins
8.1 Running unit tests inside Docker containers8.2 Automating code linter integration with Jenkins8.3 Generating code coverage reports8.4 Injecting security in the CI pipeline8.5 Running parallel tests with Jenkins8.6 Improving quality with code analysis8.7 Running mocked database tests8.8 Generating HTML coverage reports8.9 Automating UI testing with Headless Chrome8.10 Integrating SonarQube Scanner with JenkinsSummary
9 Building Docker images within a CI pipeline
9.1 Building Docker images9.1.1 Using the Docker DSL9.1.2 Docker build arguments9.2 Deploying a Docker private registry9.2.1 Nexus Repository OSS9.2.2 Amazon Elastic Container Registry9.2.3 Azure Container Registry9.2.4 Google Container Registry9.3 Tagging Docker images the right way9.4 Scanning Docker images for vulnerabilities9.5 Writing a Jenkins declarative pipeline9.6 Managing pull requests with JenkinsSummary
10 Cloud-native applications on Docker Swarm
10.1 Running a distributed Docker Swarm cluster10.2 Defining a continuous deployment process10.3 Integrating Jenkins with Slack notifications10.4 Handling code promotion with Jenkins10.5 Implementing the Jenkins delivery pipelineSummary
11 Dockerized microservices on K8s
11.1 Setting up a Kubernetes cluster11.2 Automating continuous deployment flow with Jenkins11.2.1 Migrating Docker Compose to K8s manifests with Kompose11.3 Walking through continuous delivery steps11.4 Packaging Kubernetes applications with Helm11.5 Running post-deployment smoke tests11.6 Discovering Jenkins XSummary
12 Lambda-based serverless functions
12.1 Deploying a Lambda-based application12.2 Creating deployment packages12.2.1 Mono-repo strategy12.2.2 Multi-repo strategy12.3 Updating Lambda function code12.4 Hosting a static website on S312.5 Maintaining multiple Lambda environments12.6 Configuring email notification in JenkinsSummary
Part 4. Managing, scaling, and monitoring Jenkins
13 Collecting continuous delivery metrics
13.1 Monitoring Jenkins cluster health13.2 Centralized logging for Jenkins logs with ELK13.2.1 Streaming logs with Filebeat13.2.2 Streaming logs with the Logstash plugin13.3 Creating alerts based on metricsSummary
14 Jenkins administration and best practices
14.1 Exploring Jenkins security and RBAC authorization14.1.1 Matrix authorization strategy14.1.2 Role-based authorization strategy14.2 Configuring GitHub OAuth for Jenkins14.3 Keeping track of Jenkins users’ actions14.4 Extending Jenkins with shared libraries14.5 Backing up and restoring Jenkins14.6 Setting up cron jobs with Jenkins14.7 Running Jenkins locally as a Docker containerSummaryWrapping up
index

Content preview from Pipeline as Code

11 Dockerized microservices on K8s

This chapter covers

Setting up a Kubernetes cluster on AWS with Terraform
Automating application deployment on Kubernetes with Jenkins pipelines
Packaging and versioning Kubernetes Helm charts
Converting Compose files to Kubernetes manifests with Kompose
Running post-deployment tests and health checks within CI/CD pipelines
Discovering Jenkins X and setting up serverless CI/CD pipelines

The preceding chapter covered how to set up a CI/CD pipeline from scratch for containerized applications running in Docker Swarm (figure 11.1). This chapter covers how to deploy the same application in Kubernetes (K8s) and automate the deployment. In addition, you’ll learn how to use Jenkins X to simplify the workflow of ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.

Julian F.

Head of Cybersecurity

I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.

Addison B.

Field Engineer

I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.

Amir M.

Data Platform Tech Lead

I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.

Mark W.

Embedded Software Engineer

Publisher Resources

ISBN: 9781617297540Publisher Support Publisher Website

Cloud Computing

Data Engineering

Data Science

AI & ML

Programming Languages

Software Architecture

IT/Ops

Security

Design

Business

Soft Skills

Pipeline as Code

by Mohamed Labouardy

11 Dockerized microservices on K8s

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.