Skip to Main Content
Data Engineering with Google Cloud Platform
book

Data Engineering with Google Cloud Platform

by Adi Wijaya
March 2022
Beginner to intermediate content levelBeginner to intermediate
440 pages
9h 43m
English
Packt Publishing
Content preview from Data Engineering with Google Cloud Platform

Chapter 11: CI/CD on Google Cloud Platform for Data Engineers

Continuous integration and continuous deployment (CI/CD) is a common concept for DevOps engineers, but most of the time, data engineers need to understand and be able to apply this practice to their development endeavors. This chapter will cover the necessary concepts of CI/CD and provide examples of how to apply CI/CD to our Cloud Composer example from Chapter 4, Building Orchestration for Batch Data Loading Using Cloud Composer. Upon completing this chapter, you will understand what CI/CD is, why and when it's needed in data engineering, and what GCP services are needed for it.

In this chapter, we will cover the following topics:

  • Introduction to CI/CD
  • Understanding CI/CD components ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

Data Engineering with Google Cloud Platform - Second Edition

Data Engineering with Google Cloud Platform - Second Edition

Adi Wijaya
Architecting Data and Machine Learning Platforms

Architecting Data and Machine Learning Platforms

Marco Tranquillin, Valliappa Lakshmanan, Firat Tekiner

Publisher Resources

ISBN: 9781800561328Supplemental Content