Skip to Main Content
Data Engineering with Google Cloud Platform - Second Edition
book

Data Engineering with Google Cloud Platform - Second Edition

by Adi Wijaya
April 2024
Beginner to intermediate content levelBeginner to intermediate
476 pages
12h 22m
English
Packt Publishing
Content preview from Data Engineering with Google Cloud Platform - Second Edition

12

CI/CD on GCP for Data Engineers

Continuous integration/continuous deployment (CI/CD) is a common concept for DevOps engineers, but most of the time, data engineers need to understand and be able to apply this practice to their development endeavors. This chapter will cover the necessary concepts of CI/CD and provide examples of how to apply CI/CD to our Cloud Composer example from Chapter 4, Building Workflows for Batch Data Loading Using Cloud Composer. Upon completing this chapter, you will understand what CI/CD is, why and when it’s needed in data engineering, and what GCP services are needed for it.

In this chapter, we will cover the following topics:

  • An introduction to CI/CD
  • Understanding CI/CD components with GCP services
  • Exercise ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

Fundamentals of Data Engineering

Fundamentals of Data Engineering

Joe Reis, Matt Housley
Fundamentals of Data Engineering

Fundamentals of Data Engineering

Joe Reis, Matt Housley
Visualizing Google Cloud

Visualizing Google Cloud

Priyanka Vergadia

Publisher Resources

ISBN: 9781835080115Supplemental Content