12
CI/CD on GCP for Data Engineers
Continuous integration/continuous deployment (CI/CD) is a common concept for DevOps engineers, but most of the time, data engineers need to understand and be able to apply this practice to their development endeavors. This chapter will cover the necessary concepts of CI/CD and provide examples of how to apply CI/CD to our Cloud Composer example from Chapter 4, Building Workflows for Batch Data Loading Using Cloud Composer. Upon completing this chapter, you will understand what CI/CD is, why and when it’s needed in data engineering, and what GCP services are needed for it.
In this chapter, we will cover the following topics:
- An introduction to CI/CD
- Understanding CI/CD components with GCP services
- Exercise ...
Get Data Engineering with Google Cloud Platform - Second Edition now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
