Skip to Main Content
Data Engineering with Google Cloud Platform
book

Data Engineering with Google Cloud Platform

by Adi Wijaya
March 2022
Beginner to intermediate content levelBeginner to intermediate
440 pages
9h 43m
English
Packt Publishing
Content preview from Data Engineering with Google Cloud Platform

Chapter 4: Building Orchestration for Batch Data Loading Using Cloud Composer

The definition of orchestration is a set of configurations to automate tasks, jobs, and their dependencies. If we are talking about database orchestration, we talk about how to automate the table creation process.

The main objects in any database system are tables, and one of the main differences between an application database and a data warehouse is the creation of tables. Compared to tables in application databases, where tables are mostly static and created to support applications, tables in data warehouses are dynamic. Tables are products, collections of business logic, and data flows.

In this chapter, we will learn how to orchestrate our data warehouse tables ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

Data Engineering with Google Cloud Platform - Second Edition

Data Engineering with Google Cloud Platform - Second Edition

Adi Wijaya
Architecting Data and Machine Learning Platforms

Architecting Data and Machine Learning Platforms

Marco Tranquillin, Valliappa Lakshmanan, Firat Tekiner

Publisher Resources

ISBN: 9781800561328Supplemental Content