© The Author(s), under exclusive license to APress Media, LLC, part of Springer Nature 2022
A. CarruthersBuilding the Snowflake Data Cloudhttps://doi.org/10.1007/978-1-4842-8593-0_8

8. Data Pipelines

Andrew Carruthers1  
(1)
Birmingham, UK
 

Most of our data ingestion into Snowflake is via one of two routes: flat file submission loaded via S3 or directly landed using ELT/ETL tooling . We do not address ELT/ETL tooling specifically in this chapter but do call out entry points where relevant, instead of focusing on the Snowflake components and interactions.

You should be familiar with data historization and Slowly Changing Dimensions (SCD) concepts from previous chapters. I reuse the same pattern here but also recognize not every feed requires SCD2. However, ...

Get Building the Snowflake Data Cloud: Monetizing and Democratizing Your Data now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.