Modern Data Architectures with Python

Table of Contents

Preface

Part 1: Fundamental Data Knowledge

1

Modern Data Processing Architecture

Technical requirements

Databases, data warehouses, and data lakes

OLTP

OLAP

Data lakes

Event stores

File formats

Data platform architecture at a high level

Comparing the Lambda and Kappa architectures

Lambda architecture

Kappa architecture

Lakehouse and Delta architectures

Lakehouses

The seven central tenets

The medallion data pattern and the Delta architecture

Data mesh theory and practice

Defining terms

The four principles of data mesh

Summary

Practical lab

Solution

2

Understanding Data Analytics

Technical requirements

Setting up your environment

Python

venv

Graphviz

Workflow initialization

Cleaning and preparing your data

Duplicate values