As microservices, data services, and serverless APIs proliferate in a cloud native world, analysts still need to report on the business as a whole. Data engineers need to collect and standardize data in an increasingly complex and diverse system. Luckily, the problem is also the solution. The way to manage data in a cloud native environment is to build cloud native data pipelines.
Gwen Shapira (Confluent) discusses how data engineering requirements have changed in a cloud native world and how the solutions have changed with them. She then shares architectural patterns that are commonly used to build cloud native data infrastructure and explains how they help you build flexible, scalable, and reliable pipelines to give your business visibility on all your data.
This session was recorded at the 2019 O'Reilly Strata Data Conference in San Francisco.
Table of contents
- Title: Cloud native data pipelines with Apache Kafka
- Release date: October 2019
- Publisher(s): O'Reilly Media, Inc.
- ISBN: 0636920333722
You might also like
Certified Kubernetes Application Developer (CKAD)
9+ Hours of Video Instruction Certified Kubernetes Application Developer (CKAD) Complete Video Course provides more than …
Spark: The Definitive Guide
Learn how to use, deploy, and maintain Apache Spark with this comprehensive guide, written by the …
Kafka: The Definitive Guide
Every enterprise application creates data, whether it’s log messages, metrics, user activity, outgoing messages, or something …
Fluent Python, 2nd Edition
Python’s simplicity lets you become productive quickly, but often this means you aren’t using everything it …