As microservices, data services, and serverless APIs proliferate in a cloud native world, analysts still need to report on the business as a whole. Data engineers need to collect and standardize data in an increasingly complex and diverse system. Luckily, the problem is also the solution. The way to manage data in a cloud native environment is to build cloud native data pipelines.
Gwen Shapira (Confluent) discusses how data engineering requirements have changed in a cloud native world and how the solutions have changed with them. She then shares architectural patterns that are commonly used to build cloud native data infrastructure and explains how they help you build flexible, scalable, and reliable pipelines to give your business visibility on all your data.
This session was recorded at the 2019 O'Reilly Strata Data Conference in San Francisco.
Table of contents
- Title: Cloud native data pipelines with Apache Kafka
- Release date: October 2019
- Publisher(s): O'Reilly Media, Inc.
- ISBN: 0636920333722
You might also like
Digital Customer Experience Engineering : Strategies for Creating Effective Digital Experiences
Customer experience engineering applied to the engineering department is rare, but needed. Most companies keep support, …
Practical Event-Driven Microservices Architecture: Building Sustainable and Highly Scalable Event-Driven Microservices
In the simplest terms, event-driven architectures are like onions; they are manageable as a single layer …
Hands-On Machine Learning with Scikit-Learn, Keras, and TensorFlow, 2nd Edition
Through a series of recent breakthroughs, deep learning has boosted the entire field of machine learning. …
The PAYTECH Book
The only globally-crowdsourced book on the future of payments (“PayTech”), offering comprehensive understanding of a rapidly …