Cloud native data pipelines with Apache Kafka

As microservices, data services, and serverless APIs proliferate in a cloud native world, analysts still need to report on the business as a whole. Data engineers need to collect and standardize data in an increasingly complex and diverse system. Luckily, the problem is also the solution. The way to manage data in a cloud native environment is to build cloud native data pipelines.

Gwen Shapira (Confluent) discusses how data engineering requirements have changed in a cloud native world and how the solutions have changed with them. She then shares architectural patterns that are commonly used to build cloud native data infrastructure and explains how they help you build flexible, scalable, and reliable pipelines to give your business visibility on all your data.

This session was recorded at the 2019 O'Reilly Strata Data Conference in San Francisco.