In the last chapter, we built up a streaming frame of reference for working with data in-flight. By introducing common problems and pitfalls that tend to occlude the path to streaming success, you discovered the nuances between local and global coordinated time, aka the trouble with time. You also learned about the complex problems that arise when corrupt or invalid data makes its way into your data network, in data problems in flight. In a perfect world, each event or ...
© The Author(s), under exclusive license to APress Media, LLC, part of Springer Nature 2022
S. HainesModern Data Engineering with Apache Sparkhttps://doi.org/10.1007/978-1-4842-7452-1_1010. Patterns for Writing Structured Streaming Applications
Scott Haines1
(1)
San Jose, CA, USA
Get Modern Data Engineering with Apache Spark: A Hands-On Guide for Building Mission-Critical Streaming Applications now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
