Learning Apache Apex

Files

Now we are going to look at the support Apex offers for file I/O, another important category of sources and destinations for processing. Streaming sources are on the rise, which is evident by the growing popularity of Kafka. At the same time, many integrations still have to rely on files and a batch oriented ingestion, even when the processing framework is stream based like Apex. That kind of integration puts the brakes on the stream processor, but in large organizations pieces of end-to-end solutions are often owned by different groups and involve legacy systems that take time to change.

Then, there is still the segment of batch-based analytics that typically consume very large amounts of data from files. Processing results are also ...