Data Lake for Enterprises

Step 1 - Preparing streams

This step involves preparing data streams by publishing the data into the Kafka topic, for which we will utilize the simple producer API (explained in Chapter 7, Messaging Layer with Apache Kafka). In this step, we will read the data from the database and publish the records into a topic in Kafka:

1. In order to prepare streams, navigate to the chapter08 folder, which contains the code for this chapter. For preparing the streams, the code is contained in one of the modules of chapter08, that is, in the chapter08/flink-example1 folder.
2. Change  the following properties files as per your environment:
   • chapter08/flink-example1/config/db.properties: This file contains all the database related properties to access the database ...