Data Lake for Enterprises

Data Generation

Generate the data using the following commands as done in earlier chapters. For this example, we will target to generate 1 million rows for each of the entities:

Populate database

We will be reusing the database tables of customer and address for this example. In case the database tables are empty due to any reasons, the database can be re-populated using the same utility as before. The related command is again specified here briefly for quick reference. This command needs to be run from the location where we had extracted these utilities from the tar files:

java -jar client-generator-1.0-SNAPSHOT.jar config/db.properties  2000000

Generate Spool File

We can reuse the contacts.log file generated earlier. In case the file does ...