Data Lake for Enterprises

Step 1: Installing and verifying Flume

In this section we will install Apache Flume and then verify its installation. Follow the given steps for complete installation:

1. Download the Apache Flume binary distribution with the following command; we will be using the current version of Apache Flume, which is 1.7.0.

wget http://www-us.apache.org/dist/flume/1.7.0/apache-flume-1.7.0-bin.tar.gz

2. Once downloaded, change the directory to a location where you will want to extract contents by using the following command:

tar -zxvf ${DOWNLOAD_DIRECTORY}/apache-flume-1.7.0-bin.tar.gz

3. Let us refer to the extracted flume folder as ${FLUME_HOME}. Set ${FLUME_HOME} as an environment variable as well as in the ~/.bashrc file with the following command, ...