May 2017
Beginner to intermediate
596 pages
15h 2m
English
Content preview from Data Lake for Enterprises
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
Start your free trial
Kafka Connect
As discussed earlier, Kafka Connect can be used to copy streaming messages from or to Kafka and is very similar to Flume. However, in order to use Kafka connect there is a dependency to have confluent setup. Provided here are the steps to install Confluent:
- Download the latest Confluent package from the following link, using the command given below. It’s a big download so it may take some time to complete:
wget http://packages.confluent.io/archive/3.2/confluent-oss-3.2.0-2.11.tar.gz
- Change directory to a user directory and extract the contents of the preceding tarball using the following command. We will refer the extracted confluent folder as ${CONFLUENT_HOME}:
tar zxvf ${DOWNLOAD_DIRECTORY}/confluent-oss-3.2.0-2.11.tar.gz ...