May 2017
Beginner to intermediate
596 pages
15h 2m
English
Content preview from Data Lake for Enterprises
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
Start your free trial
Kafka Installation
We will perform a basic, bare minimum setup of Kafka, only as a message broker (message going in an out of a component), playing a primary role of a Flume sink. We will go ahead with default configurations for now.
- Download the Kafka binaries with the following command:
wget http://redrockdigimark.com/apachemirror/kafka/0.10.1.1/kafka_2.11-0.10.1.1.tgz
- Change directory to a user directory, where we will want to extract the contents of the kafka tarball using the following command:
tar -xzvf <DOWNLOAD_DIRECTORY>/kafka_2.11-0.10.1.1.tgz
- Let us refer to the extracted Kafka folder as ${KAFKA_HOME} and configure the same using the following command and add the same to ~/.bashrc file. Also, as with other installations, ...