Mastering Apache Storm

Multiple Kafka brokers on a single node

If you want to run multiple Kafka brokers on a single node, then follow the following steps:

1. Copy config/server.properties to create config/server1.properties and config/server2.properties.

 

2. Populate the following properties in config/server.properties:

broker.id=0 
port=9092 
log.dirs=/var/kafka-logs 
zookeeper.connect=zoo1:2181,zoo2:2181,zoo3:2181 

3. Populate the following properties in config/server1.properties:

broker.id=1 
port=9093 
log.dirs=/var/kafka-1-logs 
zookeeper.connect=zoo1:2181,zoo2:2181,zoo3:2181 

4. Populate the following properties in config/server2.properties:

broker.id=2 
port=9094 
log.dirs=/var/kafka-2-logs 
zookeeper.connect=zoo1:2181,zoo2:2181,zoo3:2181 

5. Run the following commands ...