Learning Elastic Stack 6.0

Kafka

This plugin is used to write events to a Kafka topic. It uses the Kafka Producer API to write messages to a topic on the broker. The only required configuration is the topic_id.

Let's see a basic Kafka configuration:

#kafka.confinput {   stdin{      } } output {             kafka {                     bootstrap_servers => "localhost:9092"                     topic_id => 'logstash'             }       }

The bootstrap_servers parameter takes the list of all server connections in the form of host1:port1, host2:port2 and the producer will only use it for getting metadata (topics, partitions, and replicas). The socket connections for sending the actual data will be established based on the broker information returned in the metadata. topic_id refers to the topic name where messages will published.

Note: Only ...