Writing into Elasticsearch
Flink supports various connectors which are included as part of the Flink distribution. There is also a connector available for Elasticsearch as part of the Flink distribution. As we see here, we are also writing the documents with the same id as contained in the document, instead of depending on randomly generated document id. Additionally, we are specifying the bulk size and bulk flush interval for optimum throughput with Elasticsearch connector.
The next code snippet uses Elasticsearch ink for Address. A similar code is used for contacts as well. Certain properties such as esHost and esPort are passed as command line arguments. As we see here, we are also writing the documents with the same id as contained in ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access