Data Lake for Enterprises

Writing into Elasticsearch

Flink supports various connectors which are included as part of the Flink distribution. There is also a connector available for Elasticsearch as part of the Flink distribution. As we see here, we are also writing the documents with the same id as contained in the document, instead of depending on randomly generated document id. Additionally, we are specifying the bulk size and bulk flush interval for optimum throughput with Elasticsearch connector.

The next code snippet uses Elasticsearch ink for Address. A similar code is used for contacts as well. Certain properties such as esHost and esPort are passed as command line arguments. As we see here, we are also writing the documents with the same id as contained in ...