Data Lake for Enterprises

Streaming connectors

Flink has many connectors for easy integration that can be broadly categorized as follows:

1. Built-in Connectors: Connectors that are already there along with the Flink installation and developed by various providers and are already supported and maintained come under this category:
   • File: Reads file from a specified file path. It can monitor a directory and as and when a file is added or changed can read and do the needful
   • Collection: Reads from elements and also is capable of reading from Java collections
   • Socket: Reads text socket from exposed port
   • Basic:
     • File
     • Socket
     • Standard output
   • Advanced:
     • Elasticsearch: Used to store and index JSON documents. We do have a dedicated chapter on this in which we will discuss this ...