Data Lake for Enterprises

Core architecture principles of Flink

We have gone through Flink’s architecture and its important components in the previous section. Before going deep into Flink internals it's very important to understand the principles on which Flink was conceived and developed. Some of the core architecture principles followed by Flink are as follows:

• Hide internal workings of many aspects away from users (abstract as much as possible so as to become easy for users).
• Decouple API’s from actual execution logic (interface-implementation approach). This helps Flink to execute the same program in multiple ways hidden away from the users achieving maximum performance.
• Declarative.
• Little or no tuning.
• Execute everything as stream (even batch data).
• Little ...