May 2017
Beginner to intermediate
596 pages
15h 2m
English
Content preview from Data Lake for Enterprises
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
Start your free trial
Flink execution model
The following figure shows Flink’s execution model. The Flink program written is parsed by the program compiler and then type extracted and then optimized (Flink Optimizer). Each submitted job is then converted to a dataflow graph and then passed onto Job Manager, which then creates an execution plan and the job graph is then passed onto Task Manager where the tasks are finally executed (execution graph).
Figure 11: Flink execution model