May 2017
Beginner to intermediate
596 pages
15h 2m
English
Content preview from Data Lake for Enterprises
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
Start your free trial
Memory management
Memory management in Flink is often attributed to be innovative and claims to be one of the first big data technology which has implemented custom memory management. To achieve this Flink has its own mechanisms for type extraction and serialization.
The following figure shows the JVM heap that is divided into areas dedicated to do certain defined activities in regards to memory. As shown in the figure, Flink has a managed heap, which is a dedicated memory fraction given to Flink for various Flink related operations such as caching and data processing:
Figure 17: Flink memory management
Some of the core features of Flink’s ...