Data Lake for Enterprises

Checkpointing in Flink

One aspect of Apache Flink that allows it to handle stateful streaming is checkpointing and this is one of core features that makes it different from others. Other aspect namely savepoint (explained in the next section), also enables Flink to handle stateful streaming.

Fault tolerance is one of the core features of Flink. Achieving this feature with high throughput and performance is quite a tricky combination to achieve. But Flink achieves this using the so called checkpointing feature.

As against batch (which has a defined start and end), stream data does not have a clear start and end. Also the stream data coming in has a state that has to be preserved and this poses additional challenges in achieving fault tolerance. ...