November 2017
Beginner to intermediate
290 pages
7h 34m
English
Incremental recovery refers to the ability of Apex to handle a failure of an operator by only recovering the affected operator and its downstream dependencies versus resetting the entire DAG.
Let's consider how the failure of an operator affects the processing in the following two topologies:

The pipeline upstream of the failed operator is identical, downstream is different. Operators affected by the failure are in gray.
On the left-hand side, the stream merges with another branch. In this case, processing in the output operator is blocked and no results can be emitted until the failed operator recovers. On the right-hand ...
Read now
Unlock full access