Cloud Native Development Patterns and Best Practices

Solution

Delegate events with unrecoverable errors to another component for handling so that they do not block legitimate events from processing. Publish these errors as fault events, along with the effected events and the stream processor information, so that the events can be resubmitted when appropriate. Monitor and alert on these fault events so that the team can react in a timely manner. Provide the necessary utilities to resubmit the effected events from the data lake to the component that emitted the fault event.

Implement the stream processor logic so that it is tolerant of events that are received out of order and idempotent when it receives and processes events more than once. Optionally, leverage a traditional synchronous circuit ...