Hands-On Software Engineering with Golang

Design goals for the pipeline package

Let's quickly enumerate some of the design goals for the pipeline package that we will be building. The key principles that will serve as guides for the design decisions that we will be making are: simplicity, extensibility, and genericness.

First and foremost, our design should be able to adapt to different types of payloads. Keep in mind that payload formats are, in the majority of cases, dictated by the end user of the pipeline package. Consequently, the pipeline internals should not make any assumptions about the internal implementation details of payloads that traverse the various pipeline stages.

Secondly, the main role of a data-processing pipeline is to facilitate the flow of payloads between ...