Hands-On Software Engineering with Golang

Multistage processing

The key concept behind pipelining is to break down a complex processing task into a series of smaller steps or stages that can be executed independently of each other and in a predefined order. Multistage processing, as an idea, also seems to resonate quite well with the single-responsibility principle that we discussed in Chapter 2, Best Practices for Writing Clean and Maintainable Go Code.

When assembling a multistage pipeline, the end user is expected to provide a set of functions, or processors, that will be applied to incoming payloads as they flow through each stage of the pipeline. I will be referring to these functions with the notation F_i, where i corresponds to a stage number.

Under normal circumstances, the ...