Hands-On High Performance with Go

Common queuing patterns

Having an optimized queuing mechanism can be very helpful for writing performant Go code. Being able to push non-critical tasks to a queue allows you to complete the critical tasks faster. Another point to consider is that the queueing mechanism that you're using doesn't necessarily have to be a Go queue. You can push data to external mechanisms such as Kafka (https://kafka.apache.org/) or RabbitMQ (https://www.rabbitmq.com/) in a distributed system. Managing your own messaging queue can become very operationally expensive, so having a separate message queuing system is commonplace today. We will cover this in more detail in Chapter 14, Clusters and Job Queues, when we look at clustering and job queuing.