Python Concurrency with asyncio

12 Asynchronous queues

This chapter covers

• Asynchronous queues
• Using queues for producer-consumer workflows
• Using queues with web applications
• Asynchronous priority queues
• Asynchronous LIFO queues

When designing applications to process events or other types of data, we often need a mechanism to store these events and distribute them to a set of workers. These workers can then do whatever we need to do based on these events concurrently, yielding time savings as opposed to processing events sequentially. asyncio provides an asynchronous queue implementation that lets us do this. We can add pieces of data into a queue and have several workers running concurrently, pulling data from the queue and processing it as it becomes available.

These are ...