Throttling pattern
A typical cloud application can have a variable load over time based on different situations such as a number of concurrent requests, a number of active users over time, types of actions that the application must perform and so on. In each of these situations, resources could become insufficient and the application could have poor performances or it could have a failure.
One common way to handle these situations is to scale the application accordingly by adding more instances, but as you can imagine this approach has two main side-effects—costs and time to scale up a new instance.
The Throttling pattern is an approach that permits a cloud application to use resources up to a defined limit. When the limit is exceeded, the ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access