Practical Site Reliability Engineering

Design pattern for scalability

Scalability is the ability of a system either to handle an increase in load without an impact on performance or that we can readily increase scaling on resource utilization for the available resources:

• Avoid, a single point of failure
• Scale, horizontally, not vertically
• Move work away from your core service
• Implementation of caching system
• Keep, your cache up to date
• Asynchronous system
• Statelessness
• Make, your system able to handle any failure

Scalability is one among many AWS WAF components. When scaling to handle load, you will find the preceding design principles in the following points. We usually see these in practical implementations in our real cloud and container worlds:

• Scaling on CPU utilization ...