Design Patterns and Best Practices in Java

Autoscaling pattern

This is more of a deployment pattern than development pattern. But it is important to understand this, as it will impact our development practices. Autoscaling is directly related to the elastic property of the application. A service can be scaled up or down to handle a higher or lower number of requests in two ways: vertical scaling and horizontal scaling. Vertical scaling usually refers to adding more power to the same machine, and horizontal scaling refers to adding more instances that can load share. As vertical scaling is normally costly and has limits, when we talk about autoscaling we are usually referring to horizontal scaling.

Autoscaling is implemented by monitoring the instance-capacity usage and making a call ...