5 Autoscaling

This chapter covers

  • Problems that autoscalers set out to solve
  • How Knative Serving’s autoscaling works under various scenarios
  • A walkthrough of the core autoscaling algorithm
  • Configuration options and how these affect autoscaling

Autoscaling awakens the engineering imagination in a way that few topics do. Most of the systems we build seem lifeless or mindless. But to build a system that appears to breathe is somehow uniquely fascinating. Depressingly, though, autoscaling turns out to be easy to spell, yet hard to achieve. The system that breathes peacefully today is yelling obscenities tomorrow.

My goal in this chapter is to explain the basic structure and functioning of the components responsible for the management of scaling ...

Get Knative in Action now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.