Three Load-Balancing Strategies
Three strategies can be used for solving the discovery and load balancing problem:
-
Server proxying—your client sends its requests to a load balancer that knows the servers (either by querying a service registry or by being the service registry) and proxies the requests to your back-end services.
-
External load balancing—your client queries an external load-balancing service that knows the servers and tells the client which server to send the RPC.
-
Client-side balancing—your client queries a service registry to learn about the servers, picks the server to send its RPC, and sends its RPC directly to the server.
Using a server proxy is the most commonly used discovery and load-balancing pattern. Most servers don’t ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access