October 2025
Intermediate to advanced
264 pages
8h 30m
English
Overview
Practical techniques for delivering low latency software.
From first principles to production-ready code, Latency teaches you how to make your software faster at every layer of the stack. You’ll learn what latency really is, how it differs from bandwidth, and why it matters for user experience. Then, guided by practical examples, you’ll apply Little’s Law, design lock-free algorithms, and architect caching systems that scale. You’ll discover how your code runs differently on distributed systems, databases, and operating systems, and understand the common latency-causing issues in each situation.
In Latency you’ll learn how to:
Put simply, latency is the delay between a cause and effect. In practice, too much latency can create problems throughout a software system, ranging from inaccurate calculations and timeouts to impatient users simply abandoning your applications. Latency issues can be challenging to avoid and troubleshoot. This book balances theory with practical implementations, turning academic research into useful techniques you can apply to your projects.
About the Technology
From lost microseconds routing server messages to page loads that keep users waiting, latency can kill good software. This one-of-a-kind book shows you how to spot, understand, and fix unwanted latency in your applications and infrastructure.
About the Book
Latency: Reduce delay in software systems shows you how to troubleshoot latency in existing applications and create low latency systems from the ground up. In it, you’ll discover high-impact fixes for measuring latency and advanced optimizations in memory management, concurrency models, and predictive execution. The tips and tricks, hands-on projects, and personal insights make this book as enjoyable as it is practical.
What's Inside
About the Reader
For software engineers with a working knowledge of backends. Examples in Rust.
About the Author
Pekka Enberg has experience in operating systems, databases, and distributed systems, having worked on the Linux kernel and the Scylla and Turso databases.
Quotes
Enlightening read and hugely recommended for all practitioners.
- Debasish Ghosh, Author of Functional and Reactive Domain Modeling
Easy to follow explanations and practical examples and diagrams.
- Robin Marx, Akamai
Great resource for distributed systems engineers!
- Piotr Sarna, co-author of Writing for Developers and Founding Engineer
A must read for anyone working on latency-sensitive projects.
- Tomasz Grabiec, ScyllaDB
Provides a broad understanding of latency.
- Thad Meyer, AUXSEND
From first principles to production-ready code, Latency teaches you how to make your software faster at every layer of the stack. You’ll learn what latency really is, how it differs from bandwidth, and why it matters for user experience. Then, guided by practical examples, you’ll apply Little’s Law, design lock-free algorithms, and architect caching systems that scale. You’ll discover how your code runs differently on distributed systems, databases, and operating systems, and understand the common latency-causing issues in each situation.
In Latency you’ll learn how to:
- Define latency, distinguish it from bandwidth, and understand its impact on user experience
- Model performance with Little’s Law and Amdahl’s Law, then measure and visualize delays
- Optimize data access with colocation, replication, partitioning, and caching
- Accelerate logic with algorithmic improvements, memory tuning, and lock-free concurrency
- Minimize delays with asynchronous processing, predictive techniques, and speculative execution
Put simply, latency is the delay between a cause and effect. In practice, too much latency can create problems throughout a software system, ranging from inaccurate calculations and timeouts to impatient users simply abandoning your applications. Latency issues can be challenging to avoid and troubleshoot. This book balances theory with practical implementations, turning academic research into useful techniques you can apply to your projects.
About the Technology
From lost microseconds routing server messages to page loads that keep users waiting, latency can kill good software. This one-of-a-kind book shows you how to spot, understand, and fix unwanted latency in your applications and infrastructure.
About the Book
Latency: Reduce delay in software systems shows you how to troubleshoot latency in existing applications and create low latency systems from the ground up. In it, you’ll discover high-impact fixes for measuring latency and advanced optimizations in memory management, concurrency models, and predictive execution. The tips and tricks, hands-on projects, and personal insights make this book as enjoyable as it is practical.
What's Inside
- How to model and measure latency
- Organizing application data for low latency
- Accelerating your code
- Hiding latency
About the Reader
For software engineers with a working knowledge of backends. Examples in Rust.
About the Author
Pekka Enberg has experience in operating systems, databases, and distributed systems, having worked on the Linux kernel and the Scylla and Turso databases.
Quotes
Enlightening read and hugely recommended for all practitioners.
- Debasish Ghosh, Author of Functional and Reactive Domain Modeling
Easy to follow explanations and practical examples and diagrams.
- Robin Marx, Akamai
Great resource for distributed systems engineers!
- Piotr Sarna, co-author of Writing for Developers and Founding Engineer
A must read for anyone working on latency-sensitive projects.
- Tomasz Grabiec, ScyllaDB
Provides a broad understanding of latency.
- Thad Meyer, AUXSEND
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.