June 2010
Intermediate to advanced
338 pages
10h 33m
English
Content preview from Web OperationsBecome an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Improvements Since Then
We still have the same basic system in place today. However, we have made a few enhancements.
One of the key enhancements we made is that the population of the read-only database is now managed by an event-driven system which uses Gearman, a distributed job queue system, instead of on a schedule using scripts that were run via cron. This allows content to be pushed to the frontend as soon as it is ready. At first, we feared this would create an unpredictable load on our primary database. But it turned out that the opposite was true. The scheduled data migration was causing surges in database work. The server would be idle for minutes and then flooded with work to perform all at once. Likewise, the servers that moved the data would see similar peaks and valleys in their usage. If we experienced any unexpected event during these peaks, the database server would become unresponsive. Now the load is spread out based on the speed at which our content team creates new content.
Another enhancement we made is that now we operate two datacenters. The second datacenter has a full set of frontend proxy, application, and read-only database servers. In addition, the database is replicated over VPN from our primary datacenter. We use geo-IP-based DNS to send users to their closest datacenter. Plus, we have the ability to shift all requests to one datacenter after a short DNS timeout, allowing us to conduct major maintenance on a location and still serve content to our readers. ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.