System Design on AWS

Chapter 16. Designing a Video Processing Pipeline for a Streaming Service

A Note for Early Release Readers

With Early Release ebooks, you get books in their earliest form—the authors’ raw and unedited content as they write—so you can take advantage of these technologies long before the official release of these titles.

This will be the 20th chapter of the final book. Please note that the GitHub repo will be made active later on.

If you have comments about how we might improve the content and/or examples in this book, or if you notice missing material within this chapter, please reach out to the editor at [e-mail].

We talked about video uploads and downloads between the users on a messaging application in Chapter 19. To ensure optimal customer experience, there are certain steps we need to take on this video upload process, such as compression to reduce the size, transcode to support different media formats and a wide variety of devices. In this chapter, we’ll focus on building a video processing pipeline for streaming services such as Netflix, Amazon Prime Video and YouTube. As always, we’ll start with system requirements and then dive deep into details on the different steps involved in the video processing pipeline. The main goal of our design decisions throughout the chapter will be that the video content should be available to viewers in the optimal quality and minimum time possible. We’ll conclude the chapter by deploying the system on AWS cloud by using AWS ...