Chapter 15Images, Video, and Audio

In this chapter, peripherals are attached to the RPi so that it can be used for capturing image, video, and audio data using low-level Linux drivers and application programming interfaces (APIs). It describes Linux applications and tools that can be used to stream captured video and audio data to the Internet. Open Source Computer Vision (OpenCV) image processing and computer vision approaches are investigated that enable the Raspberry Pi (RPi) to draw inferences from the information content of the captured image data. Capture and playback of audio streams is described, along with the use of Bluetooth A2DP audio. The chapter also covers some applications of audio on the RPi, including streaming audio, Internet radio, and text-to-speech (TTS).

Equipment Required for This Chapter:
  1. Raspberry Pi (any model, but ideally an RPi3)
  2. Raspberry Pi camera or a USB webcam
  3. USB audio, audio HAT, and/or Bluetooth adapter

Further resources for this chapter are available at www.exploringrpi.com/chapter15/.

Capturing Images and Video

In this section, the RPi is used as a platform for capturing image and video data and saving the data on the RPi file system. This is useful for RPi applications such as robotics, home security, home automation, and aeronautics, when networked image streaming is not an available option—for example, if the application is untethered and distant from a wireless network. With suitable peripherals, the RPi can be used to capture very ...

Get Exploring Raspberry Pi now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.