Chapter 2. Who’s there?

The Kinect sensor can be defined as a multistream source—it can provide a stream for every kind of data it collects. Because the Kinect sensor is a color/depth/audio sensor, you can expect it to send three different streams. In this chapter, you’ll learn about the kinds of data provided by these streams and how you can use them. Furthermore, you’ll see how the Kinect for Windows SDK can compute a complete tracking of skeletons detected in front of the sensor using only these raw streams.

SDK architecture

Before you learn more about streams, you need to become familiar with the inner structure of the Kinect for Windows SDK, shown in Figure 2-1. The SDK installs the natural user interface (NUI) application programming interface ...

Get Programming with the Kinect™ for Windows® Software Development Kit now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.