Programming with the Kinect™ for Windows® Software Development Kit

Chapter 5. Capturing the context

Before you can start detecting gestures using the Kinect sensor with the help of the skeleton frame, it is important to understand the “discussion context.”

This concept defines all the things that help you understand what a person wants to express. For example, when you are speaking with someone, you are also looking at that person and you can understand the gestures she makes while talking because of the discussion context. The gestures are just one part of a collection of information that also includes speech, body position, facial expressions, and so forth.

This point—that communication includes movement as well as words—is central when you are trying to detect gestures. Indeed, there are two categories of gestures: ...