O'Reilly logo

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Augmented Reality with Kinect

Book Description

If you know C/C++ programming, then this book will give you the ability to develop augmented reality applications with Microsoft’s Kinect. By the end of the course you will have created a complete game.

  • Understand all major Kinect API features including image streaming, skeleton tracking and face tracking
  • Understand the Kinect APIs with the help of small examples
  • Develop a comparatively complete Fruit Ninja game using Kinect and augmented Reality techniques

In Detail

Microsoft Kinect changes the notion of user interface design. It differs from most other user input controllers as it enables users to interact with the program without touching the mouse or a trackpad. It utilizes motion sensing technology and all it needs is a real-time cameras, tracked skeletons, and gestures.

Augmented Reality with Kinect will help you get into the world of Microsoft Kinect programming with the C/C++ language. The book will cover the installation, image streaming, skeleton and face tracking, multi-touch cursors and gesture emulation. Finally, you will end up with a complete Kinect-based game.

Augmented Reality with Kinect will help you get into the world of Kinect programming, with a few interesting recipes and a relatively complete example. The book will introduce the following topics: the installation and initialization of Kinect applications; capturing color and depth images; obtaining skeleton and face tracking data; emulating multi-touch cursors and gestures; and developing a complete game using Kinect features.

The book is divided in such a way so as to ensure that each topic is given the right amount of focus. Beginners will start from the first chapter and build up to developing their own applications.

Table of Contents

  1. Augmented Reality with Kinect
    1. Table of Contents
    2. Augmented Reality with Kinect
    3. Credits
    4. About the Author
    5. About the Reviewers
    6. www.PacktPub.com
      1. Support files, eBooks, discount offers and more
        1. Why Subscribe?
        2. Free Access for Packt account holders
    7. Preface
      1. What this book covers
      2. What you need for this book
      3. Who this book is for
      4. Conventions
      5. Reader feedback
      6. Customer support
        1. Downloading the example code
        2. Errata
        3. Piracy
        4. Questions
    8. 1. Getting Started with Kinect
      1. Installation of Kinect
        1. Setting up your Kinect software on PCs
        2. Why did I do that?
      2. The idea of the AR-based Fruit Ninja game
      3. Summary
    9. 2. Creating Your First Program
      1. Preparing the development environment
        1. Building the Visual Studio project
      2. Starting the device
        1. Initializing and using Kinect in C++
        2. Understanding the code
        3. Additional information
      3. Summary
    10. 3. Rendering the Player
      1. Choosing image stream types
      2. Obtaining color and depth images
        1. Drawing color and depth as textures
        2. Understanding the code
      3. An incorrect way to combine depth and color
        1. A traditional way for background subtraction
        2. Understanding the code
      4. Aligning color with depth
        1. Generating a color image from depth
        2. Understanding the code
        3. Additional information
      5. Using a green screen with Kinect
        1. Making a magic photographer
        2. Understanding the code
        3. Additional information
      6. Summary
    11. 4. Skeletal Motion and Face Tracking
      1. Understanding skeletal mapping
      2. Obtaining joint positions
        1. Drawing the skeleton
        2. Understanding the code
      3. Drawing the linetrails following the hands
        1. Drawing the path for specified joints
        2. Understanding the code
      4. Face tracking in Kinect
      5. Detecting a face from the camera
        1. Detecting and drawing the face rectangle
        2. Understanding the code
      6. Constructing the face model
        1. Drawing the parametric face model
        2. Understanding the code
      7. Summary
    12. 5. Designing a Touchable User Interface
      1. Multitouch systems
      2. Locating the cursors
        1. Drawing cursors from two hands
        2. Understanding the code
        3. Additional information
      3. Common touching gestures
      4. Recognizing holding and swiping gestures
        1. Drawing cursors using two hands
        2. Understanding the code
        3. Additional information
      5. Sending cursors to external applications
        1. Emulating Windows mouse with cursors
        2. Understanding the code
      6. Summary
    13. 6. Implementing the Scene and Gameplay
      1. Integrating the current code
        1. Integrating existing elements in a scene
        2. Understanding the code
      2. Cutting the fruits
        1. Adding and handling fruit objects
        2. Understanding the code
      3. Playing the game
        1. Adding simple game logic
        2. Understanding the code
        3. Additional information
      4. Summary
    14. A. Where to Go from Here
      1. libfreenect – the pioneer of Kinect middleware
      2. OpenNI – a complete and powerful Kinect middleware
      3. Free and open source resources
      4. Commercial products using Kinect
    15. Index