Kinect in Motion - Audio and Visual Tracking by Example. Start building for the Kinect today by capturing gestures, movements, and spoken voice comman

Kinect in Motion - Audio and Visual Tracking by Example. Start building for the Kinect today by capturing gestures, movements, and spoken voice comman - Opis

Kinect is a motion-sensing input device by Microsoft for the Xbox 360 video game console and Windows PCs. It provides capabilities to enhance human-machine interaction along with a zero-to-hero journey to engage the user in a multimodal interface dialog with your software solution.Kinect in Motion - Audio and Visual Tracking by Example guides you in developing more than five models you can use to capture gestures, movements, and voice spoken commands. The examples and the theory discussed provide you with the knowledge to let the user become a part of your application.Kinect in Motion - Audio and Visual Tracking by Example is a compact reference on how to master color, depth, skeleton, and audio data streams handled by Kinect for Windows.Starting with an introduction to Kinect and its characteristics, you will first be shown how to master the color data stream with no more than one page of lines of code. Learn how to manage the depth information and map them against the color ones. You will then learn how to define and manage gestures that enable the user to instruct the application simply by moving arms or any other type of natural action. Finally you will complete your journey through a multimodal interface, combining gestures with audio.The book will lead you through many detailed, real-world examples, and even guide you on how to test your application. Spis treści:
Kinect in Motion Audio and Visual Tracking by Example
Table of Contents
Kinect in Motion Audio and Visual Tracking by Example
Credits
About the Authors
About the (...) więcej Reviewers
www.PacktPub.com
Support files, eBooks, discount offers and more
Why Subscribe?
Free Access for Packt account holders
Preface
What this book covers
What you need for this book
Who this book is for
Conventions
Reader feedback
Customer support
Downloading the example code
Downloading the color images of this book
Errata
Piracy
Questions
1. Kinect for Windows Hardware and SDK Overview
Motion computing and Kinect
Hardware overview
The IR projector
Depth camera
The RGB camera
Tilt motor and three-axis accelerometer
Microphone array
Software architecture
Video stream
Depth stream
Audio stream
Skeleton
Summary
2. Starting with Image Streams
Color stream
Editing the colored image
Image tuning
The color image formats
The Infrared color image format
The raw Bayer formats
YUV raw format
Depth stream
DepthRange the default and near mode
Extended range
Mapping from the color frame to the depth frame
Summary
3. Skeletal Tracking
Tracking users
Copying the skeleton data
Default and Seated mode
Detecting simple actions
Joint rotations
Summary
4. Speech Recognition
Speech recognition
Grammars
A simple grammar sample
The Microsoft.Speech library
Tracking audio sources
Sound source angle
Beam angle
Summary
A. Kinect Studio and Audio Recording
Kinect Studio capturing Kinect data
Audio stream data recording and injecting
Summary
Index mniej