Page 1 | Microsoft

Introduction to audio stream

Kinect for Windows Video Courses

Page 2 | Microsoft

Kinect Audio Information

Going Inside of Kinect• Four microphone array

with hardware-basedaudio processing– Sound position tracking– Multichannel echo cancellation (MEC)– Other digital signal processing (noise suppression and reduction)

Audio Capture Range

-50 0 +50

Sound Position

• Beam Angle – The angle used to record audio that you can set as a “directional microphone”

• Sound Source Angle – the angle and confidence level of where audio is coming from

-50 0 +50

Recording

• KinectSensor.AudioSource – Type: KinectAudioSource– Contains audio capture and audio source

location functionality

KinectAudioSource

http://msdn.microsoft.com/en-us/library/microsoft.kinect.kinectaudiosource_members.aspx

Speech Recognition• Microsoft Speech Platform SDK

• Grammar --- What we are listening for

Page 9 | Microsoft

• OverviewHardware overview and SDK installation

• Color• Introduction to color stream• Demo: How to get color stream• Demo: ColorBasics sample

• Depth• Introduction to depth stream• Demo: How to get depth data• Demo: DepthBasics sample

• Skeleton• Introduction to skeleton stream• Demo: How to get skeleton stream• Demo: SkeletonBasics sample

• Audio• Introduction to audio stream• Demo: How to capture audio• Demo: Speech recognition

• Advanced Topics• Streams sync and coordinate mapping• Demo: Streams sync and coordinates

mapping• Accelerometer and tilt angle• Demo: How to get accelerometer and tilt

angle

Page 10 | Microsoft

SDK Installation

Thanks

Contact us: http://social.msdn.microsoft.com/Forums/en-US/kinectsdk

Page 11 | Microsoft