Imagine a world in which you can grab a virtual 3D lump of clay and mold it mid-air into the flagship sculpture for your next art opening, recite your favorite Shakespearean sonnet in English and have it translated real-time for your friend in Shanghai, select and

play your favorite tune with a mid-air flick of your hand or try on those cool new sunglasses that everyone seems to be wearing without

leaving your PC. Perceptual Computing is about bringing exciting user experiences through new human-computing interactions such that

devices sense and perceive the user actions in a natural, immersive, and intuitive way.

With the Intel® Perceptual Computing SDK 2013 you can begin to

create this world and usher in the next wave of visual computing

interactivity. The Intel Perceptual Computing SDK enables you to

create the next generation of immersive, engaging, innovative

software applications that incorporate close-range depth tracking,

speech recognition, facial analysis and augmented reality on

Intel® Core™ processor-powered Ultrabook™ devices and PCs.

Download the Intel® Perceptual Computing SDK 2013The Intel Perceptual Computing SDK 2013 is a free, downloadable

software development kit supporting 2nd, 3rd and 4th generation

Intel Core processors. High-level APIs provide developers with fast,

easy programming access to perceptual computing functionality,

while low-level APIs provide experienced developers the control

needed for application innovation. Additionally, due to Intel forward

compatibility, the code you write now will run on future platforms

saving you valuable resources in the future. The SDK also supports

the CREATIVE* Interactive Gesture Camera, a small, light-weight,

USB-powered depth sensor camera optimized for close-range

interactivity powered by SoftKinetic* technology.

Supported Perceptual Computing Usage ModesWith the Perceptual Computing SDK, developers have access to

the following usage modes, which can be used individually or

combined to create unique, compelling applications and usages:

• Speech Recognition from Nuance*

• Facial Analysis

• Close-Range Depth Tracking by SoftKinetic*

• Augmented Reality from Total Immersion*

• Usage-Mode Coordination: With the Perceptual

Computing SDK, applications can easily implement more

than one perceptual computing usage mode simultaneously

such as close-range depth tracking, facial analysis, and

speech recognition.

• Multi-Application Coordination: The SDK manages

sharing of the CREATIVE* camera and other system

resources so that users can switch seamlessly between

perceptual computing applications.

• Privacy Notification: To protect the privacy of end-

users, the SDK includes a privacy notification function that

notifies end-users when the RGB and depth camera are

switched on.

• Extensibility: The Perceptual Computing SDK was

designed with the ability to easily add more usage modes

in the future.

To learn more about how to download your FREE copy of the

Intel Perceptual Computing SDK 2013 or to find out how to

purchase the CREATIVE Interactive Gesture Camera, visit intel.

com/software/perceptual.

To download your FREE copy of the Intel® Perceptual Computing SDK 2013 or for additional information and resources, visit the Intel Visual Computing Source at: www.intel.com/software/perceptual

PRODUCT BRIEF

Intel® Perceptual Computing SDK 2013

1

Intel® Perceptual Computing SDK 2013Create a New World of Interactivity with Your Intel® Core™ Processor-Based Applications for Intel Platforms

Product Brief: Intel Perceptual Computing SDK 2013

The Intel Perceptual Computing SDK 2013 supports the key perceptual computing

usage modes speech recognition, facial analysis, close-range depth tracking, and

augmented reality.

Speech RecognitionSpeech recognition is a common way to add perceptual computing interactivity to an

application. Examples of this might be direct PC commands, dictation, or translation.

For speech recognition, when a user speaks to the

CREATIVE Camera, the speech recognition algorithm

in the SDK interprets the speech, recognizes that the

user has spoken a command pre-programmed into

the application, and passes the command on to the

application. In the application shown below, the user

can select the processor information by saying “i3”,

“i5”, or “i7”.

Facial AnalysisFace tracking can be used as a perceptual computing component in games or

other interactive applications. The Intel Perceptual Computing SDK supports facial

recognition, facial tracking, gender and age determination, attribution detection

such as smile.

In the example shown below, the camera senses the user’s face within the field of

view, identifies the seven landmark points for the mouth, nose and eyes, and then

tracks the face as her head moves.

Close-Range Depth Tracking Close-range tracking is the overall term for a sub-category of perceptual computing

interactivity that includes recognition and tracking of hand poses, such as the thumbs

up, hand and finger tracking, and hand gestures.

In the example shown below, the user’s hand is recognized by the close-range

tracking algorithm of the depth camera allowing the user to turn the virtual door

handle on the screen of the Ultrabook device. Close-range depth tracking is one of

the most well-known and recognizable forms of perceptual computing and can be

used for gaming as well as enhancing productivity.

Augmented Reality 2D/3D object tracking provides the user with an augmented reality experience

in which real-time input from the CREATIVE* depth sense camera (RGB video,

depth map and audio) is combined with other graphics sources or video. In the

example below, a woman is trying on a pair of glasses. The application recognizes

the image of her face, her face is tracked in space, and the image of the glasses is

superimposed on her face and then both the face and glasses are tracked real time.

Learn More About Intel® Core™ Processors

For more information say . . .

“i3” “i5” “i7”

2

The Intel Perceptual Computing SDK ArchitectureThe Intel Perceptual Computing SDK 2013 development environment and library

can help you quickly and easily start adding perceptual computing interactivity to

your applications.

The SDK architecture consists of several layers of components (see diagram above).

The I/O modules serve as data sources that retrieve data from input devices such

as the CREATIVE camera or data sinks that provide data to output devices such as

a monitor. The algorithm modules implement the pattern detection and recognition

algorithms that are critical ingredients of innovative human computer experience,

such as facial analysis, gesture recognition, voice recognition, and text to speech.

The SDK standardizes the interfaces of the I/O modules and the algorithm modules

so that applications can access the functionalities focusing on the underlying

implementations. Additional features provided by the SDK include:

• Usage Mode Coordination: Manages system resources so that each

application can use individual modalities such as speech, tracking or face

analysis or can combine multiple modalities.

• Hardware Acceleration: The SDK is compatible with other Intel Visual

Computing SDKs, including the Intel Media SDK 2013, Intel SDK for

OpenCL* Applications 2013.

• Power Management State: Exposes the power management state of the

device to algorithm modules so appropriate action can be taken.

• Privacy Notification: This service will inform end-users whenever an

application turns on the CREATIVE camera. This is important to alert end-users

that their movements and images are being captured.

Supported Processors, Software, Samples, and Tools

INTEL® PERCEPTUAL COMPUTING SDK ARCHITECTURE

Usage Mode Coordination

Hardware Acceleration

Power Management State

Privacy Notification

IO Modules

Augmented Reality

Algorithm Module

Close-Range Depth Tracking

Algorithm Module

Facial Analysis

Algorithm Module

Speech Recognition

Algorithm Module

DRIVERS

2ND , 3RD OR 4TH GENERATION INTEL® CORE™ PROCESSORS

APPLICATIONS & SAMPLES

PERCEPTUAL COMPUTING SDK

Processors 2nd, 3rd, and 4th Generation Intel® Core™

Operating SystemsMicrosoft* Windows* 7 and 8 desktop (32- and 64-bit)

Programming Languages

C++, C#

Microsoft Visual Studio*

VS 2008, VS 2010, VS 2012

Application SamplesCamera Viewer, Audio Recorder, Face Detection, Landmark Detection, Gesture Viewer

Supported Tools

• Total Immersion* D’Fusion Studio

• Intel Media SDK 2013

• Intel SDK for OpenCL Applications 2013

• Processing* Open Source Programming Language and Environment

• Unity* Game Development Environment

3

Product Brief: Intel Perceptual Computing SDK 2013

CREATIVE Interactive Gesture CameraThe CREATIVE Interactive Gesture Camera* is a small, light-weight, low-power camera

that is tuned for close-range interactivity. Designed with ease of setup and portability

in mind, it includes an HD web camera, depth sensor based on SoftKinetic technology,

and a dual-array microphone.

Specifications for the camera are:

• Maximum RGB Camera Resolution: 720p (1280 x 720)

• Maximum IR Depth Resolution: QVGA (320 x 240)

• RGB + Depth frame sync

• Frame Rate: 30 fps

• FOV: 73° diagonal

• Range: 0.5 ft. to 3.25 ft.

• Dual-array microphone

• Size: 4.27 in. x 2.03 in. x 2.11 in.

• Weight: 9.56 oz.

• Power: Single USB 2.0 (power <2.5W)

The Intel® Perceptual Computing Website: Downloads, Code Samples, and SupportThe Intel® Perceptual Computing Website (intel.com/software/perceptual) is a

developer’s one-stop shop for downloads, support and information for the Intel

Perceptual Computing SDK 2013. You’ll find free downloads of the SDK, software,

code samples, demo applications, product documentation, tutorials, videos, links to

twitter*, and a support forum. In addition, you’ll be able to purchase a CREATIVE

Interactive Gesture Camera.

To download your FREE copy of the Intel® Perceptual Computing SDK 2013 or for additional information and

resources, visit the Intel Visual Computing Source at: intel.com/software/perceptual

Optimization notice: Refer to our Optimization Notice for more information regarding performance and optimization choices in Intel software products.

INFORMATION IN THIS DOCUMENT IS PROVIDED IN CONNECTION WITH INTEL PRODUCTS. NO LICENSE, EXPRESS OR IMPLIED, BY ESTOPPEL OR OTHERWISE, TO ANY INTELLECTUAL PROPERTY RIGHTS IS GRANTED BY THIS DOCUMENT. EXCEPT AS PROVIDED IN INTEL’S TERMS AND CONDITIONS OF SALE FOR SUCH PRODUCTS, INTEL ASSUMES NO LIABILITY WHATSOEVER AND INTEL DISCLAIMS ANY EXPRESS OR IMPLIED WARRANTY, RELATING TO SALE AND/OR USE OF INTEL PRODUCTS INCLUDING LIABILITY OR WARRANTIES RELATING TO FITNESS FOR A PARTICULAR PURPOSE, MERCHANTABILITY, OR INFRINGEMENT OF ANY

PATENT, COPYRIGHT OR OTHER INTELLECTUAL PROPERTY RIGHT.

A “Mission Critical Application” is any application in which failure of the Intel Product could result, directly or indirectly, in personal injury or death. SHOULD YOU PURCHASE OR USE INTEL’S PRODUCTS FOR ANY SUCH MISSION CRITICAL APPLICATION, YOU SHALL INDEMNIFY AND HOLD INTEL AND ITS SUBSIDIARIES, SUBCONTRACTORS AND AFFILIATES, AND THE DIRECTORS, OFFICERS, AND EMPLOYEES OF EACH, HARMLESS AGAINST ALL CLAIMS COSTS, DAMAGES, AND EXPENSES AND REASONABLE ATTORNEYS’ FEES ARISING OUT OF, DIRECTLY OR INDIRECTLY, ANY CLAIM OF PRODUCT LIABILITY, PERSONAL INJURY, OR DEATH ARISING IN ANY WAY OUT OF SUCH MISSION CRITICAL APPLICATION, WHETHER OR NOT INTEL OR ITS SUBCONTRACTOR WAS NEGLIGENT IN THE DESIGN, MANUFACTURE, OR WARNING OF THE INTEL PRODUCT OR ANY OF ITS PARTS.

Intel may make changes to specifications and product descriptions at any time, without notice. Designers must not rely on the absence or characteristics of any features or instructions marked “reserved” or “undefined”. Intel reserves these for future definition and shall have no responsibility whatsoever for conflicts or incompatibilities arising from future changes to them. The information here is subject to change without notice. Do not finalize a design with this information.

The products described in this document may contain design defects or errors known as errata which may cause the product to deviate from published specifications. Current characterized errata are available on request. Contact your local Intel sales office or your distributor to obtain the latest specifications and before placing your product order.

Copies of documents which have an order number and are referenced in this document, or other Intel literature, may be obtained by calling 1-800-548-4725, or go to: www.intel.com/design/literature.htm

Copyright © 2013 Intel Corporation. All rights reserved. Intel, the Intel logo, Core, and Ultrabooks are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries.

*Other names and brands may be claimed as the property of others. Printed in USA 0213/PW/JP/SPC/PDF Please Recycle 327943-003US

4