Making XR a reality for everyone - Qualcomm · Making XR a reality for everyone Hugo Swart, Senior...
Transcript of Making XR a reality for everyone - Qualcomm · Making XR a reality for everyone Hugo Swart, Senior...
Making XR a reality for everyoneHugo Swart, Senior Director, Head of XR Business ManagementHiren Bhinde, Director, XR Product Management
Qualcomm Technologies, Inc
@qualcommMay 29, 2018 Augmented World Expo
2
Healthcare
Marketing &advertising
Retail
Engineering
Military
Education
Industrial &manufacturing
EntertainmentEmergency response
XR is thenext mobile computingplatform
33
Professionals Working
Architects collaborating
on a shared design to
improve efficiency
Families Socializing
Families virtually brought
together with life-like
communication
Young Adults Exploring
A young man exploring
Rome and seeing the
Colosseum as originally built
XR will serve a broad spectrum of roles in daily life,reach critical mass and go mainstream
Children Learning
Children transported
into Amazon jungle for
virtual lesson
44
Standalone devices are helping to make this happen
A new category of devices has arrived
Lenovo Mirage Solo w/Daydream
HTC VIVE Focus
Oculus Go
ODG R9
Shadow Creator
5
Standalone AR + VRInstall Base by 2023
186 Million
Source: IDC, ABI Research, Qualcomm Technologies
66
Consumers want convenience, comfort and affordability
Higher-resolution screensare most desired feature
Top reason for notbuying AR/VR device
45% 46%
Prefer astandalone device
Tooexpensive
Source: The reality of AR and VR survey: Technalysis Research
77
Premium quality
The quality of XR experiences is key
Cheap VR goggles PC tethered
Low quality experiences that give XR a bad name
Quality standalone XR experiences
at an affordable price for mainstream users
For tech aficionados at high price
point and cumbersome setup
High quality
88
For tech aficionados at high price
point and cumbersome setup
High quality Premium quality
High quality Premium quality
Low quality experiences that give XR a bad name
Standalone XR devices offer options for consumers
6DoF
Room scale trackingand positioning
Ultrasonic controllersand hand tracking
3DoF
Lean back and360 viewing
Simplecontrollers
99
The first dedicated XR platform
Interactions
Audio
Visual Art
ific
ial I
nte
llig
en
ce
High quality XR experiences for mainstream audiences
Qualcomm Snapdragon is product of Qualcomm Technologies, Inc. and/or its subsidiaries.
#SnapdragonXR1
1010
GPU
ISP
CPU
Security
Wi-Fi
DSP
Audio
System Memory
Location
Specially designed just for XR
Heterogenous Compute
#SnapdragonXR1
11
WatchLean back and enjoy movies, videos and sports
11#SnapdragonXR1
12
PlayInteract in game environments
12#SnapdragonXR1
13
CaptureCapture moments worth saving
13#SnapdragonXR1
14
ShareShare your experience asit’s happening
• “See what I see”
14#SnapdragonXR1
1515
VisualIntuitiveinteractions
Sounds
An XR platform needs to address technology demandsto enable high quality XR experiences
IMMERSION
Dual DisplayMotion tracking
ApplicationInterfaces
Voice UI
3D Audio
Stereo Camera
Video &Graphics
Performance
16c16
Immersion highlightsGet full immersion with low power andthermals that allow for sleek, lightweightand stylish headworn designs
Qualcomm aptX and Aqstic are products of Qualcomm Technologies, Inc. and/or its subsidiaries.
UltraHD Premiumvideo playback
Adreno GPUFast graphics rendering
at low power
Kryo CPU
Qualcomm Aqstic and Qualcomm aptX audio
Qualcomm Aqstic voice UI
QHD+ (2K) display
6DoF headtracking
3DoF / 6DoFcontrollers
#SnapdragonXR1
17
Visuals
18c18
Pixels so realistic theyare indistinguishablefrom the real world
• Ultra HD premium video and display(up to 4K60 video w/ audio)
• Jitter reduction
• Fast graphics rendering at lower powerand reduced memory bandwidth
• OLED support for wide color gamut,and amazing contrast
#SnapdragonXR1
19
AudioAudio input/voice input
20c20
True-to-life soundis critical to immersiveexperiences
• Support Object and Scene based audioas well as Audiophile-grade DSD audio
• Improved quality high fidelity sound w/ Qualcomm Aqstic and pre-integratedaptX & aptX HD audio
• Low latency Immersive Audio supportedusing a 3D Audio SDK (Object-based audio,Ambisonics (HOA), HRTF and Reverb)
• Active noise cancellation
#SnapdragonXR1
The sounds and visuals mustmatch —depth, direction, andmagnitude of sound sources
21c21
Voice is a natural way to interact with devices
• Voice activation
• Noise filtering, suppression, and cancellation
• Speech recognition
• Natural language processing
• Voice biometrics
• Deep learning
Qualcomm aptX and Aqstic are products of Qualcomm Technologies, Inc. and/or its subsidiaries.
A hands-free interface is necessaryin certain situations
#SnapdragonXR1
“Show me diagram and
location to insert cord”
22
Intuitive Interactions
23c23#SnapdragonXR1
Natural userinterfaces withminimal latencyand precise headmotion tracking
• VIO Head Tracking
• Motion to Photon latencyless than 20ms
• DSP Sensor Fusion
• Support for 3DoF as wellas 6DoF controllers
24
Artificial Intelligence
#SnapdragonXR1
25
Hexagon
Vector Processor
Adreno
Ha
rdw
are
Tools• Snapdragon Neural Processing SDK
• Android NN
• Hexagon NN
Frameworks• Caffe/Caffe2
• TensorFlow/TensorFlow Lite
• ONNX
INT8 precision networks
FP32 and FP16 precision networks
FP32 and INT8 8bit precision networks
Kryo
Object classification
Pose prediction
Natural language understanding
Speaker recognition
On-device intelligence for XRXR1 heterogeneous computing key for on-device intelligence
#SnapdragonXR1
26
Coming Soon
#SnapdragonXR1
27#SnapdragonXR1
282828
Qualcomm® Snapdragon™ XR1 platform
Making XR a reality for everyone
CaptureWatch Play Share
#SnapdragonXR1
Follow us on:
For more information, visit us at:
www.qualcomm.com & www.qualcomm.com/blog
Thank you!
Nothing in these materials is an offer to sell any of the
components or devices referenced herein.
©2018 Qualcomm Technologies, Inc. and/or its affiliated
companies. All Rights Reserved.
Qualcomm is a trademark of Qualcomm Incorporated,
registered in the United States and other countries. Other
products and brand names may be trademarks or registered
trademarks of their respective owners.
References in this presentation to “Qualcomm” may mean Qualcomm
Incorporated, Qualcomm Technologies, Inc., and/or other subsidiaries
or business units within the Qualcomm corporate structure, as
applicable. Qualcomm Incorporated includes Qualcomm’s licensing
business, QTL, and the vast majority of its patent portfolio. Qualcomm
Technologies, Inc., a wholly-owned subsidiary of Qualcomm
Incorporated, operates, along with its subsidiaries, substantially all of
Qualcomm’s engineering, research and development functions, and
substantially all of its product and services businesses, including its
semiconductor business, QCT.