Mixed Reality Interfaces and Product Management
-
Upload
jeremy-horn -
Category
Career
-
view
186 -
download
0
Transcript of Mixed Reality Interfaces and Product Management
![Page 1: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/1.jpg)
Mixed Reality and Product ManagementVikas BatraFeb 2017
![Page 2: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/2.jpg)
2 Product Management Role
Define Product...
Viable
Valuable
UsableFeasible
![Page 3: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/3.jpg)
3 The Objective
Augmented Reality and Virtual Reality Examine
Competitive Advantage ? Address New Market/Customer Segment ?
Process of Assessment
![Page 4: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/4.jpg)
4 Spatial User Interface
New Compute Interface Redefines human interaction with Physical Objects and Physical Space
1. 3-Dimensional, Computer-generated, Graphical Spatial View 1. augments actual physical view (Augmented Reality), or 2. eliminates actual physical view (Virtual Reality)
2. Hands Free. Controlled by hands gestures, head/body movements
![Page 5: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/5.jpg)
5 Spatial User Interface
Source Microsoft
![Page 6: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/6.jpg)
6 Compute Interface Evolution
Command Line Interface
Graphical User Interface
Touch Screen Voice Interface
Spatial User Interface
2D Screen – Text 2D Screen – Graphical
2D Screen – Graphical
Speakers 3D Spatial Projection
Keyboard KeyboardMouce
Touch Screen Mic Camera. InfraRed Sensors
Key press Mouse move, clicks Swipe, Pinch Speak Hand gesturesHead/Body movement
MS–DOS Windows, Mac Smartphones, Tablets, etc.
Echo, Siri, Google Assistant
Head Mounted Display, Smart Glasses
![Page 7: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/7.jpg)
7 Virtual Reality(VR)
![Page 8: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/8.jpg)
8 Virtual Reality - Phone Based
![Page 9: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/9.jpg)
9 Virtual Reality – Head Mounted Display
![Page 10: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/10.jpg)
10 Virtual Reality – Gaming Console
Source: Sony
Sony PlayStation VR
![Page 11: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/11.jpg)
11 Virtual Reality – PC Based
Source: Facebook/Oculus/Endgadet
Facebook Oculus Development Platform
Facebook Oculus Rift and Touch
![Page 12: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/12.jpg)
12 Creating Virtual Reality Content
Capture Store Edit Transmit Playback
Nokia Ozo 360Camera
Source: Nokia
![Page 13: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/13.jpg)
13 Augmented Reality(AR)
![Page 14: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/14.jpg)
14 On TV
![Page 15: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/15.jpg)
15 On Mobile Phone
Lets see it in action
![Page 16: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/16.jpg)
16 On Mobile Phone - Tango
Depth Sensing Motion Tracking
Google Tango Application Development Platform
Lenovo Pahb2 Pro
![Page 17: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/17.jpg)
17 On Mobile Phone – Tango
See Before you Buy Wayfair View App on Tango
![Page 18: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/18.jpg)
18 Visualization in 3D Space
Visualize Wi-Fi Signal Coverage
Signal Mapper App on Tango By Signal Garden
![Page 19: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/19.jpg)
19 On Smart Glasses
Microsoft HoloLens ODG R-8 Smart Glasses
![Page 20: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/20.jpg)
20 Optics
Holographic Waveguide
Curved CombinerFlat Combiner
Display
Lens
Computer Graphics
Actual Physical View
![Page 21: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/21.jpg)
21 Smart Glasses
40+ Smart Glasses AugmentedReality.org ww.arglassesbuyersguide.com
Source: AugmentedReality.org
![Page 22: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/22.jpg)
22 Software
Recognize and Track Environment Define AR Experiences Execute AR Experiences Integration with Existing Systems
50+ AR Authoring Platforms/SDKs Comparison at Social Comparehttp://socialcompare.com/en/comparison/augmented-reality-sdks
![Page 23: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/23.jpg)
23 End-User Interface
Source Microsoft
![Page 24: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/24.jpg)
24 The Big PictureInternet of Things
Artificial Intelligence/ Analytics
Humans
Data
Automated Control
Data Manual Control
‘Pull’
‘ Contextually Relevant Push’
![Page 25: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/25.jpg)
25 The Promise
Augmented Reality 3-Dimensional, Augmented Views (Audio-Video) Hands Free Operation - Input/output from hand gestures, voice,
camera, sensors … Larger, adjustable display area Greater Comfort, Always with you. ‘Contextually Relevant Push’
Virtual Reality Immersive Experiences
Significantly better end-user experience compared to Smartphone/PC/Tablets
![Page 26: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/26.jpg)
26 The Challenges
Technical Optics Weight Battery Life Bandwidth/Delay
Business Price
Content Application Platforms and Eco-system
![Page 27: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/27.jpg)
27 Trends
~4B VC funding since 2014 Big Players
Miniaturization Optics Lower Prices
5G Wireless Networks WiGig/802.11ad
![Page 28: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/28.jpg)
28 Example Uses Cases
![Page 29: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/29.jpg)
29 Use Cases Areas
Physical Objects
Physical Space
Immersive Experiences
![Page 30: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/30.jpg)
30 Use Cases – Physical Objects
Design Assemble Warehouse/Logistics Operate/Use Maintain
Support. I See What You See
Survey Education/Training
Execute a Procedure
![Page 31: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/31.jpg)
31 Use Cases – Physical Spaces
Architecture/Interior Design Navigation Venue Experiences e.g. Museums See Before You Buy 3-D Visualization in Space Language Translation …
![Page 32: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/32.jpg)
32 Uses Cases – Immersive Experiences
Gaming Social Virtual Experience Movies Theme Parks Live Events – Every Viewer on Prime Seat Virtual Tours
Before to travel Real Estate
… Holoportation
![Page 33: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/33.jpg)
33
What will you define?
![Page 34: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/34.jpg)
34 The Process
![Page 35: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/35.jpg)
35 Assessment Process
Define Concept
Identify and Capture Value •End Customers, Organization, PartnersUsability Viability• Customer ROI/Time • Impact to organization (e.g. CBA, Users, Usage Time)
• Partners (CBA) RisksConcept Assessment •Objective•Cost/Effort • Time/Schedule
Assess Concept
Refine Value, Usability, Viability, and Risks Prototype • Objective• Deliverable• Cost/Effort• Time/Schedule
Develop Prototype
Refine Value, Usability, Viability and RisksProduct Development• Scope • Cost/Effort• Time/Schedule
Go To Market, Support etc.
Perform Assessment
? Develop
Prototype? Develop Product?
![Page 36: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/36.jpg)
36 Questions ?
![Page 37: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/37.jpg)
37 Back Up
![Page 38: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/38.jpg)
38 Example Use Cases
3D Virtual Design Design prior to development Visualize prior to purchase
Execute Procedure. Hands-free, 3D AR, Audio assisted
Physical Object: Install, Operate, MaintainExample ; Boeing Example ;
Nokia Small Cell Surgical/Medical Procedure Pick and Pack Surveys, Navigation
Always On Self/Environment Monitoring, Compliance Non intrusive Alerting, Audio output
Contextual Situation Awareness Push Contextually Relevant Information IOT Enabled Machine Visibility and Control Multi party conference
I see what you see Remote Expert, Customer Support, etc.
3D Non-real time Video for Training Example
Contextual Marketing Larger Viewing Area, Non intrusive Contextually relevant
Holo-portation. Real Time Communication 3D Virtual Travel 3D Immersive Entertainment ….
![Page 39: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/39.jpg)
39 See before you buy
Wayfair View App on Tango
![Page 40: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/40.jpg)
40 Design
SketchUp Viewer Trimble Inc.
Meta 2 GlassesMeta
![Page 41: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/41.jpg)
41 Execute a Procedure
AR Car Repair Solution Continental Corporation
Hands Free Instructions in the FieldEpson/Atheer
![Page 42: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/42.jpg)
42 Medical
VeinViewer ChristieMed
![Page 43: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/43.jpg)
43 Interior Design
InContext Solutions
![Page 44: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/44.jpg)
44 Education
HoloAnatomy by Case Western Reserve University
HoloHeart by Made In Point GmbH
![Page 45: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/45.jpg)
45 Navigation
Aircraft NavigationAero Glass
Indoor Navigation to the shelf/aisle Aisle 411 -
![Page 46: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/46.jpg)
46 Navigation
Car Navigation.Navdy
![Page 47: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/47.jpg)
47 Support
Skype. Microsoft
![Page 48: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/48.jpg)
48 Venue Experience
Source EPSON
![Page 49: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/49.jpg)
49 Virtual Keyboard/Key pad
Augumenta Interaction PlatformHoloLens 3D3 Keyboard
![Page 50: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/50.jpg)
50 Live Events
Live Events – US Open Golf NextVR
![Page 51: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/51.jpg)
51
Spectacles SnapChat
![Page 52: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/52.jpg)
52 Technology Components
Optics (Waveguide, Curved Surface Combiner) Gesture Recognition and Control Voice Recognition and Control Depth Sensing Inertial Measurement Unit (IMU) Context Aware – Computing 3D Video/Audio, Capture, Editing, and Transmission Augmented Reality Authoring Software Platform
![Page 53: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/53.jpg)
Enterprise AR Value Chain
Nokia Internal Use. Confidential.
Components
• Qualcomm• TI• Intel
• Nvidia • AMD•…
• Samsung• Lumus• Rochester Optical •….
Smart Glasses
• ODG • Intel/Recon • Epson• Vuzix• Daqri (Helmet) • Google
• Microsoft • Meta• Lenovo
• MagicLeap
Connectivity
• Nokia, Ericsson, Huawei
• Cisco, Brocade/Ruckus, HPE/Aruba..
Applications Development
• APX Labs/UpSkill• PTC • Atheer• Wikitude• Augumenta
• Daqri,• Pristine • UBIMax • Incontext Solutions• Surgical Theater• …
SystemIntegration
• IBM• Accenture• HP•…• Nokia Services ?
Operations & Management
• AirWatch by vmware
• Augmate •Nokia Impact (MDM)?
![Page 54: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/54.jpg)
54 End User Experience
At Home Source Microsoft
![Page 55: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/55.jpg)
55 End User Experience
Source: Microsoft HoloLens
![Page 56: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/56.jpg)
56 End User Experience
Source: Microsoft HoloLens Everywhere ElseSource ODG,
![Page 57: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/57.jpg)
57 Questions to Ask
Can it enable meeting existing customer needs better ? Can it enable meeting an unmet customer need? Are there new customer segments that can now become attractive? Can it improve monetization ? E.g. moving subscriber from free to premium
offering?
Can it enable higher Productivity? Can it enable higher Quality? Can it enable greater Safety? Can it help with Compliance requirements?Directly from VR HMD/AR Smart Glasses and Technology building blocks
![Page 58: Mixed Reality Interfaces and Product Management](https://reader035.fdocuments.net/reader035/viewer/2022070510/58abedef1a28ab504e8b5cf7/html5/thumbnails/58.jpg)
58 Resources
www.arglassesbuyersguide.com/ www.augmentedworldexpo.com/ Augmented Reality for Enterprise Alliance (AREA)
www.thearea.org/ Karl Guttag on Technology www.kguttag.com Depth Sensing Technologies Comparison
http://www.ti.com/lsds/ti/sensing-products/optical-sensors/3d-time-of-flight-sensors-technology-comparison.page