Augmented reality for the Enterprise
-
Upload
cameron-vetter -
Category
Technology
-
view
284 -
download
0
Transcript of Augmented reality for the Enterprise
![Page 1: Augmented reality for the Enterprise](https://reader036.fdocuments.net/reader036/viewer/2022062821/58acda741a28ab36288b63d3/html5/thumbnails/1.jpg)
www.cameronvetter.com 1
AugmentedReality
Let’s Make Some Holograms!
![Page 2: Augmented reality for the Enterprise](https://reader036.fdocuments.net/reader036/viewer/2022062821/58acda741a28ab36288b63d3/html5/thumbnails/2.jpg)
2
Goal of this Presentation
www.cameronvetter.com
Learn AR Terminology
Build an Application
Enterprise Use Cases
See Lots of Examples
![Page 3: Augmented reality for the Enterprise](https://reader036.fdocuments.net/reader036/viewer/2022062821/58acda741a28ab36288b63d3/html5/thumbnails/3.jpg)
www.cameronvetter.com
About Me Senior Software Architect
www.cameronvetter.com
@PoshPorcupine
About Me
![Page 4: Augmented reality for the Enterprise](https://reader036.fdocuments.net/reader036/viewer/2022062821/58acda741a28ab36288b63d3/html5/thumbnails/4.jpg)
HoloLens Video Collage
www.cameronvetter.com
![Page 5: Augmented reality for the Enterprise](https://reader036.fdocuments.net/reader036/viewer/2022062821/58acda741a28ab36288b63d3/html5/thumbnails/5.jpg)
5
Presentation Roadmap
www.cameronvetter.com
Holograms
Control
Real World UnderstandingSpatial MappingPlane FindingSpatial Understanding
GazeCursorGesturesVoice
BillboardingPlacement
Physics
![Page 6: Augmented reality for the Enterprise](https://reader036.fdocuments.net/reader036/viewer/2022062821/58acda741a28ab36288b63d3/html5/thumbnails/6.jpg)
Holographic Lens1268 x 720 Per Eye3 Waveguide Lenses Per Eye
Intel Atom CPUX5-Z8100 1.4 GHZ2GB Ram
Holographic Processing UnitCustom build Microsoft GPU
Sensors4 Environment Cameras1 Depth Camera1 Video Camera4 Microphones1 Light Sensor
What is the HoloLens?
www.cameronvetter.com 06
![Page 7: Augmented reality for the Enterprise](https://reader036.fdocuments.net/reader036/viewer/2022062821/58acda741a28ab36288b63d3/html5/thumbnails/7.jpg)
7
Development Stack
www.cameronvetter.com
Visual Studio 2015 Update 3
Windows 10 SDK
Unity 3D v5.4+
HoloLens Emulator
HoloToolkit / HoloToolkit-Unity
![Page 8: Augmented reality for the Enterprise](https://reader036.fdocuments.net/reader036/viewer/2022062821/58acda741a28ab36288b63d3/html5/thumbnails/8.jpg)
Trimble Architecture
www.cameronvetter.com
![Page 9: Augmented reality for the Enterprise](https://reader036.fdocuments.net/reader036/viewer/2022062821/58acda741a28ab36288b63d3/html5/thumbnails/9.jpg)
Real World Understanding
www.cameronvetter.com 9
![Page 10: Augmented reality for the Enterprise](https://reader036.fdocuments.net/reader036/viewer/2022062821/58acda741a28ab36288b63d3/html5/thumbnails/10.jpg)
World Coordinate System1 Unit = 1 Meter
User Start is OriginX=0, Y=0, Z=0
Hidden TrianglesCalled the Spatial Mesh
Spatial AnchorsAttach Hologram to Reference Points in the Spatial Map
Spatial Mapping
www.cameronvetter.com 010
![Page 11: Augmented reality for the Enterprise](https://reader036.fdocuments.net/reader036/viewer/2022062821/58acda741a28ab36288b63d3/html5/thumbnails/11.jpg)
Room Spatial MeshVisualized with Solids in the Illustration
PhysicsHolograms and Real World interact with each other through Game Engine Physics
OcclusionWorks Both Ways
Plane FindingAbility to Find Planes in the Real World
What do we get?
www.cameronvetter.com 011
![Page 12: Augmented reality for the Enterprise](https://reader036.fdocuments.net/reader036/viewer/2022062821/58acda741a28ab36288b63d3/html5/thumbnails/12.jpg)
Uses Spatial MapSpatial Map Data used to find Planes
Type of PlanesWallsFloorCeilingHorizontal SurfacesOther
Skipping this TopicWe now have Spatial Understanding
Plane Finding
www.cameronvetter.com 012
![Page 13: Augmented reality for the Enterprise](https://reader036.fdocuments.net/reader036/viewer/2022062821/58acda741a28ab36288b63d3/html5/thumbnails/13.jpg)
World UnderstandingMore Detail than Spatial Map
Topology QueriesSimple Surface and Spatial Queries
Object Placement SolverConstraint Based Placement of Object Sets
Shape QueriesLook for Real World Shape Matching Custom Shape by the User
Spatial Understanding
www.cameronvetter.com 013
![Page 14: Augmented reality for the Enterprise](https://reader036.fdocuments.net/reader036/viewer/2022062821/58acda741a28ab36288b63d3/html5/thumbnails/14.jpg)
Demos
www.cameronvetter.com
Spatial Mapping
Spatial Understanding
![Page 15: Augmented reality for the Enterprise](https://reader036.fdocuments.net/reader036/viewer/2022062821/58acda741a28ab36288b63d3/html5/thumbnails/15.jpg)
Thyssenkrupp Elevator
www.cameronvetter.com
![Page 16: Augmented reality for the Enterprise](https://reader036.fdocuments.net/reader036/viewer/2022062821/58acda741a28ab36288b63d3/html5/thumbnails/16.jpg)
Holograms
www.cameronvetter.com 16
![Page 17: Augmented reality for the Enterprise](https://reader036.fdocuments.net/reader036/viewer/2022062821/58acda741a28ab36288b63d3/html5/thumbnails/17.jpg)
Body LockedTags Along with the Display
Display LockedPositionally Locked to the Display
Use SparinglyClinginess is Frustrating for Users
Breaks IllusionHolograms are Intended to Blend, Not Overlay
Billboarding
www.cameronvetter.com 017
![Page 18: Augmented reality for the Enterprise](https://reader036.fdocuments.net/reader036/viewer/2022062821/58acda741a28ab36288b63d3/html5/thumbnails/18.jpg)
Relative to OriginOrigin is Starting Position, Not Current Position
Relative to Real WorldMust take into Account, Real World Objects
Spatial UnderstandingUsed to Accurately Place Objects with Object Placement Solver
Plane FindingUsed to Quickly Find Ceiling, Tables, Walls, and Other Surfaces
Placement
www.cameronvetter.com 018
![Page 19: Augmented reality for the Enterprise](https://reader036.fdocuments.net/reader036/viewer/2022062821/58acda741a28ab36288b63d3/html5/thumbnails/19.jpg)
Tracks World StateReal World Objects and Holograms
Placement TypesOnFloor, OnWall, OnCeiling, OnShape, OnEdge, OnFloorAndCeiling, RandomInAir, InMidAir, UnderFurnitureEdge
Placement ConstraintNearPoint, NearWall, AwayFromOtherObjects, AwayFromPoint
Placement RulesAwayFromPosition, AwayFromWalls, AwayFromOtherObjects
Object Placement Solver
www.cameronvetter.com 019
![Page 20: Augmented reality for the Enterprise](https://reader036.fdocuments.net/reader036/viewer/2022062821/58acda741a28ab36288b63d3/html5/thumbnails/20.jpg)
Unity Engine ProvidedAdd a RigidBody to Any Hologram to Make it Observe Game Engine Physics
Spatial Map ColliderEach Plane in the Spatial Mesh Receives a Unity Collider
Not the Other WayReal World Objects are not Impacted by Holograms
Real World ImpactHolograms are Impacted by Real World
Physics
www.cameronvetter.com 020
![Page 21: Augmented reality for the Enterprise](https://reader036.fdocuments.net/reader036/viewer/2022062821/58acda741a28ab36288b63d3/html5/thumbnails/21.jpg)
Demos
www.cameronvetter.com
Placement Solver
![Page 22: Augmented reality for the Enterprise](https://reader036.fdocuments.net/reader036/viewer/2022062821/58acda741a28ab36288b63d3/html5/thumbnails/22.jpg)
PGA Tournament
www.cameronvetter.com
![Page 23: Augmented reality for the Enterprise](https://reader036.fdocuments.net/reader036/viewer/2022062821/58acda741a28ab36288b63d3/html5/thumbnails/23.jpg)
Control
www.cameronvetter.com 23
![Page 24: Augmented reality for the Enterprise](https://reader036.fdocuments.net/reader036/viewer/2022062821/58acda741a28ab36288b63d3/html5/thumbnails/24.jpg)
Detects Using RaycastRaycast from User’s Eyes to Unity Collider
Primary InteractionLooking At Holograms is the Primary Way to Interact with Holograms
Real World has CollidersRemember During Spatial Mapping the Real World is given Colliders
Invisible ObjectsAny Holograms missing a Collider are not Selectable with Gaze
Gaze
www.cameronvetter.com 024
![Page 25: Augmented reality for the Enterprise](https://reader036.fdocuments.net/reader036/viewer/2022062821/58acda741a28ab36288b63d3/html5/thumbnails/25.jpg)
Center of ViewDisplay Locked to Center of View
Requires GazeCursor Depends on Gaze, Expect Both to be in Every Project
Stick with Standard CursorUse Microsoft Provided Cursors Unless you Have a Good Reason to Customize, TIP: You Don’t
SelectionPrimarily used for Selection Confirmation in Conjunction with Gaze and Gestures
Cursor
www.cameronvetter.com 025
The Cursor
![Page 26: Augmented reality for the Enterprise](https://reader036.fdocuments.net/reader036/viewer/2022062821/58acda741a28ab36288b63d3/html5/thumbnails/26.jpg)
BloomTask Switch / Start Menu
Air TapSimilar to Primary Mouse Button
ManipulationTypically Used to Move or Drag Items
HoldSimilar to Right Clicking
Gestures
www.cameronvetter.com 026
![Page 27: Augmented reality for the Enterprise](https://reader036.fdocuments.net/reader036/viewer/2022062821/58acda741a28ab36288b63d3/html5/thumbnails/27.jpg)
Auxiliary ControlsThe Real Right Click
Use Windows 10 SpeechStandard Engine Built into Windows
System Level CommandsSelect == Air TapFace MeBiggerSmaller
Concise CommandsToo Long is Hard to RememberToo Short is Hard to Differentiate
Voice Input
www.cameronvetter.com 027
![Page 28: Augmented reality for the Enterprise](https://reader036.fdocuments.net/reader036/viewer/2022062821/58acda741a28ab36288b63d3/html5/thumbnails/28.jpg)
Caterpillar Sales
www.cameronvetter.com
![Page 29: Augmented reality for the Enterprise](https://reader036.fdocuments.net/reader036/viewer/2022062821/58acda741a28ab36288b63d3/html5/thumbnails/29.jpg)
29
LIVE DEMO!!!
www.cameronvetter.com
01
02
0304
05
06
Place Holograms
Map the Room
Use A Gesture
Shadows
Voice Commands
Physics
![Page 30: Augmented reality for the Enterprise](https://reader036.fdocuments.net/reader036/viewer/2022062821/58acda741a28ab36288b63d3/html5/thumbnails/30.jpg)
30
In Summary
www.cameronvetter.com
Holograms
Control
Real World UnderstandingSpatial MappingPlane FindingSpatial Understanding
GazeCursorGesturesVoice
BillboardingPlacement
Physics
![Page 31: Augmented reality for the Enterprise](https://reader036.fdocuments.net/reader036/viewer/2022062821/58acda741a28ab36288b63d3/html5/thumbnails/31.jpg)
Interior Design Reimagined
www.cameronvetter.com