Augmented Reality: On a new powerful mobile computing platforms
If you can't read please download the document
-
Upload
chetan-kumar-s -
Category
Technology
-
view
506 -
download
0
Transcript of Augmented Reality: On a new powerful mobile computing platforms
Inspiration
Chetan Kumar S
[email protected]
Augmented Reality: On new powerful mobile computing platforms
Emerging trends in Mobile computing - From Mobile Application to Context Aware Computing
MSRIT
Disclaimer
The video and photos are copyright of respective owners
Some of text are from various papers/report, copyright of respective owners
What is Augmented Reality(AR)
What is Augmented Reality
In a nutshell, Augmented Reality (AR) blends virtual objects into real world.
AR Systems must have following characteristics:Combines real and virtual
Interactive and realtimeMovie like avatar is it AR ?
Registered in 3DWeather reporting in TV is AR ??
What is augmented reality
Devices may beHead mounted displayGoogle glasses and beyond
Mobile phones and tablet
What can it do
Interior DesignSee how the furniture fits in before you buy,
Change orientation in AR before spending effort
What can it do
Product Information Allows customer better experience
Interact with the product
What can it do
Medicine Display 3D model of CT image on actual part
Why is it becoming important now
Processing power Becoming more powerful and also lower cost
Why is it becoming important now
Everything is coming into mobile
High speed CPU
High speed GPU
Camera
High speeddata
Mobile phone as platform
Cheap
Socially acceptable
Well known
Discrete
Wide spread
Intuitive to use
AR Browsers
AR technology
AR technology involve two major parts:
Computer vision trackingTrack objects not location/contextIndoor may be simple, outdoor is complex
More useful than GPS/compass
Computer graphics renderingSituated information visualization
Multimedia
Technology in AR: Components
AR Hardware componentsEssentially three componentsA camera
A Display
A Processing unit
The form factor can varyMobile phone/Tablet
Dedicated devicesLike one used in NatGeo example
Technology in AR: Tracking
Types of ARMarker based tracking, normally using rectangular fiducial markingEdge detection operation by thresholding
Normalization using perspective transformation
Pattern matching
AR Technology: Tracking
Types of ARMarkerless Tracking Edge detection approach
3D model analysis approach
Human model approach
AR Technology: Rendering
What about cluttered images ?
AR Technology: Rendering
Image driven layout
Few AR toolkits and SDK
ARTookKithttp://www.hitl.washington.edu/artoolkit/ARToolKitPlushttps://launchpad.net/artoolkitplusAndARhttp://code.google.com/p/andar/Open TDLhttps://github.com/zk00006/OpenTLD/wikivuforiahttps://www.vuforia.com/
Few AR toolkits and SDK
Software for Articulated Tracking
http://humim.org/tracker
Computer Visionhttp://www.computervisiononline.com/software
Design Challenges: AR on mobile devices
AR combines graphics, vision, interaction
AR requires (unlike related disciplines)Strict real time operation Unlike Ubicomp or mobile information systems
High spatial precision (1cm, 1 degree)Unlike location based services
Robustness for operation by human userUnlike many computer vision methods in automation etc.
Design Challenges: AR on mobile devices
Mobile phone AR requires (in addition)No thin client!
Same level of performance as desktop ARNew algorithms must be orders of magnitude more efficient
No unrealistic assumptions about HW
Unique form factor considerationsScreen size
Camera quality
Research issues & challenges
TrackingIncreased robustnessAutomatic adaptation to changing conditions
Use new hardware capabilities (GPU)
Wider range of object typesLess textured, general 3D objects
Live object capture for tracking
Tracking in unknown environmentsUnderwater ? Night/day ? Rainy/Shiny day
Research issues and challenges
Models generation, capture and renderingCapture of appearanceImage based rendering, cheaper end user capturing
Semantic information from user-inputEnables more complex interactions with the environmentCan we inform the system if the object is a rubber ball OR ceramic ball
Thank you
Questions
CLIQUE PARA EDITAR O FORMATO DO TEXTO DO TTULO
Clique para editar o formato do texto da estrutura de tpicos2. Nvel da estrutura de tpicos3. Nvel da estrutura de tpicos4. Nvel da estrutura de tpicos5. Nvel da estrutura de tpicos6. Nvel da estrutura de tpicos7. Nvel da estrutura de tpicos
