insideAR Tokyo 2014 - AR Maintenance - How to create guided-through maintenance applications -...
-
Upload
metaioar -
Category
Presentations & Public Speaking
-
view
266 -
download
3
description
Transcript of insideAR Tokyo 2014 - AR Maintenance - How to create guided-through maintenance applications -...
AR Maintenance How to create guided-through
maintenance applications
Thomas Berton - Metaio
Table of contents1. Introduction2. The scenario3. Tracking configuration preparation4. Content preparation5. AREL Package creation6. Tests and deployment7. Conclusion8. Q&A
InsideAR Tokyo 2014 – How to create guided-through maintenance applications
Introduction – The Metaio SDK: Rough overview
InsideAR Tokyo 2014 – How to create guided-through maintenance applications
Camera image capturing
Rendering
Tracking
AR experience
Application(choices: online/offline, native/AREL programming language, platform, ...)
Introduction – Tracking technologies• Image/pattern recognition
– 2D marker• ID markers• Picture markers
– 2D markerless– LLA marker– Extensible tracking
• Object and environment recognition and exploration– 3D tracking– Edge-based initialization + 3D tracking
• Instant tracking• Sensors
– GPS position / orientation• Barcodes, QR codesInsideAR Tokyo 2014 – How to create guided-through maintenance applications
Introduction – Rendering features• SDK provides own rendering
– Loading MD2, OBJ, MFBX* models– Adjustment of translation, rotation, scale based on tracked coordinate system or
other coordinate system (e.g. in camera space; relative to screen corners e.g. for GUI purposes)
– Built-in effects: environment mapping (reflections), fade in when pattern tracked– Dynamic lighting– Custom shading
• Custom rendering– Use any 3D/game engine or renderer– Only use Metaio SDK for capturing/tracking of camera images and calculating
the pose• Unity pluginInsideAR Tokyo 2014 – How to create guided-through maintenance applications
Introduction – Different platforms and application types
InsideAR Tokyo 2014 – How to create guided-through maintenance applications
Native application(Java / C++ / Objective-C)
AREL-based application
(JavaScript, cross-platform)
AREL Player(JavaScript, standalone for
Windows/Mac)
Unity(choice between
C#/JavaScript/Boo)
Junaio channel(JavaScript, cross-platform)
Cloud Plugin(JavaScript, cross-platform)
The scenario• On the air conditioner, we will guide the maintenance worker through
different procedure to remove the fan and the fan motor of the unit
• We will use AREL and the Metaio SDK with edge based initialization
InsideAR Tokyo 2014 – How to create guided-through maintenance applications
Tracking configuration preparation• 2 tracking configurations
– 1 for application development – On an image– 1 for the final application – On the real object
• Application development– Image provided in the Metaio SDK (AR Marker)
• Final application tracking (Edge based initialization)– From the CAD data of the object– Creator and Edge based initialization configurator
InsideAR Tokyo 2014 – How to create guided-through maintenance applications
Content preparation• In the Metaio Creator
– Check that the models are properly displayed– Align the elements properly– Find out the names of the animations– Test with the live preview
• Convert FBX to MFBX
InsideAR Tokyo 2014 – How to create guided-through maintenance applications
AREL Package creation• XML containing
– AREL configuration• Tracking configuration• Objects
– Scenario configuration• User workflow• Parameters for the different steps
• HTML files for the GUI• Assets• Tracking configuration files• JavaScript logic / AREL filesInsideAR Tokyo 2014 – How to create guided-through maintenance applications
Test and deployment• Change the tracking configuration file to the real object tracking
• Test on the real object
• Make fine tuning adjustment
InsideAR Tokyo 2014 – How to create guided-through maintenance applications
Conclusion• Simple maintenance workflow
• AREL based – Platform independent
• Can be extended easily with XMLs
• Track any type of object (simple or complex)
• Works with wearable
InsideAR Tokyo 2014 – How to create guided-through maintenance applications
Q&A
InsideAR Tokyo 2014 – How to create guided-through maintenance applications
MetaioPhone (EMEA): +49-89-5480-198-0Phone (US): [email protected]
http://www.facebook.com/metaio
@twitt_ARhttp://twitter.com/#!/twitt_AR
http://augmentedblog.wordpress.com/
http://www.youtube.com/user/metaioAR