Standard VENTURI presentation (10min)

Click here to load reader

  • date post

  • Category


  • view

  • download


Embed Size (px)


VENTURI is a collaborative European project targeting the shortcomings of current Augmented Reality design; bringing together the forces of mobile platform manufacturers, technology providers, content creators, and researchers in the field. VENTURI aims to place engaging, innovative and useful mixed reality experiences into the hands of ordinary people, by co-evolving next generation AR platforms and algorithms. VENTURI plans to create a seamless and optimal user experience through a thorough analysis and evolution of the AR technology chain, spanning device hardware capabilities to user satisfaction.

Transcript of Standard VENTURI presentation (10min)

  • 1. Oct 11 Oct 14creating a pervasive Augmented Reality paradigm, where information is presented in auser rather than a device centric wayFP7-ICT-2011-1.5 Networked Media and Search SystemsEnd-to-end Immersive and Interactive Media Technologies

2. PartnersFBK - ItalyFraunhofer HHI - GermanyST-Microelectronics ItalyMetaio - GermanyST-Microelectronics andST-Ericsson Francee-Diam Sistemas - SpainSony Mobile - SwedenResearch38% 37% IstitutionsINRIA - FranceSME25%Industry 3. Market End Users Products Pre-product Mobile Prototypes Lab PrototypesCoverage Applied Research Pure Research 4. ChallengesO AR focused platform developmentO Visual registration chain user-device-worldO World modelling using consumer-level mobile devicesO Mobile contextual understandingO Context sensitive content deliveryO User interactions with AR 5. AR Platform EvolutionO Multi-core CPU & GPUO Hi-res single or dual cameras,plus large set of sensorsO Smart power managementpoliciesO Address AR requirements in development of platformSW framework and services (e.g. sensor fusion, videopipe optimized for AR use)O Optimize the whole processing chain, taking serverside resources (i.e. The cloud) when possible 6. Registration chainO Match visual features with nearbyphotos to identify tagged landmarksO Match visual features to syntheticmodels of the WorldO Locate text/logos/signs in theenvironment then check against localgeo-objects/eventsO Use on-board sensors to guide image /audio processing algorithmsO Estimate user (body, face, hands)position with respect to the device 7. World modellingO Photogrammetric 3Dreconstruction using mono/stereo cameras (includinghistorical imagery)O Structure from motion formodelling dynamic objects inthe sceneO Planar surface identificationfor ad-hoc interactive surfaces 8. Mobile context understandingO User motion/activity analysis using on-board sensorsO Fusion of cues from:O modelling and registrationO geo-objectsO geo-social activity 9. Context sensitive AR deliveryO Inject AR data in a natural manner according to:O The environmentO OcclusionsO Lighting and shadowsO User activityO Exploit user and environment context to selectbest delivery modality (text, graphics, audio,haptic, etc.), i.e. scalable/simplify-able audio-visual content 10. User InteractionsO Explore evolving means of ARdelivery and interaction O In-air interfaces for sensing gestures (motion of device, hands, face, etc..) O 3D audio O Micro-projection for multi-user, social-AR O AR visors/glasses 11. PrototypesO A consolidated prototype at the end of each year to beevaluated through Use CasesO 3 Use Cases O Tourism O Gaming O Personal assistant 12. creating a pervasive Augmented Reality paradigm, where information is presented in auser rather than a device centric way