Augmented and Mixed Reality – Virtual and Mirror Worlds Reality Jan 2009.pdf · Augmented and...

22
Augmented and Mixed Reality Virtual and Mirror Worlds Charles Woodward Charles Woodward January 20, 2009

Transcript of Augmented and Mixed Reality – Virtual and Mirror Worlds Reality Jan 2009.pdf · Augmented and...

Page 1: Augmented and Mixed Reality – Virtual and Mirror Worlds Reality Jan 2009.pdf · Augmented and Mixed Reality – Virtual and Mirror Worlds ... Polarized data glasses ... Mixed Reality

Augmented and Mixed Reality –Virtual and Mirror Worlds

Charles WoodwardCharles Woodward

January 20, 2009

Page 2: Augmented and Mixed Reality – Virtual and Mirror Worlds Reality Jan 2009.pdf · Augmented and Mixed Reality – Virtual and Mirror Worlds ... Polarized data glasses ... Mixed Reality

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

Introduction (1)Introduction (1)Virtual Reality

CAVE SystemsE.g. ”Lumeportti” at VTTBack projected screensBack projected screensPolarized data glassesMagnetic tracker, other

PC applications3D CADComputer

GamesOn-Line

Virtual WorldsWorlds

Page 3: Augmented and Mixed Reality – Virtual and Mirror Worlds Reality Jan 2009.pdf · Augmented and Mixed Reality – Virtual and Mirror Worlds ... Polarized data glasses ... Mixed Reality

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

Introduction (2)

Augmented Reality (AR)Mixes virtual objects with view of real world

Introduction (2)Related technologies

Augmented VirtualityMixes virtual objects with view of real worldC.f. Virtual Reality (completely virtual worlds)Properties: real-time, interactive, 3DTracking + rendering + display

Augmented Virtuality Mediated RealityDiminished Reality

-> Mixed Reality (MR)Tracking + rendering + display > Mixed Reality (MR)

Reality Augmented Reality Augmented Virtuality Virtual Reality

Mixed Reality

Page 4: Augmented and Mixed Reality – Virtual and Mirror Worlds Reality Jan 2009.pdf · Augmented and Mixed Reality – Virtual and Mirror Worlds ... Polarized data glasses ... Mixed Reality

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

Display DevicesDisplay Devices

Page 5: Augmented and Mixed Reality – Virtual and Mirror Worlds Reality Jan 2009.pdf · Augmented and Mixed Reality – Virtual and Mirror Worlds ... Polarized data glasses ... Mixed Reality

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

Example Application

ARCatalogueViewing with data glasses / web camera

Example Application

Viewing with data glasses / web cameraStereo 3D products appear from catalogueBased on marker detection from camera view

Applications, e.g.B2B marketing by Lappset Group 3D viewing of isometric views by Pöyry

Also, camera phones, p

Page 6: Augmented and Mixed Reality – Virtual and Mirror Worlds Reality Jan 2009.pdf · Augmented and Mixed Reality – Virtual and Mirror Worlds ... Polarized data glasses ... Mixed Reality

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

Entertainment, GamesEntertainment, Games

Page 7: Augmented and Mixed Reality – Virtual and Mirror Worlds Reality Jan 2009.pdf · Augmented and Mixed Reality – Virtual and Mirror Worlds ... Polarized data glasses ... Mixed Reality

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

Interior DesignInterior Design

Project “AR Sisustus”Project AR-SisustusTekes TILADuration 2008-2010P tPartners: VividWorks, Floobs, UPCode, DeskArtes, Sensetrix, Kesko,

Page 8: Augmented and Mixed Reality – Virtual and Mirror Worlds Reality Jan 2009.pdf · Augmented and Mixed Reality – Virtual and Mirror Worlds ... Polarized data glasses ... Mixed Reality

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

ArchitectureArchitecture

Page 9: Augmented and Mixed Reality – Virtual and Mirror Worlds Reality Jan 2009.pdf · Augmented and Mixed Reality – Virtual and Mirror Worlds ... Polarized data glasses ... Mixed Reality

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

Mobile / OutdoorsMobile / Outdoors

“Google Earth on Earth”

Page 10: Augmented and Mixed Reality – Virtual and Mirror Worlds Reality Jan 2009.pdf · Augmented and Mixed Reality – Virtual and Mirror Worlds ... Polarized data glasses ... Mixed Reality

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

Production SitesProduction Sites

Page 11: Augmented and Mixed Reality – Virtual and Mirror Worlds Reality Jan 2009.pdf · Augmented and Mixed Reality – Virtual and Mirror Worlds ... Polarized data glasses ... Mixed Reality

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

Augmented AssemblyAugmented Assembly

Page 12: Augmented and Mixed Reality – Virtual and Mirror Worlds Reality Jan 2009.pdf · Augmented and Mixed Reality – Virtual and Mirror Worlds ... Polarized data glasses ... Mixed Reality

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

Mobile Augmented RealityMobile Augmented Reality

one of the technologies toone of the technologies to

“most likely to alter industries fields of researchmost likely to alter industries, fields of research, and the way we live”.

- MIT’s annual review “10 Emerging Technologies 2007”

- Also, Gartner’s “Top Ten Disruptive Technologies 2008-2012”

Page 13: Augmented and Mixed Reality – Virtual and Mirror Worlds Reality Jan 2009.pdf · Augmented and Mixed Reality – Virtual and Mirror Worlds ... Polarized data glasses ... Mixed Reality

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

Technology Enablers and DriversTechnology Enablers and DriversSmart mobile terminal

Technology convergence to smart phonesTechnology convergence to smart phonesIncl. camera, 3D graphics, WLAN, WiMAX, 4GUp to accelerometer, compass, RFID, 3D displaysE g Nokia N95 -> 6210 (MARA) iPhoneE.g. Nokia N95 > 6210 (MARA), iPhone

Minituriarised data glasses E L th h lE.g. Lumus see through glassesMyVu video glasses for iPodLaster EnhancedView AR l ?!AR contact lenses?!

Page 14: Augmented and Mixed Reality – Virtual and Mirror Worlds Reality Jan 2009.pdf · Augmented and Mixed Reality – Virtual and Mirror Worlds ... Polarized data glasses ... Mixed Reality

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

Technology Enablers and DriversTechnology Enablers and DriversAR software technology

Markerless trackingMarkerless trackingContent creation tools

Game industry e gGame industry, e.g.Sony Eye Toy (gesture based AR)Eye of Judgment (marker-based AR)G t T k ( d i h )GestureTek (camera driven phone games)

Commercial activitiesIntersense (USA)Metaio (Germany)Total Immersion (France)ARToolWare (New Zealand)

Page 15: Augmented and Mixed Reality – Virtual and Mirror Worlds Reality Jan 2009.pdf · Augmented and Mixed Reality – Virtual and Mirror Worlds ... Polarized data glasses ... Mixed Reality

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

Virtual and Mirror WorldsVirtual and Mirror WorldsSecond Life, Habbo Hotel etc.

Massively multi-user online worldsMassively multi user online worlds

Google Earth User created content / geo taggingUser-created content / geo-tagging Incl. 3D buildings, photos, panorama, etc.

fMicrosoftPhotoSynth3D reconstruction of the the world

NokiaImage SpaceImage SpacePoint and Find

Enablers for Mixed RealityEnablers for Mixed Reality Shared content, navigation, tracking

Page 16: Augmented and Mixed Reality – Virtual and Mirror Worlds Reality Jan 2009.pdf · Augmented and Mixed Reality – Virtual and Mirror Worlds ... Polarized data glasses ... Mixed Reality

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

Mixed RealityMixed Reality Not just visualization

Interface between digital and real worlds

Applications, e.g.Google Earth <-> On EarthSecond Life <-> Real LifeInterface between digital and real worlds

User-created Internet content, feedbackLife logging, physical object loggingInteroperability devices and applications

Second Life Real Life4D BIM <-> Construction siteDigital factory <-> Real factory

Interoperability, devices and applications

Augmented with 3D models, images, signs, tags, instructions, messages, ...Digital World

Virtuality

Augmented Reality

RealityA t d

Augmented with photos, videos,

Augmented Virtuality Mixed Reality

R l W ldug e ted t p otos, deos,textures, messages, products, people, ...

Real World

Page 17: Augmented and Mixed Reality – Virtual and Mirror Worlds Reality Jan 2009.pdf · Augmented and Mixed Reality – Virtual and Mirror Worlds ... Polarized data glasses ... Mixed Reality

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

Mixed Reality Projects at VTTMixed Reality Projects at VTT

Page 18: Augmented and Mixed Reality – Virtual and Mirror Worlds Reality Jan 2009.pdf · Augmented and Mixed Reality – Virtual and Mirror Worlds ... Polarized data glasses ... Mixed Reality

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

Project ”Mobile Mixed Reality”Project Mobile Mixed RealityNational ICT-SHOK project

Duration 2008-2010, budget 4,3 M€

Partners Nokia Sesca VTT HUT TUTPartners Nokia, Sesca, VTT, HUT, TUT

Piloting in Ubiquitous Helsinki, Living Labs context

Mixed Reality services, user created content at public spaces

MissionMission

“Enable social ubiquitous media by linking global resources and local relevance – often supplied directly by empowered users – with visual discovery and interaction in the physical world and on-line, using mobile phones as gateway between physical and digital worlds”g y y g

Page 19: Augmented and Mixed Reality – Virtual and Mirror Worlds Reality Jan 2009.pdf · Augmented and Mixed Reality – Virtual and Mirror Worlds ... Polarized data glasses ... Mixed Reality

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

Project ”AR4BC”Project AR4BCAugmented Reality for Building and Construction

Industrial partners incl. Pöyry, Tekla, Skanska, ...Industrial partners incl. Pöyry, Tekla, Skanska, ... Tekes VAMOS programme, 2008 – 2010

Augmented on site visualizationAugmented on-site visualizationComparing project plans (4D BIM) with actual situation on site

Augmented site journaling Mobile feedback to BIM systemAttach images, tags etc. to components in BIM modelAugmented Virtuality

Page 20: Augmented and Mixed Reality – Virtual and Mirror Worlds Reality Jan 2009.pdf · Augmented and Mixed Reality – Virtual and Mirror Worlds ... Polarized data glasses ... Mixed Reality

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

Project ”MR-Conference”Project MR ConferenceMixed Reality Video Conference

Teleconference btw real people and SL avatarsTeleconference btw real people and SL avatarsTekes TILA programme, partners VTT, TKK, Nokia, IBMOne year, starting October 2008

Page 21: Augmented and Mixed Reality – Virtual and Mirror Worlds Reality Jan 2009.pdf · Augmented and Mixed Reality – Virtual and Mirror Worlds ... Polarized data glasses ... Mixed Reality

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

Real factoryKnowMan: Smart Factory Scheme Real factorymachinesproductspeople

Digital information represented at factory floor,

KnowMan: Smart Factory Scheme

people

Interoperation between

p y ,for operation, training etc., using augmented reality

Interoperation between digital and physical factory

Intuitive visualization by Augmented Reality

Feedback by natural HCI / Augmented Virtuality

Digital factory3D models, layoutssimulations, processes

Augmented Virtuality

Feedback from real to plans, forecasts digital factory, incl. silent

information, methods e.g. motion capture, photos, videos (augmented virtuality)

Page 22: Augmented and Mixed Reality – Virtual and Mirror Worlds Reality Jan 2009.pdf · Augmented and Mixed Reality – Virtual and Mirror Worlds ... Polarized data glasses ... Mixed Reality

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

Thank You!

Prof. Charles WoodwardVTT T h i l R h C t f Fi l dVTT Technical Research Centre of Finland

Vuorimiehentie 3, Espoo, FinlandTel: +358 20 722 5629Tel: +358 20 722 5629

[email protected]://www.vtt.fi/multimedia