Virtual Reality - Lecture10- Applications of VR

8/10/2019 Virtual Reality - Lecture10- Applications of VR

1/10

1

1

Applications of VR

The pplications of VR

SGN-5406 Virtual Reality Autumn [email protected]

2

Applications of VR

Virtual Reality Technology

Entering the imageMore compelling, expressive and comprehensible than just viewingVarious levels, from Desktop VR to immersive high-end

Need for be tter competitiveness, time-to-market, product developmentand personalizationReduction in hardware cost

N,000,000 is now N,000 , or even in smartphonesWider range of applications3D CAD, CAM systems have become more commonplace

Improved VR technologyVR applications from prototypes to industrial phase3D rendering speed revolution!

Still many problemsUtilization and maintenance require highly skilled personnel. Developmentcosts may be highOften custom software, incomplete documentation, conversion problems

Intuitive: becoming a general-purpose UI?

3

Applications of VR

Signal processingOptics Acoustics

Process tech.

Robotics

Pedagogy

Sociology

Philosophy

Art

Etc. etc.

Computer science

Ergonomics

Measurement tech.Electronics

History

Psychology

Physiology

VR Needs Other Sciences4

Applications of VR

Signal processingOptics Acoustics

Process tech.

Robotics

Pedagogy

Sociology

Philosophy

Art

Etc. etc.

Computer science

Ergonomics

Measurement tech.Electronics

History

Psychology

Physiology

Other Sciences Need VR

5

Applications of VR

The Applications of VR

Applicable to enormous range of thingsDo not try to force VR to everythingImagination sets the limitsVR technology is getting more advanced and lower costHigh demand, enthusiasmUseful and/or entertainingSome applications (in Finnish):http://www.csc.fi/downloadPublication?uid=e252b504caf89b681bc95bc13e93e4ca

Excellent courses on 3D, VR etc at annual SIGGRAPHconferences, http://www.siggraph.org/s2009/sessions/courses/See EUs Intuition research network reports

http://www.intuition-eunetwork.org/

6

Applications of VR

Some Potential Advantages of VR

Cost savings, profitImproved marketing, presentationConveying information, artistic expression, etc.Exploring, familiarizing with data in a new wayEntertainment, games, escapismNon-invasive experimentationWhat if -scenariosSafety, saving livesImproved quality of lifeTraining hard and impossible tasks

www.jntuworld.com

www.jntuworld.com


2/10

2

7

Applications of VR

Some Fields of Applications

Simulators, training, educationPerhaps the most important currently

Product-, virtual planningProduction, manufacturing

real-time walk-through of complex systemsVisualization, data explorationPresentations, marketingMission planningEntertainment, games

ILM, PIXAR, etc.Tele-presence

Augmented realityweb3D

8

Applications of VR

Training, Education: Simulators

All kinds of simulatorsOne of the first VR application fieldsMany simulators also in Finland:

Emergency services college ArmyPoliceFinnair Flight controller trainingTruck driversCranes

Many more applications to come

9

Applications of VR

Why Simulator?

The costsMaterial, time, money

Perils, harmfulnessRare or impossible situationsFast modifications

E.g., full load to empty load

ControllabilityRepeatability, action record

10

Applications of VR

Military Applications

The first field of VR applicationsNASA and US army have developed a lot

Future Combat Systems: $170B project!Simulators, education

Augmented realityHUD, head-up display, onto a windscreen

HMD, head-mounted displayTele-presence, tele-surgery, etc.

Samsung robot watchmanHoneywell Micro Air Vehicle (see image)U.S. drones in Afghanistan, Pakistan

Battle planning, troop training, etc.Space technology

Repairing Hubble Space Telescope in 1999. Therole of VR used in astronaut training was useful

11

Applications of VR

Military Simulators

Finnish air forces, Pirkkala, Finland: HornetFlight, helicopter Ship, submarineTanks, vehiclesInfantry, commandoGame-based learning, simulators

http://adlcommunity.net/Networked battle training

Huge simulator centers100s of LAN -connected mixed simulatorsGoal as 100,000 objects

12

Applications of VR

Military: Parachute simulator

Students wear the VR glasses while suspended in a parachuteharness, and learn to control their movements through a seriesof computer-simulated scenariosThe computer receives signals from the student as they pull onthe risers that control the parachuteSaves lives, money, gas for the jets

www.jntuworld.com

www.jntuworld.com


3/10

3

13

Applications of VR

DARWARS Ambush! simulator

A set of PC simulators for military missionsmultiplayerhttp://www.darwars.net/

DARPA projectRestricted to U.S. MilitaryUser-authorable: soldiers can create new scenarios and trainingTactical language tutors

support.tacticallanguage.comVirtual Vietnam, Virtual Iraq (PTSD) (CGW 8/2008)

14

Applications of VR

Military Application: recruiting

Public military simulator (game)http://www.americasarmy.com/ A realistic training and battlesimulator

Not immersive VR, but a game ona PC monitor

Made by U.S. Army!Made for positive publicity,recruiting

15

Applications of VR

Civil Simulators

Flight simulatorsSince 1920sComputerized in 1960s

Finnair DC-9 (8 KB (!) main memory, 112 KB f ull)

MD-11 etc.

16

Applications of VR

Flight Simulators

Many categories of simulatorsThe best are identical to the real thing

Often big hydraulic systems are usedUnited Airlines Flight Training Center

Denver, CO, USAThe worlds biggest simulation center Try it yourself! Boeing 777: $1350 / h

Microsoft Flight Simulator < $50

17

Applications of VR

Other Simulators

Car simulatorsCar manufacturersDriving schoolsDrinking and driving in Haaga neurological institute

Professional vehiclesHarvestersSkyliftsCranesTrucksTrains, ships

Virtual control desks for nuclear power plantsimulation, IEEE CGA 8/2008Mock up = the physical copy of real cockpit

18

Applications of VR

Driving Simulators

Realistic rally simulator Bus, truck training s imulatorshttp://www.simrac.com/

Mobile truck training simulator http://www.ek-aktiva.fi/rekkasimulaattori-www/

www.jntuworld.com

www.jntuworld.com


4/10

4

19

Applications of VR

Military simus: Insta Group Oy20

Applications of VR

Walking Simulators

TreadportOmniDirectional Treadmill (ODT)

21

Applications of VR

Some Fields of Applications

Oil and Gas explorationExploratory holes 10M each, of which 2/3 drySeismic data is 3DVisualization may raise success rate to 80%

Espionage, militaryimageryvideo

3D terraingeospatial datasimulatorsmission planningbattlefield visualizationdefense imagingintelligence

22

Applications of VR

Scientific Visualization

3D objectsComplex phenomenaCan be more clear, expressiveand comprehensibleTouching the imageImmersionProcessesSimulationsFlows etc.

23

Applications of VR

Applications of Scientific Visualiz.

BiologyMolecular structures

AstronomyHayden Planetarium, NYC, www.amnh.org

Geological seismic interpretationPhysicsDrug designEconomyResearch

Education

24

Applications of VR

Research Tool

Using various flavours of VR to gain knowledge ofhumans

University of Tampere: human balanceHuman cognition, perceptionBehaviour, attitudes, etc.

Science, other phenomenaPhysics, flow dynamics

Astronomical macrostructuresNumerical tables to visualizationsEconomicsEtc.

www.jntuworld.com

www.jntuworld.com


5/10

5

25

Applications of VR

Medicine

Medicine Meets VR-conference (MMVR)

Virtual Human project Augmented reality

SurgeryExamining the fetus

Winning the fearsFear of high placesFear of flyingFear of public speakingMilitary trauma careE.g., http://www.vrphobia.com/

Drug rehabilitationVR pain control:

http://www.hitl.washington.edu/research/burn/

26

Applications of VR

Psych. treatment: pain reduction

27

Applications of VR

Medicine

VisualizationsTelemedicine, military medicine

daVinci Surgical SystemDevelopment of new drugsEndoscopic examination simulators

Virtual surgery and visualisationIEEE CG&A Nov/Dec 2006http://www.brainlab.com

28

Applications of VR

Surgeon simulator case

LiverPlanner: liver surgery planningCombines VR and high-level image analysis algorithmsEffectiveness and ease of useThree main stages:

Image analysis, which involves mostly automatic tissue segmentation and vesselextractionSegmentation refinement, where defects can be checked for, uncovered, andcorrectedTreatment planning, in which a surgical plan can be detailed based on data

inspection, spatial analysis, and resection simulationSmall defects can be corrected in LiverPlanner through the use of directdeformation tools, while template shape tools help users correct largerdefectsLiverPlanner employs a camera-equipped optical tracking system, a TabletPC, a custom-designed hybrid 2D-3D input device dubbed the Eye of Ra,and a stereoscopic large-screen projection systemLiver Surgery Planning Using Virtual RealityIEEE Computer Graphics and Applications (12/06)

Telepresence

In VR the user is immersed in a computer generated worldIn telepresence the user is immersed in a remote real worldReal and virtual data can be mixedRobots are frequently used as part of a tele-operated systemTele-operation in dangerous or impossible environments

Chernobyl tele-operation with VR and robotsU.S. drones, UAVs in Pakistan, teleoperated from Las Vegas

Tight spots, physically demanding jobs, boring jobsUnmanned vehicles are lighter, smaller Battlefield surgery, telemedicine

Communication, tele-conferencing

29

Applications of VR

30

Applications of VR

Nano-, Macropresence

Nanopresence, macropresenceThe scale is micro/macroscopic

Also timescale can be adjustedwww.romereborn.virginia.edu

Live connection possible

www.jntuworld.com

www.jntuworld.com


6/10

6

31

Applications of VR

Telepresence

Dangerous tasksImpossible placesMultiuser systems

32

Applications of VR

CAD & Design

Traditional miniature models, prototypesThe material costThe cost of making, the need for spaceNeed for miniature models reducedFull scale clay car model: $1MFast alteration of plans and designSmall items can even be printed as 3D physical objects

Big, complex devicesBoeing 777Submarines

Engineering Automotive styling etc.Most car manuf acturers employ

Animations, manualsCollaboration over the net

33

Applications of VR

Virtual Design

Entering the image, moving in itVirtual models

Fast prototypingFast designFlexibility

Alternations

Time-to-marketLife-likeExpressivityRemote viewing

Assembly validationErgonomic analysisPlant design, optimizationTraining, marketing

34

Applications of VR

Architecture

BuildingsTraffic networksVirtual prototypesUrban and rural environmentsThe search of potential problemsVisualization of plansMarketing, presentation

35

Applications of VR

Art

Illusion, experience A new tool and art formMuseums, installationsReconstructionsSalvador Dali would have been delighted!

36

Applications of VR

Virtual Orchestra

A training tool for the conductor

www.jntuworld.com

www.jntuworld.com


7/10

7

37

Applications of VR

Simulations

Ergonomy Assembly simul.

Factory modelsLogistics simulation, bottlenecks

Traffic simulationsFinding of bottlenecks in rushPrototyping layouts

Security

38

Applications of VR

Presentations

Cool visualizationsBoosts marketingSupports salesMore expressive, appealingClarifies complex systemsSmall money for big companies

Construction projectsMachines, devices

39

Applications of VR

Other Visualizations

Traffic, 3D city maps Air traffic controlVirtual planetariumsLas Vegas casino, restaurant decorationsHistorical reconstructions

3D Shoe sizer Legal

Accidents, crimesCrime scene 3D scanning

40

Applications of VR

Virtual Stage

Used in TV in daily basisWeather reports

Combining several image sourcesChroma-keyTracking of camerasVirtual worlds + realityMixed reality

41

Applications of VR

3D Movies

3D movies with colored glasses were popular in the 1950s A new coming of 3D movies recently3D versions of movies give better profit than standard movies,but require investment

Thousands of movie theaters are being equippedStereoscopic filming, or 2D -> 3D transformation software

Avatar (Dec09): $237 million for production3D digital cinema is here, thousands of 3D theaters in USA

RealD: market leader (3300), XPAND (1100), Dolby (1000),IMAX (300), MasterImage (300), Sony 4K (300)Panasonic 3D HD camera, E&S ESLP 8K laser 3D projector

A host of consumer-oriented 3D products are likely in the next

few years. Web 3.0?3D: the next big wave in consumer electronics?Hard to pirate a 3D movie with a smuggled in-theater camera

42

Applications of VR

3D Movies

Hollywood plans to release60 3D movies in 18 months 3D theater screens: ~6500

NA 4000, Eur 1200, As 1300

www.jntuworld.com

www.jntuworld.com


8/10

8

43

Applications of VR

Movies, TV

Not really VR, but 3D stereoscopic

TV is broadcast, but could become more interactiveBorder between TV, PC and web may become unclear

3D content is necessary to enable the widespread deploymentand commercial success of 3D displaysMany standard movies Its hard & expensive to make a movie,never mind 3D

All the normal tasks plus many 3D issues intertwinedOld movies can be converted to 3D

Semi-automatic, can sometimes be fa ir quality (or bad)E.g., Philips, DDD, In-Three, Conversion Works, Mercury 3D,JVC, make3D, imcube Media,

Quality conversion is a massive p ost-production taskFor conversion of a 90 -minute film, the post-production schedulewill cover about 10 months

Some new movies are already filmed as 3D just in case

Making 3D Movies

A major transition in HollywoodThe mistakes that can happen in 3D movie making

Left/right eye reversal, unintentional monoscopic frames, out of sequencestereo frames, action within a l imited volume, focus depth changes, etc.

The screen size has an effectRecent examples: Beowulf, Chicken Little, Star Wars, U2 3D,Nightmare Before Christmas, Polar Express, Avatar The 3D industry needs to train a lot more people in the art andscience of 3D movie makingBetter 3D workflow tools, particularly in 3D editing, are needed(being developed in-house in major studios)DIY: StereoMovie Maker, http://stereo.jpn.org/eng/stvmkr http://nowin3d.com/, http://www.digdia.com/

A list of 3D movies, 3D ready HDTVs etc.: www. 3dmovielist.com/

44

Applications of VR

45

Applications of VR

3DTV is coming

Several ideas, prototypes, visionsBlu-ray Disc Association: 3D spec in Dec09

Already here: Colorcode3d glasses in Super bowl 2009Is it technically, commercially feasible (in recession)?

A need, a market for real people (not engineers)?

Commercial issues will dictate deploymentHow about usability (for couch potatoes)?3DTV emerging (glasses or autostereoscopic)3D movies may help, but many obstaclesFew standards, infrastructure not readyEUs 3DTV project, http://www.3dtv -research.org/3D Consortium, http://www.3dc.gr.jp/english/3D @ Home Consortium, www.3dathome.org

46

Applications of VR

3DTV

ddd.com: 3D Conversion in a Set Top BoxReal-time, special LCD TV, polarization glasses

TDVision, http://www.tdvision.com/Develops full HD stereoscopic 3D real-time encoder

Sensio Technologies Inc., www.sensio.tv2D->3D real-time decoder ASIC chip

to be integrated into Hyundai's LCD-TVs and SpectronIQ "Full 3D" TVInThree: semiautomatic 2D->3D conversion, in-three.com/YouTube is working on a 3D stereoscopic video player Sky UK launches Europe's 1st 3DTV in 2010 (&Channel 4 UK?)Sonic Solutions & Nvidia add 3D content to Roxio / CinemaNowInternet movie service for 3D ready TVs and PC displaysTexas Instruments: 3D DLP technology for existing HDTVsSony becoming an active player (3D Bravia TV, Playstation etc)http://www.informationdisplay.org/ July 2009: 3DTV specialGeneral info: http://www.stereoscopy.com/

47

Applications of VR

Entertainment, Games

Game consoles at home!iZ3D 22 3D gaming monitor for $999Resident Evil 5 is designed to exploit S3DWalls into displays

The office of the fu ture, MIT KidsRoomHome VR theatres?

New kinds of interaction, tracking?What is the most violent place of the world?

Our living rooms in front of TV sets!VR has a lot to give for violence etc.

Youll know when S3D is a success when you dont talk aboutit. When was the last time you went to a movie and came outsaying, WOW did you see the color in that movie?

48

Applications of VR

Entertainment, Games

LBE, location-based entertainmentNamco Bandai GamesVR entertainment centers

DisneyQuest VR park, OrlandoFuturoscope (France)Universal Studios, Disneyland

Many kinds of VR experiencesVirtual actors

The virtual actor is created in real time based on tracking ofa real face

Motion capture can be used to create more realistic games

www.jntuworld.com

www.jntuworld.com


9/10

9

Virtual golf cafs in Korea

12,000 simulators, 300,000 players Always nice weather indoorsMat tilts downward to replicate a downhill slopeIn Japan and Korea, golf is very expensive, but VR golf is cheapPlenty of international golf courses to choose fromCameras and sensors capture the club speed, the ball's launchangle, and its spin. The computer creates its trajectory, audioand visual effectshttp://www.businessweek.com/globalbiz/content/oct2008/gb20081027_293085.htm

49

Applications of VR

50

Applications of VR

LBE: DisneyQuest

CyberSpace MountainDesign your ultimate roller coasterride it on a 360 pitch / roll simulator

Aladdin's Magic Carpet Ride

51

Applications of VR

DisneyQuest

Virtual Jungle Cruise Invasion

52

Applications of VR

DisneyQuest

53

Applications of VR

Augmented Reality (AR)

Augmented reality alters how we see the real world(in Finnish: listty todellisuus)

Numerous flavors and applications

54

Applications of VR

AR Visions

www.jntuworld.com

www.jntuworld.com


10/10

55

Applications of VR

Mobile AR / VR

An emerging field: devices get smaller, display gets bigger,processing faster 3D user interfaces?3G phones with multi-sensorsiPhone and other smartphonesLocation-based visualization

Google Maps 3D for SymbianGIS-based applicationsNumerous consumer personal viewers emerging

E.g., Icuiti iWear, MicroOptical myvu, i-O Displays iTheater,Oriscape Cyberman GVD310A

The disappearing computer, ambient intelligence"The-computer-as-we-know-it" will have no role in our futureeveryday liveshttp://www.arconsortium.org/Mobilizy.com: Augmented Reality Mark-up Language (ARML)

56

Applications of VR

VR Desktop

Take head-mounted display Add tracking =>Virtual desktop, personal data space (mobile AR, iPhone)Extends displayImmersionInteraction

57

Applications of VR

VR Desktop

MobiVRMicrodisplay + finger pointingEnables easy input on a hand-held deviceEnables also VR apps on a mobile phonehttp://www.cs.tut.fi/~ira/MobiVR.html

Tactile feedback ?

58

Applications of VR

Web3D Applications

The same application possibilities as with most of other VR A growing branch of VR, not yet immersive

Typically displayed on a monitor A new UI, aid for communicationEveryman VRTurbulent technologies, browsers

Mobile phones becoming 3D! Ads, product presentations3D comics, gamesCommunity-based services

Sony PS3 Home, Project Wonderland, Active worlds, muse, worlds.com,moove, Lively (Google, ended)

Compresses well!

59

Applications of VR

Some Haptic Applications

Medicine: surgical simulators for medical training; manipulatingmicro and macro robots for minimally invasive surgery; remotediagnosis for telemedicine; aids for the disabled such as hapticinterfaces for the blindEntertainment: video games and simulators that enable the userto feel and manipulate virtual solids, fluids, tools, and avatarsEducation: giving students the feel of phenomena at nano,macro, or astronomical scales; what if -scenarios for non-terrestrial physics; experiencing complex data setsIndustry: integration of haptics into CAD systems such that adesigner can freely manipulate the mechanical components of anassembly in an immersive environmentGraphic Arts: virtual art exhibits, concerts, and museums in whichthe user can login remotely to play the musical instruments, andto touch and feel the haptic attributes of the displays; individual orco-operative virtual sculpturing across the internet

60

Applications of VR

Biggest Gaps for VR Technology

The investment (purchase, integrate, install, maintain)Large corporations, space, militaryPrototype and pilot nature expert personnel requiredBut smartphones, game consoles may make consumer products

CAD VR integrationSeparate systems: incompatible. No direct support for VROften only 2D is used in design. 3D too advanced for SMEs

Content: tools are more for engineers, not for designersLack of physical contact with 3D virtual objects

Only low-level, limited or specialized haptic devicesLimited interaction tools, modalities and user interfaces

Interaction paradigm for shape and part designMulti-user visualization systemsPrecise tracking, expensive trackersCollision detection handling of very large modelsSimulation of complex physical phenomena like thermal diff usion orelectromagnetic interferencesCourse recap in 60 seconds: Dont be a WIMP

www.jntuworld.com
http://www.youtube.com/watch?v=CAKsjfbDwVQhttp://www.youtube.com/watch?v=CAKsjfbDwVQhttp://www.youtube.com/watch?v=CAKsjfbDwVQ

Virtual Reality - Lecture10- Applications of VR

Documents

Transcript of Virtual Reality - Lecture10- Applications of VR