Virtual Reality

Virtual RealityBrandon LambertOverviewWhat is Virtual Reality (VR)?Classifications of VRBrief HistoryImmersive VR EnvironmentsSoftware and ChallengesApplications

DefinitionA computer generated simulation that enables people to interact with visual and sensory three-dimensional objects or environments through the use of computer modelingTypes of Virtual RealityDesktop VRUsed by most people every dayImmersive VRUsed in industry mainlyExpensiveDesktop VREveryday computers, laptops, phonesGaming consolesNon-immersive environmentsCommon Associated Inputs:Computer mice, keyboards, and game controllers

Immersive VRClassical DepictionComplex system of software and hardwareRealistic ExperienceUser immersion in environmentEasily amount to hundreds of thousands of dollars

HistoryIvan SutherlandBS: EE, PH.D EECSUltimate Display (1965)First concepts of VR systemPioneer in Computer Graphics, 3D modeling, and VR

TronFirst movie to heavily rely on computer generated graphics (CGI)Opened doors for the use of CGI in entertainment industry

Data GloveDr. G. Grimes, of Bell LabsPatented 1983Used for measuring of hand positions using sensors on the wrist and joints.Initially thought glove would replace the keyboardExpensiveVirtual Reality Modeling Language(VRML)Released by Silicon Graphics in 1995Designed to be standard modeling language for interactive simulations on the webVRML 2.0 is used today on IE, Firefox, and Chrome for viewing world (.wrl) files

Immersive VR EnvironmentsCave Automatic Virtual Environments (CAVE)ProjectorsHead Mounted Display Environments (HMD)HMDsCAVEUses projectors to display the virtual objects and environment on the walls, ceiling, and floor of the VR volumeUsers wear 3D glassesTo increase resolution, multiple cameras can be used on each wall of the VR volume CAVE SystemSoftwareInput DevicesMotion CaptureDisplayProjectorsData AcquisitionModeling & SimulationProjectorsWalls & ScreensGlassesControllersMotion TrackingCAN DevicesOtherHMD VR EnvironmentsUses HMD devices to display the virtual environment and objects to the userField of view is limited by screens on HMDPeripherals

HMD SystemSoftwareInput DevicesMotion CaptureDisplayHMDData AcquisitionModeling & SimulationProjectors or Monitors ScreenHMD(s)ControllersMotion TrackingCAN DevicesOtherMotion Capture SystemsOpticalCamerasMagneticSensorsElectro mechanicalSensor suits

Optical Motion CaptureUses cameras to track markers in a tracking volumeTracking data is streamed into VR systemVicon Bonita

Optical System

Magnetic Motion CaptureUses magnetic sensors to gather dataMetal can interfere with the sensor readings

Electro mechanical Motion CaptureUses a suit of sensors to track the wearers motionHigh portabilitySome designs are motion restricting

SoftwareVicon Bonita OpticalOptical Motion capture systemPower over Ethernet to facilitate data streamingEasy setup and teardownVicon DataStream SDK 1.2 and Virtual Vicon System 1.2TrackingThe Vicon optical system tracks objects in the environment with the use of reflective markersThe cameras use infrared light, which reflects off the markers.User range of motion is limited by tracking volumeOther reflective objects may be picked up by the cameras, but this is handled by using masks during calibrationVicon Tracker

Latency Graph

Using Vicon TrackerAddition of new tracked objects is easyPlace markers on new objectSave the marker configuration in Vicon TrackerSDK can be used to access the data stream for custom application developmentSimulation SoftwareVega PrimeVortexJack and Process Simulate (Jack)Vega PrimeProduced by PresagisUsed to produce real-time 3D simulation applicationsPlatform IndependentLynx Interface is provided for making real-time changes to the simulationAvailable Application Programming Interface (API)

VortexPhysics Package for Vega Prime SimulationsAllows for physically accurate machine simulationsPackage is integrated with Lynx InterfaceLynx Interface

JackProduced by SiemensUsed to visually analyze workspace environments to improve:ErgonomicsSafetyEfficiencyIntegrated Python and TCL languagesCustom modulesBuilt-in Python consoleJack Interface320D Current Production

Software ChallengesVR requires a wide range of skills from software developersCoordinate SystemsMotion capture versus SimulationModeling?InputAdding new devicesCAN DevicesMotion basesOther Software (MATLAB, Custom Applications)Custom Program SolutionsLinkage Configurator ExampleDefines coordinates for pivot points on a vehicle or machineMaps model files to linkage in Jack

Immersive VR ApplicationsIndustry ApplicationsManufacturing and Product DevelopmentEducation and TrainingHealthcare IndustryPainTherapyEntertainmentGamingMoviesManufacturing Product DesignCompanies such as John Deere, BMW, and Ford use VR in their product designReduced costFewer physical prototypesFaster concept analyzingMore evaluationsFewer defectsUsed to check ISO visibility standardsEducation and TrainingSimulations for operator trainingOperator can make mistakes in VRUse real controlsHelps demonstrate proper methodsAssembly techniqueRepairsMaintenanceAllows anyone to familiarize themselves with machines in the fieldHealthcareVR has been found to reduce the pain patients endure during treatmentsUsed magnetic resonance to watch brain activities during treatment with and without VRSnowWorld - commonly used for burn victimsSnowWorld

VR TherapyUsed to treat patients with fear of heights, spiders.SpiderWorldAlso can be used to treat addictions, anxiety, post traumatic stress disorders (PTSD), and other conditionsSpiderWorld

VR for PTSDVR Therapy has been reported to reduce PTSD in soldiers returning from Iraq and Afghanistan significantly for 62% of those undergoing treatment9/112012, NBC - article about a returning soldier using VR Therapy EntertainmentMovie productionAnimated filmsCGIGamingAnimationsPlayStation MoveXbox KinectWii

ConclusionVR is used in applications across a broad spectrum of industries and is becoming increasingly better with new technologiesSoftware developers will need a wide range of skills to meet the ever evolving demands of VR environments

ReferencesLambert, B. (2012). Virtual reality.(2012). Retrieved from http://i.i.com.com/cnwk.1d/i/tim//2010/07/12/slimhor.jpg(2012). Retrieved from http://upload.wikimedia.org/wikipedia/commons/thumb/6/6d/CAVE_Crayoland.jpg/220px-CAVE_Crayoland.jpg(2012).Ivan edward sutherland. (2012). [Print Photo]. Retrieved from http://en.wikipedia.org/wiki/Ivan_Sutherland(2012).Tron. (2012). [Print Photo]. Retrieved from http://images3.wikia.nocookie.net/__cb20090111000835/tron/images/2/28/Tron_poster1.jpg(2012).Vrweb vrml viewer. (2012). [Print Photo]. Retrieved from http://www.iicm.tugraz.at/Ressourcen/Papers/vrml95/vrml95-inlines/fig1.jpg(2011). Retrieved from http://regmedia.co.uk/2011/11/15/sony_hmz-t1_personal_3d_head_mounted_display_5.jpg

References Continued(2012). Retrieved from http://www.roadtovr.com/files/2012/08/HMD_T2_basic_cw_1800x1125.jpg(2012).Bonita optical. (2012). [Print Photo]. Retrieved from http://vicon.com/products/bonita/optical.html(2012). Retrieved from http://www.polhemus.com/polhemus_editor/assets/handmocapphoto.gif(2012). Retrieved from http://www.mediasysdubai.com/mc3.jpg(2012).Igs-190. (2012). [Print Photo]. Retrieved from http://www.razor3d.co.kr/dlp/Animazoo IGS.htm(2012).Vicon tracker. (2012). [Print Photo]. Retrieved from http://vicon.com/products/images/tracker-01-lrg.jpg(2012). Retrieved from http://grouplab.cpsc.ucalgary.ca/cookbook/uploads/Toolkits/ViconCameraSet.jpg(2012). Retrieved from http://www.nvidia.com/docs/IO/38272/snow_world.jpg(2012). Retrieved from http://www.firsthand.com/creations/images/SpiderHand02_800.png