Virtual Reality Games on Oculus Rift - Markus...

39
Virtual Reality Games on Oculus Rift

Transcript of Virtual Reality Games on Oculus Rift - Markus...

Page 1: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Virtual Reality – Games on Oculus Rift

Page 2: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 2Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Innovation Project

IS VIRTUAL REALITY THE FUTURE OF THE

VIDEO GAMES INDUSTRY?

Page 3: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 3Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Innovation Project - Targets

Get to know the Oculus Rift Development Kit

How can it be used for gaming?

Where is the state of technique?

Is Virtual Reality solved with the Oculus Rift?

What can you do with it?

Use a game prototype for experimentations.

Page 4: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 4Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Innovation Project – Game Prototype

Racing Game Prototype

Unity Racing Game Tutorial

Page 5: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 5Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Innovation Project – Game Prototype

Input

Xbox 360 Controller

Xbox 360 Wireless Racing Wheel

Performance Optimization

60 FPS

Page 6: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 6Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Innovation Project – Game Prototype

Car McLaren MP4-12C from archive3d.net

2 versions

Display prototype Oculus Rift prototype

Page 7: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 7Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Innovation Project – User Test

40 participants

Played both versions

20 started with the Oculus Rift version first

Filled out a survey at the end

Questions

Is the gaming experience with VR more enjoyable?

Is VR more immersive?

What are the weaknesses of the Oculus Rift

Development Kit?

Page 8: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 8Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Innovation Project – User Test

Page 9: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 9Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Innovation Project – User Test

Page 10: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 10Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Innovation Project – User Test

Page 11: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 11Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Innovation Project - Results

Number of participants, who played

maximum play time

10

3

7

8

3

9

0 2 4 6 8 10 12

MAXIMUM TIME BOTH VERSIONS

DISPLAY PROTOTYPE

OCULUS PROTOTYPE

MAXIMUM TIME BOTH VERSIONS

DISPLAY PROTOTYPE

OCULUS PROTOTYPE

FIR

ST P

LAYE

D D

ISP

LAY

PR

OTO

TYP

EFI

RST

PLA

YED

OC

ULU

S R

IFT

PR

OTO

TYP

E

Page 12: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 12Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Innovation Project - Results

Fastest lap time Oculus Rift Prototype (Display Prototype First): 1:21.912

Display Prototype (Display Prototype First): 1:25.083

Number of participants, who set their personal fastest lap time

8

12

10

10

0 2 4 6 8 10 12 14

DISPLAY PROTOTYPE

OCULUS PROTOTYPE

DISPLAY PROTOTYPE

OCULUS PROTOTYPE

PLA

YED

FIR

ST D

ISP

LAY

PR

OTO

TYP

EP

LAYE

D F

IRST

OC

ULU

S R

IFT

PR

OTO

TYP

E

Page 13: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 13Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Innovation Project - Results

Slowest lap time

Oculus Rift Prototype (Display Prototype First): 4:58.494

Display Prototype (Display Prototype First): 5:03.397

Number of participants, who set their personal slowest lap time

12

8

6

14

0 2 4 6 8 10 12 14

DISPLAY PROTOTYPE

OCULUS PROTOTYPE

DISPLAY PROTOTYPE

OCULUS PROTOTYPE

PLA

YED

FIR

ST D

ISP

LAY

PR

OTO

TYP

EP

LAYE

D F

IRST

OC

ULU

S R

IFT

PR

OTO

TYP

E

Page 14: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 14Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Innovation Project - Results

Percentage of participants, who used a head-

mounted display for the first time

22.5%

77.5%

NO

YES

Page 15: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 15Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Innovation Project - Results

Percentage of participants, who suffered

from motion sickness

25%

75%

NO

YES

Page 16: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 16Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Innovation Project - Results

Percentage of participants, who used a head-mounted

display for the first time and suffered from motion sickness

2.5%

20.0%

22.5%

55.0%

NOT MOTION SICK

MOTION SICK

NOT MOTION SICK

MOTION SICK

NO

T FI

RST

HM

D

USE

FIR

ST H

MD

USE

Page 17: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 17Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Innovation Project - Results

Percentage of participants, who rated which version as the

better playing experience

5%

25%

70%

BOTH VERSIONS

DISPLAY PROTOTYPE

OCULUS RIFT PROTOTYPE

Page 18: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 18Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Innovation Project - Results

Percentage of participants, who would prefer to buy a

commercial racing game version of which type

15%

25%

60%

NO VERSION

CLASSICAL DISPLAY

HEAD-MOUNTED DISPLAY

Page 19: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 19Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Innovation Project - Results

The average price participants would pay for an commercial version of the rift is:

319 €

Participants who would buy the rift for a cost lower than $400 (293,08 €)

Participants who would buy the rift for a cost higher than $400 (293,08 €)

67.5%

32.5%

NO

YES

25%

75%

NO

YES

Page 20: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 20Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Innovation Project - Results

Immersion of prototype

average result with a scale from 1 to 10

4.2

7.775

1 2 3 4 5 6 7 8 9 10

DISPLAY PROTOTYPE

OCULUS RIFT PROTOTYPE

Page 21: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 21Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Innovation Project - Results

Possible Oculus Rift hardware improvements

Participants filled out their top 3 hardware improvements

Multiple different answers

Following 3 were the most important hardware

improvements

5.0%

7.5%

60.0%

LOWER LATENCY

IMPROVED GRAPHICS

HIGHER RESOLUTION

Page 22: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 22Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Innovation Project - Results

Possible Oculus Rift hardware improvements

average result with a scale from 1 to 10

3.45

4.225

4.625

6.925

7.05

7.65

9.425

1 2 3 4 5 6 7 8 9 10

WIRE LENGTH

WIRELESS

LESS WEIGHT

LOWER LATENCY

IMPROVED HEAD-TRACKING

ELIMINATION OF MOTION BLUR/JUDDER

HIGHER RESOLUTION

Page 23: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 23Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Innovation Project - Results

Game genre, which works in Virtual Reality average result with a scale from 1 to 10

2.85

3.1

4.625

5.625

6.6

6.675

7

7

8.175

8.5

8.725

8.95

9.025

0 1 2 3 4 5 6 7 8 9 10

STRATEGY

BEAT 'EM UP

THIRD PERSON SHOOTER

SPORTS

ADVENTURE

SIMULATION

ACTION-ADVENTURE

RPG

STEALTH GAME

OPEN WORLD

FIRST PERSON SHOOTER

RACING

SURVIVAL HORROR

Page 24: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 24Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Innovation Project - Conclusion

[OVR]

[OVR]

Technical problems of Oculus Rift Development Kit

Resolution

• 1280 to 800

• 90 degree horizontal field of view

Motion blur and judder

• Full persistence

Latency

• Between 30 to 50 ms head-tracking to photon latency

• Holy grail: under 20 ms head-tracking to photon latency

Head tracking

• No positional tracking

Motion sickness

Page 25: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 25Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Oculus Rift Versions Comparison

Development Kit Development Kit 2 1st Consumer

Version

Future Version

Head-tracking Rotational tracking Rotational and

positional tracking

Rotational and

positional tracking

Rotational and

positional tracking

Field of view 90 degrees

horizontal

100 degrees nominal 100 degrees nominal 120 degrees

horizontal

Panel type LCD phone panel OLED OLED ???

Resolution per eye 640-by-800 960-by-1080 2k-by-2k ??? 8k-by-8k ???

Pixels per degree 7.11 9.6 20 66.67

Update rate 60 Hz 75 Hz 75 Hz 120 Hz

Latency 30 to 50 ms 30 to 40 ms < 20ms < 20ms

G-Sync/

FreeSync

No No Maybe Yes

Persistence Full persistence Low persistence

(2 ms)

Low persistence Low persistence

Cost $300 $350 $200 to $400 $200 to $400

Classical 30” display, resolution 2560x1600, 50-degree field of view (normal viewing distance), 51.2 pixels per degree

Page 26: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 26Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Innovation Project - Conclusion

If we have the perfect Rift, it is all about the

games

Some games can be ported to VR

racing games

It is important that there will be VR only

games

Success of VR will also be defined by its

content

Page 27: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 27Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Innovation Project – Informatics Inside 2014

Wrote paper about my project

Paper, poster and slides of this presentation

can be downloaded from my homepagehttp://www.markusrapp.de/projects/oculus-rift-racing-game-prototype/

Page 28: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 28Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Virtual Reality Game Development

Oculus VR Developer Center https://developer.oculusvr.com

Downloads

• Oculus SDK for Windows, Linux and Mac OS

• Unity 4 Pro Integration

• Oculus – UDK

Documentation

• Oculus Best Practices

• Configuring the Oculus Rift

• Oculus SDK Overview

• Oculus Rift Development Kit Instruction Manual

• Oculus Unity Integration Guide

Page 29: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 29Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Most Important Best Practices for VR

Minimize latency

Minimum 60fps (DK2 75 fps)

No lags and dropped frames

Ideally < 20ms motion-to-photon latency

Head-tracking

Display should respond to head-tracking and viewpoint changes all the time

Even when game is paused

In-game impacts and collisions

Do not move the camera without the user’s control

UI

Make it a 3D part of the visual world

Sound

Allow user to select their output devices (headphone or speakers)

Page 30: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 30Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Virtual Reality Game Development

Unity 4 Pro

Package for integration into Unity

Detailed integration guide

Problems

• Unity Editor “Play” mode does not represent the final result of the game

on the Rift.

• No detection of the Rift. Build only opens on primary screen.

Page 31: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 31Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Virtual Reality Game Development

UDK

Fully integrated into engine

Only control with config files

Better testing in engine

• Play game feature in Editor automatically detects the rift and opens full

screen window on the rift

Build of game automatically detects connected Rift

• Even if Rift is set up as secondary monitor

• If there is no Rift connected game will start in classical mode

Page 32: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 32Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Undercurrent – Hammerhead Studios

http://www.desura.com/games/undercurrent

Page 33: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 33Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Mario Kart VR

https://developer.oculusvr.com/forums/viewtopic.php?f=42&t=5704

Page 34: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 34Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

AaaaaAAaaaAAAaaAAAAaCULUS!!!

https://share.oculusvr.com/app/aaaaaaaaaaaaaaaaaaaaculus

Page 35: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 35Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Dumpy Going Elephant

http://www.dumpygame.com/

Page 36: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 36Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Alone

https://developer.oculusvr.com/forums/viewtopic.php?f=51&t=3498

Page 37: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 37Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Ciess

https://share.oculusvr.com/app/ciess

Page 38: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 38Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

Unreal Engine 4 Roller Coaster

https://developer.oculusvr.com/forums/viewtopic.php?t=8032

Page 39: Virtual Reality Games on Oculus Rift - Markus Rappmarkusrapp.de/wordpress/wp-content/uploads/rift/VR... · Unity Racing Game Tutorial. Markus Rapp mr113@hdm-stuttgart.de Virtual Reality

Page 39Virtual Reality – Games on Oculus RiftMarkus Rapp [email protected]

References

[OVR] http://www.oculusvr.com/

[ORK] http://www.kickstarter.com/projects/1523379957/oculus-rift-step-into-the-game

[AB1] http://blogs.valvesoftware.com/abrash/latency-the-sine-qua-non-of-ar-and-vr/

[AB2] http://blogs.valvesoftware.com/abrash/when-it-comes-to-resolution-its-all-relative/

[JC] http://www.altdevblogaday.com/2013/02/22/latency-mitigation-strategies/