Mixed RealityHow to present your VR game

Jaroslav Stehlík

Lead programmer

DIVR Labs

@jaroslavstehlik

DIVR Labs

First Czech VR game company

Working on a sci-fi horror shooter Blue Effect

for Oculus Rift, HTC Vive, Playstation VR

http://divrlabs.com

Mixed Reality?

Why we have to shoot a mixed reality video?

http://youtube.com/v/jH7bfZ_dRPM

Mixed reality

First person camera in VR

Resembles every FPS game.We already saw "everything" in FPS, nothing new and exciting going on there.

Mixed reality

How we present virtual reality without VR headset?

Put the player inside the gameplay footage.

The natural interaction between player and the virtual world will speak for it self.

Mixed reality

Much better!

Mixed reality

But how we actually capture this?

Making of video

DIY Mixed reality - Hardware

1x Studio full of lights

2x walls and floor with green screen

3x HTC Vive controllers

1x Super computer :)

1x 4K monitor

1x HD camera + fixed lens

1x Video capture/streaming card

DIY Mixed reality

Our green screen setup

DIY Mixed reality - Game support

OpenVR SDK has mixed reality support but it is clunky.

The developer has to create the UI for proper setup.

Setup camera field of view, camera XYZ offset, camera XYZ rotation etc.

It is also a good practice to bring the UI to your players/youtubers

DIY Mixed reality

Hardcore camera training

DIY Mixed reality - Camera setup

The camera sensor should be ideally 35mm with a fixed lens.

Fix the third HTC Vive controller on the camera rock solid!

Third controller has to be connected via USB cable with a USB repeater.

Game needs virtual shutter for syncing game footage with camera.

DIY Mixed reality

Camera matching is hard!

DIY Mixed reality - Camera match

Match the game recording frame rate to the real camera!

Overlay the gameplay video with the camera footage 50% blend.

Use any streaming software "OBS, Evolve, etc" for this purpose.

Align the virtual camera with the real camera.

You have to record the game in 4K to get HD as a result.

That are basically the harderst part of the whole mixed reality thing.

DIY Mixed reality

Actor must shine!

Trailer

Thank you for your attention!

For detailed information visit: http://www.kertgartner.com/making-mixed-reality-vr-trailers-and-videos

Also, we are hiring: http://divrlabs.com