subtitles in VR and 360-degree © IRT / i2cat 2018

1

Subtitles in VR and 360°

Mario Montagud Peter tho Pesch

subtitles in VR and 360-degree © IRT / i2cat 2018

2

Scenery 360-degree videos

subtitles in VR and 360-degree © IRT / i2cat 2018

3

Equirectangular

subtitles in VR and 360-degree © IRT / i2cat 2018

4

and more…

many services

subtitles in VR and 360-degree © IRT / i2cat 2018

5

What is the best way to present subtitles?

subtitles in VR and 360-degree © IRT / i2cat 2018

6

So

urc

e: rb

b-o

nlin

e.d

e

subtitles in VR and 360-degree © IRT / i2cat 2018

7

additional degree of freedom

video detached from field of view

subtitles in VR and 360-degree © IRT / i2cat 2018

8

Source: https://sites.arte.tv/360/en

subtitles in VR and 360-degree © IRT / i2cat 2018

9

Main challenges

Comfort

Readability

Speaker identifiaction

subtitles in VR and 360-degree © IRT / i2cat 2018

10

Source: https://www.bbc.co.uk/rd/blog/2017-10-subtitles-360-video-virtual-reality-vr

1) Evenly spaced

2) Follow head immediatly

3) Follow head with lag

4) Appear in front, then fixed

subtitles in VR and 360-degree © IRT / i2cat 2018

11

So

urc

e: h

ttp

s:/

/ww

w.g

am

eg

rin

.co

m/r

evie

ws/a

ssa

ssin

s-c

reed

-orig

ins-r

evie

w/

Barrier free award (by Dager System)

Is this the best there is in games?

Lin

k: h

ttp

s:/

/da

ge

rsyste

m.c

om

/an

nou

ncin

g-d

age

rs-b

arr

ier-

bre

aker-

aw

ard

/

subtitles in VR and 360-degree © IRT / i2cat 2018

12

Source: https://www.gamasutra.com/blogs/IanHamilton/20150715/248571/How_to_do_subtitles_well__basics_and_good_practices.php

subtitles in VR and 360-degree © IRT / i2cat 2018

13

Ludwig Maximilian Universität (LMU)„dynamic subs“

Positive:

Subtitles more comfortable (less motion sickness, better „presence“

Better speaker identification

Negative

Forced to look at speaker→ In some cases, viewers didn‘t look around that

much.

Dynamic vs. Always centered→ No clearly preferred method

subtitles in VR and 360-degree © IRT / i2cat 2018

14

Two approaches

video as base field of view as base

subtitles in VR and 360-degree © IRT / i2cat 2018

15

Presentation of subtitles

subtitles in VR and 360-degree © IRT / i2cat 2018

16

Possibilities

Rendering Reference?

Flat 2D / Perspective / 3D depth?

Subtitles anchored to the main action

Guiding Mechanisms: Arrows, Compass / Radar, Side Text...

Forced Perspective (i.e. Automatic Guiding)

subtitles in VR and 360-degree © IRT / i2cat 2018

17

Source: https://sites.arte.tv/360/en

subtitles in VR and 360-degree © IRT / i2cat 2018

18

subtitles in VR and 360-degree © IRT / i2cat 2018

19

subtitles in VR and 360-degree © IRT / i2cat 2018

20

subtitles in VR and 360-degree © IRT / i2cat 2018

21

Explore how Accessibility Services can be integrated with Immersive Media

Enable truly Inclusive, Immersive and Personalized Multi-Screen Experiences

End-to-End Workflow: From Production/Edition to Consumption

User-Centered Design

2 pilots focused on Subtitling: Spanish (CCMA), German (RBB)

subtitles in VR and 360-degree © IRT / i2cat 2018

22

Pre-pilot tests demos

P1: Immersive & Accessible Opera (with ImmersiaTV): https://goo.gl/xpqVPF

subtitles in VR and 360-degree © IRT / i2cat 2018

23

CFoV (Safe Area!) in HMD?

Comfortable Field of View (CFoV)

subtitles in VR and 360-degree © IRT / i2cat 2018

24

All rights reserved. All text, images, graphics and charts are protected by copyright. Reproduction or use of the content is not permitted without the express consent of the author.

Peter tho PeschInstitut für Rundfunktechnik

thopesch@irt.de

Mario Montagudi2cat foundation

mario.montagud@i2cat.net

Thank you for your attention!