Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive...

33
Interactions in Virtual Reality Copyright 2018 © Virtual Reality at Berkeley

Transcript of Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive...

Page 1: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were

Interactions in Virtual Reality

Copyright 2018 © Virtual Reality at Berkeley

Page 2: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were

2

Hardware

Gaze Gaze and tap Clickers

Hand tracking 6DOF controllers Eye tracking

Page 3: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were

Gaze and Hold

Makes the least hardware assumptions. 3

Page 4: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were

Gaze and Tap

Better, but make targets large and use sparingly. 4

Page 5: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were

Clickers

More versatile, but potentially a false affordance? 5

Page 6: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were

Hand Tracking

Most natural, but not necessarily the best. 6

Page 7: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were

Great compromise between intuitiveness and utility.

Tracked 6DOF controllers

7

Page 8: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were

Coming soon

Eye tracking

8

Page 9: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were

9

Presence

Page 10: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were

Personal: Illusion of Self-embodiment

Environmental: Illusion of Physical Interaction

Social: Illusion of Social Companionship

Presence

10

Page 11: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were

11

Interactions in Personal Space

Page 12: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were

Personal Presence

12

Page 13: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were

IK Arms

Page 14: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were

IK Arms

Page 15: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were

15

Environmental Presence

Page 16: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were

Beware of Metaphors

16

https://i.imgur.com/RjbxvQt.gifv

Page 17: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were

The more repeated the action, the easier it should be

17

Page 18: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were

18

Can we do better than reality?

Page 19: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were

Learnings on Maintaining Environmental Presence

19

● Large arms motions are tiring● If you give the users hands, give them something to do with them● If you let players swing around, they’ll break something (one in N times)

Page 20: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were

20

Social Presence

Page 21: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were

Hand-Eye Coordination

Interactive Eye Contact

Eye Tracking

21

Page 22: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were

Eye Tracking

22

Hand-Eye Coordination

Interactive Eye Contact

Page 23: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were

Eye Trackers on the Market

23

Page 24: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were

Full Body Presence

(You can finally kick things!)

Body Tracking

24

Page 25: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were

Body Tracking

25

Full Body Presence

(You can finally kick things!)

Page 26: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were

Body Trackers on the Market

26

Page 27: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were

Tracking

27

Track and show what we can, leave the rest to the brain.

Page 28: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were

Believable NPCs

A big part of social VR is interacting with other people, but VR is also a powerful tool for interacting with other virtual people.

28

Page 29: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were

Immersive Journalism

“That was my goal. Take a story about people who are hungry, who I felt were invisible, and make them visible in a way that was so compelling that people would really get what the fuck was going on out there. So that works. And it works in a way that has blown my mind.”

Nonny de la Peña

29

Page 31: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were

VRChat

31

Page 32: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were

VRChat

32

Page 33: Interactions in Virtual Reality - Extended Reality at Berkeley · 2018-03-07 · Immersive Journalism “That was my goal. Take a story about people who are hungry, who I felt were

Immersive Theater

33