Virtual Museum
-
Upload
diana-schultz -
Category
Documents
-
view
24 -
download
0
description
Transcript of Virtual Museum
Virtual MuseumEugeni Casadesús, Ramón Oliva & Miguel Pasenau
2012, January 24th
Virtual Reality, Immersive Interaction, Usability and Presence (RVA) course
Master in Computing ( LSI – UPC)
2012, January 24th / 2
Contents• Goal
• Implementation
• Results
• Conclusions
2012, January 24th / 3
Contents• Goal
• Implementation
• Results
• Conclusions
2012, January 24th / 4
Goal• Virtual Museum: 3 rooms• User can move around:– Collision detection
• Objects exposed, selectable for inspection
2012, January 24th / 5
Environment & tools• Cave or Power-Wall:– Limited space– User gestures to move around scene Kinect
• VRJuggler:– Targets Cave, Power-Wall and desktop computer
as well• Kinect interface:– NITE + OpenNI + FAAST
• Bullet: collision detection
2012, January 24th / 6
Contents• Goal
• Implementation
• Results
• Conclusions
2012, January 24th / 7
Museum floor plan
2012, January 24th / 8
Objects
1.024 triangles
28.688 triangles
69.451 triangles
111.658 triangles
54.931 triangles
51.925 triangles
51.132 triangles 97.425 triangles
99.877 triangles
2012, January 24th / 9
User movements• Forward, backward, left, right:– Segway: lean forward / backward: moves fw / bw – Rotate torso left / right: rotates left / right– Left arm up / down: starts / ends movement
• Selection– Wand ?– Collision with pedestal ?– Stretching arm ?
• Help– Raising hand ?
2012, January 24th / 10
VRJuggler approach• User stays fixed, scene moves
• Init():– Initialize devices– read ply models: walls, pedestals & objects– Create bullet physics:• Museum, objects and pedestals containers• Scene constraints
2012, January 24th / 11
VRJuggler approach• preFrame():– Update physics– Gets kinect data
• Draw():– Navigation mode: draw museum and objects– Inspection mode: draw selected object zoomed
2012, January 24th / 12
Actual state• Museum, pedestals and objects are rendered• Collision detection is enabled• Use movement is enabled:– Forward and backward, left and right turning
• Starting Kinect integration:– Gestures recognition and application responds
2012, January 24th / 13
VRJuggler issues• No x64 alone build & install• Only mixed x32 and x64 Linux build and install• Using x32 build:
– https://github.com/rpavlik/vrjuggler-windows-binaries
• Units in feet and inches, not meters• User centred, scene moving • No restrictions or definition of movements• No event filtering possible
2012, January 24th / 14
Bullet + VRJuggler issues• User centred, scene moving • Translations whole scene is translated the hard way• Rotations whole scene is rotated the hard way• Collisions:– User: forward ray– Scene: bbox and cylinders– Object selection = collision wand ray - object
2012, January 24th / 15
Kinect issues• Unstable FAAST 0.10• Using .jconf: lot of noise• Gesture recognition using FAAST, associate
with keys / events of vrjuggler
2012, January 24th / 16
Contents• Goal
• Implementation
• Results
• Conclusions
2012, January 24th / 17
Results
2012, January 24th / 18
Results
2012, January 24th / 19
Contents• Goal
• Implementation
• Results
• Conclusions
2012, January 24th / 20
Conclusions• Developing a RV application:– Hard to do– Still a juggling art
• VRJuggler:– Hard to build and install: documentation so-so– Only x32 is known to work
• Bullet: easy to install and to start with• Kinect: difficult to incorporate to VRJuggler:– Gesture analysis and interpretation– Complicated device and proxies structure
2012, January 24th / 21
References
Virtual Museum
Eugeni, Ramón Oliva & Miguel Pasenau2012, January 24th
Virtual Reality, Immersive Interaction, Usability and Presence (RVA) course
Master in Computing ( LSI – UPC)