VisualizationStudio · •December 16 VIC Open House 15:00 –19:00 •Link 2016-11-02 Romero 21....
54
VisualizationStudio 2016-11-02 Romero 1
Transcript of VisualizationStudio · •December 16 VIC Open House 15:00 –19:00 •Link 2016-11-02 Romero 21....
VisualizationStudio
2016-11-02 Romero 1
Mixed-Reality Whole-Body Interaction
Mario Romero2016/11/02
Photo: Fredrik Lilkaer. Project: SolarSense (AGI2013)
Note
Most of the images have links to online content. Please, explore and enjoy them.
2015/11/04 MMI15-L2 3
Who am I talking to today?
• Microsoft Kinect• Leap Motion• Google Cardboard• Epson Moverio BT300• Novint Falcon• Google Glass• Oculus Rift• HTC VIVE • Microsoft Hololens• Google Tango• Magic Leap
2015/11/04 MMI15-L2 4
Outline
• Who are you talking to today?
• Mixed-Reality Whole-Body Interaction
• Visualization Studio
• Selected Projects
• Second Hour – Demos in VIC
2016-11-02 Romero 5
WHO ARE YOU TALKING TO?
2015/11/04 MMI15-L2 6
Associate Professor
HCI Visualization Graphics
2015/11/04 MMI15-L2 16
Mixed Reality StockholmMS Thesis Opportunity
2016-11-02 Romero 19
MultiModal Interaction and Interfaces Projects
• First Come First Serve
• 4 Projects
• Examples from 2015:
– Goats vs. Frogs vimeo
– Intereator vimeo
– Mockstar vimeo
– ARban vimeo
2016-11-02 Romero 20
Advanced Graphics and Interaction
• November 7 MMII demonstration in VIC
• December 16 VIC Open House 15:00 – 19:00
• Link
2016-11-02 Romero 21
Mixed-Reality Spectrum
2016-11-02 Romero 22
Reality Augmented Reality Augmented Virtuality Virtual Reality
Why external sensing?Why only static biking?
2016-11-02 Romero 23
single accelerometersingle accelerometer
Nordic Skiing
2016-11-02 Romero 24
A vision of the future
2016-11-02 Romero 28
Skin Input
Harrison 2010
2016-11-02 Romero 29
Muscle Input
Saponas 20092016-11-02 Romero 30
Muscle Output
Lopes 20132016-11-02 Romero 31
Bone Output
Walker 2005
2016-11-02 Romero 32
Multi-surface Input
Synaptics Fuse 2006
2016-11-02 Romero 33
Air periphery phone input
Fuffr 2015
2016-11-02 Romero 34
Virtual Reality
Oculus Rift 2016
2016-11-02 Romero 35
Mobile VR
2016-11-02 Romero 37
Mobile 3D Intelligence
Google Tango 2014
2016-11-02 Romero 38
Full Mixed Reality
Microsoft Hololens 20152016-11-02 Romero 39
2016-11-02 Romero 40
• Research
• Visualization Supported Collaborative Work
• Foundational Technology
• User Evaluations
• Showcase and classroom environment
• Outreach
Students’ Resources:Visualization Studio
2016-11-02 Romero 41
• High-resolution stereoscopic projection wall
• Oculus Rift
• HTC Vive
• Holographic displays
• Multi-touch surfaces
• Eye tracking
• GPU-based computing cluster
• Diverse interaction and sensor systems (haptic, mocap, etc.)
• Haptic Devices
• 3D printer
Technologies in
2016-11-02 Romero 42
VisualizationStudio
2016-11-02 Romero 43
Students
2016-11-02 Romero 44
Select Portfolio
2016-11-02 Romero 45
Virtual Sculpting
2016-11-02 Romero 46
2016-11-02 Romero 47
2016-11-02 Romero 49
Embodied Sculpting
2016-11-02 Romero 50
MegaMind Tekniska Museet – Forma i Luften
Hands-on interaction with 3D, haptics, sound
2016-11-02 Romero 51
Base Jumper
• Octree rendering
• Computer vision body control
• Link (not on the image)
2016-11-02 Romero 52
DangeRoads
2016-11-02 Romero 53
PodRacer
2016-11-02 Romero 54
PodRacer
2016-11-02 Romero 55
InvadAR
2016-11-02 Romero 56
YA3
2016-11-02 Romero 57
2016-11-02 Romero 58
2016-11-02 Romero 59
Mad Sand
2016-11-02 Romero 60
Resources• ACM SIGGRAPH
• ACM CHI
• ASSETS: ACM International Conference on Computers and Accessibility
• CSCW: ACM conference on Computer Supported Cooperative Work
• DIS: ACM conference on Designing Interactive Systems
• ECSCW: European Conference on Computer-Supported Cooperative Work: ACM conference on supporting group work
• HRI: ACM/IEEE International Conference on Human–robot interaction
• ICMI: International Conference on Multimodal Interfaces
• ITS: ACM conference on Interactive Tabletops
and Surfaces
• IUI: International Conference on Intelligent User Interfaces
• MobileHCI: International Conference on Human–Computer Interaction with Mobile Devices and Services
• NIME: International Conference on New Interfaces for Musical Expression
• Ubicomp: International Conference on Ubiquitous computing
• UIST: ACM Symposium on User Interface Software and Technology
• i-USEr: International Conference on User Science and Engineering
2016-11-02 Romero 65
