Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate...
Transcript of Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate...
![Page 1: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/1.jpg)
Danyel Fisher VIBE Researcher Microsoft Corporation
![Page 2: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/2.jpg)
![Page 3: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/3.jpg)
![Page 4: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/4.jpg)
Design Data and Tasks • 310 newspaper articles
• Find relevant articles
• Form hypotheses, connections
![Page 5: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/5.jpg)
• Follow separate hypotheses (correct or incorrect)
• Capitalize on the group effort
![Page 6: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/6.jpg)
The New Yorker, 2003
Follow separate
hypotheses (correct or incorrect)
Capitalize on the
group effort
![Page 7: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/7.jpg)
DiamondTouch PerceptivePixel Microsoft Surface
ReacTable Multitouch LCDs $2 Multitouch
![Page 8: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/8.jpg)
Mixed-focus collaboration
Tang et al., CHI 2006
Loosely Coupled Work Closely Coupled Work
![Page 9: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/9.jpg)
Collaborative Information Analysis Processes
Clarify
Strategize
Discuss Collaboration Style
Validate
Select
Operate
Parse
Browse
Loosely Coupled Work Closely Coupled Work
Isenberg et al., CHI 2008
![Page 10: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/10.jpg)
Support individual & group • Surface application with parallel input
• Provide peripheral awareness information of others’ work
![Page 11: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/11.jpg)
Cambiera
video
![Page 12: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/12.jpg)
Who
searched
Related searches Search order Who read Read Frequency
Collaborative Brushing and Linking – the other view:
![Page 13: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/13.jpg)
Awareness information • Did another search also find my document?
• Has someone else issued my search?
• Has someone extracted the same document?
• Has someone read the same document?
![Page 14: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/14.jpg)
![Page 15: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/15.jpg)
How to design multi-object operations?
![Page 16: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/16.jpg)
How to design multi-object operations?
![Page 17: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/17.jpg)
How to design multi-object operations?
By [benwatts] on flickr
![Page 18: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/18.jpg)
• How do virtual and physical techniques carry over?
• How will people use hands and fingers?
• How dextrous will they be?
• Will they focus on single objects or groups?
![Page 19: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/19.jpg)
Pile-N-Browse
From (Wu et al., 2006)
![Page 20: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/20.jpg)
Studying gestures
From (Wobbrock et al., 2009)
![Page 21: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/21.jpg)
Goals • Study tasks with manipulation
of large number of small objects
• Compare gestures from physical/mouse to surface
• Derive gesture vocabulary
![Page 22: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/22.jpg)
Mouse (M) • 24’’ Desktop Screen
• Single click, marquee selection, ctrl+shift click
• Rendered circles
Physical (P) • 24’’x18’’ MS Surface Screen
• Any physical interaction
• Game chips
Surface (S) • 24’’x18’’ MS Surface Screen
• Single finger touch, convex hull
• Rendered circles
All • Physical circle sizes matched
• 200 circles total, 4 colors (50 circles per color)
![Page 23: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/23.jpg)
• 32 (25 male, 7 female)
• All users do the Surface, and either mouse or physical
• Mouse + Surface (MS)
• Surface + Mouse (SM)
• Physical + Surface (PS)
• Surface + Physical (SP)
Data for 32 Surface, 16 Mouse, 16 Physical
Physical Surface Mouse
![Page 24: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/24.jpg)
1. Separate blue and white chips into clusters
2. Spread blue cluster so no 2 circles overlap
3. Timed clustering
Task 1 Result
![Page 25: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/25.jpg)
1. Gesture sets from Task 1 & 2 • From video analysis in physical & surface condition
• Both successful & unsuccessful gestures
2. Timing results from Task 3 • Analyzed with a 2x2 mixed Anova
3. Participant comments
![Page 26: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/26.jpg)
1. One handed – applied to a group • Splayed hand pushes pieces
• One hand shove
• Pinch
• Hand and palm
![Page 27: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/27.jpg)
2. One handed – applied to single item • Drag single item
• Select single items with multiple fingers
• Toss single object
![Page 28: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/28.jpg)
3. Two handed – applied to single group • Both hands coalesce large group to small
• Two-hand transport
• Add/remove from selection
![Page 29: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/29.jpg)
4. Two handed – applied to > 1 group • Drag two objects with pointer fingers
• Two hands grab points in sync
• Rhythmic use of both hands
• Two hands grab groups
![Page 30: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/30.jpg)
5. Surface Only • One hand hull manipulation
• Two-hand hull manipulation
• Treat finger like a mouse
• Push hard to multi-select
![Page 31: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/31.jpg)
6. Physical Only • Lift up
• Go outside the lines
• Slide around objects
• Texture-based
• Toss chips between hands
• Drag and drop some chips on the way
![Page 32: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/32.jpg)
• Fingertip-based most popular
• Difference based on starting condition • Starting in physical: 88%
• Starting in mouse/surface: 56%/50%
• 70% used multiple hands for >1 group
• On Surface many used fingers as a mouse • Starting in mouse: 50%
• Starting in physical: 25%
![Page 33: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/33.jpg)
Surface is sign. faster than Mouse • Surface: 116s, Mouse 134s, (F1,14=6.10, p=.027)
• No effect of cond. order (F1,14=9.28, p=.352)
Physical is sign. faster than Surface • Physical: 89s, Surface: 120s (F1,14=11.96, p=.004)
• Sign. effect for cond. order (PS < SP) (F1,14=11.482, p<.001)
Impact of first condition • Participants starting in Physical sign. faster on Surface (PS < MS) (t1,2=2.38, p<.035)
![Page 34: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/34.jpg)
Surface perceived as sign. easier than Mouse • No effect between Physical/Surface
88% preferred clustering task on Surface compared to Mouse • 44% preferred Surface to Physical
Perceived advantages • Physical: tactile feedback
• Surface: drag over circles, two handed interaction
• Mouse: select dispersed circles
![Page 35: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/35.jpg)
• Participants showed influence of previous condition • Gestures sets and work speed influenced
• Multi-touch grouping was common
• Two-handed interaction common • Wide variety of co ordinations (in sync, in parallel, ...)
![Page 36: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/36.jpg)
![Page 37: Danyel Fisher VIBE Researcher Microsoft Corporation€¦ · The New Yorker, 2003 Follow separate hypotheses (correct or incorrect) Capitalize on the group effort . DiamondTouch PerceptivePixel](https://reader035.fdocuments.net/reader035/viewer/2022071016/5fcfd4403b8f9b6ffc006dd1/html5/thumbnails/37.jpg)