Achi 2013
-
Upload
alexander-toet -
Category
Technology
-
view
262 -
download
0
description
Transcript of Achi 2013
![Page 1: Achi 2013](https://reader035.fdocuments.net/reader035/viewer/2022062319/55677914d8b42a60198b4587/html5/thumbnails/1.jpg)
Subjective Usability of Speech, Touch and Gesture
in a Heterogeneous Multi-Display Environment
Arnoud de Jong Susanne Tak Alexander Toet Sven Schultz
Jan-Pieter Wijbenga Jan van Erp
TNO, The Netherlands
![Page 2: Achi 2013](https://reader035.fdocuments.net/reader035/viewer/2022062319/55677914d8b42a60198b4587/html5/thumbnails/2.jpg)
Overview
‒ Introduction‒ Related work‒ User Study‒ Tasks & Results‒ Conclusions‒ Future Work
![Page 3: Achi 2013](https://reader035.fdocuments.net/reader035/viewer/2022062319/55677914d8b42a60198b4587/html5/thumbnails/3.jpg)
Introduction:Facilitating cross-display interaction
Multi-touch Table
Interactive small groupsessions
Wall Screen
Large grouppresentations
Mobile Devices
Personal contentviewing
![Page 4: Achi 2013](https://reader035.fdocuments.net/reader035/viewer/2022062319/55677914d8b42a60198b4587/html5/thumbnails/4.jpg)
Introduction:Using different interaction techniques
Speech- Spoken commands- Direct hands-free interaction at close to medium range
Gesture- In-air body movements- Interaction over longer ranges
Touch - Hand contact - Physical interaction at close range
![Page 5: Achi 2013](https://reader035.fdocuments.net/reader035/viewer/2022062319/55677914d8b42a60198b4587/html5/thumbnails/5.jpg)
Related Work
− New techniques have been proposed to move objects between heterogeneous devices.
− Typically keyboard, touch, gesture, speech based.
− Single-user single-display paradigm still dominates.
− Available techniques complement each other:
![Page 6: Achi 2013](https://reader035.fdocuments.net/reader035/viewer/2022062319/55677914d8b42a60198b4587/html5/thumbnails/6.jpg)
Related Work
− New techniques have been proposed to move objects between heterogeneous devices.
− Typically keyboard, touch, gesture, speech based.
− Single-user single-display paradigm still dominates.
− Available techniques complement each other:
− Direct touch is fast - but only feasible at close range.
![Page 7: Achi 2013](https://reader035.fdocuments.net/reader035/viewer/2022062319/55677914d8b42a60198b4587/html5/thumbnails/7.jpg)
Related Work
− New techniques have been proposed to move objects between heterogeneous devices.
− Typically keyboard, touch, gesture, speech based.
− Single-user single-display paradigm still dominates.
− Available techniques complement each other:
− Direct touch is fast - but only feasible at close range.
− Speech suitable for descriptive techniques
and in conditions with occlusion.
![Page 8: Achi 2013](https://reader035.fdocuments.net/reader035/viewer/2022062319/55677914d8b42a60198b4587/html5/thumbnails/8.jpg)
Related Work
− New techniques have been proposed to move objects between heterogeneous devices.
− Typically keyboard, touch, gesture, speech based.
− Single-user single-display paradigm still dominates.
− Available techniques complement each other:
− Direct touch is fast - but only feasible at close range.
− Speech suitable for descriptive techniques and in conditions with occlusion.
− Gestural interaction enables remote manipulation of objects.
![Page 9: Achi 2013](https://reader035.fdocuments.net/reader035/viewer/2022062319/55677914d8b42a60198b4587/html5/thumbnails/9.jpg)
Related Work
− New techniques have been proposed to move objects between heterogeneous devices.
− Typically keyboard, touch, gesture, speech based.
− Single-user single-display paradigm still dominates.
− Available techniques complement each other:
− Direct touch is fast - but only feasible at close range.
− Speech suitable for descriptive techniques and in conditions with occlusion.
− Gestural interaction enables remote manipulation of objects.
− Users prefer combination of speech and gestural interaction
when handling graphics.
![Page 10: Achi 2013](https://reader035.fdocuments.net/reader035/viewer/2022062319/55677914d8b42a60198b4587/html5/thumbnails/10.jpg)
User Study: Usability and Preference
Display Pairs:
Table Screen Table MobileScreen MobileMobile Screen
Participants:
21 participants12 male 9 female27 average age
Usability Questionnaire:
− without thinking − intuitive− unnatural− tiring− responsive− complex− error-prone
Interaction Modes:
− Speech− Touch− Gesture
BlablaBlabla
![Page 11: Achi 2013](https://reader035.fdocuments.net/reader035/viewer/2022062319/55677914d8b42a60198b4587/html5/thumbnails/11.jpg)
Interaction Techniques
Table to screenSpeech: Select photo and say “send to screen”.Touch: Drag photo to a window entitled ‘Screen’.Gesture: Select photo and point at the screen.
Table to mobile
Speech: Select photo and say “send to Harry”.Touch: Drag photo to a window entitled ‘Harry’.Tangible: Place mobile on table and drag photo to it.
Screen to mobile
Speech: Start voice command by saying “screen” then say “send to Harry”.Gesture: Hold phone as if taking a photo of the screen.
Mobile to screen
Speech: Start voice command by dragging finger downwards over screen and say “send to screen”.Touch: Press send button below photo and select the ‘Screen’ menu item.Gesture: Point phone at the screen.
![Page 12: Achi 2013](https://reader035.fdocuments.net/reader035/viewer/2022062319/55677914d8b42a60198b4587/html5/thumbnails/12.jpg)
![Page 13: Achi 2013](https://reader035.fdocuments.net/reader035/viewer/2022062319/55677914d8b42a60198b4587/html5/thumbnails/13.jpg)
Tasks: Table to Screen
Results
• Most participants preferred touch technique
• 5 participants thought speakingcommands out loud was awkward
SpeechSelect photo and say “send to screen”.
TouchDrag photo to window entitled ‘Screen’.
GestureSelect photo and point at screen.
![Page 14: Achi 2013](https://reader035.fdocuments.net/reader035/viewer/2022062319/55677914d8b42a60198b4587/html5/thumbnails/14.jpg)
Tasks: Table to Screen
SpeechSelect photo and say “send to screen”.
TouchDrag photo to window entitled ‘Screen’.
GestureSelect photo and point at screen.
Preference Usability
![Page 15: Achi 2013](https://reader035.fdocuments.net/reader035/viewer/2022062319/55677914d8b42a60198b4587/html5/thumbnails/15.jpg)
Tasks: Table to Mobile
Results
• Most participants preferred the tangible technique
• The tangible technique was very well received,
with 10 participants calling it “fun” or “cool”.
SpeechSelect photo and say “send to Harry”.
TouchDrag photo to window entitled ‘Harry’.
TangiblePlace mobile on table and drag photo to it.
![Page 16: Achi 2013](https://reader035.fdocuments.net/reader035/viewer/2022062319/55677914d8b42a60198b4587/html5/thumbnails/16.jpg)
Tasks: Table to Mobile
SpeechSelect photo and say “send to Harry”.
TouchDrag photo to window entitled ‘Harry’.
TangiblePlace mobile on table and drag photo to it.
Preference Usability
![Page 17: Achi 2013](https://reader035.fdocuments.net/reader035/viewer/2022062319/55677914d8b42a60198b4587/html5/thumbnails/17.jpg)
Tasks: Screen to Mobile
Results
• No significant preference for either of the techniques
• 12 participants preferred speech the most, 9 participants preferred gesture the most
SpeechSay “screen” followed by “send to Harry”.
GestureHold phone as if taking photo of screen.
![Page 18: Achi 2013](https://reader035.fdocuments.net/reader035/viewer/2022062319/55677914d8b42a60198b4587/html5/thumbnails/18.jpg)
Tasks: Screen to Mobile
SpeechSay “screen” followed by “send to Harry”.
GestureHold phone as if taking photo of screen.
Preference Usability
![Page 19: Achi 2013](https://reader035.fdocuments.net/reader035/viewer/2022062319/55677914d8b42a60198b4587/html5/thumbnails/19.jpg)
Tasks Mobile to Screen
Results
• Most participants preferred the gesture technique
SpeechDrag finger and say “send to screen”.
TouchSelect ‘Screen’ menu item and press ‘Send’.
GesturePoint phone at screen.
![Page 20: Achi 2013](https://reader035.fdocuments.net/reader035/viewer/2022062319/55677914d8b42a60198b4587/html5/thumbnails/20.jpg)
Tasks Mobile to Screen
SpeechDrag finger and say “send to screen”.
TouchSelect ‘Screen’ menu item and press ‘Send’.
GesturePoint phone at screen.
Preference Usability
![Page 21: Achi 2013](https://reader035.fdocuments.net/reader035/viewer/2022062319/55677914d8b42a60198b4587/html5/thumbnails/21.jpg)
Conclusions
‒ User preference for interaction techniques depends on the nature of the displays.
‒ Speech technique is generally disliked: people feel embarrassed when speaking commands out loud.
‒ Holding an object that provides a clear visual cue indicating the user’s actions makes gesture-based interaction more acceptable.
![Page 22: Achi 2013](https://reader035.fdocuments.net/reader035/viewer/2022062319/55677914d8b42a60198b4587/html5/thumbnails/22.jpg)
Future Work
‒ Explicitly address embarrassment: test whether participants are primarily spatial, verbal or object oriented
‒ Register objective performance measures (e.g. time required to perform different actions).
‒ Investigate multiple users settings and/or more complex display combinations.
![Page 23: Achi 2013](https://reader035.fdocuments.net/reader035/viewer/2022062319/55677914d8b42a60198b4587/html5/thumbnails/23.jpg)
Questions ?