Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices Adaptive...
-
Upload
mariana-crowden -
Category
Documents
-
view
215 -
download
0
Transcript of Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices Adaptive...
![Page 1: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices Adaptive Systems and Interaction Research Group Microsoft Research.](https://reader030.fdocuments.net/reader030/viewer/2022032517/56649c855503460f9493b8ad/html5/thumbnails/1.jpg)
Hover Widgets: Using the Tracking State to Extend the Capabilities of
Pen-Operated Devices
Adaptive Systems and Interaction Research Group Microsoft Research www.research.microsoft.com
Tovi GrossmanKen Hinckley
Patrick BaudischManeesh AgrawalaRavin Balakrishnan
Dynamic Graphics Project Dept of Computer Science University of Toronto www.dgp.toronto.edu
![Page 2: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices Adaptive Systems and Interaction Research Group Microsoft Research.](https://reader030.fdocuments.net/reader030/viewer/2022032517/56649c855503460f9493b8ad/html5/thumbnails/2.jpg)
Pen-Based Interfaces
• Great for notes, sketches• Lack of shortcuts problematic
![Page 3: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices Adaptive Systems and Interaction Research Group Microsoft Research.](https://reader030.fdocuments.net/reader030/viewer/2022032517/56649c855503460f9493b8ad/html5/thumbnails/3.jpg)
Pen-Based Interfaces
• Great for notes, sketches• Lack of shortcuts problematic• Round trip problem
![Page 4: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices Adaptive Systems and Interaction Research Group Microsoft Research.](https://reader030.fdocuments.net/reader030/viewer/2022032517/56649c855503460f9493b8ad/html5/thumbnails/4.jpg)
Localized User Interfaces
• Gesture Interaction• Tivoli (Moran, Chiu, Melle. UIST ’97)• SKETCH (Zeleznik, Herndon & Hughes. SIGGRAPH ’96)• DENIM (Newman, Lin, Hong & Landay. HCI ’03)
• Menu Interaction• Marking Menu (Kurtenbach & Buxton. CHI ’93)• Flow Menu (Guimbretière & Winograd. UIST ’03)
• Scroll ring (Smith & schraefel. Moscovich & Hughes. UIST ’04)
• Hybrid• Scriboli (Hinckley, Baudisch, Ramos, & Guimbretière. CHI ’05)
![Page 5: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices Adaptive Systems and Interaction Research Group Microsoft Research.](https://reader030.fdocuments.net/reader030/viewer/2022032517/56649c855503460f9493b8ad/html5/thumbnails/5.jpg)
Localized User Interfaces
• Gesture Interaction• Ink confused with gesture• Explicitly switch with button
• Menu Interaction• Activated with button
![Page 7: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices Adaptive Systems and Interaction Research Group Microsoft Research.](https://reader030.fdocuments.net/reader030/viewer/2022032517/56649c855503460f9493b8ad/html5/thumbnails/7.jpg)
Localized User Interfaces
![Page 8: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices Adaptive Systems and Interaction Research Group Microsoft Research.](https://reader030.fdocuments.net/reader030/viewer/2022032517/56649c855503460f9493b8ad/html5/thumbnails/8.jpg)
Localized User Interfaces
![Page 9: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices Adaptive Systems and Interaction Research Group Microsoft Research.](https://reader030.fdocuments.net/reader030/viewer/2022032517/56649c855503460f9493b8ad/html5/thumbnails/9.jpg)
Design Challenge
1. Localized user interface2. Clearly distinct from ink input3. No button required
![Page 10: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices Adaptive Systems and Interaction Research Group Microsoft Research.](https://reader030.fdocuments.net/reader030/viewer/2022032517/56649c855503460f9493b8ad/html5/thumbnails/10.jpg)
Tracking menus
Fitzmaurice G., Khan A., Pieke R., Buxton B., Kurtenbach G. UIST 2003
![Page 11: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices Adaptive Systems and Interaction Research Group Microsoft Research.](https://reader030.fdocuments.net/reader030/viewer/2022032517/56649c855503460f9493b8ad/html5/thumbnails/11.jpg)
Hover Widgets
• Gesture in tracking state• Widget fades in• Click on widget
![Page 12: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices Adaptive Systems and Interaction Research Group Microsoft Research.](https://reader030.fdocuments.net/reader030/viewer/2022032517/56649c855503460f9493b8ad/html5/thumbnails/12.jpg)
Hover Widgets
![Page 18: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices Adaptive Systems and Interaction Research Group Microsoft Research.](https://reader030.fdocuments.net/reader030/viewer/2022032517/56649c855503460f9493b8ad/html5/thumbnails/18.jpg)
Independent Variables
• Technique (Hover Widget, Icon)• GridN (4, 8, 12)• Distance (300, 600, 900, 1200)
![Page 21: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices Adaptive Systems and Interaction Research Group Microsoft Research.](https://reader030.fdocuments.net/reader030/viewer/2022032517/56649c855503460f9493b8ad/html5/thumbnails/21.jpg)
Summary
• New distinct command layer• Button free • Localized UI
• Reduce time• Minimal shift of attention
![Page 22: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices Adaptive Systems and Interaction Research Group Microsoft Research.](https://reader030.fdocuments.net/reader030/viewer/2022032517/56649c855503460f9493b8ad/html5/thumbnails/22.jpg)
Future Work
• Customize & adapt
![Page 23: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices Adaptive Systems and Interaction Research Group Microsoft Research.](https://reader030.fdocuments.net/reader030/viewer/2022032517/56649c855503460f9493b8ad/html5/thumbnails/23.jpg)
Future Work
• Customize & adapt• Large displays
![Page 24: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices Adaptive Systems and Interaction Research Group Microsoft Research.](https://reader030.fdocuments.net/reader030/viewer/2022032517/56649c855503460f9493b8ad/html5/thumbnails/24.jpg)
Acknowledgements
• Members of The Microsoft Research Adaptive Systems & Interaction group
• Members of the Microsoft Research Visualization and Interaction Group
• Members of the University of Toronto Dynamic Graphics Lab
• David Thiel• Study Participants
![Page 25: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices Adaptive Systems and Interaction Research Group Microsoft Research.](https://reader030.fdocuments.net/reader030/viewer/2022032517/56649c855503460f9493b8ad/html5/thumbnails/25.jpg)
Questions?
![Page 27: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices Adaptive Systems and Interaction Research Group Microsoft Research.](https://reader030.fdocuments.net/reader030/viewer/2022032517/56649c855503460f9493b8ad/html5/thumbnails/27.jpg)
Using the Tracking State
• Tool tips• Input panel gesture
![Page 30: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices Adaptive Systems and Interaction Research Group Microsoft Research.](https://reader030.fdocuments.net/reader030/viewer/2022032517/56649c855503460f9493b8ad/html5/thumbnails/30.jpg)
Visualization
![Page 31: Hover Widgets: Using the Tracking State to Extend the Capabilities of Pen-Operated Devices Adaptive Systems and Interaction Research Group Microsoft Research.](https://reader030.fdocuments.net/reader030/viewer/2022032517/56649c855503460f9493b8ad/html5/thumbnails/31.jpg)
Learning