Automatically Generating Interfaces for Multi-Device Environments Jeffrey Nichols Carnegie Mellon...
-
Upload
michelle-maynard -
Category
Documents
-
view
217 -
download
1
Transcript of Automatically Generating Interfaces for Multi-Device Environments Jeffrey Nichols Carnegie Mellon...
![Page 1: Automatically Generating Interfaces for Multi-Device Environments Jeffrey Nichols Carnegie Mellon University Intel Research Seattle Workshop #5: Multi-Device.](https://reader036.fdocuments.net/reader036/viewer/2022081518/5514672e5503462d4e8b5bce/html5/thumbnails/1.jpg)
Automatically Generating Interfaces for Multi-Device Environments
Jeffrey NicholsCarnegie Mellon University • Intel Research Seattle
Workshop #5: Multi-Device Interfaces for Peripheral InteractionThe Fifth International Conference on Ubiquitous ComputingSeattle, Washington USA
![Page 2: Automatically Generating Interfaces for Multi-Device Environments Jeffrey Nichols Carnegie Mellon University Intel Research Seattle Workshop #5: Multi-Device.](https://reader036.fdocuments.net/reader036/viewer/2022081518/5514672e5503462d4e8b5bce/html5/thumbnails/2.jpg)
2
My Problem
Appliances are too complex
![Page 3: Automatically Generating Interfaces for Multi-Device Environments Jeffrey Nichols Carnegie Mellon University Intel Research Seattle Workshop #5: Multi-Device.](https://reader036.fdocuments.net/reader036/viewer/2022081518/5514672e5503462d4e8b5bce/html5/thumbnails/3.jpg)
3
Interfaces
Control
Feedback
Specifications
My Solution
Separate the interface from the appliance!
Several ways to separate interfaces• Pre-programmed interfaces on mobile device• Downloadable pre-designed interfaces• Automatic interface generation
![Page 4: Automatically Generating Interfaces for Multi-Device Environments Jeffrey Nichols Carnegie Mellon University Intel Research Seattle Workshop #5: Multi-Device.](https://reader036.fdocuments.net/reader036/viewer/2022081518/5514672e5503462d4e8b5bce/html5/thumbnails/4.jpg)
4
1. Single UI device controlling one or more appliances
Three Multi-Device Interactions
![Page 5: Automatically Generating Interfaces for Multi-Device Environments Jeffrey Nichols Carnegie Mellon University Intel Research Seattle Workshop #5: Multi-Device.](https://reader036.fdocuments.net/reader036/viewer/2022081518/5514672e5503462d4e8b5bce/html5/thumbnails/5.jpg)
5
Three Multi-Device Interactions1. Single UI device controlling one or more
appliances2. Multiple users controlling an appliance
![Page 6: Automatically Generating Interfaces for Multi-Device Environments Jeffrey Nichols Carnegie Mellon University Intel Research Seattle Workshop #5: Multi-Device.](https://reader036.fdocuments.net/reader036/viewer/2022081518/5514672e5503462d4e8b5bce/html5/thumbnails/6.jpg)
6
Three Multi-Device Interactions1. Single UI device controlling one or more
appliances2. Multiple users controlling an appliance3. One user using multiple UI devices to control an
appliance
![Page 7: Automatically Generating Interfaces for Multi-Device Environments Jeffrey Nichols Carnegie Mellon University Intel Research Seattle Workshop #5: Multi-Device.](https://reader036.fdocuments.net/reader036/viewer/2022081518/5514672e5503462d4e8b5bce/html5/thumbnails/7.jpg)
7
Personal Universal Controller (PUC)
We have built an automatic interface generation system
• Abstract specification language
• Interface generators for multiple platforms
• PocketPC• TabletPC (Desktop)• Smartphone• Speech (with “Speech Graffiti”
platform)
• Architecture for controlling real appliances
• Windows Media Player (shown)
• Sony DV Camcorder• Axis UPnP Pan-Tilt Camera• Lutron and X10 Lighting• Many others…
![Page 8: Automatically Generating Interfaces for Multi-Device Environments Jeffrey Nichols Carnegie Mellon University Intel Research Seattle Workshop #5: Multi-Device.](https://reader036.fdocuments.net/reader036/viewer/2022081518/5514672e5503462d4e8b5bce/html5/thumbnails/8.jpg)
8
Multi-Device UI and the PUC
PUC supports all three multi-device interactions
Third interaction could be improved however• Support for a fluid user experience
Controllers need to know what others are doing
E.g. When light controls are used on one device, other devices also display light controls
• SpecializationCurrently each controller provides access to all appliance functionality with roughly the same structure
Each controller should specialize; provide better access to features that will be accessed from its type of interface
Access to all features should be maintained
![Page 9: Automatically Generating Interfaces for Multi-Device Environments Jeffrey Nichols Carnegie Mellon University Intel Research Seattle Workshop #5: Multi-Device.](https://reader036.fdocuments.net/reader036/viewer/2022081518/5514672e5503462d4e8b5bce/html5/thumbnails/9.jpg)
9
AcknowledgementsFunding
• National Science Foundation• Microsoft• General Motors• Pittsburgh Digital
Greenhouse
Equipment Grants• Mitsubishi (MERL)• VividLogic• Symbol Technologies• Hewlett-Packard• Lucent• Lutron• Lantronix
PUC Project Members• Brad A. Myers• Kevin Litwack• Thomas K. Harris• Roni Rosenfeld• Michael Higgins• Joseph Hughes• Rajesh Seenichamy• Mathilde Pignol• Stefanie Shriver• Pegeen Shen• Jeffrey Stylos• Suporn Pongnumkul• Peter Lucas
![Page 10: Automatically Generating Interfaces for Multi-Device Environments Jeffrey Nichols Carnegie Mellon University Intel Research Seattle Workshop #5: Multi-Device.](https://reader036.fdocuments.net/reader036/viewer/2022081518/5514672e5503462d4e8b5bce/html5/thumbnails/10.jpg)
Thanks for listening!
For more information…http://www.cs.cmu.edu/~pebbles/puc/http://www.cs.cmu.edu/~jeffreyn/