Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS ›...
Transcript of Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS ›...
![Page 1: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/1.jpg)
1
Ubiquitous computing: a call for plasticity!
Gaëlle Calvary Grenoble INP Laboratory of Informatics of Grenoble (LIG)
![Page 2: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/2.jpg)
Ubiquitous computing
2 © G. Calvary
![Page 3: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/3.jpg)
Ubiquitous computing
3 © G. Calvary [Lyytinen 2002]
![Page 4: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/4.jpg)
Ubiquitous computing
4 © G. Calvary [Lyytinen 2002]
Smart window, Samsung
![Page 5: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/5.jpg)
Ubiquitous computing
5 © G. Calvary [Lyytinen 2002]
[The Economist 2007]
![Page 6: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/6.jpg)
Ubiquitous computing
6 © G. Calvary [Lyytinen 2002]
![Page 7: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/7.jpg)
• Display surfaces every where: fixed surfaces
Blue sky demonstrators
7 © G. Calvary
[Crowley 2004]
![Page 8: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/8.jpg)
Blue sky demonstrators
• Display surfaces every where: mobile inert surfaces
8 © G. Calvary
[Borkowski 2004]
![Page 9: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/9.jpg)
• Display surfaces every where: mobile mostly inert surfaces
Blue sky demonstrators
9 © G. Calvary [Mistry 2009]
![Page 10: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/10.jpg)
• Display surfaces every where: mobile embodied surfaces
Blue sky demonstrators
10 © G. Calvary [Harrison 2010]
[Antaniac 2002]
![Page 11: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/11.jpg)
• Display surfaces every where: flexible extensible surfaces
Blue sky demonstrators
11 © G. Calvary
![Page 12: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/12.jpg)
• Display surfaces every where: composable surfaces
Blue sky demonstrators
12 © G. Calvary
[Hinckley 2003]
![Page 13: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/13.jpg)
• Display surfaces every where: dynamic composition of entities
Blue sky demonstrators
13 © G. Calvary
[Rekimoto 2001]
![Page 14: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/14.jpg)
Question 1
• What about the gap between research and real life?
14 © G. Calvary
![Page 15: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/15.jpg)
Exercice 1
• Let’s imagine a valuable ubiquitous system …
15 © G. Calvary
![Page 16: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/16.jpg)
Research question
• How to cope with this • Diversity • Variability • Unforeseeability
• Of both • The context of use (user, platform, environment) • The user’s goal?
16 © G. Calvary
![Page 17: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/17.jpg)
Approach 1: ad-hoc
• To develop the systems on a case per case basis (ad-hoc manner) • Development cost and maintenance: very high! • Not consistent versions!
17 © G. Calvary
![Page 18: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/18.jpg)
Exercice 2: Let’s analyze the two systems
• Google maps on PC vs on Ipad
18 © G. Calvary
![Page 19: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/19.jpg)
Approach 2: plasticity
• Approach2: to improve the methods and tools in order to support • Portability • Reusability • Modifiability • Scalability in terms of
o Computing resources o Services o Interaction techniques
=> Plasticity
19 © G. Calvary
![Page 20: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/20.jpg)
20
Plasticity: definition
• Capacity of a User Interface (UI) • To adapt • To its context of use • While preserving user-centered properties [Thevenin 99]
![Page 21: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/21.jpg)
Plasticity: example?
• FlexClock [Grolaux 01]
21 © G. Calvary
![Page 22: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/22.jpg)
Plasticity: example?
• FlexClock [Grolaux 01]
22
Nothing is or
is not plastic per se!
![Page 23: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/23.jpg)
Exercice 3
• Let’s go for a series of questions • 1. Is adaptation plasticity? • 2. Is plasticity automatic? • 3. Is temperature part of the context of use?
23 © G. Calvary
![Page 24: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/24.jpg)
Plasticity: example
• CamNote [Coutaz 2012]
24 © G. Calvary
![Page 25: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/25.jpg)
Plasticity: example
• Sedan Bouillon [Coutaz 2012]
25 © G. Calvary
![Page 26: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/26.jpg)
26
Plasticity: definition
• Context of use • No general definition
« There is no context without context »
• For plasticity « Any information that may inform the adaptation process » o User o Platform o Environment
« Any information peripheral to the user’s task but that may have an impact on it! »
P. Brézillon
Adaptation … context of use
… properties
![Page 27: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/27.jpg)
27
Plasticity: definition
• Adaptation
Style
Adaptation … context of use
… properties
![Page 28: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/28.jpg)
28
Plasticity: definition
• Adaptation
Style
Interaction modality: < channel, device, language >
Adaptation … context of use
… properties
![Page 29: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/29.jpg)
29
Plasticity: definition
• Adaptation
Style
Structure
Adaptation … context of use
… properties
Interaction modality: < channel, device, language >
![Page 30: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/30.jpg)
30
Plasticity: definition
• Adaptation
Style
Remolding Structure
Task
Adaptation … context of use
… properties
Interaction modality: < channel, device, language >
![Page 31: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/31.jpg)
31
Plasticity: definition
• Adaptation
Style
Remolding
Redistribution
Structure
Task
Partial/total migration
Adaptation … context of use
… properties
Remolding
Interaction modality: < channel, device, language >
![Page 32: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/32.jpg)
32
Plasticity: definition
• Adaptation
Remolding
Redistribution
Style
Structure
Task
Partial/total migration
A large set of possibilities
Adaptation … context of use
… properties
Interaction modality: < channel, device, language >
![Page 33: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/33.jpg)
33
Plasticity: definition
• User-centered properties • Utility • Usability • … Worth [Cockton 2006]
• + Inter-usability! [Karsenty 2005]
Adaptation … context of use
… properties
A difficult decision process
even at design time
![Page 34: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/34.jpg)
34
Context of use
User task Constant
Static & planned
Dynamic & planned
Unplanned
Plasticity: evolution of research
![Page 35: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/35.jpg)
35
Context of use
User task Constant
Static & planned
Dynamic & planned
Unplanned
Latent
Plasticity: evolution of research
![Page 36: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/36.jpg)
36
Context of use
User task Constant
Static & planned
Dynamic & planned
Unplanned
Latent Emergent
Plasticity: evolution of research
![Page 37: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/37.jpg)
37
Context of use
User task Constant
Static & planned
Dynamic & planned
Unplanned
Latent Emergent
Challenge
Plasticity: evolution of research
![Page 38: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/38.jpg)
References
• Lyytinen, K., Yoo, Y.: Research commentary: the next wave of nomadic computing. Information Systems Research 13 (2002) 377-388
• S. Borkowski, J. Letessier, and J.L. Crowley, Spatial Control of Interactive Surfaces in an Augmented Environment. ;In Proceedings of EHCI/DS-VIS. 2004, 228-244.
• P. Mistry, P. Maes. SixthSense – A Wearable Gestural Interface. In the Proceedings of SIGGRAPH Asia 2009, Sketch. Yokohama, Japan. 2009
• Antoniac, P., Pulli, P., Kuroda,T., Bendas, D., Hickey, S., Sasaki, H. Wireless User Perspectives in Europe: HandSmart Mediaphone Interface, Wireless Personal Communications, Vol. 22, pp. 161-174, 2002
38 © G. Calvary
![Page 39: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/39.jpg)
References
• Harrison, C., Tan, D. Morris, D. 2010. Skinput: Appropriating the Body as an Input Surface. In Proceedings of the 28th Annual SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, April 10 - 15, 2010). CHI '10. ACM, New York, NY. 453-462
• Hinckley, K., Ramos, G., Guimbretiere, F., Baudisch, P., and Smith, M. Synchronous Gestures for Multiple Persons and Computers. In Proc. UIST 2003 Symp. on User interface Software and Technology, Vancouver, Canada, pp. 149-158
• Jun Rekimoto, Brygg Ullmer, Haruo Oba, Proceedings ofCHI '01, pp 269 - 276 ACM New York
• Thevenin, D., Coutaz, J. Plasticity of User Interfaces: Framework and Research Agenda. In Proc. Interact’99, Edinburgh, Sasse, A., Johnson, C. Eds, IFIP IOS Press Publ., 1999, pp.110-117
39 © G. Calvary
![Page 40: Ubiquitous computing: a call for plasticity!iihm.imag.fr › calvary › UIS-MCAIS › 1-plasticity-def.pdf · • User-centered properties • Utility • Usability • … Worth](https://reader030.fdocuments.net/reader030/viewer/2022041113/5f20e8c0ad0c1642554dcf34/html5/thumbnails/40.jpg)
References
• Donatien Grolaux, Peter Van Roy, Jean Vanderdonckt: FlexClock, a Plastic Clock Written in Oz with the QTk toolkit, TAMODIA 2002: 135-142
• J. Coutaz, G. Calvary HCI and Software Engineering for User Interface Plasticity (2012) In The Human Computer Handbook - Fundamentals, Evolving Technologies, and Emerging Applications, 3rd edition, Julie A. Jacko Ed.
• Gilbert Cockton, Designing Worth is Worth Designing, NordiCHI 2006
• Karsenty, L., Botherel, V. Analyse empirique de l’inter-utilisabilité d’un service multisupport Web et onferenc. Actes des Deuxièmes Journées Francophones sur l’Ubiquité et la Mobilité (UbiMob’05), Grenoble, 31 Mai-3 Juin 2005, ACM Press
40