CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp...
Transcript of CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp...
![Page 1: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/1.jpg)
1
Special Topics in Ubiquitous and Cognitive ComputingCSE5390 & 7390
Tangible User InterfacesEric C. Larson, Lyle School of Engineering,
Computer Science and Engineering, Southern Methodist University 11
![Page 2: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/2.jpg)
class logistics• P1 Due this Friday by 5PM
• no class this Thursday!
• next up for lecture: Danh, Luke, Alex
• natural gestures
• how were flipped lecture videos last time?
2
![Page 3: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/3.jpg)
presenting discussion• I am sitting in the audience
• but I still start lecture…
• you summarize the points of the paper
• trade off as often as possible: don’t divide by section
• bring in your own stories
• use contemporary issues, examples
• open up debate
• less text >= lots of text
3
![Page 4: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/4.jpg)
presenting discussion• these papers are different: less vision; more building
• how does it fit into the vision of ubicomp?
• motivate the work like you wrote it (own the paper)
• explain what was built or evaluated (and if you liked it)
• is it good science or just a novel idea?
• what can we learn from it?
4
![Page 5: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/5.jpg)
UbiComp Visions• lots of talking thus far, no real apps - is this how you guys feel?
5
say Weiser’s vision again!
![Page 6: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/6.jpg)
agenda• tangible bits then and now (ish)
6
![Page 7: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/7.jpg)
tangible bits• Hiroshi Ishii, Associate Director of the MIT Media Lab
7
the development of tangible interfaces requires the rigor of both scientific and artistic review
![Page 8: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/8.jpg)
tangible bits• to make the digital bits of information tangible and graspable, physically-
embodied digital information in physical space
• 1997:
• computer beats chess world champion (at chess)
• steve jobs returns to apple
• end of oklahoma city bombing trial
• 2008:
• obama elected president
• heath ledger dies
• tornado in burma; earthquakes in china
8
![Page 9: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/9.jpg)
tangible bits
9
tangible bits is about scientific art projectsconceived in such a way to be visionary
which lasts generations…
![Page 10: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/10.jpg)
art and science
10
![Page 11: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/11.jpg)
tangible bits 1997• claim is that it is different than ubiquitous computing
• thesis: tangible interfaces afford more traditional interaction and are naturally ubiquitous
• ubicomp genre: interaction
• “Interactions between people and cyberspace are now largely confined to traditional GUI-based boxes sitting on desktops or laptops. The interactions with these GUIs are separated from the ordinary physical environment within which we live and interact.”
11
![Page 12: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/12.jpg)
TUI example 1: metaDESK
12
![Page 13: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/13.jpg)
TUI example 1: metaDESK
13
what are tangible equivalents of other UI design elements?
modal image
list box
toggles
date/time picker
breadcrumbs
notifications
![Page 14: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/14.jpg)
TUI example 2: ambientROOM
14
• tangible gives better affordances
• when constant, we tune it out
• changes trigger attention
• would this be a better way to get notifications?
• TUI3: they also did transBOARD
• but it wasn’t all that compelling
![Page 15: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/15.jpg)
TUI example 2: ambientROOM
15
![Page 16: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/16.jpg)
strengths / weaknesses
16
• explored an unprecedented number of new interactions techniques
• extremely technical implementations without technical baggage
• but this also hides deficiency in the design
• how many people thought all these things were created and usable?
• visionary in that it codified a field of existing research and made it into a field of HCI
• created the field of tangible computing
• tangible UIs are limited in a way that pixels are not
![Page 17: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/17.jpg)
tangible bits 2008• claim TUI are appropriate for many spaces, but not general
computing
• thesis: application space of TUIs is mature and we are ready to move to the next phase
• ubicomp genre: interaction and vision
• “Where the sea meets the land, life has blossomed into a myriad of unique forms in the turbulence of water, sand, and wind. At another seashore between the land of atoms and the sea of bits, we are now facing the challenge of reconciling our dual citizenships in the physical and digital worlds.”
17
![Page 18: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/18.jpg)
tangible bits 2008
18
• TUI has many genres for applications:
• tangible telepresence
• kinetic memory
• constructive assembly
• tokens and constraints
• tabletop surfaces
• continuous plastic (deformable)
• augmented everyday objects
• ambient media
slides provided by Hiroshi Ishii
![Page 19: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/19.jpg)
designing tangible bits
19
• build on design through MVC
• defines how each element communicates
model
view
controller
controller has direct reference to view and model
view “targets” generic controller from actions
model “radios” to subscribers
![Page 20: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/20.jpg)
designing tangible bits
20
• build on design through MVC
• defines how each element communicates
digital information
tangible view
controller
info “radios” to subscribers
view “targets” generic controller from actions
controller has direct reference to view and model, interprets collisions
intangible viewvisual/force feedback
![Page 21: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/21.jpg)
21
tangible view
intangible view
design gets complicated quickly
![Page 22: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/22.jpg)
properties of a tangible view
22
• often NOT visual changes that get conveyed
• weight
• size
• temperature
• texture
• springy-ness
• sound
• shadow
tangible view
excellent affordances:
plus the tactile
representation in our brain!
![Page 23: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/23.jpg)
an example of tangible
23
![Page 24: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/24.jpg)
vision should not be ignored
24
![Page 25: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/25.jpg)
25
Through the design of a variety of TUIs, however, we have learned that TUIs are limited by the rigidity
of “atoms” in comparison with the fluidity of “bits”.
TUIs have limited ability to change the form or properties of physical objects in real time. This constraint can make the physical state of TUIs inconsistent with the underlying digital models.
the elephant in the room
![Page 26: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/26.jpg)
26
![Page 27: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/27.jpg)
27
a vision for 100 years
![Page 28: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/28.jpg)
28
a vision for 100 years
![Page 29: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/29.jpg)
29
a vision for 100 years
![Page 30: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/30.jpg)
for next class...• Thursday: no class!
• Tuesday: first student lead discussion
• natural user interfaces
30
![Page 31: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/31.jpg)
31
Special Topics in Ubiquitous and Cognitive ComputingCSE5390 & 7390
Tangible User InterfacesEric C. Larson, Lyle School of Engineering,
Computer Science and Engineering, Southern Methodist University 3131
![Page 32: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/32.jpg)
phantom haptics: leveraging the digital
CSE5390 & 7390 Special Topics in Ubiquitous Computing 32
• thesis: richer haptic output can be achieved
• ubicomp genre: interaction
• problem: creating phantom sensations from a vibration array
![Page 33: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/33.jpg)
phantom haptics: technique
CSE5390 & 7390 Special Topics in Ubiquitous Computing 33
![Page 34: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/34.jpg)
phantom haptics: evaluation
CSE5390 & 7390 Special Topics in Ubiquitous Computing 34
• four users
• various continuous motions
• “clarity” of creeping effect was then evaluated
![Page 35: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/35.jpg)
strengths and weaknesses
CSE5390 & 7390 Special Topics in Ubiquitous Computing 35
• work in progress
• weak user study
• interesting idea, with good motivation
• no control case
• limited to entertainment
• only on back!
![Page 36: CSE5390 & 7390lyle.smu.edu/~eclarson/teaching/ubicomp/spring2016/... · 2016-02-03 · • ubicomp genre: interaction and vision • “Where the sea meets the land, life has blossomed](https://reader034.fdocuments.net/reader034/viewer/2022043000/5f77a8a1da1e0a2d6f034fcd/html5/thumbnails/36.jpg)
more tangible bits
36