Designing Grounded Interfaces

52
Drew Harry Designing Grounded Interfaces MIT Media Lab Speech + Mobility Thursday, December 16, 2010

description

In this talk, I'll show how we might apply some of the lessons of Herb Clark's model of conversational grounding to designing systems that support interactions between distributed groups of users. I'll use this model to frame two specific designs that use shared physical displays to build a better shared understanding among groups: • backchan.nl uses a projection to collect audience questions and comments, ensuring that audiences and panelists are on the same page about what the audience's interests are. • Tin Can grounds distributed meeting participants' ideas about discussion topics, tasks, and how meeting time is being spent by visualizing current meeting state on iPads in each meeting location. Video of this presentation is available here: http://bcove.me/0cnm6kso

Transcript of Designing Grounded Interfaces

Page 1: Designing Grounded Interfaces

Drew Harry

Designing Grounded Interfaces

MIT Media LabSpeech + Mobility

Thursday, December 16, 2010

Page 2: Designing Grounded Interfaces

All collective actions are built on common ground and its accumulation.

Clark and Brennan, 1991

Thursday, December 16, 2010

Page 3: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n

573573

Thursday, December 16, 2010

Page 4: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n

What is common ground?

Thursday, December 16, 2010

Page 5: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n

A B

C

Thursday, December 16, 2010

Page 6: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n

Common Ground

Thursday, December 16, 2010

Page 7: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n

How do we add to common ground?

Thursday, December 16, 2010

Page 8: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n

...establish for each utterance the mutual belief that the addressees have understood what the speaker meant...

Clark and Schaefer, 1987

Thursday, December 16, 2010

Page 9: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n

Presentation Acceptance

Contribution

Acknowledgement

Relevant Next Turn

Continued Attention

Thursday, December 16, 2010

Page 10: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n Clark and Schaefer, 1987Thursday, December 16, 2010

Page 11: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n Clark and Schaefer, 1987Thursday, December 16, 2010

Page 12: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n

Presentation

Acceptance

Con

tributio

n

CommonGround

Thursday, December 16, 2010

Page 13: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n

Formulation

Production

Reception

Start-up

Delay

Speaker Change

Display

Repair

Thursday, December 16, 2010

Page 14: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n

How can we make it easier to add to common ground?

Thursday, December 16, 2010

Page 15: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n

What’s already part of common ground when a conversation starts?

Thursday, December 16, 2010

Page 16: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n

Identity

Environment

Thursday, December 16, 2010

Page 17: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n

Adding information to the environment can make it part of common ground.

Thursday, December 16, 2010

Page 18: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n flickr/jm3Thursday, December 16, 2010

Page 19: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n flickr/edmittanceThursday, December 16, 2010

Page 20: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n flickr/cubicgardenThursday, December 16, 2010

Page 21: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n

Adding information to the environment can make it part of common ground.

Thursday, December 16, 2010

Page 22: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n

How can we improve question asking at panels and presentations?

Harry, Green, and Donath 2008

Thursday, December 16, 2010

Page 23: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n

How can we create common ground between presenters and their audiences?

Harry, Green, and Donath 2008

Thursday, December 16, 2010

Page 24: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n

Presenter AudiencePresentation

Acceptance

Thursday, December 16, 2010

Page 25: Designing Grounded Interfaces

flickr/opacity

Thursday, December 16, 2010

Page 26: Designing Grounded Interfaces

Thursday, December 16, 2010

Page 27: Designing Grounded Interfaces

Thursday, December 16, 2010

Page 28: Designing Grounded Interfaces

Thursday, December 16, 2010

Page 29: Designing Grounded Interfaces

Thursday, December 16, 2010

Page 30: Designing Grounded Interfaces

Thursday, December 16, 2010

Page 31: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n

Thursday, December 16, 2010

Page 32: Designing Grounded Interfaces

flickr: paigebuiltThursday, December 16, 2010

Page 33: Designing Grounded Interfaces

“I would love to hear more about buzz marketing - how it actually works and how clients want it to integrate it with more traditional methods”

“What’s the role of Social Media in advertising and Convergence Culture”

“What affect does the ephemeral nature of your art (changes in technology, disappearing technologies) have on your art practice?”

“Moot, what is your favorite 4chan meme?”

McCarthy, J.F. 2005

Work

Thursday, December 16, 2010

Page 34: Designing Grounded Interfaces

“Is anyone else cold?”

“::abuses backchannel:: Someone lost a Lumix camera yesterday. Find Susannah on the ROFLTeam to describe it/pics on it.”

“So, is NOW the time the panel should turn some attention to these excellent user-generated questions?”

“We need power strips in these seats!”

Logistics

McCarthy, J.F. 2005Thursday, December 16, 2010

Page 35: Designing Grounded Interfaces

“Can we get some more questions from the board answered this time? xthxbye”

How has your web-based and viral advertising work affected your work in traditional advertising?

so i herd u liek mudkipz

hard to hear :(

Did he just cite Eisner?

Props for stirring the pot!

High Rank Low Rank

Thursday, December 16, 2010

Page 36: Designing Grounded Interfaces

flickr: paigebuiltThursday, December 16, 2010

Page 37: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n flickr/Tom PurvesThursday, December 16, 2010

Page 38: Designing Grounded Interfaces

Rekimoto, et al 1998 flickr/pfhyperThursday, December 16, 2010

Page 39: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n

Thursday, December 16, 2010

Page 40: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n

How can we create common ground among meeting participants?

Thursday, December 16, 2010

Page 41: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n

4 3

1

1

Thursday, December 16, 2010

Page 42: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n

Speaker Change

Thursday, December 16, 2010

Page 43: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n

4 3

1

1

Thursday, December 16, 2010

Page 44: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n

4 3

1

1

Thursday, December 16, 2010

Page 45: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n

Tasks Topics

Time

Thursday, December 16, 2010

Page 46: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n

Demo!

Thursday, December 16, 2010

Page 47: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n

Create new kinds of relevant turns.

Thursday, December 16, 2010

Page 48: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n

Create new ways to show continued attention.

Thursday, December 16, 2010

Page 49: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n

Future Directions

Thursday, December 16, 2010

Page 50: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n

How can we make it easier to add to common ground?

Adding information to the environment can make it part of common ground!

Thursday, December 16, 2010

Page 51: Designing Grounded Interfaces

Com

mon

Gro

un

dback

chan

.nl

Tin

Can

Con

clusio

n

Thinking in terms of common ground can help identify both problems and solutions.

Thursday, December 16, 2010