Off the Page Into the Wild: Designing For the Internet of Things
description
Transcript of Off the Page Into the Wild: Designing For the Internet of Things
5/12/14
OFF THE PAGE, INTO THE WILD DESIGNING FOR THE INTERNET OF THINGS !!!DAVID SHERWIN | @CHANGEORDER JENNIFER DUNNAM | @JDUNNAM !!HOW DESIGN CONFERENCE 2014
THIS IS WHAT WE’RE FAMOUS FOR
THIS IS WHAT WE DO NOW
WE <3 IoT!4
Image&Credit:&h.p://www.marke4ngtechblog.com/the:internet:of:things/
!5
!6
!7
!8
!9
!10
!11
!12
SESSION OVERVIEW
WHAT IS THE IoT? TOOLS WE USE
1. ECOSYSTEMS 2. BEHAVIORS 3. STORIES
WRAP UP Q&A
!13
WHAT IS THE IoT?
IT’S MORE THAN SIMPLY SMART OBJECTS
Image&Credit:&h.p://veni4sm.blogspot.com/2013/05/the:internet:of:things.html
IT’S A WORLD OF CONNECTED THINGS
THE ‘PHYSICAL GRAPH’ IS STARTING TO TAKE SHAPE
THERE’S SO MUCH MORE THAN MEETS THE EYE
BENEATH THE SURFACE LIES A NEW DOMAIN FOR DESIGN
!21
LET’SPRETEND TO BE THE IoT
DEVICE COMMUNICATION AND DATA SHARING IS FUNDAMENTAL TO THE INTERNET OF THINGS
DEVICES WITHIN THE INTERNET OF THINGS HAVE DIFFERENT CAPABILITIES
smart&objectCARGPS & location services
PORTABLE SPEAKERWi-Fi triangulation
THERMOSTATTemperature, humidity
TABLETAccelerometer, GPS & location services, Wi-Fi triangulation, camera
SMARTPHONEAccelerometer, GPS & location services, Wi-Fi triangulation, camera
FITNESS BANDAccelerometer, heart rate, sleep patterns
SMART TVCamera
LAPTOPWi-Fi triangulation, camera
CARGPS & location services
PORTABLE SPEAKERWi-Fi triangulation
THERMOSTATTemperature, humidity
TABLETAccelerometer, GPS & location services, Wi-Fi triangulation, camera
SMARTPHONEAccelerometer, GPS & location services, Wi-Fi triangulation, camera
FITNESS BANDAccelerometer, heart rate, sleep patterns
SMART TVCamera
LAPTOPWi-Fi triangulation, camera
smart&object&with&cloud&connec3vity
!24
THERE ARE 10 TABLES IN THE ROOM THAT ARE LABELED AS SMART OBJECTS
shoe&pedometer
wrist&sensor
skin&sensor
heart&monitor
home&thermostat
smart&pillow
smart&weigh&scale
smart&alarm&clock
smart&refrigerator
smart&pill&bo:le
pa3ent doctor
!25
EACH OF THESE TABLES HAS A BEACH BALL TO REPRESENT A BIT OF COLLECTED DATA
shoe&pedometer
heart&monitor
home&thermostat
smart&pillow
smart&scale
smart&alarm&clock
smart&refrigerator
smart&pill&bo:le
pa3ent doctor
wrist&sensor
skin&sensor
!26
THERE ARE FOUR TABLES LABELED AS CLOUD OBJECTS WITHIN THE ROOM
shoe&pedometer
heart&monitor
home&thermostat
smart&pillow
smart&scale
smart&alarm&clock
smart&refrigerator
smart&pill&bo:le
pa3ent doctor
cloud cloud cloud cloud
wrist&sensor
skin&sensor
!27
pa3ent doctor
HOW COULD A DOCTOR & PATIENT LEVERAGE DATA FROM SMART OBJECTS?
!28
STEP 1: WRITE A BIT OF INFORMATION ON THE BEACH BALL TO DESCRIBE SOMETHING YOU COULD SENSE ABOUT A PERSON’S HEALTH
smart&pillow
Irregular sleep
patterns during past
week
2 MINUTES
!29
STEP 2: SEND THAT INFORMATION TO THE CLOSEST CLOUD
cloudsmart&pillow
Irregular sleep
patterns during past
week
1 MINUTE
!30
STEP 3: FROM THE CLOUD, SEND THE INFORMATION BALL UP TO THE FRONT FOR THE DOCTOR TO REVIEW
cloud
doctor
Irregular sleep
patterns during past
week
1 MINUTE
THE INTERNET OF THINGS IS HERE TO STAY
Image&Credit:&h.p://www.psC.com/2014/03/internet:of:things:infographic.html#!MsfBf
!33
YIKES
HUMAN SYSTEMS OF COMMUNICATION ARE BEING INFLUENCED BY THE DISTRIBUTED COMMUNICATION INHERENT TO THE INTERNET
SCARY?
!35
WE NO LONGER LIVE IN A DISCONNECTED WORLD
!36
UBIQUITOUS, FLEXIBLE COMPUTING IS A NORM
Image&Credit:&h.p://blogs.cisco.com/ioe/cisco:iox:an:applica4on:enablement:framework:for:the:internet:of:things/
COMMUNICATION & COLLABORATION ACCELERATES
Image&Credit:&h.p://bryansmith1138.com/2014/01/30/column:get:off:your:cell:phones/
THE IoT CAN EMPOWERHUMANS IN WAYSTHAT INCREASE THE QUALITY OF HOW WE LIVE THEIR LIVES
NOT SCARY
DESIGNERS AREUNIQUELY POSITIONEDAND SKILLED TOMAKE THE IoTHUMAN CENTERED
INSPIRING, IMHO
TOOLSWE USE
!41
GRAB THIS WORKSHEET
!42
CLIENT CHALLENGE:
YOUR CLIENT HAS HIRED YOU TO DESIGN A NEW MUSIC APPLICATION THAT IS ABLE TO DETECT PEOPLE’S ROUTINES AND PLAY MUSIC ACCORDINGLY.
!43
CLIENT CHALLENGE:
THE APPLICATION CAN READ DATA FROM ANY DEVICE THEY ARE USING TO MAKE THAT POSSIBLE.
TOOLS WE USE !
1. ECOSYSTEMS
!44
!45
SIGNAL VIA WIREINVENTED BY
SOEMMERING & CAMPILLO
IMPLEMENTEDBY COOKE & OTHERS
IT USED TO BE SO SIMPLE…
POINT A
POINT B
!46
!47
ACK
!48
X10000000000000000000
!49
“THIS S%@T IS COMPLICATED.”— ME
!50
TOOL 1: ECOSYSTEM MAPPING
!51
1. LIST YOUR ENTITIES
DEVICES WHAT DEVICESWILL BE USED BY THOSE PEOPLE AND ACCESS OR TRANSMIT DATA?
SERVICES WHAT APPS AND SERVICES ARE PEOPLE USING ON THIS DEVICE?
PEOPLE WHO IS USING DEVICES IN YOUR ECOSYSTEM?
!52
1. LIST YOUR ENTITIES
PEOPLE PERSONA 1PERSONA 2PERSONA 3PERSONA 4 …?
DEVICES SMARTPHONETABLETLAPTOP/PCSMART TVTHERMOSTATAUDIO SPEAKERFITNESS BANDCAR …?
SERVICES STREAMING MEDIA CLOUD LOCKERINTERNET RADIO SOCIAL MEDIA …?
!53PERSONA
2. SELECT A PERSONA
!54PERSONA
Joanna is a 37-year-old nurse that works in a hospital emergency room in Sioux Falls, Idaho. She lives in a three bedroom house, where she
takes care of her four-year-old daughter and cat.
Joanna’s needs around music enjoyment include making sure the music she plays at home is kid-safe,
discovering new high-energy songs for when she exercises, and staying awake when driving home.
!55
CARGPS & location services
PORTABLE SPEAKERWi-Fi triangulation
THERMOSTATTemperature, humidity
TABLETAccelerometer, GPS & location services, Wi-Fi triangulation, camera
SMARTPHONEAccelerometer, GPS & location services, Wi-Fi triangulation, camera
FITNESS BANDAccelerometer, heart rate, sleep patterns
SMART TVCamera
LAPTOPWi-Fi triangulation, camera
WE LIKE TO ARRANGE THEM BY FREQUENCY OF ACCESS.
3. PLACE THE DEVICES
!56
CARGPS & location services
PORTABLE SPEAKERWi-Fi triangulation
THERMOSTATTemperature, humidity
TABLETAccelerometer, GPS & location services, Wi-Fi triangulation, camera
SMARTPHONEAccelerometer, GPS & location services, Wi-Fi triangulation, camera
FITNESS BANDAccelerometer, heart rate, sleep patterns
SMART TVCamera
LAPTOPWi-Fi triangulation, camera
DEVICES AND ENVIRONMENTAL SENSORS PROVIDE IMPORTANT DATA TO YOU.
4. IDENTIFY SENSORS
!57
CARGPS & location services
PORTABLE SPEAKERWi-Fi triangulation
THERMOSTATTemperature, humidity
TABLETAccelerometer, GPS & location services, Wi-Fi triangulation, camera
SMARTPHONEAccelerometer, GPS & location services, Wi-Fi triangulation, camera
FITNESS BANDAccelerometer, heart rate, sleep patterns
SMART TVCamera
LAPTOPWi-Fi triangulation, camera
CLOUD LOCKER (i.e. iTunes Match)
STREAMING MUSIC LIBRARY (i.e. Spotify)
INTERNET RADIO (i.e. Pandora)
SOCIAL NETWORKS (i.e. Facebook, Twitter)
5. LIST AVAILABLE SERVICES
!58
CARGPS & location services
PORTABLE SPEAKERWi-Fi triangulation
THERMOSTATTemperature, humidity
TABLETAccelerometer, GPS & location services, Wi-Fi triangulation, camera
SMARTPHONEAccelerometer, GPS & location services, Wi-Fi triangulation, camera
FITNESS BANDAccelerometer, heart rate, sleep patterns
SMART TVCamera
LAPTOPWi-Fi triangulation, camera
CLOUD LOCKER (i.e. iTunes Match)
STREAMING MUSIC LIBRARY (i.e. Spotify)
INTERNET RADIO (i.e. Pandora)
SOCIAL NETWORKS (i.e. Facebook, Twitter)
6. DRAW THE RELATIONSHIPS
!59
DOING THIS TAKES TIME. BUT IT SERVES AS YOUR FOUNDATION FOR THE ENTIRE IoT DESIGN PROCESS.
AND IT KEEPS THINGS LIKE THIS FROM HAPPENING
!61
TOOLS WE USE !
1. ECOSYSTEMS 2. BEHAVIORS
“DESIGNERS NEED TO BE AT THE FRONT END OF THE SENSOR TRANSITION, SO THEY CAN HUMANIZE IT.”
— TIMOTHY MOREY, AVP OF STRATEGY, FROG
!62
OUR THINGS GROW SMARTER EVERY DAY
WITH THIS INTELLIGENCE COMES A NEW LANGUAGE FOR COMMUNICATION
BEHAVIORS AND RELATIONSHIPS MUST BE DESIGNED
THE WHOLE WILL BE GREATER THAN THE SUM OF ITS PARTS
TOOL 2:DESCRIBING BEHAVIORS
GET NETWORKED. (WE MEAN: FIND A PARTNER.)
!70
GRAB THIS WORKSHEET
CONNECTED SYSTEMS ARE INTELLIGENT (BUT COMPLEX)
CARGPS & location services
PORTABLE SPEAKERWi-Fi triangulation
THERMOSTATTemperature, humidity
TABLETAccelerometer, GPS & location services, Wi-Fi triangulation, camera
SMARTPHONEAccelerometer, GPS & location services, Wi-Fi triangulation, camera
FITNESS BANDAccelerometer, heart rate, sleep patterns
SMART TVCamera
LAPTOPWi-Fi triangulation, camera
CLOUD LOCKER (i.e. iTunes Match)
STREAMING MUSIC LIBRARY (i.e. Spotify)
INTERNET RADIO (i.e. Pandora)
SOCIAL NETWORKS (i.e. Facebook, Twitter)
THIS COMPLEXITY CAN BE MANAGED THROUGH DESIGN
1. Pick what device would serve as Joanna’s primary touchpoint for controlling her music-listening experience.
2. Identify how Joanna would communicate with that object.
3. List out what data could be passed along to her secondary devices.
4. Outline ideas for how a secondary device would use that data.
When designing for the Internet of Things, we repeat this process for all devices.
•"voice"command"•"hand"gestures"•"facial"recogni4on
•"mood"/"temperament"•"music"selec4on
•"con4nue"the"music"currently"playing"in"car"•"play"music"selec4on"that"aligns"with"her"current"mood
!79
TOOLS WE USE !
1. ECOSYSTEMS 2. BEHAVIORS 3. STORIES
!80
STORIES HELP US ENVISIONTOUCHPOINTS IN AN ECOSYSTEM FROM UNIQUE POINTS OF VIEW
!81
STORIES HELP US ENVISIONTOUCHPOINTS IN AN ECOSYSTEM FROM UNIQUE POINTS OF VIEWTOUCHPOINTS ARE THE INTERFACE BETWEEN PEOPLE & WHAT’S DESIGNED
POINTS OF VIEW ILLUMINATE A PARTICULAR CHARACTER’S PERSPECTIVE—OR PROVIDE A HOLISTIC VIEW OF THE ECOSYSTEM ITSELF
!82
STORIES HELP US ENVISIONTOUCHPOINTS IN AN ECOSYSTEM FROM MULTIPLE POINTS OF VIEW
CARGPS & location services
PORTABLE SPEAKERWi-Fi triangulation
THERMOSTATTemperature, humidity
TABLETAccelerometer, GPS & location services, Wi-Fi triangulation, camera
SMARTPHONEAccelerometer, GPS & location services, Wi-Fi triangulation, camera
FITNESS BANDAccelerometer, heart rate, sleep patterns
SMART TVCamera
LAPTOPWi-Fi triangulation, camera
!83
THIS IS TOO ABSTRACT
!84
EACH STORY YOU CREATEIS A SLICE OF A SYSTEMATICIoT SOLUTION.
!85
EACH STORY YOU CREATEIS A SLICE OF A SYSTEMATICIoT SOLUTION.
!87
STORIES WORK BEST WHEN THEY CONTAIN DETAILS THAT EXPLAIN WHY CHARACTERS CHOOSE TO ACT.
!88
STORIES WORK BEST WHEN THEY CONTAIN DETAILS THAT EXPLAIN WHY CHARACTERS CHOOSE TO ACT.
WHAT IS THEIR MOTIVATION?
!89
STORIES WORK BEST WHEN THEY CONTAIN DETAILS THAT EXPLAIN WHY CHARACTERS CHOOSE TO ACT.
WHAT IS THEIR MOTIVATION? WHAT CONFLICT IS BEING RESOLVED?
!90
WHO IS LOOKING AT THIS?
!91
HOW DOES THIS HELP THEM?
TOOL 3:CREATINGSTORIES
!93
GRAB THIS WORKSHEET
!94
THIS IS THE MOST FUN & FAMILIAR PART OF THE PROCESS
!95
WHO IS IN THE STORY? WHERE DO THEY GO? WHEN DO THEY GO THERE? WHAT DO THEY DO? WITH WHAT DEVICES? WHY?
1. WHAT HAPPENS?
!96
2. DESCRIBE HOW
SKETCH OF KEY
MOMENT
Front of Index Card: Try to visually capture character,
time, place, and occasion.
Back of Index Card: Write down what happens, on what devices,
and using what data.
DESCRIBE WHAT
HAPPENS
!97
Joanna"starts"dancing"with"her"daughter."The"TV"sees"the"ac4vity"and"instructs"the"thermostat"to"start"cooling"the"room.
When"driving"home,"Joanna"hears"a"song"she"likes"on"the"radio."She"tells"her"car"to"add"the"song"to"her"exercise"playlist.
Joanna"tells"the"television"to"switch"music"channels"to"children’s"music"and"transfer"to"the"portable"speaker.
smart"TV"+"thermostat car"+"fitness"band smart"TV"+"portable"speaker
data"about"music"type"and"ac4vity"level data"about"the"song"and"data"about"Joanna’s"playlists
data"about"music"type"and"user"type
WRAP UP
THE TECHNOLOGY TO BUILD THE IoT IS ALREADY HERE
Image&Credit:&h.p://djokic.org/internet:of:things/
OUR OBJECTS WILL SOON TALK, LEARN, AND COORDINATE ON OUR BEHALF
DESIGNERS ARE KEY FOR HUMANIZING THE IoT EXPERIENCE
!107
WITH NEW TECHNOLOGY COMES NEW EXPECTATIONS FROM USERS
“IN THE INTERNET WORLD, IF YOU’RE DOING THE SAME THING YOU WERE DOING 6 MONTHS AGO, YOU’RE DOING SOMETHING WRONG.”
— BRUCE FEILER
!108
!109
Jennifer Dunnam [email protected] @jdunnam jenniferdunnam.com
David Sherwin [email protected] @changeorder davidsherwin.com
THANK YOU! AND LET US KNOW HOW YOU USE THESE TOOLS IN YOUR WORK. !GET THIS DECK AT SLIDESHARE.NET/FROGDESIGN
See you on Thursday? 3:00–3:30 PM: Signing Creative Workshop & Success by Design 4:30–5:30 PM: “Creating Creative Superteams”
frog is a company of Aricent. © 2014 frog design inc.frog is a company of Aricent. © 2014 frog design inc.