Making sense of the data
-
Upload
dana-chisnell -
Category
Documents
-
view
116 -
download
0
description
Transcript of Making sense of the data
![Page 1: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/1.jpg)
Making sense of the dataCollaborative techniques for analyzing observations
Dana Chisnell@danachis#makingsense
1
![Page 2: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/2.jpg)
What I’m talking aboutIn-time reporting, collaboratively
Shortcut to persona attributes
Ending the opinion wars through team analysis
Democratic, fast prioritizing
2
![Page 3: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/3.jpg)
Rolling Issues Lists
![Page 4: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/4.jpg)
Rolling issues listsObservations in real time
Observer participation = buy-in
Low-fi reporting
![Page 5: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/5.jpg)
Observations in real timeLarge whiteboard
Colored markers
Don’t worry about order
Be clear enough to remember what was meant
![Page 6: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/6.jpg)
Rolling issues
![Page 7: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/7.jpg)
Rolling issuesAngela Coulter
![Page 8: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/8.jpg)
Observer participationAfter 1-3 participants, longer break
You start
Invite observers to add and track items
![Page 9: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/9.jpg)
Weighting
Number of incidents
Who’s who
![Page 10: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/10.jpg)
![Page 11: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/11.jpg)
Consensus: Observers buy in
observers contribute to identifying issuesyou learn constraintsinstant reporting
Big ideas, so far
![Page 12: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/12.jpg)
A3 Persona studio
![Page 13: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/13.jpg)
MatthewAttorney House in Tel Aviv MarriedLoves his BlackberryHates emailReads NYTimes on iPadAddicted to Words With Friends
![Page 14: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/14.jpg)
!
Buying tickets on a website for for the Maccabiah
![Page 15: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/15.jpg)
EdithFollows American sports, especially baseballHates ESPN.com Loves face-to-face online
![Page 16: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/16.jpg)
DennisBuilding contractor Cell phone is for calling home Very tuned in to current eventsSees no usefulness in FacebookRecently more absent-mindedDifficulty doing standard calculations
![Page 17: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/17.jpg)
Jane1,000-acre farm Tweets soil chemical readings Tablet instrumented to aggregate data
![Page 18: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/18.jpg)
Personas: Archetypal users‣ Composites of real users
‣ Function or task-based
![Page 19: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/19.jpg)
You: designer & developerHow do you design for these people based on what you know?
Think about each of the people as you answer these questions:
![Page 20: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/20.jpg)
What can we say about how persistent the person is?
![Page 21: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/21.jpg)
How pro-active will this person be in solving problems?
![Page 22: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/22.jpg)
How easily will this person become frustrated?
![Page 23: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/23.jpg)
How tech savvy is this person?
![Page 24: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/24.jpg)
How literate is this person in the domain?
![Page 25: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/25.jpg)
Little data, lots of assumptions
![Page 26: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/26.jpg)
MatthewBlackberry-loving attorney
How old are they?
54 83 28 60
EdithESPN.com-hating Hangouts fan
DennisFacebookwhat?
JaneFarmer nerd
![Page 27: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/27.jpg)
How old are they? How educated are they?
How much money do they make?
![Page 28: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/28.jpg)
These don’t matter.
![Page 29: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/29.jpg)
If demographics don’t matter, what do you do?
![Page 30: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/30.jpg)
• persistence with tech
• tolerance for risk & experimentation
• how patient, how easily frustrated
• tech savviness, expertise
• strength of tech vocabulary
• physical or cognitive abilities
Ask the right questions
![Page 31: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/31.jpg)
•Attitudemotivation, emotion, risk tolerance, persistence, optimism or pessimism
•Aptitudecurrent knowledge, ability to make inferences, expertise
•Ability physical and cognitive attributes
![Page 32: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/32.jpg)
!
A3
![Page 33: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/33.jpg)
Technique‣ Focus on the attributes that matter
‣ Accounting for what the user brings to the design
‣ Adjustable to context, relationships, domain
![Page 34: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/34.jpg)
Tool‣ Framework to think about provisional or proto-
personas (little or no data)
‣ Schema to evaluate existing personas’ strength of coverage
![Page 35: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/35.jpg)
Collaboration tool‣ Do our personas cover all the right attributes?
‣ Have we heard from all the users we need to hear from?
![Page 36: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/36.jpg)
Task + functionality!
Buying tickets on a website for the MaccabiahVIP?
Suites?
Close to participants?
Event?
![Page 37: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/37.jpg)
• Who is the most persistent when it comes to working with technology?
• Who is the most likely to experiment and create workarounds when something doesn’t work the way they expect?
• Who do you think will give up when they encounter frustrations out of impatience?
Ask the right questions
![Page 38: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/38.jpg)
• Which one has the most tech expertise? Which one strikes you as the least tech savvy?
• Which one is the most likely to call tech support to help them get out of some tech pickle?
• Who will have the most advanced tech vocabulary when they do call for support?
Ask the right questions
![Page 39: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/39.jpg)
MatthewAttorney House in Tel Aviv, marriedAssistant books reservations Loves his BlackberryHates emailReads NYTimes on iPadAddicted to Words With FriendsDoesn’t spend a lot of time on the Web Avid hiker and birderBad knees Needs Rx eyepiece for scope
![Page 40: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/40.jpg)
!
Where does Matthew fit?
M
M
M
![Page 41: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/41.jpg)
EdithAvid sports fanFollows Detroit Tigers Hates ESPN.com Loves face-to-face onlinePicked up Skype early, quickly Prefers Google Hangouts Dropped FaceTime - gestures were frustrating
![Page 42: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/42.jpg)
!
Where does Edith fit?
E
E
E
![Page 43: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/43.jpg)
DennisBuilding contractor Married to a nurseThey have 2 kids8-year-old cell phone Gets current events on the Web Sees no usefulness in FacebookTrouble sleeping, easily distractedServed in the military: Blunt Force Brain Trauma
![Page 44: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/44.jpg)
!
Where does Dennis fit?
D
D
D
![Page 45: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/45.jpg)
Jane1,000-acre farm 12 different systems every dayTweets soil chemical readings Smartphone alerts from exchangesTablet instrumented to aggregate dataMinimized manual inputArthritic thumbsNeeds stronger progressive lenses
![Page 46: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/46.jpg)
!
Where does Jane fit?
J
J
J
![Page 47: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/47.jpg)
!
A3 Persona modeling
M
M
M
E
E
E
D
D
D
J
JJ
![Page 48: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/48.jpg)
How do design decisions change with these attributes?
![Page 49: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/49.jpg)
Subtlety of affordances
Size of targets
Directness of the happy path
Feedback modalities
Labeling & trigger words
Amount of copy
Wording of instructions & messages
![Page 50: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/50.jpg)
If you had this tool, what would you do next?What would be different for your design?
![Page 51: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/51.jpg)
• Designing for attitude, aptitude, & ability
• Accounting for what the user brings to the design
• Checking that personas cover the right things
A3 Persona modeler
![Page 52: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/52.jpg)
Persona modeler: fast way to visualize users by asking important questions
framework for talking about who users are
can tell which users might be missing
works with any amount of data
middle ground between demographics and research-based personas
Big ideas
![Page 53: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/53.jpg)
What obstacles do teams facein delivering the best possible user experiences?
![Page 54: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/54.jpg)
Guess the reason
![Page 55: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/55.jpg)
![Page 56: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/56.jpg)
![Page 57: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/57.jpg)
![Page 58: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/58.jpg)
![Page 59: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/59.jpg)
Observation to Direction
![Page 60: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/60.jpg)
Observations to direction
Observation Inference Direction
![Page 61: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/61.jpg)
Observations
Participants typed in the top chat area rather than the bottom area.
![Page 62: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/62.jpg)
ObservationsSources:
usability testing
user research
sales feedback
support calls and emails
training
What you saw
What you heard
![Page 63: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/63.jpg)
Inferences
- Participants are drawn to open areas when they are trying to communicate with other attendees - Participants are drawn to the first open area they see
![Page 64: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/64.jpg)
InferencesJudgements
Conclusions
Guesses
Intuition
+ Weight of evidence
![Page 65: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/65.jpg)
Inferences Review the inferences
What are the causes?
How likely is this inference to be the cause?
How often did the observation happen?
Are there any patterns in what kinds of users had issues?
![Page 66: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/66.jpg)
Direction
- Make the response area smaller until it has content
![Page 67: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/67.jpg)
DirectionWhat’s the evidence for a design change?
What does the strength of the cause suggest about a solution?
Test theories
![Page 68: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/68.jpg)
![Page 69: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/69.jpg)
![Page 70: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/70.jpg)
Big ideas: Making sense of the data
Observation What happened
Inference Why there’s a gap between behavior & UI
Direction A theory about what to do
![Page 71: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/71.jpg)
KJ Analysis
![Page 72: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/72.jpg)
ReviewHow’d that go? What might be different for your situation?
![Page 73: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/73.jpg)
Priorities, democratically
reach consensus from subjective data
similar to affinity diagramming
invented by Jiro Kawakita
objective, quick
8 simple steps
![Page 74: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/74.jpg)
1. Focus questionWhat needs to be fixed in Product X to improve the user experience?(observations, data)
What obstacles do teams face in implementing UX practices? (opinion)
![Page 75: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/75.jpg)
2. Organize the groupCall together everyone concerned
For user research, only those who observed
Typically takes an hour
![Page 76: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/76.jpg)
3. Put opinions or data on For a usability test, ask for observations
(not inferences, not opinion)
No discussion
![Page 77: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/77.jpg)
4. Put notes on a wallRandom
Read others’
Add items
No discussion
![Page 78: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/78.jpg)
5. Group similar items In another part of the room
Start with 2 items that seem like they belong together
Place them together, one below the other
Move all stickies
Review and move among groups
Every item in a group
No discussion
![Page 79: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/79.jpg)
6. Name each groupUse a different color
Each person gives each group a name
Names must be noun clusters
Split groups
Join groups
Everyone must give every group a name
No discussion
![Page 80: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/80.jpg)
7. Vote for the most important Democratic sharing of opinions
Independent of influence or coercion
Each person writes their top 3
Rank the choices from most to least important
Record votes on the group sticky
No discussion
![Page 81: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/81.jpg)
8. Rank the groupsPull notes with votes
Order by the number of votes
Read off the groups
Discuss combining groups
Agreement must be unanimous
Add combined groups’ votes together
Stop at 3-5 clear top priorities
![Page 82: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/82.jpg)
Goal: share the most important observations
Focus: identify priorities
democraticquick
Big ideas, so far
![Page 83: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/83.jpg)
Big idea: Collaborative analysis
build consensus in real time: rolling issues observers contribute to identifying issues you learn constraints instant reporting
model users: A3 persona modeler
attitude
aptitude
ability
make sense of the data, together
observation: what you heard, saw
inference: why the gap between the UI and the behavior
direction: a theory about what to do about it
![Page 84: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/84.jpg)
No reports. :)
![Page 85: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/85.jpg)
Where to learn more
Dana’s blog: http://usabilitytesting.wordpress.com
Download templates, examples, and links to other resources from www.wiley.com/go/usabilitytesting
![Page 86: Making sense of the data](https://reader034.fdocuments.net/reader034/viewer/2022051412/54c7c5a34a79595a768b45d5/html5/thumbnails/86.jpg)
www.usabilityworks.net 415.519.1148
@danachis
Dana Chisnell