Jonathan Rubin - The benefits of do it yourself usability testing
-
Upload
plaintalkconf -
Category
Technology
-
view
422 -
download
1
description
Transcript of Jonathan Rubin - The benefits of do it yourself usability testing
![Page 1: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/1.jpg)
The benefits of “Do It
Yourself” Usability Testing
By Jonathan Rubin
First Fridays Program Manager
General Services Administration
![Page 2: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/2.jpg)
2
Let me tell you a story
![Page 3: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/3.jpg)
3
Hanging chads
![Page 4: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/4.jpg)
4
inspections
![Page 5: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/5.jpg)
5
butteflu
![Page 6: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/6.jpg)
They didn’t listen to customer’s
wants, needs and expectations.
TAKEWAY MESSAGE: Testing
with customers gets you
valuable feedback (duh)!
Why did problems occur?
![Page 7: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/7.jpg)
7
In this hour…
1. What is usability
2. Why you need usability
3. Idea: Do your own testing!
![Page 8: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/8.jpg)
1. What is usability?
![Page 9: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/9.jpg)
Usability =
How people interact with a
product, system or service,
and how they expect it to
work.
![Page 10: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/10.jpg)
Usability ≠ Quality Control
10
![Page 11: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/11.jpg)
Good products are usable
11
![Page 12: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/12.jpg)
12
What is it? How do you use it?
![Page 13: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/13.jpg)
13
What is it? How do you use it?
![Page 14: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/14.jpg)
14
Don’t feel stupid!
![Page 15: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/15.jpg)
1. Observe users (customers) using your
product
2. (Re)design with users in mind
3. Get a usable product
4. Repeat
4 Steps to Working with Users
![Page 16: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/16.jpg)
• Education • Demonstration Tests • Awareness
![Page 17: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/17.jpg)
We’ve helped these folks
• DOT
• Interior
• IRS
• U.S. Army
• NASA
• Labor
• OMB
• GSA
17
• State
• FCC
• USAJobs
• Census
• NSF
• NIH
• And 35
others
![Page 18: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/18.jpg)
Free @ Howto.gov/firstfridays
• Usability Testing Scripts • Email Templates • Best Practices • Final Report Examples • Project Management • Before and After Screenshots • Videos • Etc.
![Page 19: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/19.jpg)
2. Why you need usability
![Page 20: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/20.jpg)
Top 5 Government Usability
Problems
• Too many words
![Page 21: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/21.jpg)
Top 5 Government Usability
Problems
• Too many words
• Gov speak / jargon
![Page 22: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/22.jpg)
Top 5 Government Usability
Problems
• Too many words
• Gov speak / jargon
• Top tasks hard to find
![Page 23: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/23.jpg)
Top 5 Government Usability
Problems
• Too many words
• Gov speak / jargon
• Top tasks hard to find
• Ineffective navigation
![Page 24: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/24.jpg)
Top 5 Government Usability
Problems
• Too many words
• Gov speak / jargon
• Top tasks hard to find
• Ineffective navigation
• Ineffective search results
![Page 25: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/25.jpg)
Example 2: GSA Intranet Example 2: GSA Intranet
![Page 26: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/26.jpg)
?
![Page 27: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/27.jpg)
9/11/2012 27
Before After
![Page 28: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/28.jpg)
![Page 29: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/29.jpg)
![Page 30: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/30.jpg)
![Page 31: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/31.jpg)
• Reduced developer time
Usability’s Return on Investment (ROI)
![Page 32: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/32.jpg)
• Reduced developer time
• Reduced training time
Usability’s Return on Investment (ROI)
![Page 33: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/33.jpg)
• Reduced developer time
• Reduced training time
• Reduced help desk calls / emails
Usability’s Return on Investment (ROI)
![Page 34: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/34.jpg)
• Reduced developer time
• Reduced training time
• Reduced help desk calls / emails
• Higher task completion rate
Usability’s Return on Investment (ROI)
![Page 35: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/35.jpg)
• Reduced developer time
• Reduced training time
• Reduced help desk calls / emails
• Higher task completion rate
• PR boost
Usability’s Return on Investment (ROI)
![Page 36: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/36.jpg)
Know your users, for you are not them
- Usability Yoda
![Page 37: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/37.jpg)
3. Idea: Do your own testing!
![Page 38: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/38.jpg)
38
Must read: ‘Rocket Surgery Made Easy’
• Commit to monthly
product testing
• Same time each
month
• More observers +
more testing = more
buy-in
![Page 39: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/39.jpg)
Needed for “discount” usability testing
• Executive champion!
Needed for UT
![Page 40: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/40.jpg)
• Executive champion!
• One morning a month
Needed for UT
Needed for “discount” usability testing
![Page 41: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/41.jpg)
• Executive champion!
• One morning a month
• 1-2 rooms
Needed for “discount” usability testing
![Page 42: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/42.jpg)
• Executive champion!
• One morning a month
• 1-2 rooms
• Laptops
Needed for “discount” usability testing
![Page 43: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/43.jpg)
• Executive champion!
• One morning a month
• 1-2 rooms
• Laptops
• Screen sharing
software ($1000/yr)
Needed for “discount” usability testing
![Page 44: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/44.jpg)
• Executive champion!
• One morning a month
• 1-2 rooms
• Laptops
• Screen sharing
software ($1000/yr)
• Volunteers
Needed for “discount” usability testing
![Page 45: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/45.jpg)
• Executive champion!
• One morning a month
• 1-2 rooms
• Laptops
• Screen sharing
software ($1000/yr)
• Volunteers
• Food ($10/person)
Needed for “discount” usability testing
![Page 46: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/46.jpg)
• Executive champion!
• One morning a month
• 1-2 rooms
• Laptops
• Screen sharing
software ($1000/yr)
• Volunteers
• Food ($10/person)
• Incentives ($0- $80)
Needed for “discount” usability testing
![Page 47: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/47.jpg)
• Executive champion!
• One morning a month
• 1-2 rooms
• Laptops
• Screen sharing
software ($1000/yr)
• Volunteers
• Food ($10/person)
• Incentives ($0- $80)
• Training (FF)
Needed for “discount” usability testing
![Page 48: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/48.jpg)
48
How many people do I need?
![Page 49: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/49.jpg)
Spending on usability
49
When usability is present, 10% of
development budget spent on
usability
- Usability Return on Investment (2008, Nielsen
Norman Group Report)
![Page 50: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/50.jpg)
Staffing options (all are good)
1. Usability Contractor ($17,000 per test)
2. Dedicated Usability Staff ($60,000+)
3. Get training and do it yourself (Free)
50
![Page 51: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/51.jpg)
Matrixed Approach to Staffing
51
• Part-time volunteers! • Borrow from other departments • You are “providing skill building opportunities” • Flexible needs: 1 -20 hours a month
![Page 52: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/52.jpg)
Types of First Fridays Tests
• 1. Formal, talk-aloud tests
![Page 53: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/53.jpg)
Stakeholder
Meeting
Develop
Scenarios
Recruit
Participants
+ Observers
Conduct
Test
Write
Report
Follow-up
Meeting
Formal Testing Process
![Page 54: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/54.jpg)
Testing Room Observation Room
It takes two (rooms) to test
![Page 55: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/55.jpg)
55
Formal Testing Schedule
• 8:20 – 8:30 Welcome
• 8:30 - 9:30 Tester #1
• 9:30 – 10:30 Tester #2
• 10:30 – 11:30 Tester #3
• 11:30 – Noon Lunch
• Noon – 1:30 Debrief / Critique
![Page 56: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/56.jpg)
Absolute Minimum Usability Staffing
Testing Room
T
F
T = Tester,
F = Facilitator
![Page 57: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/57.jpg)
Minimum First Fridays Staffing
Observation Room Testing Room
T
O
F M
O O
O O
O = Observer
F = Facilitator
M = Room Manager
![Page 58: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/58.jpg)
Better Staffing
Observation Room Testing Room
T
F M
O
O
G = Greeter
DG = Data Gatherer
BU = Back up
G
F O O O O O
DG
BU
BU
BU
O = Observer
F = Facilitator
M = Room Manager
![Page 59: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/59.jpg)
Types of First Fridays Tests
1. Formal, talk-aloud tests
2. Hallway Tests
![Page 61: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/61.jpg)
Types of First Fridays Tests
1. Formal, talk-aloud tests
2. Hallway Tests
3. Navigation Improvement / Card sort
![Page 62: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/62.jpg)
3. Navigation Improvement
![Page 63: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/63.jpg)
Types of First Fridays Tests
1. Formal, talk-aloud tests
2. Hallway Tests
3. Navigation Improvement / Card sort
4. Quick Win Evaluation (Heuristics Analysis)
![Page 64: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/64.jpg)
64
4. Quick Win Evaluation (Heuristics)
• Not for newbies
• Group or single person feedback
– Checklist
– Task run-through
• PRO: Fast! <1 week
• CON: No users
![Page 65: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/65.jpg)
Teach em to fish Teach ‘em to fish
![Page 66: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/66.jpg)
• Executive champion!
• One morning a month
• 1-2 rooms
• Laptops
• Screen sharing
software
• Volunteers
• Food
• Incentives for testers
• Training (First Fridays!)
Review: What you need to fish
![Page 67: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/67.jpg)
Howto.gov/firstfridays
Free usability resources!
![Page 68: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/68.jpg)
• Observe a test
More info on First Fridays
![Page 69: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/69.jpg)
• Observe a test
• Recommend a website
More info on First Fridays
![Page 70: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/70.jpg)
• Observe a test
• Recommend a website
• Volunteer as a tester
(remote or in person)
More info on First Fridays
![Page 71: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/71.jpg)
• Observe a test
• Recommend a website
• Volunteer as a tester
(remote or in person)
• Learn to fish (Facilitator
in Training program)
More info on First Fridays
![Page 72: Jonathan Rubin - The benefits of do it yourself usability testing](https://reader034.fdocuments.net/reader034/viewer/2022051818/54b852a64a7959b46d8b45ca/html5/thumbnails/72.jpg)
Once a month