Usability Testing How To's - EventHandler, London Jan 22nd 2014
-
Upload
evgenia-jenny-grinblo -
Category
Design
-
view
1.405 -
download
8
description
Transcript of Usability Testing How To's - EventHandler, London Jan 22nd 2014
![Page 1: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/1.jpg)
USABILITY TESTING HOW TO’sFor small teams & little budgets
Evgenia (Jenny) Grinblo & www.eventhandler.co.uk London, UK January 22, 2013 (This is Henrik)
![Page 2: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/2.jpg)
�2
http://bit.ly/1f9Pnzt
USABILITY TESTING: INTRODUCTION
Hello, I’m... !
Evgenia (Jenny) Grinblo User Experience Specialist Future Workshops, London !
!
![Page 3: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/3.jpg)
�3
http://bit.ly/1f9Pnzt
USABILITY TESTING: INTRODUCTION
Our usability testing story… !
!Intuitive
“For everyone”
Easy to use Simple
“For everyone”
Clients !!
Users !!
![Page 4: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/4.jpg)
�4
http://bit.ly/1f9Pnzt
USABILITY TESTING: INTRODUCTION
And you… !
Why are you here? !
!
![Page 5: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/5.jpg)
0 / Usability testing introduction 1 / What do we test: preparing a test plan 2 / Facilitating a usability test & recording results 3 / Analysing and presenting key learnings
USABILITY TESTINGWorkshop schedule
![Page 6: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/6.jpg)
USABILITY TESTING: INTRODUCTION
!
How to run a £3000 fool-proof test
✓ The easiest, quickest, cheapest methods
✓ Tips on facilitating, note-taking, & prioritising
✓ How to run a usability test tomorrow
✓ Resources & tools to keep learning
!
A6
WHAT TO EXPECT TODAY
![Page 7: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/7.jpg)
USABILITY TESTING: INTRODUCTION
!
✓ Slides will be on SlideShare
✓ If you need to leave early, tell me now
✓ You don’t need your laptops yet
✓ Questions welcome anytime
!
!
A7
HOUSEKEEPING ITEMS
![Page 8: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/8.jpg)
�8
http://bit.ly/1f9Pnzt
What is usability testing & why do it?
USABILITY TESTING: INTRODUCTION
![Page 9: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/9.jpg)
USER EXPERIENCE BUILDING BLOCKS
�9
http://bit.ly/1f9Pnzt
http://www.flickr.com/photos/7855449@N02/2779597129 Diagram by David Armano
USABILITY TESTING: INTRODUCTION
![Page 10: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/10.jpg)
USABILITY IS A MAJOR BUILDING BLOCK OF A GOOD EXPERIENCE
�10
http://bit.ly/1f9Pnzt
http://www.flickr.com/photos/7855449@N02/2779597129 Diagram by David Armano
USABILITY TESTING: INTRODUCTION
![Page 11: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/11.jpg)
1. INTUITIVE (n.) Using what one feels to be true without conscious reasoning
�11
http://bit.ly/1f9Pnzt
www.youtube.com
USABILITY TESTING: INTRODUCTION
![Page 12: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/12.jpg)
�12
http://bit.ly/1f9Pnzt
NEEDING INSTRUCTIONS MEANS SOMETHING CAN BE MADE MORE SIMPLE
USABILITY TESTING: INTRODUCTION
![Page 13: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/13.jpg)
2. EASY TO USE Doesn’t make people feel stupid or inferior to the tool they are using. Helps them feel in control.
�13
http://bit.ly/1f9Pnzt
USABILITY TESTING: INTRODUCTION
www.errorwallofshame.tumblr.com
![Page 14: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/14.jpg)
�14
http://bit.ly/1f9Pnzt
USABILITY TESTING: INTRODUCTION
3. ACCESSIBLE People of different abilities can use it
![Page 15: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/15.jpg)
A15
http://bit.ly/1f9Pnzt
YOU CAN’T DIFFERENTIATE IF THE EXPERIENCE IS BROKEN
USABILITY TESTING: INTRODUCTION
![Page 16: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/16.jpg)
67.45% (AVERAGE E-COMMERCE CART ABANDONMENT RATE)
�16
http://bit.ly/1f9Pnzt
EVERYONE DEEPLY UNDERSTANDS THE USERS
http://baymard.com/lists/cart-abandonment-rate
July 28, 2013
![Page 17: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/17.jpg)
�17
http://bit.ly/1f9Pnzt
http://www.shopify.com/blog/8484093-why-online-retailers-are-losing-67-45-of-sales-and-what-to-do-about-it
USABILITY TESTING: INTRODUCTION
![Page 18: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/18.jpg)
�18
http://bit.ly/1f9Pnzt
http://www.shopify.com/blog/8484093-why-online-retailers-are-losing-67-45-of-sales-and-what-to-do-about-it
USABILITY TESTING: INTRODUCTION
![Page 19: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/19.jpg)
WHERE TO FIND USABILITY PROBLEMS
A19
http://bit.ly/1f9Pnzt
Analytics (Impersonal)
Survey (Tricky)
Usability test (Immediate, easy)
USABILITY TESTING: INTRODUCTION
![Page 20: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/20.jpg)
USABILITY TESTING
�20
http://bit.ly/1f9Pnzt
USABILITY TESTING: INTRODUCTION
• Behavioral vs. Self-reported • Opportunity to ask “why?” • Motivates teammates • Removes “designer bias” • Can be done on prototypes • Can be cheap & quick
![Page 21: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/21.jpg)
WHAT HAPPENS IN A USABILITY TEST?
�21
http://bit.ly/1f9Pnzt
USABILITY TESTING: INTRODUCTION
Video: http://www.youtube.com/watch?v=QckIzHC99Xc
![Page 22: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/22.jpg)
�22
http://bit.ly/1f9Pnzt
TEST YOUR IDEAS REGULARLY WITH REAL PEOPLE
USABILITY TESTING: INTRODUCTION
![Page 23: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/23.jpg)
USABILITY TEST STEPS
�23
http://bit.ly/1f9Pnzt
USABILITY TESTING: INTRODUCTION
Recruit Participants
Prepare a test plan Test Analyse +
iterate
![Page 24: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/24.jpg)
WHO DO WE TEST WITH?
�24
http://bit.ly/1f9Pnzt
USABILITY TESTING: INTRODUCTION
‣ Anyone who hasn’t seen the app
‣ Similar demographics to real users (whenever possible)
![Page 25: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/25.jpg)
WHERE DO WE FIND PARTICIPANTS?
�25
http://bit.ly/1f9Pnzt
USABILITY TESTING: INTRODUCTION
‣ Friends, family, colleagues
‣ Social media followers
‣ Existing customers
‣ Streets and coffee shops
‣ Recruitment agencies (<expensive!)
![Page 26: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/26.jpg)
WHEN DO WE TEST? AS EARLY AS POSSIBLE
�26
http://bit.ly/1f9Pnzt
USABILITY TESTING: INTRODUCTION
Idea stage Definition stageExploring FocusingMany ideasHigh-level“Dream world”
Best ideasRefinedRealistic
![Page 27: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/27.jpg)
DO USABILITY TESTING REGULARLY, WITH YOUR WHOLE TEAM
�27
http://bit.ly/1f9Pnzt
USABILITY TESTING: INTRODUCTION
![Page 28: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/28.jpg)
# OF TEAM MEMBERS EXPOSED TO USERS IS MORE IMPORTANT THAN # OF USERS
�28
http://bit.ly/1f9Pnzt
http://www.uie.com/articles/user_exposure_hours/
USABILITY TESTING: INTRODUCTION
![Page 29: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/29.jpg)
�29
http://bit.ly/1f9Pnzt
USABILITY TESTING: INTRODUCTION
SOMETIMES IT’S HARD TO ACCEPT YOUR PRODUCT NEEDS HELP https://twitter.com/adrianhungate/status/391954628184915970
![Page 30: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/30.jpg)
WHEN YOU SEE SOMEONE IN PAIN, YOU WANT TO HELP THEM
�30
http://bit.ly/1f9Pnzt
http://www.flickr.com/photos/martin_mcdonald/371884786/
USABILITY TESTING: INTRODUCTION
![Page 31: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/31.jpg)
— DANIEL Lead Developer, Future Workshops
�31
http://bit.ly/1f9Pnzt
“!
I was completely surprised at how cumbersome the users experience with the app was. Basic tasks were which was so obvious to me were suddenly a huge barrier.
http://www.uie.com/articles/user_exposure_hours/
USABILITY TESTING: INTRODUCTION
![Page 32: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/32.jpg)
— DANIEL Lead Developer, Future Workshops
�32
http://bit.ly/1f9Pnzt
“!
... What the usability testing did for me was really prove how much tech people can lose sight of who they are building for. It about going back to basics in some cases.
http://www.uie.com/articles/user_exposure_hours/
USABILITY TESTING: INTRODUCTION
![Page 33: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/33.jpg)
IN SUMMARY: USABILITY TESTING BENEFITS
�33
http://bit.ly/1f9Pnzt
USABILITY TESTING: INTRODUCTION
1. Highlights where our product isn’t intuitive / easy to use
2. Puts team in the shoes of users
3. Helps sell product improvements to stakeholders/ clients
4. Helps prioritise feature backlog
!
![Page 34: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/34.jpg)
5 minute breakTime for a
![Page 35: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/35.jpg)
0 / Usability testing introduction 1 / What do we test: preparing a test plan 2 / Facilitating a usability test & recording results 3 / Analysing and presenting key learnings
USABILITY TESTINGWorkshop schedule
![Page 36: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/36.jpg)
PREPARING A TEST PLAN
To run a test, you need
‣ Some representation of your product
‣ Preferably interactive
‣ Doesn’t have to be finished
‣ Or: competitor product!
‣ Idea of what you want to test
![Page 37: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/37.jpg)
PREPARING A TEST PLAN
What do we test?
‣ General impressions
‣ Ease of use of critical features
‣ Features we’re not sure about (e.g., is the help clear?)
‣ Response to design, iconography
Tip: start from high-level when testing prototypes, test the details with later builds
![Page 38: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/38.jpg)
A38
http://bit.ly/1f9Pnzt
PREPARING A TEST PLAN
Wide (Generative)
Narrow (Validating)
WHY will people use this product?
SET THE SCOPE
HOW do these people use this product?
![Page 39: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/39.jpg)
SET THE SCOPE
A39
http://bit.ly/1f9Pnzt
PREPARING A TEST PLAN
Wide (Generative)
Narrow (Validating)
Explore How is the value proposition of this tool fit in with people’s lives
Validate How do people perform specific task with this tool?
Confirm/iterate Observing what people do with this tool, in their own environment
![Page 40: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/40.jpg)
SET THE SCOPE
A40
http://bit.ly/1f9Pnzt
PREPARING A TEST PLAN
Wide (Generative)
Narrow (Validating)
Explore How is the value proposition of this tool fit in with people’s lives
Validate How do people perform specific task with this tool?
Confirm/iterate Observing what people do with this tool, in their own environment
First...
![Page 41: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/41.jpg)
FIRST IMPRESSIONS: THE 5 SECOND TEST
�41
http://bit.ly/1f9Pnzt
PREPARING A TEST PLAN
Ready?
![Page 42: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/42.jpg)
�42
http://bit.ly/1f9Pnzt
![Page 43: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/43.jpg)
5 SECOND TEST QUESTIONS
A43
http://bit.ly/1f9Pnzt
PREPARING A TEST PLAN
• What is the purpose of the website/app?
• Name 3 things you can do with this website
• Who does this site or app belong to?
• How do you feel about this organisation?
!
![Page 44: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/44.jpg)
SET THE SCOPE
A44
http://bit.ly/1f9Pnzt
PREPARING A TEST PLAN
Wide (Generative)
Narrow (Validating)
Explore How is the value proposition of this tool fit in with people’s lives
Validate How do people perform specific task with this tool?
Confirm/iterate Observing what people do with this tool, in their own environment
Now...
![Page 45: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/45.jpg)
PREPARING A DETAILED USABILITY TEST
�45
http://bit.ly/1f9Pnzt
PREPARING A TEST PLAN
Recruit Participants
Prepare a test plan Test Analyse +
iterate
![Page 46: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/46.jpg)
�46
http://bit.ly/1f9Pnzt
THE MORE DETAILED YOUR ARTIFACT, THE MORE DETAILED THE FEEDBACK
USABILITY TESTING: INTRODUCTION
![Page 47: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/47.jpg)
Choose a product to testTime: 10 minutes
EXERCISE 1
‣ We are going to validate an existing, finished product
‣ As a group, decide on a website or app to test
‣ It can be your app - I must be able to interact with it
Tip: avoid sites that require logging in (unless you have a login to share)
![Page 48: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/48.jpg)
Show & Tell
EXERCISE 3
![Page 49: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/49.jpg)
PREPARING A TEST PLAN
Test plan!
‣ Tasks: What are we testing? Why?
‣ Success Paths: What do we expect to happen?
‣ Scenarios: How can we find out if our expectation is true?
![Page 50: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/50.jpg)
!
!
// SUCCESS PATH
// TEST PLAN FOR: // PART:// GROUP:
TASK
!
!
// SCENARIO
// GENERAL SCENARIO
// INFO (passwords, etc)
!// SUCCESS PATH
TASK
!
!
// SCENARIO
// INFO (passwords, etc)
Set up the motivation
What we are testing
What we want/expect the user to do
Motivation to do the task + instructions
Information necessary for the task
![Page 51: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/51.jpg)
!
!
// SUCCESS PATH
// TEST PLAN FOR: // PART:// GROUP:
TASK
!
!
// SCENARIO
// GENERAL SCENARIO
// INFORMATION
!// SUCCESS PATH
TASK
!
!
// SCENARIO
// INFORMATION
You need to cook a new recipe for the company potluck. You found a recipe online and now you need to buy the ingredients and cook it.
You need to remember what to buy. Use the app to make a shopping list you can take to the supermarket.
Print-out of a recipe from the internet
Create a text note and make a bulleted list of ingredients
E-mail a note to a friend using swipe to share
Text note Share a note via e-mail
You really liked the new recipe and you think your friend Jenny will like it too.
Send the recipe to Jenny from within the app.
Jenny’s email: [email protected]’t show this to
the participant!
![Page 52: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/52.jpg)
PREPARING A TEST PLAN
Scenario Structure!
‣ Your character
‣ Your motivation
‣ What you need to do
‣ Any details like login information, etc
![Page 53: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/53.jpg)
PREPARING A TEST PLAN
Scenario Tips
‣ Avoid using terminology from the interface (e.g., search, tag, filter)
‣ Scenarios can have steps (e.g., find a recipe and add it to your collection)
‣ Escalate the difficulty as the test progresses
![Page 54: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/54.jpg)
Test PlanTime: 20 mins
EXERCISE 2
‣ Define 3 key tasks that must be intuitive and easy to use in the application
‣ Identify the success paths for each task (what we expect users to do)
‣ Decide on a general scenario + write specific tasks
‣ Run through the test once
![Page 55: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/55.jpg)
0 / Usability testing introduction 1 / What do we test: preparing a test plan 2 / Facilitating a usability test & recording results 3 / Analysing and presenting key learnings
USABILITY TESTINGWorkshop schedule
![Page 56: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/56.jpg)
USABILITY TEST STEPS
�56
http://bit.ly/1f9Pnzt
FACILITATING A TEST & RECORDING RESULTS
Recruit Participants
Prepare a test plan Test Analyse +
iterate
![Page 57: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/57.jpg)
Facilitating
‣ Practice staying quiet
‣ Remind the participant to speak out loud
‣ Don’t give anything away
‣ Be reassuring, say thank you
‣ If they get stuck, wait (a little)
FACILITATING A TEST & RECORDING RESULTS
![Page 58: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/58.jpg)
Facilitator Cheat-Sheet
If they forget to think aloud
‣ "What are you thinking right now?"
‣ "What are you finding confusing on this screen?"
‣ "I know it's an unusual thing to do but could I please ask you to keep thinking out loud and talk as you go along? It really helps me understand your experience better."
FACILITATING A TEST & RECORDING RESULTS
![Page 59: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/59.jpg)
Facilitator Cheat-Sheet
If they get stuck
‣ "This is very helpful for us, we are uncovering a lot of problems in the design that will help us make the app better."
‣ "I can already see how useful this is going to be in improving the app."
FACILITATING A TEST & RECORDING RESULTS
![Page 60: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/60.jpg)
Facilitator Cheat-Sheet
If they have a question
‣ "Please continue in the way that makes sense to you. We will learn a lot from seeing how you proceed with this without any help."
‣ "I will be happy to answer your questions at the end. Please try to try this task for a bit longer."
FACILITATING A TEST & RECORDING RESULTS
![Page 61: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/61.jpg)
Facilitator Cheat-Sheet
The golden go-to
‣ "We expected to uncover problems in the design. You are not doing anything wrong - we knew there would be issues and you are helping us find them."
FACILITATING A TEST & RECORDING RESULTS
![Page 62: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/62.jpg)
�62
http://bit.ly/1f9Pnzt
People will feel stupid. Make them feel at ease.
FACILITATING A TEST & RECORDING RESULTS
![Page 63: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/63.jpg)
Ways to record our findings
From easy to complicated
‣ Pair up with a note-taker
‣ DIY recording equipment
‣ Professional recording equipment
‣ Live-stream to a group of stakeholders
FACILITATING A TEST & RECORDING RESULTS
![Page 64: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/64.jpg)
�64
http://bit.ly/1f9Pnzt
Note-taking brings down 2 barriers to testing: time & equipment
(But I’ll give you some tips on recording later!)
FACILITATING A TEST & RECORDING RESULTS
![Page 65: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/65.jpg)
Note-taking tips
Only record what’s important
‣ If someone is really happy
‣ If someone is really frustrated
‣ If someone fails a task
‣ Write down short quotes if you can
FACILITATING A TEST & RECORDING RESULTS
![Page 66: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/66.jpg)
Notes Example
• Taps Map on merchant profile but this opens the system Maps
app — confused
!• Goes to Search and types “coffee shops” but there are no results
— “why can’t I see what’s around me?”
!• "If I had to think about something around me, I’d start the
merchant profile and expect to see other things around me"
!• The icons aren’t telling me that Cafe Nero is a coffee shop
!!
FACILITATING A TEST & RECORDING RESULTS
![Page 67: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/67.jpg)
What to bring to the testPrinted scenarios & tasks for participant
Printed scenarios & tasks with success paths for facilitator
Facilitator script
Optional: List of pre-test and debrief questions
Consent form (if needed)
Pen + paper / recording tools
Test setup checklist
FACILITATING A TEST & RECORDING RESULTS
![Page 68: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/68.jpg)
Setting up the testReset the mobile app / site to the default settings
Clear the test area of any open documents, written notes, etc.
Prepare participant forms: scenarios, intro script, consent form
Optional: Verify the recording equipment
Optional: Make sure the brightness on the screen is reduced
FACILITATING A TEST & RECORDING RESULTS
![Page 69: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/69.jpg)
Usability TestTime: 40 minutes
EXERCISE 3
‣ Every 8 minutes, swap one member of your group in exchange for a member from another group
‣ The ‘foreign’ member is the participant
‣ Start running through the test you’ve planned
‣ Everyone else in the group should be a facilitator and a note-taker at least once
![Page 70: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/70.jpg)
Show & Tell
EXERCISE 2
![Page 71: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/71.jpg)
0 / Usability testing introduction 1 / What do we test: preparing a test plan 2 / Facilitating a usability test & recording results 3 / Analysing and presenting key learnings
USABILITY TESTINGWorkshop schedule
![Page 72: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/72.jpg)
USABILITY TEST STEPS
�72
http://bit.ly/1f9Pnzt
ANALYSING & PRESENTING FINDINGS
Recruit Participants
Prepare a test plan Test Analyse +
iterate
![Page 73: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/73.jpg)
What to do with all the data?
‣ Identify changes with the biggest impact & smallest effort as a team
‣ Find the “low-hanging fruit”
‣ What has impact on the bottom line?
‣ Put everything else in the ice-box
ANALYSING & PRESENTING FINDINGS
![Page 74: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/74.jpg)
Identifying key findings
High-priority: people fail, or abandon the task
Medium: people succeed but are frustrated and unhappy
Low: people would enjoy the app more if...
Tip: Work hard to prioritise the highest-impact items. You can’t fix everything.
ANALYSING & PRESENTING FINDINGS
![Page 75: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/75.jpg)
Presenting findingsANALYSING & PRESENTING FINDINGS
![Page 76: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/76.jpg)
Presenting findingsANALYSING & PRESENTING FINDINGS
Interface screenshot here
Task
What we expected to happen
What really happened
What we can fix right now
![Page 77: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/77.jpg)
Identifying Key FindingsTime: 15 mins
EXERCISE 4
‣ As a group, debrief on each person’s notes
‣ Find 2 high, 2 medium, and 2 low-priority usability problems
‣ What will you fix first? Why?
‣ Jot down a quick summary of key findings to present to the larger group
![Page 78: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/78.jpg)
Show & Tell
EXERCISE 3
![Page 79: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/79.jpg)
Summary
‣ Match your test artifact to your scope
‣ Plan realistic scenarios that don’t give away the test purpose
‣ Be encouraging and open to feedback
‣ Record only what’s needed
‣ Prioritise findings for maximum impact
SUMMARY & CONCLUSION
![Page 80: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/80.jpg)
Remember this?
�80
http://bit.ly/1f9Pnzt
http://www.flickr.com/photos/7855449@N02/2779597129 Diagram by David Armano
SUMMARY & CONCLUSION
![Page 81: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/81.jpg)
Usability is only one partSUMMARY & CONCLUSION
Building a product isn’t just about usability:
‣ Business goals
‣ Usefulness & desirability
‣ Differentiation
‣ Vision of the future
… But it’s a great start!
![Page 82: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/82.jpg)
Usability is only one part SUMMARY & CONCLUSION
Translate user research into user
tasks
Plan the journey to accomplish
each task
Create interfaces to support that
journey
Match the vision with real-world
behavior
Test how real people use our
interfaces
Create a vision of our offering to
people
Iterate and simplify those
interfaces
![Page 83: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/83.jpg)
DIVE IN MORE DEEPLY
A83
http://bit.ly/1f9Pnzt
Remote Research Nate Bolt & Tony
Tulathimutte
DIY Usability Testing
Steve Krug
Lean UX Jeff Gothelf
!
SUMMARY & CONCLUSION
![Page 84: Usability Testing How To's - EventHandler, London Jan 22nd 2014](https://reader033.fdocuments.net/reader033/viewer/2022050903/53f0392d8d7f72104c8b4608/html5/thumbnails/84.jpg)
“
http://www.humanfactors.com/ROIposter.asp
Any intelligent fool can make things bigger and more complex. It takes courage, and a touch of genius, to move in the opposite direction.
– Albert Einstein
A84
A FINAL THOUGHT
SUMMARY & CONCLUSION