10 Remote Testing Tips
-
Upload
lee-duddell -
Category
Business
-
view
1.139 -
download
0
Transcript of 10 Remote Testing Tips
#nuxncl
NUX Newcastle
16 APRIL 2015
10 Remote Testing Tips
#nuxncl
Agenda
Introduction
What is Remote UX Testing?
3 x Case Studies
3 x test design tips
3 x analysis tips
10 Tips
Q & A
3s
#nuxncl
Introduction
Lee Duddell
Founder & Director of UX
@LDuddell
#nuxncl
Discuss: remote testing/insight
#nuxncl
You
#nuxncl
#nuxncl
Discuss: Pros & Cons of Remote UX
#nuxncl
3 x Case Studies
#nuxncl
1. Use it to get “Why?” answers In 2014 ~ 25% incoming sales calls start with “We just applied
RWD and conversions are down…”
Mobile Usability Report:
15 leading UK retailers
75% had severe UX issues (despite all being responsive designs)
#nuxncl
#nuxncl
Online Bill• 4 new bill variants
• About to Test (but knew they were guesses)
• UX Benchmarked bill variants
• Created Variant 5
• That won when AB Tested
• “We never would have come up with
the winning variant, but would have seen
uplift, thinking we’d got it right”
2. Test early
#nuxncl
3. Expose colleagues to users Like you they had a development list/product roadmap
Based upon hunches and opinion
Prioritised by HiPPOs
#nuxncl
User eXposure Matthew Lawson insisted everyone watch users buy white goods
On their site, on competitors’ sites, starting at Google Listed the top issues and re-wrote the development list
In a few months made changes that:
Increased online sales by 9.5%
Reduced contact by 33%
Increased engagement (product reviews) 12%
Read the full Case Study
#nuxncl
Pizza + User Videos every Friday
#nuxncl
#nuxncl
3 x Test Design Task Writing Tips
#nuxncl
4. Focus users on tasks – it’s not a survey! BAD: What do you think of our Home Page
BETTER: Where would you click first?
BAD: Out of 10, how did you find the usability of the website?
BETTER: Just watch!
OPEN: Find two items you would genuinely consider and buy them
DIRECTED: Open this link to X product page, select a Size 12 dress
#nuxncl
5. Don’t start at your Home Page Landing page
Social Stream or advert
Competitor site (benchmarking)
Google or empty browser, improve PPC/SEO
#nuxncl
#nuxncl
6. Run a pilot 2 users testing your tasks that you then refine
#nuxncl
Let’s write some tasks Please volunteer a site or journey
And then some tasks
#nuxncl
3 x Analysis Tips
#nuxncl
7. Ignore opinions (especially design ones) “That’s a lovely design, I love the blue”
Focus on what users do
#nuxncl
8. Log issues in each video (consistently)
#nuxncl
Tag consistency = Journey step + issue
“Home Page”, “Search”, “PLP,” “PDP”
Then apply a priority and a description that makes sense out of context (for when you share)
GOOD: “Application Form -country” “User could not find their country in the drop down”
#nuxncl
9. Share analysis with videos
#nuxncl
All 10 9 Tips1. Use it when you want answers why quickly
2. Test early
3. Expose colleagues (see Tip 9)
4. Set tasks
5. Don’t start on your Home Page
6. Run a pilot
7. Ignore opinion
8. Tag issues
9. Share videos
10.What’s yours?
#nuxncl
“Shut up & listen to users.”
-- Dr Jakob Nielsen
#nuxncl
Q&A