Post on 27-Jan-2015
description
Agile User StudiesDerek PoppinkUser Experience Manager
Cengage Learning
Who we are
LIFELONG LEARNING Elementary and high school 2- and 4-year colleges and
universities Private/For Profit Colleges Professional Training & Continuing
Education
RESEARCH Academic School Public Government
Annual revenue: $2 billion 5,600 employees Operations in more than 20 countries
User Experience
What we do
http://www.limina-ao.com/approach/agile.html
User Experience
Why we do it
Peter Morville’s UX Honeycomb: http://semanticstudios.com/publications/semantics/000029.php
Agile User Studies
• Why User Studies?
• What is an Agile User Study?
• When
• Where
• What
• Who
• How
• Questions
Agenda
Why User Studies?
• All sites have usability issues
• Serious issues are easy to find
• Watching users makes you a better designer
Big Honkin’ User Studies
http://www.laurasmith.info/UsabilityTest.jpg
1-2 rounds of tests when site is nearly complete1-2 days of tests per round5-8 participants per roundHeld on-site in room with one-way mirror1-2 observers (product owner)Dozens of problems prioritized by moderator1 week to prepare report afterwards$25,000 per round
Big Honkin’ User Studies
Agile User Studies
http://www.uxforthemasses.com/blog/wp-content/uploads/2010/09/usability-testing-session.jpg
1 round of tests per sprint from concept to launch1 morning per round (tests and debriefing)3 participants per roundHeld in conference rooms and remotely with WebExObserved by teamTen problems and fixes prioritized by teamFindings and fixes distributed immediately afterwards$4,000 per round
Agile User Studies
A Morning A Month
http://b.vimeocdn.com/ts/693/515/69351512_640.jpg
A Morning A Month
Morning3 sessions (9, 10, 11)Debriefing over lunchAllows more people to attend
Month (Sprint)Eliminates deciding when to testFinds enough problems to fixAffordable, iterative, scalable
Use Existing Spaces
http://portfolio.splendidnoise.com/
Or Test Remotely
Conference roomLaptop, projector, speakerphone, snacksModerator, observersWebEx
Remote participant Internet connection, phone
BenefitsEasier recruitingEasier schedulingNo travel requiredNatural environment
Test What You Have
Test What You Have
MaterialsLegacy products
Competitor products
Products in development
Completed products
Mockups (Balsamiq)
Wireframes (HotGloo)
Visual composites
Prototypes (HTML)
Test What You Have
Business & Company Resource Center
Business Insights: Global
Books & Authors
Health Matters
Course Reader
Gale Admin
Nineteenth Century Collections Online
Gale Virtual Reference Library
Illustrated London News
World Scholar: Latin America
Slavery Anti-Slavery
State Papers Online
Literature Resources from Gale
National Geographic Digital Library
What Have We Tested?
Powerspeak
Galaxy
Gale NewsVault
Business Principles and Practices for the Salon and Spa
Encyclopedia.com
Public Library Websites
PowerSearch
Academic OneFile
Newsstand
Science, Technology, Engineering, & Medicine (STEM)
Opposing Viewpoints in Context
HR Immersion Site
What Have We Tested?
http://farm7.static.flickr.com/6211/6351911040_9f7c92804b.jpg
Recruit
Recruit
Who? Representative users
How many? Three per sprint, plus one backup
How? Customers, personal networks
Why? Amazon gift cards
Prepare Tasks
http://www.uqul.uq.edu.au/
Prepare Tasks
Pre-test questionsGet participants talking
Critical tasksHome – impressionsSearch – satisfactionDocuments – outcomes
Alternative designs
Upcoming stories
Moderate
http://iutp.org/files/bunnyfoot/pics/blowup6.jpg
Moderate
Tour guideGive participant instructionsKeep things moving
TherapistGet participant talkingShow you are listeningStay neutralRespect participant, privacy
Observe
Attend a session (or three) Avoid distractions
Take notes Notice where user is confused or can’t complete tasks
Make list Three most serious usability problems
Debrief
Share observationsThree most serious usability problems per observer
Prioritize as a team
Discuss easiest fixTweak, don’t redesignTake something away
Commit to changes
1 round of tests per sprint from concept to launch1 morning per round (tests and debriefing)3 participants per roundHeld in conference rooms and remotely with WebExObserved by teamTen problems and fixes prioritized by teamFindings and fixes distributed immediately afterwards$4,000 per round
Agile User Studies