Agile User StudiesDerek PoppinkUser Experience Manager

Cengage Learning

Who we are

LIFELONG LEARNING Elementary and high school 2- and 4-year colleges and

universities Private/For Profit Colleges Professional Training & Continuing

Education

RESEARCH Academic School Public Government

Annual revenue: $2 billion 5,600 employees Operations in more than 20 countries

User Experience

What we do

http://www.limina-ao.com/approach/agile.html

User Experience

Why we do it

Peter Morville’s UX Honeycomb: http://semanticstudios.com/publications/semantics/000029.php

Agile User Studies

• Why User Studies?

• What is an Agile User Study?

• When

• Where

• What

• Who

• How

• Questions

Agenda

Why User Studies?

• All sites have usability issues

• Serious issues are easy to find

• Watching users makes you a better designer

Big Honkin’ User Studies

http://www.laurasmith.info/UsabilityTest.jpg

1-2 rounds of tests when site is nearly complete1-2 days of tests per round5-8 participants per roundHeld on-site in room with one-way mirror1-2 observers (product owner)Dozens of problems prioritized by moderator1 week to prepare report afterwards$25,000 per round

Big Honkin’ User Studies

Agile User Studies

http://www.uxforthemasses.com/blog/wp-content/uploads/2010/09/usability-testing-session.jpg

1 round of tests per sprint from concept to launch1 morning per round (tests and debriefing)3 participants per roundHeld in conference rooms and remotely with WebExObserved by teamTen problems and fixes prioritized by teamFindings and fixes distributed immediately afterwards$4,000 per round

Agile User Studies

A Morning A Month

http://b.vimeocdn.com/ts/693/515/69351512_640.jpg

A Morning A Month

Morning3 sessions (9, 10, 11)Debriefing over lunchAllows more people to attend

Month (Sprint)Eliminates deciding when to testFinds enough problems to fixAffordable, iterative, scalable

Use Existing Spaces

http://portfolio.splendidnoise.com/

Or Test Remotely

Conference roomLaptop, projector, speakerphone, snacksModerator, observersWebEx

Remote participant Internet connection, phone

BenefitsEasier recruitingEasier schedulingNo travel requiredNatural environment

Test What You Have

Test What You Have

MaterialsLegacy products

Competitor products

Products in development

Completed products

Mockups (Balsamiq)

Wireframes (HotGloo)

Visual composites

Prototypes (HTML)

Test What You Have

Business & Company Resource Center

Business Insights: Global

Books & Authors

Health Matters

Course Reader

Gale Admin

Nineteenth Century Collections Online

Gale Virtual Reference Library

Illustrated London News

World Scholar: Latin America

Slavery Anti-Slavery

State Papers Online

Literature Resources from Gale

National Geographic Digital Library

What Have We Tested?

Powerspeak

Galaxy

Gale NewsVault

Business Principles and Practices for the Salon and Spa

Encyclopedia.com

Public Library Websites

PowerSearch

Academic OneFile

Newsstand

Science, Technology, Engineering, & Medicine (STEM)

Opposing Viewpoints in Context

HR Immersion Site

What Have We Tested?

http://farm7.static.flickr.com/6211/6351911040_9f7c92804b.jpg

Recruit

Recruit

Who? Representative users

How many? Three per sprint, plus one backup

How? Customers, personal networks

Why? Amazon gift cards

Prepare Tasks

http://www.uqul.uq.edu.au/

Prepare Tasks

Pre-test questionsGet participants talking

Critical tasksHome – impressionsSearch – satisfactionDocuments – outcomes

Alternative designs

Upcoming stories

Moderate

http://iutp.org/files/bunnyfoot/pics/blowup6.jpg

Moderate

Tour guideGive participant instructionsKeep things moving

TherapistGet participant talkingShow you are listeningStay neutralRespect participant, privacy

Observe

Attend a session (or three) Avoid distractions

Take notes Notice where user is confused or can’t complete tasks

Make list Three most serious usability problems

Debrief

Share observationsThree most serious usability problems per observer

Prioritize as a team

Discuss easiest fixTweak, don’t redesignTake something away

Commit to changes

1 round of tests per sprint from concept to launch1 morning per round (tests and debriefing)3 participants per roundHeld in conference rooms and remotely with WebExObserved by teamTen problems and fixes prioritized by teamFindings and fixes distributed immediately afterwards$4,000 per round

Agile User Studies