1

Conducting Remote Unmoderated Usability Studies: Part 1

www.userzoom.com

2

Conducting Remote Unmoderated Usability Studies: Part 1

Ann RochanayonSr. Director UX/CX Research

UserZoom

speaker

Meet the Speakers

Alfonso de la

NuezCo-founder & Co-CEO

UserZoom

moderator

3

The #1 SaaS Company for Cost-effectiveUser Experience & Usability Testing

Our all-in-one enterprise solutions make research & testing cost-effective, agile and easy

4

• Chat box is available if you have any questions

• There will be time for Q&A at the end

• We will be recording the webinar for future

viewing

• All attendees will receive a copy of the

slides/recording

Quick Housekeeping

Continue the discussion using #LearnRemoteUX

Continue the discussion using: #LearnRemoteUX

5

• Introduction to Remote Unmoderated Research

• Study Design

• Recruitment

• Q&A

Agenda

Continue the discussion using #LearnRemoteUX

6

Conducting Remote Unmoderated Usability Studies: Part 1

• What is it?

• Benefits

• Fast data collection

• Geographic reach

• Natural environment

• Large sample sizes

• No moderator bias

• Cost efficient

Remote Unmoderated Research

7

Conducting Remote Unmoderated Usability Studies: Part 1

• Types of remote unmoderated research

• Task-based

• Prototypes, wireframes

• Longitudinal

• Competitive

• A/B testing

• Ad testing

• Marketing / branding studies

• Timeout testing

• Information architecture

• Card sorting (Open and closed)

• Tree testing

• Screenshot click test

Types of Remote Unmoderated Research

Task-based

Card Sorting

8

Conducting Remote Unmoderated Usability Studies: Part 1

• Quantitative

• Task effectiveness (Task Success)

• Task efficiency (Number of clicks,

unique page views, time on task)

• Rating scales, means, standard

deviation

Types of Data Collected

9

Conducting Remote Unmoderated Usability Studies: Part 1

• Qualitative

• Open ended questions

• Videos of participants’ screen

• Video and / or audio of participants performing the task

• Video question feedback

Types of Data Collected

10

Conducting Remote Unmoderated Usability Studies: Part 1

• Behavioral

• Clickstreams

• Heatmaps

Types of Data Collected

11

Conducting Remote Unmoderated Usability Studies: Part 1

• Define the study goals

• What are the hypotheses?

• Determine the study length

• Keep the participant experience under 20

– 30 minutes to minimize participant

fatigue

• Determine the number of activities and

tasks

• Estimate the amount of time required

• Between subjects design vs. within subjects

design

Study Design

12

Conducting Remote Unmoderated Usability Studies: Part 1

• Use multiple measures to triangulate on the user experience

• Quantitative measures

• Qualitative measures

• Behavioral measures

Study Design

13

Conducting Remote Unmoderated Usability Studies: Part 1

• Set expectations

• Determine what questions to ask at the beginning of

the study

• Demographic information

• Market research questions

• Brand awareness

• Any questions for pre vs. post metrics

• If segmentation or filtering of the data is needed,

close-ended questions are required for the filters

Introductory Questions

14

Conducting Remote Unmoderated Usability Studies: Part 1

• Define the tasks

• Navigation

• Process-oriented

• Content

• Value proposition

• Use a combination of close-ended and open-ended

questions to better understand the user experience

• Hypothesize potential task obstacles; design questions

to test these hypotheses

Task Design and Questions

15

Conducting Remote Unmoderated Usability Studies: Part 1

• Ask questions to understand overall experience

• Include any pre / post metrics

• Net Promoter Score (NPS)

• System Usability Score (SUS)

• Call-to-action metrics

Final Questions

16

Conducting Remote Unmoderated Usability Studies: Part 1

• Determine a target participant profile

• Who is the audience?

• What type of people use the site?

• Consider how common this type of person is in the general population.

• Create a screener if necessary

• Determine the sample size

• Methods of recruitment

Recruitment

17

Conducting Remote Unmoderated Usability Studies: Part 1

Questions & Answers

Continue the discussion using #LearnRemoteUX

18

Conducting Remote Unmoderated Usability Studies: Part 1

• Tuesday, October 7, 2014

• Conducting Remote Unmoderated Usability Testing: Part 2

Next Webinar

19

Need more info?

Get answers about UserZoom. We are here to help. Talk with one of our knowledgeable staff.

Contact us

UserZoom440 N. Wolfe Rd. Sunnyvale, CA 94085

Toll free number: (866) 599 1550

www.linkedin.com/company/userzoom@UserZoomFollow us