Stretching Online Research Tools to Meet Your Research Goals

51
#UXPA2016 @neoinsight Session Survey: www.uxpa2016.org/sessionsurvey/170 www.uxpa2016.org Stretching online research tools to meet your research goals Lisa Fast

Transcript of Stretching Online Research Tools to Meet Your Research Goals

Page 1: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Stretching online research tools to meet your research goals

Lisa FastAll links via http://bit.ly/neouxpa

Page 2: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Lisa Fast

GitHub and Twitter:

@neoinsightor connect with me on Linked In, I post articles there…

Page 3: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Favourite online

research tools

Page 4: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Treejack

Page 5: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Loop11Custom demonstration task instructions version demo is here: http://www.loop11.com/usability-test/27853/introduction/

Page 6: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

EyesDecide

Page 7: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Survey Monkey

Page 8: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Canada: FluidSurveys

Page 9: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Prototyping with Surveyware

Page 10: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Instructions: We are interested in whether you actually take the time to read the directions. So, in order to demonstrate that you have read the instructions, please ignore the question below. Instead, simply put your hand on your opposite shoulder.

Do you have on online survey account?Yes – put your hand up No, not yet

Page 11: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

People are almost twice as likely to miss key instructions on a screen versus paper test.

Oppenheimer, Meyvis and Davidenko via https://www.linkedin.com/pulse/evidence-really-dont-read-instructions-lisa-fast

Page 12: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Page 13: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Research Goal: 1 sprint to try

different approach

Page 14: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Solution: Prototype in Fluid Surveys

Page 15: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Team prototyped together for each sprint – can add images, videos

Page 16: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Lots of sophisticated logic is possible in Fluidsurvey, with no programming skills

required.

Page 17: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Research goal: iterate & test facet design alternatives

Page 18: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Page 19: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Task is a text field

Each group is a question

Page 20: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Research Goal: Recruit & run across sprints

Page 21: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Page 22: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Page 23: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Treejack Study 1

Treejack Study 2

Live Usability SessionsRecruits

Task

succ

ess r

ate

Page 24: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Try It!bit.ly/neouxpa

Flow to recruiter

Page 25: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Redirect on Messages

tab

Page 26: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Add a question to break flow

Page 27: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Recruiter shows different

questions for phones

Page 28: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Recruit Motivated

Participants

Page 29: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Research Goal: Test Interactive Voice Designs

Page 30: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Many people still call!

Page 31: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Yikes! 2 scripts x 40 Pages Long

Page 32: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Treejack! Collaborator click & read Treejack as if he is Live Phone

System

Page 33: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Some Coding Magic:

Transform Script into Excel Tree for

Treejack

Page 34: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Participant Phones in to Session Meeting

Facilitator reads tasks from Treejack

Collaborator reads script, clicks in responses

Participant listens, selects

Page 35: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Bonus: Collaborator picked up on

cues

Page 36: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Results suggested scripted emphasis

& 2 speeds

Page 37: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Research goal: Display tasks for mobile usability

sessions

Page 38: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Solution: put script & tasks into Treejack

for participant

Page 39: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Page 40: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Facilitator Screen

Task on participant laptop via Join.me

View of device and

fingers – mic picks up both

voices

Facilitator notes – can be cropped

out of session videos

Page 41: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Try it: Treejack script & tasks

- designed for iPad or Laptop

via bit.ly/neouxpa

Page 42: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Ziggi HD Document Camera, <$200

Hack a mobile UX camera - take out lead weights, flip it over- Built in microphone in swivel camera head

Page 43: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Research Goal: run eye tracking

to clarify results…

without a lab

Page 44: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Remote eye tracking – via

built-in camerahttp://eyesdecide.com

Page 45: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Video demo for UXPA:

https://youtu.be/_dxGpJ4N8Co

Page 46: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

People weren’t finding links in menu – client thought labels were the problem

Page 47: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Need for Menu Surfaces Lack of Task-Orientation Winterlude navigation is menu-oriented, not tasks on page

Confused people – expect to use links on page

People look at links on page first THEN at menus

Gaze Intensity Map4 Eye tracking participants, same task

Page 48: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Tack it on to end of remote test

sessionor build a panel

Page 49: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Issues: only get 60 seconds

Solution: run a Chalkmark too

Page 50: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Try it yourselfNeed Chrome &

camera: eyes decide

via bit.ly/neouxpa

Page 51: Stretching Online Research Tools to Meet Your Research Goals

#UXPA2016 @neoinsight

Session Survey: www.uxpa2016.org/sessionsurvey/170www.uxpa2016.org

Questions?Tweet me your stretch

uses

Survey please!