UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

64
BunnyfootSays Twitter 1

description

Rob Stevens tells the UK UPA why he feels eyetracking must be used in all web usability tests.

Transcript of UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

Page 1: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

BunnyfootSaysTwitter

1

Page 2: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

20th May 2009

You absolutely positively NEED eyetracking for web user testing.

Page 3: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

21 September 2006

3

972 days have passed....

Page 4: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

4

Page 5: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

5

Page 6: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

6

Page 7: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

7

Page 8: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

8

Page 9: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

9

‘PEEP is a voodoo technique IMHO’

Jared Spool 2009

Page 10: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

You absolutely positively NEED eyetracking for web user testing.

10

DisagreeSomewhatagree

Agree Neither agreeOr disagree

Somewhat disagree

Page 11: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

Why?

11

Page 12: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

12

Page 13: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

Effectiveness, efficiency & Satisfaction?

13

Page 14: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

14

Page 15: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

WHO USES EYETRACKING?

15

Page 16: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

Quick Poll

16

SatisfiedHighly

Satisfied

Partially Satisfied

Not Satisfied

Not at all Satisfied

Page 17: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

The Technology is NOT the Methodology

17

Page 18: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

The reasons

1. Better user tests

2. Optimisation

3. Engage stakeholders

18

Page 19: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

19

Page 20: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

20

Page 21: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

21

Page 22: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

BETTER USABILITY TESTS How to

22

Page 23: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

Post Experience Eye-Tracked Protocol

21st September 2006

UPA Presentation

Page 24: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

Or PEEP for short

21st September 2006

UPA Presentation

Page 25: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

We live much of our lives in the subconscious

Page 26: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

DON NORMAN Other’s understand this too, including

26

Page 27: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

DENNIS BERGKAMP Example of unconscious processing

27

Page 28: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

Thinking aloud can interfere with a primary task by increasing attentional demands so as to change normal strategies.

’(Russo et al., 1989)

Page 29: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

Think aloud can impact on performance and productivity‘

’(Berry & Broadbent 1984)

Page 30: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

Many users find thinking aloud difficult and it makes them feel uncomfortable‘

’(Nielsen1993)

Page 31: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

DENNIS BERGKAMP Let’s see that again

31

Page 32: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

Think aloud causes users to behave differently.

Page 33: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

A new way..

Post Experience Eyetracked Protocol

Page 34: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

PEEP generated significantly moreusability problems overall than the think-aloud method

(Mean = 12.5 Vs. 8.7)

Page 35: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

Participants in the PEEP conditions achieved significantly more correctresponses than those in thethink-aloud condition

(79% vs. 42%)

Page 36: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

79% vs. 42% ?

Page 37: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

OPTIMISATION How to

37

Page 38: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

Usability works

• Expert evaluation

• Paper prototype

• Wireframes

• Think Aloud

38

Page 39: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

39

Page 40: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

MASS USER TESTING; N=30

A New Approach

40

Page 41: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

Monte Carlo Simulation

41

Page 42: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

42

Page 43: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

43

Page 44: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

44

Page 45: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

REAL TIME TO TASK COMPLETION RESULTS

Better methodology

45

Page 46: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

ACCURATE MEASURES OF EFFECTIVENESS EFFICIENCY AND SATISFACTION

Better methodology

46

Page 47: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

79% vs. 42%

Page 48: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

HELP NON SPECIALIST STAKEHOLDERS ENGAGE IN THE PROCESS

How to

48

Page 49: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

TOMLearning from a two year old

49

Page 50: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

Not just a chair with wheels.

50

When you can drive it is a car.

Page 51: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

Not just an eyetracker.

51

When you can drive it is a neuro tool.

Page 52: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking
Page 53: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

53

Page 54: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

54

Page 55: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

Share experiences

55

Page 56: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

The reasons

1. Better user tests

2. Optimisation

3. Engage stakeholders

56

Page 57: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

You absolutely positively NEED eyetracking for web user testing.

The conclusion

Page 58: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

APPENDIX

58

Page 59: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

59

Page 60: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking
Page 61: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking
Page 62: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking
Page 63: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking
Page 64: UKUPA May 09 Rob Stevens Why You Must Use Eye Tracking

64