Testers’ tired eyes

Kaspar Loog

Speaker info

Kaspar Loog, EstoniaFounder of Browserbite

Sr Project Manager, Danske Bank

• Testing industry since 2007

• Different lead roles in QA

• Chair of Nordic Testing Days

/in/kasparloog

Do you remember a website?

• Does NOT work on your iPad?

• Does NOT work on your Safari?

• Does NOT work on Internet Explorer 8? ;)

Internet Explorer 9

Where’s thatbutton?

Internet Explorer 8

Seedcamp.commissed 20% of market!

Launch of iPad: Resolutionary?

Let’s do some math!

• Operating systems– Versions

• Devices– Variations

– Firmware versions

• Resolutions– Orientation

– Pixel scaling

• Browsers– Versions

• iOS, Win, Mac OS, Linux– 10.0, 10.1, 10.2, 10.3,. 10.4

• iPhone 7– Ordinary + Plus version

• 750 x 1334– 750 x 1334, 750 x 1334

– Normal, Large

• Safari, Chrome– Oh my god!!??

6 ways that browsers cheat you

• Gradients

• Dithering

• Antialiasing

• Javascript/DOM interpretation differences

• Resolution differences

• Code „enhancment“

• Evergreen versions

Gradients, dithering, antialias

Javascript, DOM, HTML5

Resolution differences

Your brain fools you

People see „blocks“ not HTML

Font differences

Wrapping

• Big text affects visual layout

– PROBLEM

• vs

• Small text affects visual layout

– NO PROBLEM (usually)

People fail at testing visual differences

1 tester out of 3 finds the actual issuesLayout testers are about 2x better than „average“ testers

Cross browser testing & ComputerVision

URL

Compare

Process

Capture

Report

Man vs machine – issues found

0,0%

10,0%

20,0%

30,0%

40,0%

50,0%

60,0%

70,0%

80,0%

90,0%

100,0%

Position Visual Total

browserbite

Reference group

Average tester

Tool + one tester

False positives & negatives

0,0%

5,0%

10,0%

15,0%

20,0%

25,0%

30,0%

35,0%

40,0%

45,0%

50,0%

False positive False negative

browserbite

Reference group

Average tester

Speed, performance, volume

Metric Average tester Automated

Browsers covered 2 13

URL-s tested 50 50

Time spent (minutes) 150 13

Summary

• Layout testing = money in the bank

• Browser vendors have very different implementations of standards

• Humans make lousy testers

• Best practical combination: human-computer-human

Questions

5 minutes.You can also ask questions from me in the lounge zone