Raj Subramanian - Mobile Web Testing

“Who here would travel in a plane developed and tested by their

own team?”

Mobile Web Testing - Explored by

Raj Subramanian @epsilon11

Agenda

• Introduction

• Testing Approaches

• Testing Responsive Websites

• Lessons Learned

• Future of Mobile Web

Introduction

My Bio

• Tester at Progressive Insurance (STE)

• 7 years experience in testing

• Actively involved in testing community

• NOSQAA

• NOTICE meetup

• Newsletter

• Testing articles

• Blogging

Mobile Ecosystem

The Context

• Complete redesign of mobile website

• 3 releases

• Made the website responsive

• Testing team size - 2 testers

Device Selection

• Apple

• Android

• Windows

• Blackberry

• Firefox

• Ubuntu

Device Selection - Strategy

• Step 1 - Usage Statistics

• OS versions

• Rendering engines

• Browsers

• Step 2 - Discuss findings and get feedback

• Step 3 - Select devices to test

Testing Approaches

Prioritizing story cards

• Business priority

• Impact to the user

• Amount of testing effort needed

Paired Scripted Testing

• Two sets of eyes. Domain/technical knowledge combination

• Both execute same high level test case and discuss results

Defects

Paired Exploratory Testing

• 45 - 90 min session

• Charter/Goal

• Noted ideas and scenarios

• Paraphrased/Debriefed

• Discussed observations

• Posted defects

Defects

Mobile Testing - Device

• Wi-Fi / 4G

• Interrupt testing

• Sending text messages

• Calling phone

• Disabling javascript

Mobile Testing - Web

• Back buttoning

• Hard buttons

• Soft buttons


• URL editing

• New pages

• Old pages

• System error pages


• Private browsing (Incognito)


• Checking function calls

RST Techniques

• Galumphing

• Doing number of clicks around a button, page text etc.

RST Techniques

• Blink test

• Used to compare two very similar pages and look for differences

• Testing to see visual patterns

Tools

• Browser tools

• Used Chrome/IE (F12) browser tools

• Inspect Javascript, HTML, CSS errors

Tools

• MITE

• Tool from Keynote

• Emulator - over 2200 mobile devices

• Useful for smoke testing

Tools

• Fiddler

• Captures HTTP traffic

• “Login button” scenario

Testing Responsive Websites

What is “Responsive”?

What is “Responsive”

Free Tools

• screenfly - http://quirktools.com/screenfly/

• responsivepx - http://responsivepx.com/

• resizeMyBrowser - http://resizemybrowser.com/

• Responsinator - http://www.responsinator.com/

• Matt Kersley’s tool - http://mattkersley.com/responsive/

• Chrome plugin - Window Resizer

http://quirktools.com/screenfly/

http://responsivepx.com/

http://resizemybrowser.com/

http://www.responsinator.com/

http://mattkersley.com/responsive/

My Tools

• Break point test utility

• Media query test utility

Lessons Learned

From Testing

• Proof of concepts

• Pairing

• Prior investigation

• Continuous research

From Tools

• Sikuli

• Adobe Edge Inspect

• Test Studio

• SeeTest

• Meux

• DeviceAnywhere

• perfecto mobile

For more info - www.rajsubra.com

http://www.rajsubra.com

Future of Mobile Web

Future of Mobile Web

• Testing tools still evolving

• New OS coming up - Firefox, Ubuntu

• Majority of the websites would be “Responsive”

• Integration of mobile web with watch, cars and other devices

Summary

• Introduction

• Testing Approaches

• Testing Responsive Websites

• Lessons Learned

• Future of Mobile Web

Contact Details e-mail: [email protected] website: www.rajsubra.com twitter: @epsilon11

mailto:[email protected]

http://www.rajsubra.com

Raj Subramanian - Mobile Web Testing

Technology

Transcript of Raj Subramanian - Mobile Web Testing