InfoStretch - Mobile Testing: Practical tips, tricks and techniques
23
Practical Tips, Tricks, and Techniques of Mobile Testing Damanpreet Singh Quality Assurance Technical Lead InfoStretch Corporation
-
Upload
infostretch-corporation -
Category
Documents
-
view
904 -
download
3
description
Learn how effective mobile testing strategies could quickly get your app to market. Building an app is one story but making it ‘market ready’ is a different game. The App to market lifecycle involves several steps and the most important is detailed testing across all platforms and devices for performance, usability, security, and functionality to name a few. Emulators are not a solution because they cannot imitate all carriers, OEM's and other technological characteristics that a physical device would have. And, with over 200 different Android devices, tens of Apple products, and other significant platform devices available in the market, it is practically impossible for a mobile developer to test the app on all of them. So the big question – Given these constraints, how do you take your app to market as quickly as possible? We will share experiences from the field and talk about how we’ve mastered this art by testing thousands of these applications In this session with him, you’ll learn: The importance of mobile testing in the app to market lifecycle. How to wisely choose a subset of devices from the universe of devices available? How do you acquire the devices – crowd, lease or buy? What are the different domains of mobile testing you should focus on for your type of application? What is the difference in testing different types of applications in HTML5, native, hybrid and, cross platform?
Transcript of InfoStretch - Mobile Testing: Practical tips, tricks and techniques
Practical Tips, Tricks, and Techniques of Mobile Testing
Damanpreet SinghQuality Assurance Technical Lead
InfoStretch Corporation
Agenda
• Introduction• Range of Mobile Devices• Types of Mobile Apps• Importance of Mobile App Testing• Choice of Mobile Devices• Q A
Mobile Phones Landscape
World’s average birth rate is 371,000 babies per day
Average 377,900 iPhone sold per day in Jan 2012
Average 700,000 Android Phones activated per day in Jan 2012
App Count
60k 70k
400k 600k
App Store Facts
Apple AppStore: 25 Billion downloadsAndroid MarketPlace: > 11 Billion
downloadsRecord 1 Billion apps downloaded in last
week of December 2011 on iOS and Android
Blackberry App World: > 2 Billion downloads
Range of Mobile Devices
Andr
oid • Total: 224
• Phones: 192• Tablets: 32 Ap
ple • Total: 10
• Phones: 5• Tablets: 3• Apple TVs: 2
OS Landscape - Android
Courtesy: wikimedia.org
Version Supported Portable iOS Devices
3.1.3 iPhone (original); iPod Touch (1st generation)
4.2.1 iPhone 3G; iPod Touch (2nd generation)
5.1 iPhone 3GS, iPhone 4 GSM/CDMA, iPhone 4S; iPod Touch (3rd and 4th generation); iPad, iPad 2, iPad (3rd generation)
Version Supported Apple TV
5.1 Apple TV (2nd & 3rd generation)
OS Landscape - iOS
Courtesy: wikipedia.org
Inception Design Development SubmissionTesting &Validation
App Store
App to Market Lifecycle
App Types
•Auto Loan Calculators•Credit Card / Debt Calculators
Utilities Apps
•PopEater•Gossip Grub
Entertainment Apps
•Angry Bird•Totemo
Games Apps
•NPR News•AP Mobile
News Apps
•Evernote•YPMobile
Productivity Apps
•WordRoll•Periodic Table
Search Tool Apps
•Facebook•Twitter
Social Networking
•F1 LIVE RACING•NBA Game Time Lite
Sports
•GPS Status•Wikitude
Travel
•Ancient Greece •Obit
Weather
• Diet Calendar• iPump & Fitness Builder
Fitness
• WhatsApp• Call & SMS Filter
Call and SMS
• Kindle Reader• Crimson City
eBook
• BigOven• In the Kitchen
Cooking Recipe
Test Categories
• Security
• Functional
• Usability
• Network Compliance
• User Interface
• Stability
• Profanity
• Copyright & Trademark
• Performance
Common App Failures
• Security OPT-IN/OPT-OUT
• Functional INCORRECT RULES (e.g. CHESS)
• Usability BAD USER EXPERIENCE
• Network Compliance CONT. N/W CONNECTIVITY
• User Interface AMATEUR GRAPHICS
• Stability APP CRASHES
• Profanity OBJECTIONABLE CONTENT
• Copyright & Trademark COPYRIGHTED SOUND TRACK
• Performance >75% CPU
Common OS Failures
• App won’t install• App crashes• Resolution out of proportion• Poor response to Touch, Tap, Pinch, etc.
Tool Set
• Security WIRESHARK, LOOKOUT, ETC.
• Functional FUNCTIONAL REQUIREMENTS
• Usability RANK BASED (1-10)
• Network Compliance HTTP SCOOP, PASSMARK PERFORMANCE
• User Interface RANK BASED (1-10)
• Stability MONKEY, QUICKKEYS
• Profanity CUSTOM SCRIPT FOR SCANNING
• Copyright & Trademark SOUNDHOUND
• Performance SYSTEM PANEL, ACTIVITY MONITOR TOUCH
Device vs Test Coverage
• #Android Phones = ~190• #iOS Phones = 5• #Ave. Test Cases per device = 60• Total Test Cases = 190*5*60 = 57000
Device Coverage
Courtesy: http://www.wikipedia.org
Tips
• Simple Design• Intuitive Navigation• On-Demand Network Access• Opt-In/Opt-Out Implemented• EULA
Tricks
• KeynoteDeviceAnywhere• Tools: Wireshark, Lookout, System Panel,
Activity Monitor Touch, etc.• Smoke Testing: Functional, Performance, N/W
Compliance
Example (1)
• Security
• Performance
• N/W Compliance
• Usability
Example (2)
• Usability
• Performance
• UI
• Stability
Focus Areas
• Usability, Performance, Functionality
Utilities Apps
• Usability, Stability, Copyright & Trademark
Entertainment Apps
• Usability, Performance, UI
Games Apps
• UI, Stability, Functionality
News Apps
• Usability, UI, Performance
Productivity Apps
• Functionality, Security, Stability
Search Tool Apps
• Usability, UI, Network Compliance
Social Networking
• Usability, UI, Functionality
Sports
• Usability, Security, Stability
Travel
• Usability, Functionality, Stability
Weather
• Usability, Performance, Functionality
Fitness
• Usability, UI, Security
Call and SMS
• UI, Usability, Stability
eBook
• Copyright & Trademark, UI, Usability
Cooking Recipe
Q/A
