Mobile Testing Center of Excellence GroupPerfectomobile
Mobile Performance Best Practices
Enabling Enterprise mobility
Extending Software Quality to Mobile
We will be starting momentarily
Webinar Agenda
4
• Q&A
3
• Mobile Performance Demo
• Mobile Performance Case Study
2
• Mobile Performance Intro
• Mobile Performance building blocks
1
• Intro
∙ Founded 2006
∙ 80+ employees
∙ Office in Boston, London, Israel
∙ Over 600 customers
∙ Fortune 500 enterprises, Telcos, SMBs
∙ SaaS Platform + Licenses
∙ Recurring revenue model
Mobile Application Qualityacross the mobile application lifecycle
MonitoringMonitoring TestingTesting AutomationAutomation
ALM Integration
ALM Integration
OffshoringOffshoringContinuous IntegrationContinuous Integration
Public Cloud Private Cloud
Solution - The MobileCloud™ Platform
Mobile Performance
Testing
Mobile Performance in the
application lifecycle
Functional
Automation
Performance
Time
Pro
du
ctio
n
Continuous
Delivery
Measuring the mobile end user experience in real-world simulated
conditions
Servers will be loaded
Networks will experience performance issues
Devices will behave differently
Optimizing/troubleshooting the bottlenecks
Find & measure against a mobile-specific benchmark
Understanding the specific mobile bottlenecks. And optimize
• Caching
• Reduce network dependency & chatter
• Provide graceful fallback
What is mobile performance
testing?
Virtual Users
Response time &
availability
Mobile KPI
Different devices will behave
differently when the server is loaded
(Delay, timeout,…)
Different devices will behave
differently under network
conditions
Bandwidth
Transaction
response time
Mobile KPI
3G
WiF
i
LTE
Bandwidth CPUBandwidth CPU
The mobile constraint:
POLL
“Efficiency of performance was identified as a focus for
mobile testing activity by almost two-thirds (64%) of firms”
“Mobile users expect robust performance and usability on the
move”
“Financial firms are the most acutely concerned about
application performance with 72% citing this as a priority. ”
“Performance is the key to success”
�Measure the mobile end user experience
�Define and execute the metrics that users care about
�Execute the test on a variety of devices
�Execute the test on a variety of networks
�Discover the impact of server load on mobile users
�Measure the mobile experience while server load
�Enable mobile performance testing on proven enterprise-
grade solutions
5 Key Requirements for Mobile
Performance Testing
Measure user-facing KPIs
under network conditions
Collect network sniffer file
Analyze network traffic
View network optimization
recommendations
Convert network sniffer (PCAP)
file into emulated traffic load
Conduct measurement from
real devices (while the service
is under load)
Focus on real device
measurements
Network conditions Server load conditions
Performance testing- Mobile User Experience- How To
Mobile Performance
Demo
Mobile Performance
Best Practices
Ramesh Nagarajan
Sky IT Group
1616
About Sky I.T. Group
About Sky I.T. Group• Established in 1997
• Headquartered in NYC, Office in: ATL, Raleigh, Boston, Baltimore,
Ft. Lauderdale & San Jose
• 60+ Employees
• Focus: Leverage Technology to solve Business Challenges
• Target Market – Mid-to-Large Enterprise
• HP Focus
• HP Software Reseller
• HP Solution Provider – Professional Services
• HP Education Provider
• Specialty Focus:
• Managed “Testing-as-a-Service”
• Mobility Testing CoE
• Service Delivery – Throughout the USA
Organization• Seasoned Executive & Account Management Teams
• HP Certified PS Delivery Teams
• Leading provider of HP Software Solutions
• Largest/Authorized HP SW Training Partner
• HP SW Certification Center
Awards• 2012 HP Software Spirit Award
• 2011 HP East Commercial Partner of the Quarter & Year
• 2010 HP Emerging Partner of the Year
• 2010 Arrow Partner of the Year
Importance of Mobile Performance Testing
Customer dissatisfaction
The customer goes to your competitor’s mobile site
Impact to your brand
Loss of revenue
Loss of customers
YOU YOUR COMPETITOR
Impact of mobile on performance
500 Web Virtual Users
against a web
application – No Mobile
users until 26 minutes –
stable performance
10 Mobile
users
introduced at
26 minutes
Factors that impact Mobile Performance
Number of Mobile users
Application Design and
Code
Mobile Devices
and their OS
Mobile carriers
and their quality
Type of Connection
– 3G, 4G, WiFi etc.,
Location
Selection of Right Mobile Automation
Tools
Identify the right
combination to emulate
Capture, Analyze and Identify the
performance bottlenecks
Key Considerations for Mobile Performance Testing
Selection of Right Mobile Automation Tools
Scripting capability
Network emulation capability
Load testing capability
Analyzing capability
Right combinations to emulate
Know your end user profile
Identify the business processes
Identify the most important device and network
conditions combinations
Determine the expected load
Emulate production load mobile scenarios using
PCAP and real devices
Capture, Analyze and Identify the performance bottlenecks
Monitor real devices power and performance
Correlate the metrics and identify bottlenecks
Utilize snapshots, video of test executions & logs
Analyze the impact of mobile users
In this white paper, you will be able to gain insights
into the following mobile performance aspects:
Key building blocks for a mobile performance solution
Best practices and process to build a mobile performance
solution
Best practice solution design overview
LINK to download (Registration required):
http://help.perfectomobile.com/article/AA-01594/
Mobile Performance White paper
If you have any further questions,
please contact:
Perfecto [email protected]
Thank You!
Join us on LinkedIn
Mobile Testing Center of Excellence