Mobile Testing Center of Excellence GroupPerfectomobile

Mobile Performance Best Practices

Enabling Enterprise mobility

Extending Software Quality to Mobile

We will be starting momentarily

Webinar Agenda

4

• Q&A

3

• Mobile Performance Demo

• Mobile Performance Case Study

2

• Mobile Performance Intro

• Mobile Performance building blocks

1

• Intro

∙ Founded 2006

∙ 80+ employees

∙ Office in Boston, London, Israel

∙ Over 600 customers

∙ Fortune 500 enterprises, Telcos, SMBs

∙ SaaS Platform + Licenses

∙ Recurring revenue model

Mobile Application Qualityacross the mobile application lifecycle

MonitoringMonitoring TestingTesting AutomationAutomation

ALM Integration

ALM Integration

OffshoringOffshoringContinuous IntegrationContinuous Integration

Public Cloud Private Cloud

Solution - The MobileCloud™ Platform

Mobile Performance

Testing

Mobile Performance in the

application lifecycle

Functional

Automation

Performance

Time

Pro

du

ctio

n

Continuous

Delivery

Measuring the mobile end user experience in real-world simulated

conditions

Servers will be loaded

Networks will experience performance issues

Devices will behave differently

Optimizing/troubleshooting the bottlenecks

Find & measure against a mobile-specific benchmark

Understanding the specific mobile bottlenecks. And optimize

• Caching

• Reduce network dependency & chatter

• Provide graceful fallback

What is mobile performance

testing?

Virtual Users

Response time &

availability

Mobile KPI

Different devices will behave

differently when the server is loaded

(Delay, timeout,…)

Different devices will behave

differently under network

conditions

Bandwidth

Transaction

response time

Mobile KPI

3G

WiF

i

LTE

Bandwidth CPUBandwidth CPU

The mobile constraint:

POLL

“Efficiency of performance was identified as a focus for

mobile testing activity by almost two-thirds (64%) of firms”

“Mobile users expect robust performance and usability on the

move”

“Financial firms are the most acutely concerned about

application performance with 72% citing this as a priority. ”

“Performance is the key to success”

�Measure the mobile end user experience

�Define and execute the metrics that users care about

�Execute the test on a variety of devices

�Execute the test on a variety of networks

�Discover the impact of server load on mobile users

�Measure the mobile experience while server load

�Enable mobile performance testing on proven enterprise-

grade solutions

5 Key Requirements for Mobile

Performance Testing

Measure user-facing KPIs

under network conditions

Collect network sniffer file

Analyze network traffic

View network optimization

recommendations

Convert network sniffer (PCAP)

file into emulated traffic load

Conduct measurement from

real devices (while the service

is under load)

Focus on real device

measurements

Network conditions Server load conditions

Performance testing- Mobile User Experience- How To

Mobile Performance

Demo

Mobile Performance

Best Practices

Ramesh Nagarajan

Sky IT Group

1616

About Sky I.T. Group

About Sky I.T. Group• Established in 1997

• Headquartered in NYC, Office in: ATL, Raleigh, Boston, Baltimore,

Ft. Lauderdale & San Jose

• 60+ Employees

• Focus: Leverage Technology to solve Business Challenges

• Target Market – Mid-to-Large Enterprise

• HP Focus

• HP Software Reseller

• HP Solution Provider – Professional Services

• HP Education Provider

• Specialty Focus:

• Managed “Testing-as-a-Service”

• Mobility Testing CoE

• Service Delivery – Throughout the USA

Organization• Seasoned Executive & Account Management Teams

• HP Certified PS Delivery Teams

• Leading provider of HP Software Solutions

• Largest/Authorized HP SW Training Partner

• HP SW Certification Center

Awards• 2012 HP Software Spirit Award

• 2011 HP East Commercial Partner of the Quarter & Year

• 2010 HP Emerging Partner of the Year

• 2010 Arrow Partner of the Year

Importance of Mobile Performance Testing

Customer dissatisfaction

The customer goes to your competitor’s mobile site

Impact to your brand

Loss of revenue

Loss of customers

YOU YOUR COMPETITOR

Impact of mobile on performance

500 Web Virtual Users

against a web

application – No Mobile

users until 26 minutes –

stable performance

10 Mobile

users

introduced at

26 minutes

Factors that impact Mobile Performance

Number of Mobile users

Application Design and

Code

Mobile Devices

and their OS

Mobile carriers

and their quality

Type of Connection

– 3G, 4G, WiFi etc.,

Location

Selection of Right Mobile Automation

Tools

Identify the right

combination to emulate

Capture, Analyze and Identify the

performance bottlenecks

Key Considerations for Mobile Performance Testing

Selection of Right Mobile Automation Tools

Scripting capability

Network emulation capability

Load testing capability

Analyzing capability

Right combinations to emulate

Know your end user profile

Identify the business processes

Identify the most important device and network

conditions combinations

Determine the expected load

Emulate production load mobile scenarios using

PCAP and real devices

Capture, Analyze and Identify the performance bottlenecks

Monitor real devices power and performance

Correlate the metrics and identify bottlenecks

Utilize snapshots, video of test executions & logs

Analyze the impact of mobile users

In this white paper, you will be able to gain insights

into the following mobile performance aspects:

Key building blocks for a mobile performance solution

Best practices and process to build a mobile performance

solution

Best practice solution design overview

LINK to download (Registration required):

http://help.perfectomobile.com/article/AA-01594/

Mobile Performance White paper

If you have any further questions,

please contact:

Perfecto Mobileinfo@perfectomobile.com

erank@perfectomobile.com

amirr@perfectomobile.com

rnagarajan@skyitgroup.com

Thank You!

Join us on LinkedIn

Mobile Testing Center of Excellence