How to Prevent App Failures with Real User Conditions

Prevent App FailuresTest Real User Conditions

2

Sveta Kostinsky Dir. Field Engineering

Meet your Users!

05/03/2023 3© 2015,Perfecto Mobile Ltd. All Rights Reserved.

Georgia PeterSara SamRoss

Quality reality

Mobile Calendar 2016

05/03/2023 5© 2016, Perfecto Mobile Ltd. All Rights Reserved.

Mobile application release frequency

• Most successful apps release 1-4 updates a month

• Release should balance between bug fixes and feature updates

• Updates is a great marketing tool for developers to leverage

• Developers can speak with their user base via release notes or comment in the reviews


201736 per year

App releases per year

*The IDC predicts that by 2017, most app releases will occur 36 times per year

Problem


The Digital Reality

Users expect apps to work in the mobile moment

(regardless of conditions)

Failure to satisfy is costly

Problem


The Mobile ExperienceQuality Challenge

1) Build common user environment condition profiles into test suites

2) Assemble multiple solutions to execute tests across profiles

3) Integrate user condition testing within Continuous integration pipelines

4) Analyze app performance blind spots

True user centric testing

Optimize your LAB environment, LAB configuration and the choice of user flows to reflect your users.



Georgia PeterSara SamRoss


End user conditions in your lab

Name: SaraLocation: LondonDevice: iPhone 6, iOS 9.2Carrier: BTNetwork condition: 3GBackground apps: Instagram, Facebook, Uber

Align coverage planning to business priorities

Automate lab configuration to end user conditions

Multiple devicesMobile | Tablet | Desktop

End user conditions

Quality in the digital era needs to align to the business

12

© 2015, Perfecto Mobile Ltd. All Rights Reserved.

Marketing / Business Business-Engineering alignment Automated lab configuration Communicate Risk in business terms

Name: SaraLocation: LondonAge: 25Device: NewSensitivity to UX: HighBehavior: Fashion magazine designer

Engineering

Name: SaraLocation: LondonAge: 25Device: NewSensitivity to UX: HighBehavior: Fashion magazine designer

Name: SaraLocation: LondonDevice: iPhone6, iOS 9.2Carrier: BTNetwork: 3GBackground Apps: Instagram, Facebook


Name: SaraLocation: LondonDevice: iPhone6, iOS 9.2Carrier: BTNetwork: 3GBackground Apps: Instagram

Persona dimension in the coverage matrix

Real user condition - Network

• vs. corporate firewall

• LTE to WiFi seamless transition

• WiFi assist on iOS9

• Offline mode testing

14

Real user condition - Network

• Weak network signal – will I be charged twice??

• Changing network conditions flows – 3G/LTE

• Have to test the end to end flow on IPV6

• Always helps to test on real carrier network – SIP

• Apple Network link conditioner vs. external emulation TCP layer acknowledgements timing

15

Real user condition - Working with 3rd party applications

• Sharing the device Camera application

• Notifications, incoming calls, incoming text messages

• Posting to third party application

• Performing sign in via a 3rd party application

• Context switching between the apps

16

Real user condition - Memory and CPU

• iPhone photos application

• Low memory conditions on the device

• Hybrid apps and low memory

• Thermal throttling of CPU – LTE connection

17

Real user condition - Rotation state and language

• Testing different orientation

• The need for visual analysis


User Centric Quality - Lab with Real end user environment conditions

Simple Functional Testing Is Not Enough

Perfecto Wind Tunnel - Lab Environment

Easily bring your end user experience into the lab

Offer a test environment that expands coverage to real world user conditions

So that,1. User experience blind spots are exposed2. Mobile-user expectations are met3. Business outcomes are assured


Demo time


Lab Configuration

Is your LAB up-to-date?No, really up-to-date?

Set up an agile lab, responsive to adoption trends.


Optimize your lab


User flow

BI and flow analysis as part of Persona

27

Where should I spend most of my time?

Next Webinar June 30: Why Apps Succeed

• Panel Discussion of New Survey Results

Register today:http://info.perfectomobile.com/Why-Apps-Succeed-Registration.html


http://info.perfectomobile.com/Why-Apps-Succeed-Registration.html



Please complete the survey!

[email protected]+1-339-927-4343Sveta Kostinsky

mailto:[email protected]

How to Prevent App Failures with Real User Conditions

Mobile

Transcript of How to Prevent App Failures with Real User Conditions