Quality Mobile Assurance with IBM Bluemix™

© 2014 IBM Corporation

Continuous Quality for Mobile Apps Reduce your time-to-feedback

© 2014 IBM Corporation2 #IBMMobile

Interactivity Tips

1. Ask A Question

2. Download a PDF copy of today’s presentation

3. Social Networking Tools


Leigh Williamson (speaker)

@leighawilli

IBM Distinguished Engineer

Nathan Vega (moderator/host)

@IBMBluemix

Developer Engagement, IBM Bluemix

© 2014 IBM Corporation

Continuous quality for mobile apps Reduce your time-to-feedback

Leigh Williamson, IBM Distinguished EngineerIBM Software Group, Mobile App Development

Leigh Williamson, IBM Distinguished EngineerIBM Software Group, Mobile App Development


Mobile Business Apps Are Changing Everything

High-quality mobile apps that keep users engaged are crucial to keep competition away, maintain customer loyalty, and expand customer base.


Mobile is changing our view of qualityBug counts are no longer an effective measure of mobile app quality

Quality is no longer just about bugs in the code

Move Testing beyond the Traditional Test Lab

Ratings and user feedback determines quality

New focus on reducing time to feedback vs bug count


Best practice: continuous delivery for mobile appsbacked by a set of cloud services for each stage of the app lifecycle

DeveloperChecks in codeChecks in code

Mobile build serviceMobile build service

Manual mobile testing servicesManual mobile

testing services

Post-release mobile services

Post-release mobile services

DailyDaily

HourlyHourly

Release

Release

WeeklyWeekly

Automated mobile testing services

Automated mobile testing services

Mobile device farm

IBM Mobile Quality AssuranceIBM Mobile Quality Assurance


Why does every mobile app need Mobile Quality Assurance?

Mobile app crashes often go undetected causing loss of customers/transactions/purchases

EVERY SECOND of the day, two new comments or ratings are being entered into global app stores, difficult to isolate feedback without bias

Testers typically spend 15-20 minutes PER DEFECT of time-consuming data entry

Businesses outsourcing mobile apps need insight into usability and quality of mobile apps they paid for

Deliver 5 star apps with real-time insight into mobile app usability and user experience in seconds Powerful framework to quickly collect user feedback and deliver it to key stakeholdersSubmit defects in seconds while using the app from mobile deviceReal-time usability feedback, including bugs and crashes from testers, to reduce defects and improve mobile apps experience Aggregate app user feedback, with sentimental analysis analytics to boost app ratings.

User experience testing is manual and lacks true insight of app performance in the real world

© 2014 IBM Corporation9 #IBMMobile 9

Tester End UsersDeveloperLOB/Digital Marketer

“When someone leaves a negative review in the app store, it scars your app for life, you can’t respond to it, and you can’t learn more about the problem in order to fix it quickly.”

- Mobile Orchard

• How effective our mobile app is at engaging customers?

• How can I proactively listen to user feedback, analyze user sentiments and turn them into an actionable strategy?

• How can I get early quality feedback?

• How can I tell if the apps will work with different devices, network carriers, and OS versions?

• How can I get visibility to issues that customers experience in production?

• How can I get the latest and greatest build without wasting my time to track that down?

• How can I quickly submit bug reports with screenshots and device details right from the application?

• How can I provide direct and constructive feedback?

• When will the issues that I have with the app be resolved?

Concerns that make Mobile App Quality different


IBM Mobile Quality Assurance

• Engage

• Understand

• Guide

• Diagnose

• Implement

• Distribute

• Acquire

• Capture

• Report

• Engage

• Enjoy

• Recommend

Testers UsersDevelopersLine of business

4

23

1

Distribute apps to testers in seconds1

4

23

Report bugs & crashes in app

Report feedback & crashes in app

Assess quality & app store sentiment

ibm.biz/mobilequalityassurance

IBM Worklight Quality Assurance

IBM Mobile Quality Assurance for Bluemix

OR


Over the air distribution Deliver new builds directly to testers

Developers upload builds and choose recipients (testers)

Testers get notified by MQA then download builds “in app” or from web dashboard

Dev

Owner

User

Test

Builds

Enables developers to distribute new builds to testers


In-app pre-production feedback Deliver feedback from test to development

Testers send bug reports from “in app” Apps report their own crashes, and send logs Developers diagnose and fix context rich bugs /

crashes Owners prioritize and direct resolution of bugs /

crashes

Dev

Owner

User

Test

Cra

shes

Bug

re

port

s

Log

ging

Enables testers to submit bug reports directly from their phone


In-app production feedback Deliver feedback from users to

development

Users send feedback “in app” Apps report their own crashes, and send

logs Owners assess feedback and direct

development Developers diagnose and fix crashes

Dev

Owner

User

Test

CrashesFeedback reports

Logging

Enables developers to connect with users


App store production feedback Analyze app store reviews and ratings to

derive sentiment

Users rate and review apps on app stores

Owners assess sentiment feedback and direct development

Developers review sentiment feedback and improve apps

Dev

Owner

User

Test

App store sentiment

Enables line of business to mine user sentiment


Routes to access quality assurance for mobile

IBM Worklight (On-Prem)

IBM Bluemix (SaaS)

Mobile Services

DevOpsServices

The On-Premise version will be marketed as Worklight Quality Assurance.

The SaaS version will be marketed as Mobile Quality Assurance.

QualityAssurance

SaaS vs. On-Premise1.Same features2.Different delivery methods and routes to market3.Different consumption models and charge metrics4.Require separate entitlements


1 Download the free IBM Worklight Developer Edition: ibm.co/worklightde

Learn more: ibm.com/mobilefirst

23

Ways to get started with IBM MobileFirst

Try IBM Mobile Quality Assurance: https://ibm.biz/mobilequalityassurance


Thank You,

QUESTIONS?


Attendee Services

• Download a copy of today’s presentation

• A recorded version of this seminar will be available at www.eSeminarsLive.com

• View a calendar of our Upcoming Events

Quality Mobile Assurance with IBM Bluemix™

Technology

Transcript of Quality Mobile Assurance with IBM Bluemix™