SOASTA mPulse: Delivering the Real in Real User Measurement (RUM)

1© 2012 SOASTA. All rights reserved.

SOASTA mPulse: Delivering the Real in Real User Measurement

Webinar

Presents

Analyze Real User Experiences in Real

Time

2© 2012 SOASTA. All rights reserved. May 22, 2012

Real user intelligence when you need it

In This Webinar

TODAY’S SOASTA PRESENTERSCliff Crocker - @CliffCrocker

VP Product Management, mPulse; former head of Walmart LabsBuddy Brewer: - @BBrewer

VP Engineering, mPulse; LogNormal Co-Founder

Agenda: • Why RUM?• mPulse in action

• Capture all the data• Leverage custom timer and metrics• See information real time

• Q&A during and after

Questions: Submit in chat box during event

Get FREE mPulse Lite

www.soasta.com/free


How it WorksCollecting user experiences from the source

Data is collected from end user

Beacon is fired to our analytics engine

Real-time data visualizations are displayed in our SaaS portal


Why RUM?

o For any given site, in a single moment:

• 300+ different user agents (from Chrome 27 -> Ice Weasel)

• Variable network throughput (<56K to Google fiber)

• People connected from every region in the world

• Wide proliferation of mobile devices

Today’s web and mobile landscape – “It’s Complicated”


Why RUM?

o User’s expectations continue to outpace our ability to deliver speed

• Without measuring real users, you have no visibility into the perceived speed of your application

• Further, you have no possible way of understanding the impact on your business!

User expectations are high

Bou

nce

Rat

e

Load Time


So why aren’t we using it?Minding the RUM gap

o According to a study done in 2012* only 1 in 5 of the top ecommerce sites are using some form of RUM

*http://www.webperformancetoday.com/2012/11/13/real-user-monitoring-rum-ecommerce-sites/

No RUM

RUM


Poll Question


Data problems are hard

o RUM is all about scale

o Even moderate sized sites generate a significant amount of data

o Some approaches to this problem:

• Sample the population

• Collect for short durations

• Process large data sets in ‘batch’


The Problem with SamplingSimple math

o Example: A typical site generating roughly 1M data points in a day

• Sample @ 1% -> 10,000 data points

• You only care about the U.S. which is 80% of your traffic -> 8,000 data points

• You’re focused on a problem with Checkout pages which account for 10% traffic -> 800 data points

• The problem you are investigating is specific to IE7 users(5%) -> 40 data points

• 40/1,000,000 -> Represents .004% of your population!

Your conclusions are only as good as your data


“I’ll just turn it on for a little while”Collecting a data stream for a fixed duration

o Performance and user behavior is hard to predict – and extremely variable

o If you knew what you were looking for, and when it was going to happen – you wouldn’t need data in the first place!


Batch ProcessingDon’t be late to the party

o While it can still be useful, it’s not operational

• Can’t answer the question of “What is happening on my site right now?”

• By the time you see the data (next day, hour or even minute) it may be too late

http://www.flickr.com/photos/79305942@N00/

I found it!

POSTMORTEM


Pulling it all Together

o How fast am I?

o How fast should I be?

o How do I get there?


How fast am I?(Really)


How fast am I?Measuring Performance

DNS

TCP

SSL Back-End

Front-End

DOM Loading

DOM Ready

Page Load

Above the fold

Page Usable

Third party Advertisement


How fast should I be?Bounce Rate vs. Page Load


How fast should I be?Measuring User Engagement

Bounce Rate

Conversion

Revenue

Facebook Likes

Comments

Items Sold


How do I get there?Multi-dimensional analysis


Thanks

Contact SOASTA:[email protected]

866.344.8766Follow us:

twitter.com/cloudtest

facebook.com/cloudtest

Knowledge Center• White Papers• Webinar Recordings• Case Studies

CloudLink Community• Support• Tutorials• Videos

Get FREE mPulse Lite

www.soasta.com/free

Gain performance insight across multiple dimensions• Page type• Every country in the world• User engagement• Bandwidth • Full support for all web and mobile browsers

SOASTA mPulse: Delivering the Real in Real User Measurement (RUM)

Technology

Transcript of SOASTA mPulse: Delivering the Real in Real User Measurement (RUM)