1630 omma metrics josh chasin

36
Making Sense of Measurement: Where Have We Been? Where Are We Going? Josh Chasin; Chief Research Officer; comScore Presented at the OMMA Metrics, July 21, 2011

description

 

Transcript of 1630 omma metrics josh chasin

Page 1: 1630 omma metrics josh chasin

Making Sense of Measurement:Where Have We Been? Where Are We Going?

Josh Chasin; Chief Research Officer; comScorePresented at the OMMA Metrics, July 21, 2011

Page 2: 1630 omma metrics josh chasin

2© comScore, Inc. Proprietary.

@jchasin

Page 3: 1630 omma metrics josh chasin

3© comScore, Inc. Proprietary.

Why Is There So Much Darned Confusion and Complexity Around Internet Measurement?

The Internet is the most measurable medium

The Internet is the medium with the most measures

Page 4: 1630 omma metrics josh chasin

4© comScore, Inc. Proprietary.

As the Great Media Planner Albert Einstein said…

Everything should be made

as simple as possible… but no

simpler.

Page 5: 1630 omma metrics josh chasin

5© comScore, Inc. Proprietary.

The Digital Ecosystem…

Page 6: 1630 omma metrics josh chasin

6© comScore, Inc. Proprietary.

…the Network TV EcosystemA

dve

rtis

er

Ag

ency

Net

wo

rk

Page 7: 1630 omma metrics josh chasin

7© comScore, Inc. Proprietary.

Making Measurement Make Sense: the 5 Principles

1. Move to a “viewable impressions” standard and count real exposures online.

2. Online advertising must migrate to a currency based on audience impressions, not gross ad impressions.

Reach & frequency against a target

3. Because all ad units are not created equal, we must create a transparent classification system.

4. Determine interactivity “metrics that matter” for brand marketers, so that marketers can better evaluate online’s contribution to brand building.

5. Digital media measurement must become increasingly comparable and integrated with other media.

Page 8: 1630 omma metrics josh chasin

8© comScore, Inc. Proprietary.

Where We’re Going…

Measuring viewability

Parsing campaign delivery into target reach and frequency

Toward impression quality metrics

Continued innovation in branding metrics

Breakthroughs in measuring mobile

Continued convergence of Web Analytics and Audience Measurement

Page 9: 1630 omma metrics josh chasin

9© comScore, Inc. Proprietary.

Measuring Viewability

Page 10: 1630 omma metrics josh chasin

10© comScore, Inc. Proprietary.

On Campaign-Level Viewability:

“Mpire also conducted a test directly on a top ten ad network, with the goal of proving the power of

referrer and fraud data to unlock the hidden value of horizontal networks. The impressions were bought on a CPM-basis, rather than on a CPC or CPA basis.

The results were revealing. While a large percentage (50%) of the impressions were never within view of a user, the click/impression fraud

volume, while substantial, was significantly lower than on the exchange based buys.”

Identifying and Combatting Fraud to Optimize Ad Network Buys; Marissa Gluck, Radar Research, for mpire

Page 11: 1630 omma metrics josh chasin

11© comScore, Inc. Proprietary.

Parsing Campaign Delivery into Target Reach and Frequency

Page 12: 1630 omma metrics josh chasin

13© comScore, Inc. Proprietary.

Not All GRPs Are Created Equal:Skewed Ad Server Delivery Results in Wasted GRP’s on Overly Saturated Consumers

65% of exposures

Page 13: 1630 omma metrics josh chasin

14© comScore, Inc. Proprietary.

Not all Digital GRPs are Created Equal

Frequency Capping Increases Reach and Reduces Frequency Skews

1 2 3 4 5 6 7 8 9 10+0%

10%

20%

30%

40%

30%

15%

8%6%

4% 4% 3% 2% 2%

26%

Distribution of Exposed PeopleUncapped Frequency

Exposures Per Person

46 MM ImpressionsReach = 10.5MM Average Frequency = 4.1

46 MM ImpressionsReach = 2.97MMAverage Frequency = 14.5

1 2 3 4 5 60%

10%

20%

30%

40%

50%

60%

23%

13%7% 5% 4%

48%

Distribution of Exposed PeopleFrequency Cap of 6

Exposures per Person

Because of cookie deletion, even capping

at 6x can be a challenge

Page 14: 1630 omma metrics josh chasin

15© comScore, Inc. Proprietary.

By the Way…

Cookie sharing on multi-user machines renders cookie targeting by demographics imprecise at best

Page 15: 1630 omma metrics josh chasin

16© comScore, Inc. Proprietary.

Toward Impression Quality Metrics

Page 16: 1630 omma metrics josh chasin

17© comScore, Inc. Proprietary.

What is an Impression Worth?

Page 17: 1630 omma metrics josh chasin

18© comScore, Inc. Proprietary.

This is an Impression.

Page 18: 1630 omma metrics josh chasin

19© comScore, Inc. Proprietary.

Traditionally, Advertising Metrics Are, Literally, 2-Dimensional

Those 2 dimensions are

– Reach (how many)– Frequency (how much)

In digital:

– SO MANY choices – SO MUCH fragmentation– Different objectives

…that we cannot evaluate campaign performance without attempting to assign differential value to impressions

Page 19: 1630 omma metrics josh chasin

20© comScore, Inc. Proprietary.

The Greatest Challenge in Digital Metrics: The Last Two Feet

The last 2 feet

Who’s out there?

Are they engaged with the content?

Did they see your ad?

For how long?

How did they experience your ad?

Page 20: 1630 omma metrics josh chasin

21© comScore, Inc. Proprietary.

Media Metrics 3D: The Measuring!

Reach

Frequency

Impre

ssion quality

Gross Rating Points

Exposure scoring

Differential scoring of impressions adds the missing dimension to advertising and audience measurement

Alas, there is no single metric that immediately lends itself universally to relative scoring of exposure

– Because different ad campaigns have different communications objectives

– Is it better to show me an ad or to get me to Facebook Like you?

Page 21: 1630 omma metrics josh chasin

22© comScore, Inc. Proprietary.

But How Do You Measure Impression Quality?

Time spent (duration) with the ad?

Emotional connection with the media vehicle content?

Emotional connection with the creative?

Lack of competitive clutter?

Visibility?

Change in awareness, attitude, favorability, or purchase intent?

Drive to website, search, or store?

A clickthrough?

Variable based on consumer place in purchase cycle?

Variable based on consumer presence in category?

22

Page 22: 1630 omma metrics josh chasin

23© comScore, Inc. Proprietary.

Impression Quality Metrics: A Call to Action

Can we develop a single metric that allows us to compare the quality of impressions across consumers, campaigns, media, and vehicles?

– I’m guessing no, but we should try...

If not, can we develop an array of impression scoring metrics based on the different advertiser objectives at play?

– And an ecosystem that can accommodate variable impression scoring based on marketing objective?

Page 23: 1630 omma metrics josh chasin

24© comScore, Inc. Proprietary.

Continued Innovation in Branding Metrics

Page 24: 1630 omma metrics josh chasin

25© comScore, Inc. Proprietary.

Is There a Disconnect?

Advertiser(Spendus Digitalis)

I want to get brand messages to an

engaged consumer

The Digital Ecosystem(Quantificus Algorithmus)

I want to sell you real time delivery of impressions to

cookies

Page 25: 1630 omma metrics josh chasin

26© comScore, Inc. Proprietary.

Branding Contribution Can be Measured… and Different Sites, Campaigns Perform Differently

It is possible to evaluate the contribution to branding of different impressions across different publishers in the same campaign

Page 26: 1630 omma metrics josh chasin

27© comScore, Inc. Proprietary.

Breakthroughs in Measuring Mobile

Page 27: 1630 omma metrics josh chasin

29© comScore, Inc. Proprietary.

Consumers Follow Publisher Content Across Screens Throughout the Day

Page 28: 1630 omma metrics josh chasin

30© comScore, Inc. Proprietary.

Mobile Measurement Challenges

Device Technology

Fragmentation

Mobile Web and

Application Technologies

User / Publisher / Network

Data Sources

User Platform

Fragmentation

Page 29: 1630 omma metrics josh chasin

31© comScore, Inc. Proprietary.

Mobile Measurement Challenges

Methodology

Challenges

Technical

Measurement

ChallengesDevice

Technology Fragmentatio

n

Mobile Web and

Application Technologies

User / Publisher / Network

Data Sources

User Platform

Fragmentation

Page 30: 1630 omma metrics josh chasin

32© comScore, Inc. Proprietary.

Device Technology

Fragmentation

Mobile Web and

Application Technologies

User / Publisher / Network

Data Sources

User Platform

Fragmentation

Determine Unduplicated

Audience across Multiple Platforms

Consistent Measurement of Std. Web; Mobile Web, and Apps

Integrate Best Data Sources into

Unified Methodology

Consistent Measurement

across Operating Systems

Mobile Measurement Challenges

Page 31: 1630 omma metrics josh chasin

33© comScore, Inc. Proprietary. #ARFAM6

The Digital Measurement EcosystemNetwork Logs

Site Tags

Application Tags

Household Panels

User Panels

Site-centric measurement is essential

Network-centric measurement can become bedrock

Panels matter, but concepts must evolve

…and surveys

Integrate into holistic Internet measurement

Page 32: 1630 omma metrics josh chasin

34© comScore, Inc. Proprietary. #ARFAM6

Building Unduplicated Digital Reach

Web

Home + Work

Mobile Other

Apps Schools

Libraries & Other

Multiple Shared

use machines

Home Work

Page 33: 1630 omma metrics josh chasin

35© comScore, Inc. Proprietary.

Continued Convergence of Web Analytics and Audience Measurement

Page 34: 1630 omma metrics josh chasin

36© comScore, Inc. Proprietary.

Hold On… You’re Both Right!

Site centric!

Panel centric!

Page 35: 1630 omma metrics josh chasin

37© comScore, Inc. Proprietary.

To Sum Up

Page 36: 1630 omma metrics josh chasin

38© comScore, Inc. Proprietary.

Where We’re Going

Viewable impressions

Persons reach & frequency

Impression quality metrics need to be developed

Innovation in branding performance

Breakthroughs in mobile measurement

Integration of mobile and computer-accessed content

Convergence of Web Analytics and Audience Measurement data