Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

50
Big Data and the Future of Advertising & Marketing Konrad Feldman 10/30/12 Seattle Interactive Conference 2012. 1

description

Konrad Feldman, CEO of Quantcast Big Data and the Future of Advertising and Marketing For marketers, data has become a critical asset throughout their role. Though not as “in your face” as great content or a creative video, data is the new lifeblood of their function. Not only is data essential for success, but the more data companies have, the more accurately and efficiently they can engage their customers and influence the market. Effective use of data in marketing and advertising will increasingly become a differentiating factor between businesses in this information economy. Konrad will explore the challenges, opportunities and what the future may hold for the use of big data in marketing and advertising.

Transcript of Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

Page 1: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

Seattle Interactive Conference 2012. 1

Big Data and the Future of Advertising & Marketing

Konrad Feldman

10/30/12

Page 2: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

2

Agenda• Introduction• Real-Time Advertising• Big Data in Advertising• Insights & Implications

10/30/12 Seattle Interactive Conference 2012.

Page 3: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

3

MEASUREMENT + ADVERTISINGQuantcast

10/30/12 Seattle Interactive Conference 2012.

Page 4: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

4

Measurement• World’s best audience

measurement service• Groundbreaking direct

measurement & insights• For sites, publishers,

networks and advertisers of any size

• 100% free for everyone10/30/12 Seattle Interactive Conference 2012.

Page 5: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

Seattle Interactive Conference 2012. 510/30/12

Page 6: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

6

Advertising• Dynamic real-time

advertising• RTB integrated

performance advertising• Brand advertising

integrated with premium publishers & networks

10/30/12 Seattle Interactive Conference 2012.

Page 7: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

Seattle Interactive Conference 2012. 7

DISPLAY ADVERTISING GOES REAL-TIMEAdvertising Landscape

10/30/12

Page 8: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

Seattle Interactive Conference 2012. 810/30/12

Page 9: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

Seattle Interactive Conference 2012. 910/30/12

Page 10: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

10

Display Reemerges to Overtake Search

10/30/12 Seattle Interactive Conference 2012.

Display passes Search

Page 11: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

Seattle Interactive Conference 2012. 11

Real-Time Bidding – Display’s Catalyst.Real-Time rationalizes display. RTB’s rapid rise.

2010 2011 2012 2013 2014 2015$0

$1,000,000,000

$2,000,000,000

$3,000,000,000

$4,000,000,000

$5,000,000,000

400000000

1100000000

2000000000

2900000000

3900000000

5100000000

10/30/12

RTB % of Display market

Billi

ons

Page 12: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

Seattle Interactive Conference 2012. 12

MEDIA IS DATAReal-Time Bidding

10/30/12

Page 13: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012
Page 14: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

Consumer’s Browser Ad Space Ad Exchange

Page 15: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

100s – 1000sof Potential Buyers

The Exchange sends aBid Request, with information regarding the individual ad impression, to all Qualifying Exchange Participants.

Page 16: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

0:00:00.000

Exchange sends bid request to potential buyers 1 – 1000+ Advertiser Campaigns

Page 17: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

Exchange sends bid request to potential buyers 1 – 1000+ Advertiser Campaigns

0:00:00.025

Page 18: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

What are the interests of this user?

Have they been shown impressions beforefor this campaign?

How much do they consume on the Internet?

Where is this user in the world?

Who is the publisher and whatis the context of this site and page?

How has this campaign performed onthis site in the past?

What device is the user browsing on?

What’s the time of day for the user?

Is the impression above or below the fold?

0:00:00.0450:00:00.0500:00:00.0300:00:00.0350:00:00.040

Page 19: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

DetermineBid Value for

Highest Rated

0:00:00.060What are the interests of this user?

Have they been shown impressions beforefor this campaign?

How much do they consume on the Internet?

Where is this user in the world?

Who is the publisher and whatis the context of this site and page?

How has this campaign performed onthis site in the past?

What device is the user browsing on?

What’s the time of day for the user?

Is the impression above or below the fold?

Page 20: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

0:00:00.100

Bidding RaceBids are submitted to the Exchange by all participants.

Even if the impression is not desired, $0.00 is bid to indicate buyer’s capabilityto respond.

Page 21: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012
Page 22: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012
Page 23: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

AGE OF THE MACHINES

Page 24: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

Seattle Interactive Conference 2012. 2410/30/12

Page 25: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012
Page 26: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012
Page 27: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

Seattle Interactive Conference 2012. 2710/30/12

Page 28: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

Seattle Interactive Conference 2012. 2810/30/12

Page 29: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012
Page 30: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012
Page 31: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012
Page 32: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

Seattle Interactive Conference 2012. 32

BIG DATA TO THE FORESupporting Artificial Intelligence

10/30/12

Page 33: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

33

Big Data’s Innovation Cycle

10/30/12 Seattle Interactive Conference 2012.

• Big data tends to follow an iterative cycle within organizations

• These cycles are accelerating

Data

AnalysisCapability

AnalystsData Use

Capacity

Page 34: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

Seattle Interactive Conference 2012. 34

Quantcast Data Processing ArchitectureAnalyticsPixel Delivery Realtime Bidding Website

Ad-hoc QueriesRealtime Decisioning Batch Processing

Quantcast owned hardware

RDBMSs

Keebler Redis

Storm

Realtime Engine

Quantcast File System

Turbo MapReduceHadoop QuantSort

SawzallRelational MapReduce

10/30/12

Page 35: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

Seattle Interactive Conference 2012. 35

Quantcast Data Processing ArchitectureAnalyticsPixel Delivery Realtime Bidding Website

Ad-hoc QueriesRealtime Decisioning Batch Processing

Quantcast owned hardware

RDBMSs

Keebler Redis

Storm

Realtime Engine

Quantcast File System

Turbo MapReduceHadoop QuantSort

SawzallRelational MapReduce

10/30/12

Page 36: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

Seattle Interactive Conference 2012. 36

Quantcast Data Processing ArchitectureAnalyticsPixel Delivery Realtime Bidding Website

Ad-hoc QueriesRealtime Decisioning Batch Processing

Quantcast owned hardware

RDBMSs

Keebler Redis

Storm

Realtime Engine

Quantcast File System

Turbo MapReduceHadoop 0.15 QuantSort

SawzallRelational MapReduce

10/30/12

Page 37: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

Seattle Interactive Conference 2012. 37

Quantcast Data Processing ArchitectureAnalyticsPixel Delivery Realtime Bidding Website

Ad-hoc QueriesRealtime Decisioning Batch Processing

Quantcast owned hardware

RDBMSs

Keebler Redis

Storm

Realtime Engine

Quantcast File System

Turbo MapReduceHadoop QuantSort

SawzallRelational MapReduce

10/30/12

Page 38: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

Seattle Interactive Conference 2012. 38

Quantcast Data Processing ArchitectureAnalyticsPixel Delivery Realtime Bidding Website

Ad-hoc QueriesRealtime Decisioning Batch Processing

Quantcast owned hardware

RDBMSs

Keebler Redis

Storm

Realtime Engine

Quantcast File System

Turbo MapReduceHadoop QuantSort

SawzallRelational MapReduce

10/30/12

Page 39: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

Seattle Interactive Conference 2012. 39

BY THE NUMBERSBig Data

10/30/12

Page 40: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

Seattle Interactive Conference 2012. 40

DataReal-Time Ingest

500,000+ / sec.

750+ Billion / mo.

Massive Transaction Volume 40+ TB / day

Big Raw Data

10/30/12

Page 41: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

Seattle Interactive Conference 2012. 41

ComputersReal Estate

15+ Data Centers

40+ Racks

Largest Data Center 1,000+ Servers

Machines

10/30/12

Page 42: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

Seattle Interactive Conference 2012. 42

Data ProcessingDaily Processing

Jun-09

Sep-09

Dec-09

Mar-10

Jun-10

Sep-10

Dec-10

Mar-11

Jun-11

Sep-11

Dec-11

Mar-12

Jun-12

Sep-12

0

5

10

15

20

25

30

25+Petabytes

Scaling Petabytes per day

10/30/12

Page 43: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

Seattle Interactive Conference 2012. 43

People who buys shoes onlineMore likely to visit...Site Score

runnersworld.com

halfmarathons.net

athlinks.com

runningintheusa.com

flotrack.org

running.about.com

letsrun.com

eatliverun.com

More likely affiliation...Affiliation Score

Democrat

Libertarian

Independent

Republican

10/30/12

Page 44: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

Seattle Interactive Conference 2012. 44

Advertising Insights: Clickers vs. Converters• 85% of clicks come from just

8% of internet users• Converters have a distinct

profile, which is nothing like the clickers

• Most converters don’t click ads. They view them

• Clickers are not the target customer

Converters (over-index high income)

Clickers (over-index low income)

10/30/12

Page 45: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

Seattle Interactive Conference 2012. 45

Traditional DisplayImpressions Bought in AggregatePriced as a WholeFocus: CostKey Skill: Negotiation

10/30/12

-

10

20

30

40

50

CPM

CP

A

Page 46: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

Seattle Interactive Conference 2012. 46

Real-Time is DifferentImpressions bought IndividuallyPriced IndividuallyFocus: ValueKey skill: Science

Example: Travel campaign

10/30/12

-

10

20

30

40

50

CPM

CP

A

Page 47: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

Seattle Interactive Conference 2012. 47

Real-Time is DifferentImpressions bought IndividuallyPriced IndividuallyFocus: ValueKey skill: Science

Example: Travel campaign

10/30/12

-

10

20

30

40

50

CPM

CP

A

Page 48: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

Seattle Interactive Conference 2012. 48

Consistent Feature of RTB CampaignsMedia Subscription Travel

-

25

50

75

100

125

CPM

CP

A

$0.0

0

$0.7

5

$1.5

0

$2.2

5

$3.0

0

$3.7

5

$4.5

0

$5.2

5

$6.0

0

$6.7

5

$7.5

0

$8.2

5

$9.0

0

$9.7

5 -

1

2

3

4

CPM

CP

A10/30/12

Page 49: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

Seattle Interactive Conference 2012. 49

Implications for Advertising and Marketing

• Data Science over Human Hypothesis– People guide, computers execute– Media buying must change to accommodate

• Marketers, BYOD (Bring Your Own Data)

– Leverage website and CRM assets• Publishers, get data smart

10/30/12

Page 50: Konrad Feldman - Big Data and The Future of Advertising and Marketing - SIC2012

Konrad [email protected]