Big Lies and Small Truths About Big Data

48
Big Lies and Small Truths Tales from an Accidental Big Data Scientist

Transcript of Big Lies and Small Truths About Big Data

Page 1: Big Lies and Small Truths About Big Data

Big Lies and Small Truths

Tales from an Accidental Big Data Scientist

Page 2: Big Lies and Small Truths About Big Data

Share of mind leads share of market

What Marketing Wants

Page 3: Big Lies and Small Truths About Big Data

Share of mind leads share of market

What IT Perceives

Page 4: Big Lies and Small Truths About Big Data

Share of mind leads share of market

What Consumers Fear

Page 5: Big Lies and Small Truths About Big Data

Page 5© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

Big Data Process In a Nutshell

COLLECT REPORTANALYZE TAKE

ACTION

Page 6: Big Lies and Small Truths About Big Data

Page 6© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

Where is the Data From?

• Owned

• Purchased

• Created

Page 7: Big Lies and Small Truths About Big Data

Page 7© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

What Is The Data About? People

Page 8: Big Lies and Small Truths About Big Data

Page 8© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

What is the Data About? Things

Page 9: Big Lies and Small Truths About Big Data

Share of mind leads share of market

What Is The Data About? Things About People

Page 10: Big Lies and Small Truths About Big Data

Page 10© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

Big Lie #1

“It will take millions of dollars and a huge

Hadoop cluster to prove the utility of

BIG DATA”

Page 11: Big Lies and Small Truths About Big Data

Page 11© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

AvgAI

SIP

.ML

E

-40

-30

-20

-10

0

-40

-30

-20

-10

0

1

3

-1.0 -0.5 0.0 0.5 1.0

2

4

-1.0 -0.5 0.0 0.5 1.0

Phrase.Count

500

1000

1500

2000

2500

3000

Start Small and Scale As Needed…

Page 12: Big Lies and Small Truths About Big Data

Page 12© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

Big Lie #2

“Once we have the data actionable

insights will start raining from the sky”

Page 13: Big Lies and Small Truths About Big Data

Page 13© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

Good Analysis is Tough and typically under resourced

Page 14: Big Lies and Small Truths About Big Data

Page 14© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

Need Technologist and Subject Matter Experts

Good Analysis is Tough and typically under resourced

Page 15: Big Lies and Small Truths About Big Data

Page 15© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

Big Lie #3

“Petabytes of data Plus statistical significance values of 0.00001 equals respect in the board room”

Or

“If you process it, they will come”

Page 16: Big Lies and Small Truths About Big Data

Page 16© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

Small Truth #3

• Report in the language of the decision maker• Empathy in report is critical to enable action

Page 17: Big Lies and Small Truths About Big Data

Page 17© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

Big Lie #4

“If we measure everything we will be measuring the right

things”

Page 18: Big Lies and Small Truths About Big Data

Page 18© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

“Apple is unlikely to make much of an impact on this market … the iPhone won’t make a long term mark on the industry”Matthew Lynn - Bloomberg

“The iPhone will not substantially alter the fundamental structure or challenges of the mobile industry”Charles Golvin – Forrester Research

“The iPhone is a niche product”Olli-Pekka Kallasvuo – Nokia CEO in April 2008

Page 19: Big Lies and Small Truths About Big Data

Page 19© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

“If you can not measure it, you can not improve it.”Lord Kelvin

Page 20: Big Lies and Small Truths About Big Data

Page 20© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

Others predict based on what consumers bought, Argus Insights predicts based on what consumers love

0

10

20

30

40

50

60

0

1000

2000

3000

4000

5000

6000

7000

Qtr1 Qtr2 Qtr3 Qtr4 Qtr1 Qtr2 Qtr3 Qtr4 Qtr1 Qtr2

2011 2011 2011 2011 2012 2012 2012 2012 2013 2013

Mil

lio

ns

of

iPh

on

es;

Bil

lio

ns

of

do

lla

rs in

Re

ven

ue

Bu

zz V

olu

me

fo

r iP

ho

ne

Mo

de

ls

Argus Insights Beat Wall Street Estimates for Q2 2013 iPhone Sales

Apple iPhone 4 Apple iPhone 4S Apple iPhone 5 Apple iPhone 3GS

Apple iPhone 3G Apple iPhone Quarterly iPhone Sales

Copyright© 2013 Argus Insights, Inc.

Consensus

Morgan Stanley

Argus InsightsEstimate Based on Apple’s Actual Q2

iPhone Unit Volume

Page 21: Big Lies and Small Truths About Big Data

Page 22© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

Argus Insights Proprietary Metrics Are Proven Predictors of Consumer Demand

23-Feb-13 23-Mar-13 23-Apr-13 23-May-13 23-Jun-13 23-Jul-13 23-Aug-13 23-Sep-13 23-Oct-13 23-Nov-13

Mapping Handset Consumer Buzz Metrics to Actual Handset Sales

Actual Sales/Returns for Specific Handset

Predicted Sales Using Argus Metrics from 8 weeks prior

Eight Weeks PredictingAdjusted R2 = 87.8%p-value = 4.547E-22

Han

dse

t U

nit

Sal

es/R

etu

rns

Using only our consumer metrics and retail pricing, Argus Insights was able to predict handset sales volume eight weeks into the future for a major smartphone brand

Page 22: Big Lies and Small Truths About Big Data

What Are They Really Talking About?

Page 23: Big Lies and Small Truths About Big Data

Page 29© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

Lots of chatter but few conversations

Nothing says “I love you” like a man’s armpit

wearing Old Spice inside of a tuxedo on a

battleship that has a mariachi band to serenade

you.

“Dear axe body spray, please out a suggested

serving size on your bottle. Sincerely, choking girls

everywhere.”

Page 24: Big Lies and Small Truths About Big Data

Page 30© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

Behavior over Buzz

• Brand Story

– Traditional media

– Digital media

– Digital Advocacy

• Product Reality

– Mostly shared in

consumer reviews

– Proven leading

indicator of sales

performanc

Page 25: Big Lies and Small Truths About Big Data

Page 31© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

When Consumers engage reveals how to

engage…

• Different segments of consumers engage at different times of the day

• Each segment has unique influences that shape advocacy

0

50

100

150

200

250

300

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

Co

ns

um

er

Tw

ee

ts f

rom

Dall

as

, N

YC

, a

nd

Sa

n J

os

e

Lipstick Mentions By Valid Consumers (Normalized to EST)

What to

What to Which What I saw!

Page 26: Big Lies and Small Truths About Big Data

Page 32© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

Behaviors Swamp Brands, Consumers Drive

Content

0

10000

20000

30000

40000

50000

60000

So

cia

l M

en

tio

ns f

rom

27 N

ov -

2 D

ec 2

013

Comparing Lipstick Mention vs. Brand Social Mentions

General Lipstick

Mentions Occur 100

times more than

any major brand

Page 27: Big Lies and Small Truths About Big Data

Page 33© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

VS

Page 28: Big Lies and Small Truths About Big Data

Page 34© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

Humankind has been fascinated for centuries!

Page 29: Big Lies and Small Truths About Big Data

Page 35© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

Tracking Target Segments since Oct 2012 in Twitter

Walking Dead Premiere

Vampire Diaries Premiere

Zombie Chatter is steadily 2X that of Vampire ChatterZombies are gender balanced. Twice as many women mention vampires

Page 30: Big Lies and Small Truths About Big Data

Page 36© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

Somewhere in suburban Georgia

Page 31: Big Lies and Small Truths About Big Data

Page 37© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

Introducing the Zompire Index

• Needed a way to track the both targets

• Normalized for state populations to understand relative strength of segment

• Since one target is larger than the other needed a way to balance

Page 32: Big Lies and Small Truths About Big Data

Page 38© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

Visualizing the Balance of Power across Target Segments

Page 33: Big Lies and Small Truths About Big Data

Deeper Dive into IoT

Page 34: Big Lies and Small Truths About Big Data

Page 40© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

Internet of Things continues to Drive Significant Social Buzz

IBM Pledges $3 billion to IoT Center

Page 35: Big Lies and Small Truths About Big Data

Page 41© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

IoT Attracts More Attention than Home Automation

Page 36: Big Lies and Small Truths About Big Data

Page 42© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

Wearables, driven only partially by Apple Watch Attract more Attention than IoT

Page 37: Big Lies and Small Truths About Big Data

Page 43© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

Even within IoT, Wearables drives more attention than Big Data

Page 38: Big Lies and Small Truths About Big Data

Page 44© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

Iot Means Many Things But Mainly Internet Of Things

Page 39: Big Lies and Small Truths About Big Data

Page 45© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

Industrial Internet is Getting the Most Attention Within IoT

Page 40: Big Lies and Small Truths About Big Data

Page 46© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

Security Concerns Trump Privacy Most Always

Page 41: Big Lies and Small Truths About Big Data

Page 47© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

Within IoT Manufacturing and Logistics Buzz is Limited

Significant discussion on privacy and security related to

manufacturing at US government level

Page 42: Big Lies and Small Truths About Big Data

Page 48© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

Bluetooth and WiFi dominate IoT discussions

ZigBee and Zwave fail to grab any attention

Page 43: Big Lies and Small Truths About Big Data

Page 49© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

Mind the Gap between Devices and Apps

Page 44: Big Lies and Small Truths About Big Data

Page 50© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

Smart Home App Experience As As Varied As The Brands That Make Them

Page 45: Big Lies and Small Truths About Big Data

Page 51© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

MSO Are Slowly Losing Ground With Consumers Based On App Experience

Size of bubble represents number of consumer App

Reviews (with text) per day

Delight Scale based on Consumer Star Ratings, most accurate public

metric of success

Data gather regularly from Apple, Google, Amazon and Windows App Stores

Slow decay over time is normal for brands that have not refreshed their user experience

Page 46: Big Lies and Small Truths About Big Data

Page 52© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

Though Falling, MSO’s Are Outperforming Almost Everyone Else, Even Nest!

MSO’s Dominate Category in Early 2015Vivint moves from 3rd to 1st place in hearts of consumers.

Alarm.com consistently delivers on promised experience

ADT offers a disappointing Smart Home Experience

Page 47: Big Lies and Small Truths About Big Data

Page 53© 2013 Argus Insights, Inc. Confidential: Do Not Distribute

MSO’s Beat Out AT&T Across Many Aspects of the App Experience

MSO’s offer a more usable and

stable app experience

compared to AT&T

Red Illustrates % Of Reviews With Negative Views On Topic, Green Is Positive And Gray Is Neutral

AT&T Consumers suffer through

poorly crafted and sluggish

experience

Page 48: Big Lies and Small Truths About Big Data

Please contact us if you’d like to know more!

http://www.argusinsights.com Twitter: @argusinsights1-877-992-7487 [email protected]