Was Nate Silver Wrong?

134
@bramwessel | @factorfirm | factorfirm.com WTF

Transcript of Was Nate Silver Wrong?

Page 1: Was Nate Silver Wrong?

@bramwessel | @factorfirm | factorfirm.comWTF

Page 2: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Page 3: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

WRONG?

Page 4: Was Nate Silver Wrong?

@bramwessel | @factorfirm | factorfirm.com

Page 5: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Page 6: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Page 7: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Page 8: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Page 9: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Page 10: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Page 11: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

PLACES | THINGSMADE OF INFO

Page 12: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Attention Economy

Page 13: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Hidden costs?

Page 14: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

INFLECTION POINT

IS INFLECTED

Page 15: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Is the public less informed?

Page 16: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Fake News

@bramwessel | @factorfirm | factorfirm.com

Page 17: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

TRUTHINESS

Page 18: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

ALTERNATIVE FACTS

Page 19: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

STRAW POLL…

Page 20: Was Nate Silver Wrong?
Page 21: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Clickbait ad image

Page 22: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Page 23: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Page 24: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com@bramwessel | @factorfirm | factorfirm.com

Page 25: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

CONTENT FARMS

DGAF ABOUT UR CONTENT

Page 26: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

PRODUCT IS USSUCH BIZ MODEL

SO ATTENTIVE

Page 27: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

TFW human interpretation doesn’t matter

THIS IS NOT THE CRAP WE’RE LOOKING FOR

Page 28: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Page 29: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com@bramwessel | @factorfirm | factorfirm.com

Page 30: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Page 31: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Page 32: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Doing more work for the machines

@bramwessel | @factorfirm | factorfirm.com

Page 33: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

WHAT INFLUENCE DO WE REALLY HAVE?

Page 34: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Page 35: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

RECURSIVE FEEDBACK LOOP IS RECURSIVE

@bramwessel | @factorfirm | factorfirm.com

Page 36: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Page 37: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Dopamine Rush

NORMAL COCAINE

Page 38: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Who benefits?

FOLLOW THE MONEY

Page 39: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.comNOW WITH MORE LOSSY

EFFICIENT MARKET

Page 40: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

DDOS ON MEANING

Page 41: Was Nate Silver Wrong?

MUGGLES DON’T HAVE TIME

NEITHER DO WIZARDS

Page 42: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Page 43: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

WRONG?

Page 44: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

How is Data Journalism like IA?

Page 45: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com@bramwessel | @factorfirm | factorfirm.com

Page 46: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

What’s your evidence?

Page 47: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Data vs. Access

Quant vs. Qual

Page 48: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

But, getting good data is getting harder.

Page 49: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Downstream Effects

Page 50: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

WRONG?

Page 51: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

“So number one, and this kind of goes back to the supply chain, but if you're working with

actually trying to manufacture something out of data, to come to some analysis or some

conclusion, you have to make sure the data is good to begin with.”

— Nate Silver, 2011 IAS Keynote

Page 52: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

The information supply chain.

Input OutputNoise

The Information Supply Chain

Page 53: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

First principle: the data is wrong.

Page 54: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Embracing entropy.

Page 55: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.comWe can’t read users’ minds.

Page 56: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

How to correct for wrong data?

Page 57: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Page 58: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

What inputs do we trust?

Page 59: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Prioritizing Input

Page 60: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Page 61: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Page 62: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Page 63: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Page 64: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Page 65: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

User Research recruiting

Page 66: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

How likely is someone to vote?

Page 67: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Likely voter models

Page 68: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Page 69: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Page 70: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Moving target

Page 71: Was Nate Silver Wrong?

Changes over time

Page 72: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Changes over time

BUT HER EMAILS!

Page 73: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Page 74: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Page 75: Was Nate Silver Wrong?
Page 76: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

The peril of adjustments

Page 77: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Apples to Apples

@bramwessel @factorfirm factorfirm.com

Page 78: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Page 79: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Third parties are not created equal.

Page 80: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Trend Line Adjustment

Page 81: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

House Effects Adjustment

Page 82: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Undecideds?

Page 83: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Even more stuff?

W’ELL BE RIGHT BACK…

WITH MORE STUFF

Page 84: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

This message was approved by…

Page 85: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Modeling is done by humans.

Page 86: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.comElection forecasting is grounded in classic information theory.

Page 87: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

“Information is the resolution of uncertainty.”— Claude Shannon

Page 88: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

“Findability is at the center of a quiet

revolution in how we define authority, allocate trust,

and make decisions.”

— Peter Morville, Ambient Findability

Page 89: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

What does this all mean for Information Architects?

Page 90: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

What are our information supply chains?

Page 91: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

How do we know?

Page 92: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Our jobs will keep getting harder.

Page 93: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Page 94: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Side doors

Page 95: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Re-orienting Users

Page 96: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

We are the definers.

Page 97: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Changes in Page Rank align with us

Page 98: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Page 99: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Page 100: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

What can we do as information architects

on the ground?

Page 101: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

As IA’s, what effect do we haveon the broader information environment?

Page 102: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

How do we give information users the ability determine quality?

Page 103: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

What are the implications for organizations?

Page 104: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Page 105: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

What are an organization’s information assets?

Page 106: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

What is the aboutness of your organization?

Page 107: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Bring the aboutness forward.

Page 108: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Resist the impulse to automate for its own sake.

Page 109: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Automate intelligently.

Page 110: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Consider the question.

Page 111: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Prioritization = values.

Page 112: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

What can we do as information architects as a community?What is our responsibility as a community?

Page 113: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

What are our goals as a society?

Page 114: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

#DTDT#DTDT?

Page 115: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Page 116: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Page 117: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Information environmentalists.

Page 118: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Elevating the signal to noise ratioRestoring a healthy signal to noise ratio.

Page 119: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

We need to be careful about giving up human control.

Page 120: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

What ambient entropy do automated processes generate?

Page 121: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Good, Cheap, Fast?Pick two.

Page 122: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Engaging the community of thought.

Page 123: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Human solutions for human challenges.

Page 124: Was Nate Silver Wrong?

What the triple bottom line?

What is ourtriple bottom line?

Page 125: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

MODELING FOR TRUTH, JUSTICE,AND THE CANADIAN WAY

Page 126: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Modeling from the outside in.

Page 127: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Modeling from the inside out.

Page 128: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Page 129: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Make information great againWhat kind of information environment do we want to live in?

Page 130: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

The curatorial imperative.

Page 131: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Page 132: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

Chance 538 gave Trump of winning the presidency in 2016:

28.6%

Chance a major league baseball playerwould get a hit during any at-bat in 2016:

25.5%

Page 133: Was Nate Silver Wrong?

@bramwessel @factorfirm factorfirm.com

LEAST WRONG

Page 134: Was Nate Silver Wrong?

THANK YOU!

@bramwessel | @factorfirm | factorfirm.com