Why Statisticians Avoid the Express Lane

43
TruckeeChamber.co m TTCTV.org NewLeaders.com ClearCapital.com HollandHart.com UsePayIt.com Sponsor s Community Partners TahoeDonner.com /pizza-on-the-h ill

Transcript of Why Statisticians Avoid the Express Lane

Page 2: Why Statisticians Avoid the Express Lane

Why Statisticians Avoid the Express Lane

Will Kurt

Page 3: Why Statisticians Avoid the Express Lane

Statistical analysis of why it is possibly preferable to choose

a regular lane over the “express” lane when certain

conditions apply, given that the assumptions of our model

hold.

Page 4: Why Statisticians Avoid the Express Lane

Who am I?

Data Scientist at Quick Sprout

Blog at CountBayesie.com

Author Learn Haskell (https://www.manning.com/books/learn-haskell)

Page 5: Why Statisticians Avoid the Express Lane
Page 6: Why Statisticians Avoid the Express Lane

Factors we need to consider?

Number of People in each line (known/observable)

Number of Items

Time per item

Time per person

Key issue:

Time per person >> Time per item

Page 7: Why Statisticians Avoid the Express Lane

How do we Choose which is best?

Page 8: Why Statisticians Avoid the Express Lane
Page 9: Why Statisticians Avoid the Express Lane
Page 10: Why Statisticians Avoid the Express Lane
Page 11: Why Statisticians Avoid the Express Lane
Page 12: Why Statisticians Avoid the Express Lane

Solution for optimal lane choosing:

Page 13: Why Statisticians Avoid the Express Lane
Page 14: Why Statisticians Avoid the Express Lane
Page 15: Why Statisticians Avoid the Express Lane

Express items = [1 .. 15]

Regular items = [10 .. 60]

Page 16: Why Statisticians Avoid the Express Lane
Page 17: Why Statisticians Avoid the Express Lane
Page 18: Why Statisticians Avoid the Express Lane
Page 19: Why Statisticians Avoid the Express Lane

People Time Distribution

Page 20: Why Statisticians Avoid the Express Lane

vs

Page 21: Why Statisticians Avoid the Express Lane

Let’s explore multiple-universes...

...with Monte-Carlo simulations!!!

Page 22: Why Statisticians Avoid the Express Lane
Page 23: Why Statisticians Avoid the Express Lane
Page 24: Why Statisticians Avoid the Express Lane
Page 25: Why Statisticians Avoid the Express Lane

Express = 6 Regular = 3

Page 26: Why Statisticians Avoid the Express Lane

10,000 samples! What’s the probability Regular is faster?

5 v 3 P(Regular faster) = 0.736 v 3 P(Regular faster) = 0.92

Page 27: Why Statisticians Avoid the Express Lane
Page 28: Why Statisticians Avoid the Express Lane

Cost of 6 express vs 3 regular

Page 29: Why Statisticians Avoid the Express Lane

CDF = Best Plot of All time!!!

Page 30: Why Statisticians Avoid the Express Lane
Page 31: Why Statisticians Avoid the Express Lane

“But your model is dumb, and I don’t like it.”

Page 32: Why Statisticians Avoid the Express Lane

Your alternative model...

If people in the express lane is double the number in the regular line then…

P(regular is faster) = 0.99

Otherwise

P(express is faster) = 0.99

Page 33: Why Statisticians Avoid the Express Lane
Page 34: Why Statisticians Avoid the Express Lane

Comparing hypotheses with theLikelihood ratio

Page 35: Why Statisticians Avoid the Express Lane
Page 36: Why Statisticians Avoid the Express Lane

Ratio: 0.63Your model explains the data ~1.6x better!

Page 37: Why Statisticians Avoid the Express Lane

Feeling Smart?

Your Model...

Vs.

A Coin Flip!

Page 38: Why Statisticians Avoid the Express Lane

A coin explains the data 3.2x better than your model!

Page 39: Why Statisticians Avoid the Express Lane

What did we learn today?

Nothing!

Page 40: Why Statisticians Avoid the Express Lane

What did we learn today?

Nothing!

Basically all of Statistical Inference (or at least the important bits)

Page 41: Why Statisticians Avoid the Express Lane

What did we learn today?

Nothing!

Basically all of Statistical Inference (or at least the important bits)

Everything is hard

Page 42: Why Statisticians Avoid the Express Lane

What did we learn today?

Nothing!

Basically all of Statistical Inference (or at least the important bits)

Everything is hard

We can compare our misunderstanding of the world with the relative strength of our hypotheses

Page 43: Why Statisticians Avoid the Express Lane

Thank you!!!

Email me at [email protected]

Follow me on Twitter @willkurt

Read about probability: https://www.countbayesie.com

Preorder my book on a totally unrelated topic: https://www.manning.com/books/learn-haskell