Growth Hacking and the Bandit Problem

GROWTH HACKING AND

THE BANDIT PROBLEM

Starring Lauren Iredale A Production

Friday, 8 February 2013

WHAT DO

GROWTH HACKERS DO?

GROW!Friday, 8 February 2013

Metric(sign-ups, revenue, etc)

Make this happen

HOW?Friday, 8 February 2013

MeasureLearn

Measure

MeasureLearn

FASTER IS BETTER

HOWDO WE MEASURE &

LEARN?

A/BFriday, 8 February 2013

MeasureBuild Learn

MeasureLearn

Measure/Learn

Build Measure / Learn

THE BANDIT PROBLEM(EST 1952 ... OR 1933)

k arms (or variants)

Select a variant

Receive a reward

REPEAT

MAXIMISE TOTAL REWARD

HOW?Friday, 8 February 2013

DISPLAY VARIANT WITH

HIGHEST AVERAGE REWARD

Good Variant Bad Variant

Views: 1Reward: 0Average: 0

OOPS!Friday, 8 February 2013

WILL NEVER TRY THE

GOOD VARIANT AGAIN!

BALANCE EXPLOIT

AND EXPLORE

EXPLOITTRY THE VARIANT THAT HAS WORKED BEST IN

THE PAST

EXPLORE TRY OTHER VARIANTS

TO SEE IF THEY’RE BETTER

E-GREEDYFriday, 8 February 2013

10% EXPLORE

90% EXPLOITDon’t like 10% and 90%? Change it.

MORE INTRICATE BALANCING IS POSSIBLE.

SEE UCB-1, THOMPSON SAMPLING, etc.

DOES IT

THANK YOU!NOW GO FORTH AND

ENGAGE IN BANDITRY

CREDITSPhotos and artwork by the following people were used in

this presentation:

Moyan Brenn http://www.flickr.com/photos/aigle_dore/Suicine http://www.flickr.com/photos/bigmikeyeah

ankakay http://www.flickr.com/photos/ankakay/Cdr Aitch http://www.flickr.com/people/hjsouthgate/

StJost http://stjost.deviantart.com/

Growth Hacking and the Bandit Problem

Technology

Transcript of Growth Hacking and the Bandit Problem

The Multi-Armed Bandit Problem - CAE Usershomepages.cae.wisc.edu/~sumeet/files/banditsslides.pdfMotivation Model Algorithms The Multi-Armed Bandit Problem Sumeet Katariya Electrical

Introduction to Contextual Multi-bandit Algorithm to Contextual Multi-bandit... · Outline §Introduction §Motivation §Contextual-free Bandit Algorithms §Contextual Bandit Algorithms

The Multi-Armed Bandit Problem€¦ · Sumeet Katariya Electrical and Computer Engineering December 7, 2013 Sumeet Katariya Multi-armed Bandit. Motivation Model Algorithms Outline

Reinforcement Learning - The one with the banditsMyopic vs far-sighted. 4 The k-arm Bandit Problem. 5 THE K-ARMED BANDIT PROBLEM a 1 a 2 a 3::: a k Expected value 5 6 4 7. 6 THE K-ARMED

Bandit Chippers

Multi-armed Bandit with Additional Observationsalinlab.kaist.ac.kr/resource/Multi_armed_Bandit... · Multi-armed Bandit with Additional Observations 13:3 the expert problem (i.e.,

Algorithm portfolio selection as a bandit problem …Algorithm portfolio selection as a bandit problem 51 algorithm/problem combinations, based on the model’s predictions. This trade-off

Machine Learning & Data Mining CS/CNS/EE 155 Lecture 17: The Multi-Armed Bandit Problem 1Lecture 17: The Multi-Armed Bandit Problem.

The non-stochastic multi-armed bandit problemyfreund/papers/bandits.pdfThe non-stochastic multi-armed bandit problem Peter Auer Institute for Theoretical Computer Science Graz University

Bypassing the Monster: A Faster and Simpler Optimal ... · for broader classes of contextual bandit problems. 1. Introduction The contextual bandit problem is a fundamental framework

Bandit 112

Clean Bandit

Bandit Game

Advanced Topics in Machine Learning: Part I · 2010. 2. 4. · Outline for today The Bandit Problem Gaussian Process Bandits 1 The Bandit Problem Deﬁnition of the Bandit Problem

TomTom Bandit

The MNL-Bandit Problem: Theory and Applications Vashist ...

problem - Princeton University · 2016. 2. 11. · Bernoulli bandits to general stochastic bandit problem. The algorithm for Bernoulli bandits maintains Bayesian priors on the Bernoulli

Multi-armed Bandit Problem and Bayesian Optimization in Reinforcement Learning

Optimal Regret Analysis of Thompson Sampling in Stochastic Multi-armed Bandit Problem with Multiple Plays

BANDIT BANDIT S BULLIT BREEZE FURTIVE TRUST ONE