Digital Data Tips Tuesday #2 - A/B-testing: Lukas Vermeer - Booking.com
-
Upload
webanalisten-nl -
Category
Internet
-
view
372 -
download
1
description
Transcript of Digital Data Tips Tuesday #2 - A/B-testing: Lukas Vermeer - Booking.com
![Page 1: Digital Data Tips Tuesday #2 - A/B-testing: Lukas Vermeer - Booking.com](https://reader033.fdocuments.net/reader033/viewer/2022060109/5557b920d8b42a696c8b502a/html5/thumbnails/1.jpg)
More Bandits @lukasvermeer
The World Needs
![Page 2: Digital Data Tips Tuesday #2 - A/B-testing: Lukas Vermeer - Booking.com](https://reader033.fdocuments.net/reader033/viewer/2022060109/5557b920d8b42a696c8b502a/html5/thumbnails/2.jpg)
we are all in the business of running experiments
we run experiments, because we need to know that what we do is
good for our business
our most important KPI is how many successful experiments we run
![Page 3: Digital Data Tips Tuesday #2 - A/B-testing: Lukas Vermeer - Booking.com](https://reader033.fdocuments.net/reader033/viewer/2022060109/5557b920d8b42a696c8b502a/html5/thumbnails/3.jpg)
MulC-‐Armed Bandits geFng the most out of your experiments
![Page 4: Digital Data Tips Tuesday #2 - A/B-testing: Lukas Vermeer - Booking.com](https://reader033.fdocuments.net/reader033/viewer/2022060109/5557b920d8b42a696c8b502a/html5/thumbnails/4.jpg)
A/B Test (Epsilon First) the gold standard for (business) experiments
![Page 5: Digital Data Tips Tuesday #2 - A/B-testing: Lukas Vermeer - Booking.com](https://reader033.fdocuments.net/reader033/viewer/2022060109/5557b920d8b42a696c8b502a/html5/thumbnails/5.jpg)
ExploraCon/ExploitaCon experiments cost money
![Page 6: Digital Data Tips Tuesday #2 - A/B-testing: Lukas Vermeer - Booking.com](https://reader033.fdocuments.net/reader033/viewer/2022060109/5557b920d8b42a696c8b502a/html5/thumbnails/6.jpg)
Regret minimizing the cost of your experiments
![Page 7: Digital Data Tips Tuesday #2 - A/B-testing: Lukas Vermeer - Booking.com](https://reader033.fdocuments.net/reader033/viewer/2022060109/5557b920d8b42a696c8b502a/html5/thumbnails/7.jpg)
Greedy Bandit controlled exploraCon
![Page 8: Digital Data Tips Tuesday #2 - A/B-testing: Lukas Vermeer - Booking.com](https://reader033.fdocuments.net/reader033/viewer/2022060109/5557b920d8b42a696c8b502a/html5/thumbnails/8.jpg)
Thompson Bandit exploit as much as you dare
![Page 9: Digital Data Tips Tuesday #2 - A/B-testing: Lukas Vermeer - Booking.com](https://reader033.fdocuments.net/reader033/viewer/2022060109/5557b920d8b42a696c8b502a/html5/thumbnails/9.jpg)
Contextual Bandits far beyond basic bandit experiments
![Page 10: Digital Data Tips Tuesday #2 - A/B-testing: Lukas Vermeer - Booking.com](https://reader033.fdocuments.net/reader033/viewer/2022060109/5557b920d8b42a696c8b502a/html5/thumbnails/10.jpg)
Start Now maximize experimentaCon – minimize costs
![Page 11: Digital Data Tips Tuesday #2 - A/B-testing: Lukas Vermeer - Booking.com](https://reader033.fdocuments.net/reader033/viewer/2022060109/5557b920d8b42a696c8b502a/html5/thumbnails/11.jpg)
we are all in the business of running experiments
we run experiments, because we need to know that what we do is
good for our business
our most important KPI is how many successful experiments we do
![Page 12: Digital Data Tips Tuesday #2 - A/B-testing: Lukas Vermeer - Booking.com](https://reader033.fdocuments.net/reader033/viewer/2022060109/5557b920d8b42a696c8b502a/html5/thumbnails/12.jpg)
More Bandits @lukasvermeer
The World Needs