MeasureFest

28
Scaling your Testing Program for Maximum Impact Martijn Scheijbeler / Director of Marketing / [email protected] / @MartijnSch

Transcript of MeasureFest

Page 1: MeasureFest

Scaling your Testing Program for Maximum Impact

Martijn Scheijbeler / Director of Marketing / [email protected] / @MartijnSch

Page 2: MeasureFest

• Leads Marketing at The Next Web: ±15 (60+)

• Into (web/data) analytics for 6 years

• Believes in: Scaling through coding and automating

Who is this guy?

MeasureFest 2015 - @MartijnSch

Page 3: MeasureFest

“One of the biggest online tech publications”

8 Million Monthly Unique Users 20.000+ attendees at The Next Web Conferences

MeasureFest 2015 - @MartijnSch

Page 4: MeasureFest

What do I like to talk about?

Page 5: MeasureFest

• How we created a culture of testing?

• How were / are we able to scale so fast?

• How it influences our (company / teams) culture?

• Summary: How can YOU scale your testing program?

What do I like to talk about…

MeasureFest 2015 - @MartijnSch

Page 6: MeasureFest

FAIL often, FAIL fast!

Page 7: MeasureFest

So it’s all about, VELOCITY

Page 8: MeasureFest

1 Test a Month :( That clearly wasn’t good enough

MeasureFest 2015 - @MartijnSch

Page 9: MeasureFest

25+ Tests a Month :) *Happy Panda* How did we get there?

MeasureFest 2015 - @MartijnSch

Page 10: MeasureFest

• Better ask for forgiveness, than permission

• F*CK IT, WE’LL DO IT LIVE!

• It’s not rocket science!

• We’ll do a much as possible in-house + open source

TNW ‘Core Values’

MeasureFest 2015 - @MartijnSch

Page 11: MeasureFest

What did we learn along the way? #10 Take aways!

Page 12: MeasureFest

#1 Know your goals + KPIs

MeasureFest 2015 - @MartijnSch

Page 13: MeasureFest

#2 Create swim lanes

MeasureFest 2015 - @MartijnSch

Page 14: MeasureFest

#3 Create segments

MeasureFest 2015 - @MartijnSch

Page 15: MeasureFest

How many tests can you run? DO YOU REALLY KNOW?!

Page 16: MeasureFest

#4 Don’t prioritise (yet)

MeasureFest 2015 - @MartijnSch

Page 17: MeasureFest

#5 Prioritise, based on ROI

MeasureFest 2015 - @MartijnSch

Page 18: MeasureFest

#6 Learn to code, or code fast

MeasureFest 2015 - @MartijnSch

Page 19: MeasureFest

Can you really scale this?

Page 20: MeasureFest

#7 Analyse, faster!

MeasureFest 2015 - @MartijnSch

Page 21: MeasureFest

#8 Push winning variants live, ASAP!

MeasureFest 2015 - @MartijnSch

Page 22: MeasureFest

How many of you can push code live?

Page 23: MeasureFest

#9 Always be sharing

MeasureFest 2015 - @MartijnSch

Page 24: MeasureFest

#10 Think about, what’s next?

MeasureFest 2015 - @MartijnSch

Page 25: MeasureFest

• Grow our team: 20 people?

• Cross functional, get developers on board, a mistake?

• Automate & Innovate even more

• Drink more …?

What’s next?

MeasureFest 2015 - @MartijnSch

Page 26: MeasureFest

• Take it easy… do you know what to do?

• First: become friends with your data!

• Second: become friends with your developers.

• Third: map out your strategy, do you have the resources?

• Worst case? Read back the slides!

What’s your next step?

MeasureFest 2015 - @MartijnSch

Page 27: MeasureFest

Martijn Scheijbeler Director of Marketing at The Next Web

Email: [email protected]: @MartijnSch

Have fun! Thank you!Slides: http://tnw.to/measurefest

MeasureFest 2015 - @MartijnSch

Page 28: MeasureFest

MeasureFest 2015 - @MartijnSch