Qualaroo & Optimizely Webinar - 5 Steps to Your First A/B Testing Win
-
Upload
optimizely -
Category
Data & Analytics
-
view
10.455 -
download
0
Transcript of Qualaroo & Optimizely Webinar - 5 Steps to Your First A/B Testing Win
![Page 1: Qualaroo & Optimizely Webinar - 5 Steps to Your First A/B Testing Win](https://reader037.fdocuments.net/reader037/viewer/2022103120/55d496febb61eb9d698b45a3/html5/thumbnails/1.jpg)
5 Steps to Your First A/B Testing Win
![Page 2: Qualaroo & Optimizely Webinar - 5 Steps to Your First A/B Testing Win](https://reader037.fdocuments.net/reader037/viewer/2022103120/55d496febb61eb9d698b45a3/html5/thumbnails/2.jpg)
Sean Ellis, CEO, Qualaroo (@seanellis)Sean Ellis is the CEO of Qualaroo and founder of GrowthHackers.com. Prior to Qualaroo, Sean held marketing leadership roles with breakout companies including Dropbox, LogMeIn (IPO), Uproar (IPO), Eventbrite and Lookout.
Ryan Lillis, Strategic Optimization Consultant, Optimizely
(@Optimizely)Ryan Lillis is a web conversion optimization specialist who helps Optimizely clients get the most out of their A/B, multivariate testing and targeting campaigns. He has worked in the website optimization space for eight years and has worked with companies as small as 5 people all the way up to Fortune 100 companies.
![Page 3: Qualaroo & Optimizely Webinar - 5 Steps to Your First A/B Testing Win](https://reader037.fdocuments.net/reader037/viewer/2022103120/55d496febb61eb9d698b45a3/html5/thumbnails/3.jpg)
#winningtests
![Page 4: Qualaroo & Optimizely Webinar - 5 Steps to Your First A/B Testing Win](https://reader037.fdocuments.net/reader037/viewer/2022103120/55d496febb61eb9d698b45a3/html5/thumbnails/4.jpg)
Why Spend Time on A/B Testing?
$92 dollars spent on acquisition for every $1 on optimization
87% of companies (currently testing) run 1-5 tests per month
Best companies in the world run hundreds per month
Source: Econsultancy & Redeye Conversion Rate Optimization Report 2014
#winningtests
![Page 5: Qualaroo & Optimizely Webinar - 5 Steps to Your First A/B Testing Win](https://reader037.fdocuments.net/reader037/viewer/2022103120/55d496febb61eb9d698b45a3/html5/thumbnails/5.jpg)
Optimization is a Process
QuantitativeInsights
QualitativeInsightsTesting
#winningtests
![Page 6: Qualaroo & Optimizely Webinar - 5 Steps to Your First A/B Testing Win](https://reader037.fdocuments.net/reader037/viewer/2022103120/55d496febb61eb9d698b45a3/html5/thumbnails/6.jpg)
Understanding Conversion Optimization Goals
![Page 7: Qualaroo & Optimizely Webinar - 5 Steps to Your First A/B Testing Win](https://reader037.fdocuments.net/reader037/viewer/2022103120/55d496febb61eb9d698b45a3/html5/thumbnails/7.jpg)
image via: http://www.shayhowe.com/web-design/defining-multivariate-testing/
Brainstorm Test Ideas Make a Small Change See Mixed
or No Results
Typical Testing Process
#winningtests
![Page 8: Qualaroo & Optimizely Webinar - 5 Steps to Your First A/B Testing Win](https://reader037.fdocuments.net/reader037/viewer/2022103120/55d496febb61eb9d698b45a3/html5/thumbnails/8.jpg)
Ideal Testing Process
User Research Lots of Testing Ideas
QuantitativeInsights
QualitativeInsightsTesting
Continuous Process of Learning
#winningtests
![Page 9: Qualaroo & Optimizely Webinar - 5 Steps to Your First A/B Testing Win](https://reader037.fdocuments.net/reader037/viewer/2022103120/55d496febb61eb9d698b45a3/html5/thumbnails/9.jpg)
Guessing is Expensive
![Page 10: Qualaroo & Optimizely Webinar - 5 Steps to Your First A/B Testing Win](https://reader037.fdocuments.net/reader037/viewer/2022103120/55d496febb61eb9d698b45a3/html5/thumbnails/10.jpg)
Top 5 highest bounce rate pages
Top 5 abandonment points in your funnel
Top 5 most valuable pages to your business
#1: Find Your Best Opportunities
#winningtests
![Page 11: Qualaroo & Optimizely Webinar - 5 Steps to Your First A/B Testing Win](https://reader037.fdocuments.net/reader037/viewer/2022103120/55d496febb61eb9d698b45a3/html5/thumbnails/11.jpg)
1. Look at top landing pages
2. Identify those with high bounce rates
3. Conduct research on those pages
4. Develop tests to improve page performance
Image via: SmartInsights.com
Example: High Bounce Rates
#winningtests
![Page 12: Qualaroo & Optimizely Webinar - 5 Steps to Your First A/B Testing Win](https://reader037.fdocuments.net/reader037/viewer/2022103120/55d496febb61eb9d698b45a3/html5/thumbnails/12.jpg)
#2: Understand Visitor Needs
Ask and Answer Four Key Questions:!
Why did they come to your website?
What stopped them from converting?
Did they find what they were looking for?
If they did convert, what almost stopped them?
#winningtests
![Page 13: Qualaroo & Optimizely Webinar - 5 Steps to Your First A/B Testing Win](https://reader037.fdocuments.net/reader037/viewer/2022103120/55d496febb61eb9d698b45a3/html5/thumbnails/13.jpg)
Example: Post Conversion Surveys
#winningtests
![Page 14: Qualaroo & Optimizely Webinar - 5 Steps to Your First A/B Testing Win](https://reader037.fdocuments.net/reader037/viewer/2022103120/55d496febb61eb9d698b45a3/html5/thumbnails/14.jpg)
Use Data & Insights to Drive Testing
![Page 15: Qualaroo & Optimizely Webinar - 5 Steps to Your First A/B Testing Win](https://reader037.fdocuments.net/reader037/viewer/2022103120/55d496febb61eb9d698b45a3/html5/thumbnails/15.jpg)
Start small to get a win and validation for process
Test for impact, avoid ‘Meek Tweaking’
Use test result data to inform the next test
#3: Use Data & Insights to Inform Testing
#winningtests
![Page 16: Qualaroo & Optimizely Webinar - 5 Steps to Your First A/B Testing Win](https://reader037.fdocuments.net/reader037/viewer/2022103120/55d496febb61eb9d698b45a3/html5/thumbnails/16.jpg)
Image via Conversion Rate Experts
Meek Tweaking
#winningtests
![Page 17: Qualaroo & Optimizely Webinar - 5 Steps to Your First A/B Testing Win](https://reader037.fdocuments.net/reader037/viewer/2022103120/55d496febb61eb9d698b45a3/html5/thumbnails/17.jpg)
Running Your First Tests
![Page 18: Qualaroo & Optimizely Webinar - 5 Steps to Your First A/B Testing Win](https://reader037.fdocuments.net/reader037/viewer/2022103120/55d496febb61eb9d698b45a3/html5/thumbnails/18.jpg)
Testing Ideas to Start:!
4 Message Tests
4 "Aha Moment" Tests
2 Large Scale Design Tests
#4: Where to Start?
#winningtests
![Page 19: Qualaroo & Optimizely Webinar - 5 Steps to Your First A/B Testing Win](https://reader037.fdocuments.net/reader037/viewer/2022103120/55d496febb61eb9d698b45a3/html5/thumbnails/19.jpg)
Measure impact through the entire funnel, not just at the page level.
Bigger changes yield faster results.
Different levels of statistical significance will speed up or slow down decision making.
#5: Measuring Success
#winningtests
![Page 20: Qualaroo & Optimizely Webinar - 5 Steps to Your First A/B Testing Win](https://reader037.fdocuments.net/reader037/viewer/2022103120/55d496febb61eb9d698b45a3/html5/thumbnails/20.jpg)
Putting It All Together
![Page 21: Qualaroo & Optimizely Webinar - 5 Steps to Your First A/B Testing Win](https://reader037.fdocuments.net/reader037/viewer/2022103120/55d496febb61eb9d698b45a3/html5/thumbnails/21.jpg)
QuantitativeInsights
QualitativeInsightsTesting
Optimization is a Process
#winningtests
![Page 22: Qualaroo & Optimizely Webinar - 5 Steps to Your First A/B Testing Win](https://reader037.fdocuments.net/reader037/viewer/2022103120/55d496febb61eb9d698b45a3/html5/thumbnails/22.jpg)
1. Plan and run your first five to ten tests.
2. Get your first win.
3. Start the cycle of continuous improvement.
Next Steps
#winningtests
![Page 23: Qualaroo & Optimizely Webinar - 5 Steps to Your First A/B Testing Win](https://reader037.fdocuments.net/reader037/viewer/2022103120/55d496febb61eb9d698b45a3/html5/thumbnails/23.jpg)
qualaroo.com/beginners-guide-to-cro/
Resources
optimize.ly/datadna
#winningtests
![Page 24: Qualaroo & Optimizely Webinar - 5 Steps to Your First A/B Testing Win](https://reader037.fdocuments.net/reader037/viewer/2022103120/55d496febb61eb9d698b45a3/html5/thumbnails/24.jpg)
Q & A
#winningtests