5 Steps for A/B Split Testing in Bronto
-
Upload
bronto-software -
Category
Self Improvement
-
view
1.659 -
download
0
description
Transcript of 5 Steps for A/B Split Testing in Bronto
![Page 1: 5 Steps for A/B Split Testing in Bronto](https://reader033.fdocuments.net/reader033/viewer/2022052823/55581883d8b42a25588b475c/html5/thumbnails/1.jpg)
5 Steps for A/B Split TestingJune 28, 2012
![Page 2: 5 Steps for A/B Split Testing in Bronto](https://reader033.fdocuments.net/reader033/viewer/2022052823/55581883d8b42a25588b475c/html5/thumbnails/2.jpg)
Bronto Webinars
blog.bronto.com
community.bronto.com
@bronto
Bronto Nation
www.bronto.com/bpd
Thank you for attending
Q&A
Recording
Topic Suggestions?
Housekeeping
![Page 3: 5 Steps for A/B Split Testing in Bronto](https://reader033.fdocuments.net/reader033/viewer/2022052823/55581883d8b42a25588b475c/html5/thumbnails/3.jpg)
Our Contest
![Page 4: 5 Steps for A/B Split Testing in Bronto](https://reader033.fdocuments.net/reader033/viewer/2022052823/55581883d8b42a25588b475c/html5/thumbnails/4.jpg)
5 Steps for A/B Split TestingJune 28, 2012
![Page 5: 5 Steps for A/B Split Testing in Bronto](https://reader033.fdocuments.net/reader033/viewer/2022052823/55581883d8b42a25588b475c/html5/thumbnails/5.jpg)
3
2
1A/B Split Testing Overview
Best Practices
A/B Split Testing in Bronto
A/B Split Testing
Agenda
![Page 6: 5 Steps for A/B Split Testing in Bronto](https://reader033.fdocuments.net/reader033/viewer/2022052823/55581883d8b42a25588b475c/html5/thumbnails/6.jpg)
Overview
What is A/B Split Testing
• Method of experimenting with email campaigns to determine variables that generate the best results
• Results typically measured by• Open Rates• CTR• Conversion Rates• Total Revenue
![Page 7: 5 Steps for A/B Split Testing in Bronto](https://reader033.fdocuments.net/reader033/viewer/2022052823/55581883d8b42a25588b475c/html5/thumbnails/7.jpg)
Overview
What can A/B Split Testing Determine?
• What day of week gets better open rates?
• Which subject type (personalized, generic, call to action, shorter, longer) gets the best open rates?
• Is it better to use your company name or a personal name in the from address?
• Does one layout generate more revenue than another?
• Many others….
![Page 8: 5 Steps for A/B Split Testing in Bronto](https://reader033.fdocuments.net/reader033/viewer/2022052823/55581883d8b42a25588b475c/html5/thumbnails/8.jpg)
Steps for A/B Testing
5 Steps for A/B Testing
1. Create content2. Identify 2 or more randomly
selected groups of contacts3. Send message to the groups
with a variable• Subject line• From name and address• Different Content• Different Date/Time of send
4. Review results5. Take action with winnerTest and Re-test!
![Page 9: 5 Steps for A/B Split Testing in Bronto](https://reader033.fdocuments.net/reader033/viewer/2022052823/55581883d8b42a25588b475c/html5/thumbnails/9.jpg)
Best Practices
1. Stick to one test variable.2. Utilize segments large
enough to make the test valid.
3. Focus on the right data points.
4. Allow enough time to elapse.5. Test at the appropriate time.6. Choose the right kind of split
test (automated / manual).7. Always Be Testing.8. Pay attention to the results.
![Page 10: 5 Steps for A/B Split Testing in Bronto](https://reader033.fdocuments.net/reader033/viewer/2022052823/55581883d8b42a25588b475c/html5/thumbnails/10.jpg)
A/B Split Testing in Bronto
Two types of testing• Champion / Challenger• A/B Winner
4 Split Options• Subject Line• From Name / Address• Date / Time of Send• Full Message Content
Multiple winning criteria• Open Rate• Click Rate• Revenue• Etc.
Comparison Reporting
![Page 11: 5 Steps for A/B Split Testing in Bronto](https://reader033.fdocuments.net/reader033/viewer/2022052823/55581883d8b42a25588b475c/html5/thumbnails/11.jpg)
A/B Split Testing Demonstration
![Page 12: 5 Steps for A/B Split Testing in Bronto](https://reader033.fdocuments.net/reader033/viewer/2022052823/55581883d8b42a25588b475c/html5/thumbnails/12.jpg)
Client Successes with A/B Testing
Gourmet Food Retailer – Send Time Optimization Test 549% Increase in Campaign Revenue
Clothing Retailer – Subject Line Testing Click Rate Increase of 23%
Furniture Maker – Email Header Test Click Rate Increase of 37%
![Page 13: 5 Steps for A/B Split Testing in Bronto](https://reader033.fdocuments.net/reader033/viewer/2022052823/55581883d8b42a25588b475c/html5/thumbnails/13.jpg)
Which Test Won
![Page 14: 5 Steps for A/B Split Testing in Bronto](https://reader033.fdocuments.net/reader033/viewer/2022052823/55581883d8b42a25588b475c/html5/thumbnails/14.jpg)
Thanks for Joining!
![Page 15: 5 Steps for A/B Split Testing in Bronto](https://reader033.fdocuments.net/reader033/viewer/2022052823/55581883d8b42a25588b475c/html5/thumbnails/15.jpg)
Thank You for Attending!
[email protected]@bronto.com
Account Management
Webinar RecordingBlog PostWhich Test Won
Follow Up Email
![Page 16: 5 Steps for A/B Split Testing in Bronto](https://reader033.fdocuments.net/reader033/viewer/2022052823/55581883d8b42a25588b475c/html5/thumbnails/16.jpg)
Contest
Random Name Drawing
Medium Inflatable Bronto!!!