Email Marketing and A/B Testing
Options
I would like to learn about running A/B testing on emails for our upcoming holiday e-appeal campaign. Does anyone have experience using NetCommunity to A/B test and is willing to share some best practices/tips?
Tagged:
1
Comments
-
I've done a little testing on my site using the Content Comparison part. It won't help with emails in the inbox, but the Content Comparison part is similar to the Targeted Content part in that you load the part with two other parts. Then the Content Comparison part will do the A/B testing on the page for you. It collects data and updates the results nightly. You can set a threshold so that when your goal is met, it continues to deliver A or B depending on which version was more successful.
I'm pretty sure it measures success by the click throughs to the page you determine in the Content Comparison part. Of course, you have to make sure your A and your B parts are linking to the same page. Once you set those parts inside the Content Comparison part and start the test, it locks the FT&I parts from being edited. You need to make sure you like A and you like B before testing them.
From my experience, I learned how infrequently the items I promote on my homepage are clicked. It was cool, but a bit of a bummer. It took far longer than I anticipated to determine a winner.
If you're set on the A/B testing for emails and not the website, you might consider using Google Analytics and setting up goals for the site with a funnel. If email A and email B both link to different pages, you could measure goal A against goal B and get some results that were meaningful without a whole lot of filtering or advanced searching.0 -
NetCommunity's Email Campaign feature exists for this exact purpose. You can read up on it in the NetCommunity Email Guide. Campaigns allow you to choose a seed list and do A/B split testing and to track conversions and ultimately send the more effective email to the broader list.0
-
Jaime - thanks for your response. I am looking for email testing specifically, so your advice about leveraging Google Analytics is a good point. I will look into that! And I like the idea of testing the website too...I will save that for another day for sure!
And Chris, I attempted to run a campaign last year, but I had an issue when I couldn't run a test on my emails as I was creating them. My understanding is that you can only test emails in messages, so you would have to create messages and then copy the HTML into campaigns once all the glitches are worked out. Is that the only limitation with campaigns?!
Thank you again!1 -
Chris Martin:
Hi Chris, as I said in my last post: I attempted to run a campaign last year, but I had an issue when I couldn't run a test on my emails as I was creating them. My understanding is that you can only test emails in messages, so you would have to create messages and then copy the HTML into campaigns once all the glitches are worked out. Is that the only limitation with campaigns?! Any further insight you have on this would be great.
NetCommunity's Email Campaign feature exists for this exact purpose. You can read up on it in the NetCommunity Email Guide. Campaigns allow you to choose a seed list and do A/B split testing and to track conversions and ultimately send the more effective email to the broader list.0 -
Jamin Sartor:
Chris Martin:
NetCommunity's Email Campaign feature exists for this exact purpose. You can read up on it in the NetCommunity Email Guide. Campaigns allow you to choose a seed list and do A/B split testing and to track conversions and ultimately send the more effective email to the broader list.
Hi Chris, as I said in my last post: I attempted to run a campaign last year, but I had an issue when I couldn't run a test on my emails as I was creating them. My understanding is that you can only test emails in messages, so you would have to create messages and then copy the HTML into campaigns once all the glitches are worked out. Is that the only limitation with campaigns?! Any further insight you have on this would be great.This has been my experience as well. I know it has been three years, but any chance you got an answer from BB about it? I contacted BBNC Support but they did not seem to understand why this was a headache/annoying.
What I do is compose emails in Messages, always, then only set up the Campaign when I have the code 90% baked.
What I would love is to be able to save Messages in folders.... which is what I was hoping Campaigns could do for me; be an easy sorting/reporting area for a "campaign" in the sense of year-end fundraising, or similar.
0
Categories
- All Categories
- Shannon parent
- shannon 2
- shannon 1
- 21 Advocacy DC Users Group
- 14 BBCRM PAG Discussions
- 89 High Education Program Advisory Group (HE PAG)
- 28 Luminate CRM DC Users Group
- 8 DC Luminate CRM Users Group
- Luminate PAG
- 5.9K Blackbaud Altru®
- 58 Blackbaud Award Management™ and Blackbaud Stewardship Management™
- 409 bbcon®
- 2.1K Blackbaud CRM™ and Blackbaud Internet Solutions™
- donorCentrics®
- 1.1K Blackbaud eTapestry®
- 2.8K Blackbaud Financial Edge NXT®
- 1.1K Blackbaud Grantmaking™
- 527 Education Management Solutions for Higher Education
- 1 JustGiving® from Blackbaud®
- 4.6K Education Management Solutions for K-12 Schools
- Blackbaud Luminate Online & Blackbaud TeamRaiser
- 16.4K Blackbaud Raiser's Edge NXT®
- 4.1K SKY Developer
- 547 ResearchPoint™
- 151 Blackbaud Tuition Management™
- 1 YourCause® from Blackbaud®
- 61 everydayhero
- 3 Campaign Ideas
- 58 General Discussion
- 115 Blackbaud ID
- 87 K-12 Blackbaud ID
- 6 Admin Console
- 949 Organizational Best Practices
- 353 The Tap (Just for Fun)
- 235 Blackbaud Community Feedback Forum
- 55 Admissions Event Management EAP
- 18 MobilePay Terminal + BBID Canada EAP
- 36 EAP for New Email Campaigns Experience in Blackbaud Luminate Online®
- 109 EAP for 360 Student Profile in Blackbaud Student Information System
- 41 EAP for Assessment Builder in Blackbaud Learning Management System™
- 9 Technical Preview for SKY API for Blackbaud CRM™ and Blackbaud Altru®
- 55 Community Advisory Group
- 46 Blackbaud Community Ideas
- 26 Blackbaud Community Challenges
- 7 Security Testing Forum
- 1.1K ARCHIVED FORUMS | Inactive and/or Completed EAPs
- 3 Blackbaud Staff Discussions
- 7.7K ARCHIVED FORUM CATEGORY [ID 304]
- 1 Blackbaud Partners Discussions
- 1 Blackbaud Giving Search™
- 35 EAP Student Assignment Details and Assignment Center
- 39 EAP Core - Roles and Tasks
- 59 Blackbaud Community All-Stars Discussions
- 20 Blackbaud Raiser's Edge NXT® Online Giving EAP
- Diocesan Blackbaud Raiser’s Edge NXT® User’s Group
- 2 Blackbaud Consultant’s Community
- 43 End of Term Grade Entry EAP
- 92 EAP for Query in Blackbaud Raiser's Edge NXT®
- 38 Standard Reports for Blackbaud Raiser's Edge NXT® EAP
- 12 Payments Assistant for Blackbaud Financial Edge NXT® EAP
- 6 Ask an All Star (Austen Brown)
- 8 Ask an All-Star Alex Wong (Blackbaud Raiser's Edge NXT®)
- 1 Ask an All-Star Alex Wong (Blackbaud Financial Edge NXT®)
- 6 Ask an All-Star (Christine Robertson)
- 21 Ask an Expert (Anthony Gallo)
- Blackbaud Francophone Group
- 22 Ask an Expert (David Springer)
- 4 Raiser's Edge NXT PowerUp Challenge #1 (Query)
- 6 Ask an All-Star Sunshine Reinken Watson and Carlene Johnson
- 4 Raiser's Edge NXT PowerUp Challenge: Events
- 14 Ask an All-Star (Elizabeth Johnson)
- 7 Ask an Expert (Stephen Churchill)
- 2025 ARCHIVED FORUM POSTS
- 322 ARCHIVED | Financial Edge® Tips and Tricks
- 164 ARCHIVED | Raiser's Edge® Blog
- 300 ARCHIVED | Raiser's Edge® Blog
- 441 ARCHIVED | Blackbaud Altru® Tips and Tricks
- 66 ARCHIVED | Blackbaud NetCommunity™ Blog
- 211 ARCHIVED | Blackbaud Target Analytics® Tips and Tricks
- 47 Blackbaud CRM Higher Ed Product Advisory Group (HE PAG)
- Luminate CRM DC Users Group
- 225 ARCHIVED | Blackbaud eTapestry® Tips and Tricks
- 1 Blackbaud eTapestry® Know How Blog
- 19 Blackbaud CRM Product Advisory Group (BBCRM PAG)
- 1 Blackbaud K-12 Education Solutions™ Blog
- 280 ARCHIVED | Mixed Community Announcements
- 3 ARCHIVED | Blackbaud Corporations™ & Blackbaud Foundations™ Hosting Status
- 1 npEngage
- 24 ARCHIVED | K-12 Announcements
- 15 ARCHIVED | FIMS Host*Net Hosting Status
- 23 ARCHIVED | Blackbaud Outcomes & Online Applications (IGAM) Hosting Status
- 22 ARCHIVED | Blackbaud DonorCentral Hosting Status
- 14 ARCHIVED | Blackbaud Grantmaking™ UK Hosting Status
- 117 ARCHIVED | Blackbaud CRM™ and Blackbaud Internet Solutions™ Announcements
- 50 Blackbaud NetCommunity™ Blog
- 169 ARCHIVED | Blackbaud Grantmaking™ Tips and Tricks
- Advocacy DC Users Group
- 718 Community News
- Blackbaud Altru® Hosting Status
- 104 ARCHIVED | Member Spotlight
- 145 ARCHIVED | Hosting Blog
- 149 JustGiving® from Blackbaud® Blog
- 97 ARCHIVED | bbcon® Blogs
- 19 ARCHIVED | Blackbaud Luminate CRM™ Announcements
- 161 Luminate Advocacy News
- 187 Organizational Best Practices Blog
- 67 everydayhero Blog
- 52 Blackbaud SKY® Reporting Announcements
- 17 ARCHIVED | Blackbaud SKY® Reporting for K-12 Announcements
- 3 Luminate Online Product Advisory Group (LO PAG)
- 81 ARCHIVED | JustGiving® from Blackbaud® Tips and Tricks
- 1 ARCHIVED | K-12 Conference Blog
- Blackbaud Church Management™ Announcements
- ARCHIVED | Blackbaud Award Management™ and Blackbaud Stewardship Management™ Announcements
- 1 Blackbaud Peer-to-Peer Fundraising™, Powered by JustGiving® Blogs
- 39 Tips, Tricks, and Timesavers!
- 56 Blackbaud Church Management™ Resources
- 154 Blackbaud Church Management™ Announcements
- 1 ARCHIVED | Blackbaud Church Management™ Tips and Tricks
- 11 ARCHIVED | Blackbaud Higher Education Solutions™ Announcements
- 7 ARCHIVED | Blackbaud Guided Fundraising™ Blog
- 2 Blackbaud Fundraiser Performance Management™ Blog
- 9 Foundations Events and Content
- 14 ARCHIVED | Blog Posts
- 2 ARCHIVED | Blackbaud FIMS™ Announcement and Tips
- 59 Blackbaud Partner Announcements
- 10 ARCHIVED | Blackbaud Impact Edge™ EAP Blogs
- 1 Community Help Blogs
- Diocesan Blackbaud Raiser’s Edge NXT® Users' Group
- Blackbaud Consultant’s Community
- Blackbaud Francophone Group
- 1 BLOG ARCHIVE CATEGORY
- Blackbaud Community™ Discussions
- 8.3K Blackbaud Luminate Online® & Blackbaud TeamRaiser® Discussions
- 5.7K Jobs Board