Question about A/B Test Splits

Options
Sarah Byrnes
Sarah Byrnes ✭
Ancient Membership
in Training Discussion

Hi - I've watched the video on A/B test splits. Is there a way to send the test variants to small portions of the list (say 5% and 5%), and then send the "winning" subject line to the rest of the list?

 

Thanks,

Sarah Byrnes

Comments

  • Kent Gilliam
    Kent Gilliam Blackbaud Employee
    Ancient Membership Facilitator 4 Name Dropper Photogenic

    What I usually see done is orgs will create two small query-built groups. They use the cons ID and create queries that say, "Last 1 digit start with 1 and ends with 2". You have to play around with this a little to get a small random group. But you can build this using System - Contact Range - add field clause.

     

    You just create two of these and it's a nice clean way to make random testing groups. 

     

    Hope this helps!

    Kent

  • Allison King
    Allison King Blackbaud Employee
    Ancient Membership Facilitator 2 Name Dropper Photogenic

    Hi Sarah,

     

    There sure is! Just put in the 5% and 5% for each message variant (but make sure it is a statisically signfigant number) and run the test. Then you can run the message varient report to see which one performed better.

     

    Once you know, you set up the message to send, just like you would any message. The system will ask you which version you want to send. Just pick the message varient that did the best. The message will not go out to those who already received the A/B testing because Luminate Online tracks that.

Categories