A - B Testing

SOLVED
Highlighted
Participating Solution Provider

A - B Testing

I want to start testing subject lines.  I have a list of 24,000 subscribers about 18% open all the time.  How do I create the list for the A:B test?

Sincerely,
Ray Higgins
Cybermail Marketing
ray@cybermailmarketing.com
1 ACCEPTED SOLUTION

Accepted Solutions
Highlighted
CTCT Employee

Re: A - B Testing

UPDATED: June 2018

 

If you are working in a 3GE template, Subject Line A/B Testing can be turned on in the scheduling of your email campaign.

 

-----

Hello @EricM298 , 

 

We now have a feedback area of the Community where you can pass this suggestion along.  Feel free to post this topic here.  As you have seen we do not have this feature available currently; however by posting in the feedback area others can vote on the idea.  If the idea gets more votes it has a greater chance of being implemented in the future.  


Thanks,

View solution in original post

17 REPLIES 17
Highlighted
Honored Contributor

Re: A - B Testing

Hi Ray,

 

A/B Testing is manual process but it can be done by :

 

  1. Create two new test contact lists in Constant Contact.
  2. Copy (not move) or import one half of your contact list into each test list.
  3. Create two copies of your next email: "Copy A" and "Copy B".
  4. Send Copy A to one-half of your contact list at a time of day or week that you believe will be popular. 
  5. Send Copy B to the other half of your list at a different time of day or the week.
  6. Compare the open rates for each email about 48 hours after each one is sent.
  7. Repeat steps 1-5 a few times to determine which days of the week and times of day result in the best open rates.

I hope this helps,

Jarrad

If you find my post helpful, and it answers your question, please mark it as an "Accepted Solution"

Are you on Twitter? Follow me here!
Highlighted
Participating Solution Provider

Re: A - B Testing

Hi Jarrad, I did just that but my client wants me to make two lists n=250 from 28,000 subscribers.  Then he wants me to do an A/B test on those two lists.  In 12 hours he wants to decide which copy proved better.  Then he wants to use that format to send to the whole population.  How do I pull two lists of 250 each without sending them an email twice?  ...once with the test and once when we do the full send?

Sincerely,
Ray Higgins
Cybermail Marketing
ray@cybermailmarketing.com
Highlighted
Honored Contributor

Re: A - B Testing

Hi Ray,

 

What you can do is create the two lists of 250 contacts each and send out your email. Once you've created the two lists of 250 contacts each, merge your 28,000 contacts list into a new list. This essentially makes a copy of your master list.The master list will remain untouched.

 

Once you've merged the master list, export the two smaller lists which have 250 contacts in each. Once exported, you will be able to remove those contacts from the copied master list of 28,000 contacts by clicking Remove and uploading each file so that those contacts are removed from the copied master. Now that you have removed the contacts from the copied master list, you can send out your email.

 

If this doesn't make sense please let me know.

 

Thanks,

 

 

Jarrad

If you find my post helpful, and it answers your question, please mark it as an "Accepted Solution"

Are you on Twitter? Follow me here!
Highlighted
Participating Solution Provider

Re: A - B Testing

Whew!  I'm getting my head around it. Create two blank lists: A and B.  Make a copy (merge) of the original master list. Populate Lists A and B and export them.  Then "Remove" them (which leaves the original master and the merged copy master untouched?) ....can you call me?   Thanks!

Sincerely,
Ray Higgins
Cybermail Marketing
ray@cybermailmarketing.com
Highlighted
Honored Contributor

Re: A - B Testing

It was nice chatting with you Ray!

 

Thanks,

Jarrad

If you find my post helpful, and it answers your question, please mark it as an "Accepted Solution"

Are you on Twitter? Follow me here!
Highlighted
Participating Solution Provider

Re: A - B Testing

Thank you Jarrad,  However, I found that when you "remove" someone you have only two choices:  "Remove them from just this list" or "Remove them from all lists."  So, I must remove them from "all lists" and then upload them back to the original master list as well as the A or B list from which I removed them.  Thank you for your help.  It is convoluted but it works!

Sincerely,
Ray Higgins
Cybermail Marketing
ray@cybermailmarketing.com
Highlighted
Visitor

Re: A - B Testing

Integrated A-B testing option would be a great feature for CTCT to add!

Highlighted
Regular Visitor

Re: A - B Testing

That's a lot of work to do a test...I can't even be bothered. I agree, an integrated option would be very helpful. I use another email provider when I want to do testing which does offer the integrated feature, and even automatically send the test that "won."

Highlighted
Member

Re: A - B Testing

I see this is an old thread, but I am starting some A/B testing for our contact lists. We have subscribers automatically dumped into our "general interest" list via a form on our website. Will I have to continually check that list and dump the new addresses into the A/B lists every time someone signs up? Is that the only way to keep my test lists up-to-date?

Constant Contact Would Like To Hear From You!

We want to hear from customers like you about your favorite features and how they have helped your business or organization. Tell us by answering a few questions in...

Read More
Featured