cancel
Showing results for 
Search instead for 
Did you mean: 
This area of the Community has been archived.
If you are looking for assistance, please see our Knowledge & Support area. If you are looking to leave feedback, please take a look at the Your Feedback & Ideas area. If you have any questions, you can reach out to our Community team at communitysupport(at)constantcontact(dot)com.

Quick Tip: ABCs of AB Testing

CTCT Employee

Quick Tip: ABCs of AB Testing

When you’re trying out ways to improve your open rate it’s always best to do so by testing against a baseline. That is where AB testing (or split testing) can be a life saver. It allows you to do a trial run of a new subject line and see what sort of difference it makes in your numbers.

All you do is follow these steps:

 

  1. Create two new test contact lists in Constant Contact.
  2. Copy or import one half of your contact list into each test list.
  3. Create two copies of your next email: "Copy A" and "Copy B".
  4. Edit Copy B to include the change that you are testing.
  5. Send Copy A to one-half of your contact list. 
  6. Send Copy B to the other half.

Once you do that, you can sit back and watch the reporting data come in. Go ahead and test like this a few times to make sure you’ve got a steady trend. And don’t limit yourself to just working with your subject lines. You can also evaluate other things, such as design choice or best time of day to email.

Jaime McCall
Knowledge Base Writer
Constant Contact
Tags (2)
23 REPLIES 23
Honored Contributor

Re: Quick Tip: ABCs of AB Testing

It's hard to make a general rule with such a large playing field but I'd like to share another idea.

 

Here's an additional tip when you are lucky enough to have large lists (>2000).  I call it a rolling A/B test. This works best for subject line testing.  I use different subject lines for most of my clients email every month as the content of the email changes often.

 

There are certainly a few other variables like time and day but my tests in those cases show that Tuesday-Thursday are pretty much even for my lists and with so many folks reading email on their phones now a days that's becoming a diminishing factor as well.

 

I like to do my A/B with only 40% of the lists , 20% --> A     20% -->B.

 

Then send the remaining 60% to the most successful of the tests.  This way I don't lose any effectiveness on the major portion of my lists by sending it to the failing group. If there isn't a clear winner then it doesn't make a difference, if there is I minimize my expousure to the loser.

 

Does anyone else have other personal favorite ways of testing?

 

Tony Schaefer
Constant Contact Solution Provider and SMS Marketing Specialist
www.cliquemarketing.biz

Occasional Visitor

Re: Quick Tip: ABCs of AB Testing

I'm kind of surprised that manual A/B testing is still the norm here at CC. I use aWeber, but I need to use CC for a client, and this seems very outdated. 

 

People have been asking about this functionality from CC since like 2008. Is there any plan to incorporate actual A/B testing (like MailChimp, etc.) into CC?

Honored Contributor

Re: Quick Tip: ABCs of AB Testing

Hello Jeff, 

 

Thank you for posting in your Constant Contact Community.  Having A/B testing is something that we are looking into, to see if we could have this in the future; however, we do not have immediate plans to implement it at this time.  

 

I will pass along your feedback to our developers, and add an extra vote to this topic for you.  

 

 

 

Occasional Participant

Re: Quick Tip: ABCs of AB Testing

You guys should really work on making A/B testing a feature.  To suggest to your customers that they should spend the time to do A/B testing manually doesn't exactly demonstrate a good sense of people's time.  

Moderator

Re: Quick Tip: ABCs of AB Testing

Thanks for adding your thoughts! I'm happy to submit these ideas on your behalf for future developments. We do take all feedback into consideration when working to improve or add features so any ideas are appreciated!

 

Thanks again,

Hannah M.
Community and Social Media Support

If you find my post helpful, and it answers your question, please mark it as an Accepted Solution

Are you on Twitter? Follow me here!
Occasional Participant

Re: Quick Tip: ABCs of AB Testing

I must concur with the above opinions about Constant Contact as well. Frankly I'm disappointed with Constant Contact that they don't have such a fundamental necessity implemented already. MailChimp has yall seriously beat in this arena. I'll be encouraging my company to leave Constant Contact... this feature is necessary.

CTCT Employee

Re: Quick Tip: ABCs of AB Testing

thsc1986,

 

Thank you for the feedback.  AB Testing is something our engineers currently have under review for a possible future release of our product.

 

I am sorry that you may leave us before this feature is programmed into our system.  We have been diligently working to upgrade other pain points our customers have reported and this one had to get pushed back.  However, rest assured that we will get this upgrade in place if our engineers feel it is possible.

 

Incidentally, I have added you to the User Voice for this feature.  If it becomes available, you will see it posted here.

 

Thank you for your time.

 

 

Troy S.
Community & Social Media Support

If you find my post helpful, and it answers your question, please mark it as an "Accepted Solution" by clicking the Accept as Solution button in the bottom right hand corner of this post.
Senior Member

Re: Quick Tip: ABCs of AB Testing

I would also concur. An easy way of doing A/B testing is urgently needed.

Moderator

Re: Quick Tip: ABCs of AB Testing

Thanks for adding in your vote. I am happy to add it to this idea!

Hannah M.
Community and Social Media Support

If you find my post helpful, and it answers your question, please mark it as an Accepted Solution

Are you on Twitter? Follow me here!