Subject AB - Stop Collecting Reporting for Losing Subject Lines After Winner Has Been Decided

[NathanielS043]

It would be awesome if the A/B results could be locked in at the time the winning email is sent so that I can check back later to get a sense of what the difference was. As it stands now, I have to check immediately when the winning subject line is sent to get a sense of what the numbers were at that time. As a counter point, I've checked several hours into the future after a winning email is sent and the numbers have changed such that the winner is no longer the winner and I have no idea how close it was at the time mark.

This is important for many reasons. For one, it's a burden on my time if the A/B test is 12 hours or longer because it's just an extra task to always need to check and manually track. Second, being able to track the change over time is important. So, being able to see the fixed winning numbers and then check back after another 12 hours to see how much more things have changed can help us know how better to schedule these A/B test times.

The bottom line is that I can't trust the numbers from a historical perspective because they continue to change. I appreciate the need to view the changes, but it would be really helpful if locked numbers that existed at the time of send could be shown as well.

[William_A]

We're updating the status of this idea to more accurately reflect its current status with our engineering team, and also made slight changes to the subject line in order for it to be more easily found. We can't guarantee a commitment to deliver on this feature request, but it should indicate some awareness that we have heard your feedback and could be taken under consideration for a future release.