How to create an A/B test

In Mailrelay you can create A/B tests for newsletters, for a small subset of subscribers, and analyze the results obtained with this group, and then send the winning campaign to all the remaining contacts.

This will help us to get the best results from the campaigns, without having to do practically anything.

TABLE OF CONTENTS

• Step 1: Decide on the type of A/B test
• Step 2: Preparing the A/B test
• Step 3: A/B test forthe sender
  • Step 3.1: Decide manually
  • Step 3.2: Pick the newsletter with most clicks
  • Step 3.3: Pick the newsletter with most impressions
• Step 4: A/B tests for subject lines
  • Step 4.1: I will decide manually
  • Step 4.2: Pick the newsletter with most clicks
  • Step 4.3: Pick the newsletter with most impressions

Step 1: Decide on the type of A/B test

A/B tests can be created based on two conditions:

• Sender: This option allows you to use two senders to find out which one offers the best click and open rates.
• Subject line: In this case, two subjects are used to find out which one offers a better click or open rate.

Step 2: Preparing the A/B test

To start an A/B test, it is essential that you have already created a campaign that will be used in the A/B test.

In this case, simply go to Campaigns >> A/B test.

After that, click on the Add button to create the new test. Next, you will need to choose the newsletter you want to use for the A/B test. This can be done in the Base Campaign option. Once you have selected it, just click Next to continue with the process.

After that, you have to select the groups or segments to which you want to send the newsletter, for this in the option To whom you want to send the test, you must select one of the two possible options: Groups or Segment. After that, just below, you can include the groups or segments (a single group or segment is also allowed).

Please note that in order for the system to allow you to create the A/B test, the group or segment must have at least 10 subscribers, or you will not be able to send the A/B test.

When everything is ready, click Next and you will be taken to the final A/B test setup screen, where you will need to decide between several options according to your preference:

• What would you like to test: where you should click on Sender or Subject, depending on the type of A/B test you want to create.
• What percentage of recipients will receive the tests? Here you should indicate the percentage of the subscribers you will use for the test (the exact number is calculated by the system based on the total number of subscribers in each group/segment).
• How can I decide which campaign was the winner? This option allows you to automate (if you wish) the way the system will act when the A/B test is completed.

At this point, you will be able to choose between several options:

1. I will decide manually
2. Select the newsletter with the highest number of clicks.
3. Select the newsletter with the highest number of impressions.

Step 3: A/B test forthe sender