A/B testing

Automated email A/B testing

Run an A/B test on any email campaign: send two variations to part of your audience, and tinyEmail sends the higher-performing one to everyone else, decided on open rate or click rate. Test a subject line or the email content, set your own split, and start with any list size.

Subject line or contentOpen or click rateWinner sent automatically
Why test

You only get one shot at the inbox. Make it your better email.

Most campaigns go out on a hunch, and you find out how the subject line did after the whole list has seen it. Email A/B testing, or split testing, moves that answer to the front.

The whole list sees your guess

Pick the wrong subject line and every contact gets the weaker email. There is no second first impression.

Testing by hand rarely happens

Splitting a list, comparing two reports, then building a follow-up for the rest is a job in itself, so most teams skip it.

What A/B testing changes

A fraction of your audience decides for you. tinyEmail evaluates both variations, then clones and sends the winner to everyone still waiting.

How it works

How email A/B testing works in tinyEmail

Four steps inside a regular campaign. After you launch, there is nothing left to watch and nothing left to send.

  1. 1

    Create two variations

    Exactly two, A and B. Change the subject line or the content, one variable at a time.

  2. 2

    Split your audience

    You set the distribution, say 25% to A, 25% to B and 50% held back for the winner.

  3. 3

    Choose how it is judged

    Open rate or click rate decides. Add an optional target and the first to reach it wins.

  4. 4

    The winner sends itself

    tinyEmail clones the winning campaign and sends it to the rest of your audience.

What you control

Every rule of your A/B test is yours to set

Automatic does not mean opaque. You decide what is tested, who tests it, and what counts as winning.

One variable at a time

Test the subject line or the email content, never both at once, so the winner tells you exactly what worked.

You set the exposure

Full control over the split. Your audience is frozen at launch, so the groups stay consistent for the whole test.

Winning metric, your call

Judge on open rate when you test subject lines, or click rate when you test what is inside the email.

Win early on a target

Set an optional limit value. The first variation to reach it wins straight away, without waiting out the duration.

No ambiguity

Exactly how the A/B test winner is decided

The rules are fixed before you launch, and they run the same way every time.

  1. 1A target is reached. That variation wins immediately. If both reach it, the higher rate takes it.
  2. 2The duration ends first. The highest-performing variation wins, even by a fraction of a percent.
  3. 3An exact tie. Variation A is sent, so a test never stalls without a result.
  4. 4Then it ships. tinyEmail clones the winning campaign and sends it to the remaining audience.
What to test

What should you A/B test first?

Start with the subject line, then move to the content. Ideas, not rules.

Subject line · judge by open rateA/BQuestion or statementA/BShort or descriptiveA/BWith or without a nameA/BOffer up front or a teaser
Content · judge by click rateA/BHero image or product gridA/BOne button or several linksA/BLong story or short noteA/BButton wording
FAQ

A/B testing questions 

Can't find your answer? Our team is here 24/7.

Email A/B testing, also called split testing, sends two variations of the same campaign to different parts of your audience, then compares how each performed. In tinyEmail you create variations A and B, choose open rate or click rate as the winning metric, and the winner is sent to the remaining audience automatically.

For as long as the test duration you set. If you also set a limit value, the test can finish sooner: the first variation to reach that percentage wins immediately.

Either the subject line or the email content. Every test uses exactly two variations, A and B, and changes one variable, so whichever wins, you know what caused it.

You choose open rate or click rate. If you set a limit value, the first variation to reach it wins, and if both reach it, the higher rate wins. If the duration ends first, the highest-performing variation wins. An exact tie sends Variation A.

No. Once a winner is decided, tinyEmail clones the winning campaign and sends it to the remaining audience automatically.

You control the distribution, for example 25% to A, 25% to B and 50% reserved for the winner. The audience is frozen at launch, so the split stays consistent.

No. There is no minimum audience size, so you can start with the list you already have.

A/B testing is available for regular email campaigns only, not workflows or SMS.

Let your next campaign decide itself

Write two variations, choose the split and the metric, and the winner goes to everyone else. Free for Shopify stores; everyone else gets a 7-day free trial.