How do A/B tests work, and how is a winner picked?

An A/B test sends two versions of your email to the same kind of companies, split between them by company, so the same company always gets the same side. To start one, ask the assistant. Nothing is sent by starting a test: your emails still go as they do now.

How a winner is called

The test says Too early to say until each side has about 30 first emails sent and the two sides have about 5 replies between them. After that it names one side as ahead only when the difference in replies is big enough to trust. Otherwise it says No difference yet.

At 5 emails a day, that takes a few weeks.

Keeping one side

While a test runs, the Template shows each side's emails sent and replies. Until one side is ahead, you can keep either with Keep A or Keep B. Once one is ahead, Keep the winner appears. Keeping one retires the other, and its results stay on record.

Leadistry never switches a version off on its own. You decide.