02Geek HTML5 and JavaScript, TypeScript, React, Flash, ActionScript online School
Previous VideoNext Video

When should you start doing A/B tests?

When should you start doing A/B tests? as you might have figured out by the question we don't think you should worry about A/B testing unless a few conditions in your list have been met. I will talk about this really massive advice in this last lecture of part two.

Video Transcript

00:00Welcome back. So, let's talk about A-B testing. Now, I want to tell you one thing is don't worry about it too much.
00:06If you don't have, I would say, at least 5,000 subscribers, I wouldn't even worry about A-B testing.
00:12And let me tell you why. You really want to get to a scenario where your users where for basically to do anything
00:19statistic, really, you have to have at least 50 people doing what you want them to do. In other words,
00:26for example, if you send an email out to 100 people and only three people open them, you having an A-B testing won't be as effective as you
00:33might think because there isn't enough information there for statistical value. Now, Mailchimp very smartly, when you try to go inside and
00:41click on an A-B testing on a new account, will tell you you can't use it unless you pay us or wait until you've used for a few
00:48campaigns and figure things out. But I would tell you more over than that, not only don't you want to use that really at this stage,
00:55I would worry about making sure that your emails are great and you're getting people to open it up with your title originally. Now,
01:02once you get to a scenario where you have over 100 people that open your email, and ideally even 150, then it's a perfect time to
01:10start doing A-B testing. So literally, you probably wouldn't even play with this until you have 100 opens. Now, in our account,
01:17which is literally new right now, we sent an email out lately would have 96 clicks, which is obviously fantastic. But when we
01:23look at our bigger email, which we are, we have here another, another list that has over 200 clicks, even when it's in the low
01:31click rate, or the first rate, which had 300, we are already in a position where we're in a good position to start doing A-B
01:38testing. Because we have enough people opening up. Now, we could then focus on the click rate later on. But really, our
01:45first intention is to try to see could we bump up from 10% to more? Could we bump up from between 10 to 50% where we are in
01:52our bigger list. And, you know, in our smaller list, we have there 48%, which is obviously great, but it's a smaller list. So
01:58it's easier to control because we know exactly who's on that list. Contrary to our bigger list that has a lot more people, but we
02:05have less influence on them, because there are a lot of different types of people there. So once you go inside and you and
02:11you're already ready, and you could create an A-B split campaign only then or if you're ready, a paying member, then you
02:16could actually start a campaign. And in the next video, after now that we opened up that split campaign, we'll show you how to
02:23create a split campaign. So see you in the next video where we actually go through the steps of sending one split campaign.

Ready to Level Up Your Skills?

Join thousands of learners on 02GEEK and start your journey to becoming a coding expert today!

Enroll Now for Free!