What criteria will you use to evaluate the result? What metrics will you use? These could be: bounce rate (how many people visited the site and left immediately), time spent on the site, number of applications or registrations, number of purchases or average check. Make sure you have systems in place to collect statistics and analysis. Determine in advance how many users you want to target with your advertising.
Concrete logos marketers recommend the use of metrics:
- Conversion of visitors into buyers.
- Average time spent on the product page.
- Number of products added to the basket.
There is no point in trying to replicate and copy someone else's A/B test results. But it is useful to study successful cases in order to find new ideas to promote your business.
Betonlogos s.r.o. invites you to look at one of the A/B testing opportunities we offered to our client. This is a trading company that sells goods on the Czech market and uses the dropshipping business model. Dropshipper, the owner of the website, wanted to know how to optimise the checkout page to increase conversions. Betonlogos specialists offered to test two variants. Option A: the main version of the page remains unchanged. Option B: the page includes the improvement suggested by the hypothesis.
Hypothesis: Adding a quick registration option via social networks on the checkout page will increase conversion.
Test steps:
- Develop variation B of the checkout page, which adds a 'social quick signup' button.
- Randomly split site visitors into two groups: one group sees version A of the checkout page and the other group sees version B.
- Collect data on the behaviour of visitors in each group: number of purchases, average check, time spent on page and other metrics.
- Analyse the results: compare conversion and other metrics between Group A and Group B.
The result: conversion on the checkout page increased by 2.5 times and the average checkout increased (+34%).
III. Define the objective and the sample
Because user behaviour is difficult to predict: it changes frequently and depends on many factors (habits, time of day, day of the week), you should test each hypothesis for at least a week. If your goal is a purchase and you know that people usually make a purchase 10 days later rather than immediately, you should take this into account. On average, the recommended testing period is 10-14 days.
IV. Determine the duration of the test
Betonlogos case: A/B testing a dropshipping site page