How do I create and launch an A/B test?
A/B Test is a process in which you create different versions of your webpage and test which one performs better in terms of conversion rate. The test can be based on CTA, image, heading, sub-heading or any other webpage element.
A/B testing lets web designers and marketers fine tune a prescription to build the most effective webpage.
Step 1: Installing the code snippet
- Go to the Snippet page by clicking the Snippet icon in the left pane of the experiment listing page.
- Copy the code snippet and paste it into the webpages of your website you want to experiment on. The snippet must be pasted at the start of the <head> tag of the webpage’s HTML code.
NOTE: Once the code is installed on your webpage, it does not require modifications every time to run various experiments. Multiple experiments of Split URL test and A/B test can be performed with the same code snippet installed in the webpage, for all experiments on the project level.
Step 2: Creating Variations
- Click +New Experiment on the experiment listing page and choose A/B Test.
- Fill in the name of the test and the URL of the webpage that you wish to conduct the A/B Test on.
- Click Create. In the Editor tab, you'll land on the Variation 1 by default.
- Hover your mouse anywhere on the rendered webpage and the various elements will become highlighted.
- Format the variation according to your requirement by using the options from the Format tab on the right. Edit individual elements using the options that appear when you click on them.
- You can add more variations by clicking the + icon.
- Switch between Edit and Interact mode by using the toggle button on the right.
- Click Save after all your changes are made
Step 3: Setting Goals
Click Next to move to the Goals tab. Click + New Goal to add a goal to your experiment.
- You can add any or all of the goal options available:
- Engagement: Tracks the number of clicks on all the elements and links on the webpage
- Pageviews: Tracks the number of visits to a specified URL
- Click on Elements: Tracks the number of clicks on a specific element on the webpage
- Click on Links: Track the number of clicks to outbound links
- Custom Event: Tracks a specific event or set of events
- Revenue: Tracks the revenue generated by each variation
- Click Save after adding the goals.
Step 4: Handpicking Audience
Click Next to reach the Audience tab.
- Under the Participation section, use the slider to set the percentage of your audience that should participate in the experiment.
- Under the Target Audience section, choose your target audience based on their behavior.
We offer targeting All visitors by default. You can choose between the preset target audience options available or create a +Custom Audience.
Step 5: Tweaking to your need
Click Next to reach the Configuration tab.
- Under the Segment Audience section, specify the traffic distribution across all the variants.
- Under the Set Mode section, choose the mode you wish to run your experiment in:
- Quick Trends: This mode is suitable for experiments that don't affect your revenue directly. Pick this mode if you're looking to find a winner in a short span of time. This mode has a statistical significance of 90%.
- Optimal: This is the default mode and is an ideal choice for almost all kinds of experiments. Pick this mode if you're looking for fairly accurate results in a reasonable amount of time. This mode has a statistical significance of 95%.
- High Accuracy: This is the best mode for critical experiments that affect your revenue directly. Pick this mode if you want to have highly accurate results without worrying about the time taken to achieve it. This mode has a statistical significance of 99%.
- In the next section, you can enable heatmap tracking for all variations in the experiment.
- Under the Schedule section, check the Launch this experiment later option to enable scheduling your experiment's launch.
You can now choose the launch date and the end date of your experiment based on your requirement
- Under the Integrations section, you can enable the required integration at the experiment level.
Step 6: Launch!
Click Next to reach the Summary tab.
The gist of your experiments, including the number of variations, goals, audience segments, and target audience, is displayed here.
- Click Launch in the top right corner to launch the experiment.
- Once your experiment has been launched, a new tab called Reports will appear alongside the Summary tab.
The Editor, Goals, Variation, and Configuration tabs will be temporarily unavailable when the experiment is running.
If you wish to make changes to your experiment, click the Pause button. The Editor, Goals, Variation, and Configuration tabs will become available. You will be able to edit any part of your experiment.
Click Relaunch to run the experiment again.