Put Your Website to Work For You: A/B Testing
Posted on : 31-10-2011 | By : Shannon Otto | In : resources, technology
Tags: a/b testing, MemberClicks, testing, website, website analytics
0
By Adam Kearney, MemberClicks Creative Director
You’ve been tracking your website’s performance and optimizing it to perform better for search engines. Now it’s time to use one of the most proven methods for increasing the effectiveness of your website – A / B Testing.
The concept behind A / B Testing goes back to direct mail marketing, where companies would send out multiple versions of a mailer and see which ones performed better. You can apply this same concept to your website by creating multiple versions of a page and splitting your traffic between them to see which version is more effective. We’ll go through the entire process from start to finish, including setting up A / B testing, choosing pages to test, establishing testing parameters, creating different versions of a page, and planning for future optimization.
1. How To Set Up A / B Testing
Many companies offer A / B Testing services at a range of price points. The best service for your organization depends on your level of need and ability. You might use a service that does everything for you including deciding which variables to test, or you might want to have full control over the process. One service of note is offered by Google – they provide a free A / B Testing service to all Google Analytics users. If you have the necessary skill, you can also use Javascript to show different versions of a page or selected elements on a page and track their performance manually using your analytics solution. MemberClicks can provide this service for a small fee.
Also, if you don’t want to use a separate service or write the necessary code yourself, you can use sequential testing. Sequential A / B testing involves making one version of a page live on certain days and then switching that version out on other days. Though this is not quite as accurate as true A / B testing, it can provide you with valuable information, if your content is not time-sensitive.
For instance, you might run one version of your web page for a week and use a different version of the same page the following week. By comparing their relative performance in your analytics solution, you can see which version performs better. However, this would not work very well for a site that provided frequently updated content, since site performance could vary on a week-by-week basis normally.
2. Choosing Pages To Test
Once you have a solution for A / B testing in place, you’ll need to determine which pages you want to test. If you are just getting started, you might want to focus on a few key pages, such as your website’s home page, a search engine landing page or a form that you want visitors to complete. What you need to test depends on your website and how you determine success. For example, if you want visitors to fill out a Request Information form, that’s where you should start. If you simply want to increase the time visitors spend on your site and lower your bounce rate, your home page is a good place to begin.
After you have some experience with A / B testing, you might want to expand it to more pages or even your whole site. But it’s best to start out with a page or two, so you can effectively determine what is working.
3. Establishing Testing Parameters
You can use A / B testing in a number of ways. For instance, if you have two competing design ideas, you can test them against each other to see which performs better. If your site has problem areas – pages with low visits or high bounce rates – you can use A / B testing to try out different versions and determine what the problem is. If you are trying to entice more visitors into filling out a form, you can change different form elements to see which one garners more conversions.
Whatever your goal is, you need to have a clear vision for how to use A / B testing in order to establish the best testing parameters. You’ll need to think about how long you want the tests to run. If you have a large amount of traffic, you might only need to test for a few days or weeks, but if you don’t, you may need to run your test for a few months. You might want to run the test until you reach a specified number of visitors or conversions.
Once you know how long to run the test, you need to also identify what variables will determine which version is more successful. If your goal is to increase conversions, then the more successful version will be easy to determine – it will be the one with a greater number of conversions. If your goal is to fix a problem with a page, such as a low visit rate, the version that performs better in that area will be the winner. Whatever your measure of success is, make sure you know which data to observe. With this information in hand, you’re ready to create different versions of your page.
4. Creating Different Versions Of A Page
For your first test, you should create two radically different versions of the same page. You’ll want to have basically the same content with two very different presentations. If one version is heavily text-based, the other should use plenty of graphics. By creating two very different versions, you are practically guaranteeing that one will significantly outperform the other. This also gives you the opportunity to try out new approaches like video or integrated social media tools and see if they have an impact on your goals. Don’t be afraid to try something unexpected – often, the best performance improvements arise from this sort of experimentation.
5. Planning For Future Optimization
When you have established a control page, you can then start tweaking smaller elements on the page to see which leads to better performance. Some standard elements you might want to test include headlines, calls to action, copy, graphics, and colors.
It’s important to keep in mind when testing smaller individual elements that the best results are gleaned over a large amount of time. If you test out two similar headlines against one another, you might not notice an immediate difference in performance between them. But over time, the difference will become apparent, so run tests on smaller elements for a longer period of time.
A Path For Continual Improvement
By following these five steps, you have a clear path for continual improvement of your website. There are several advantages to this. For one, it provides you with clear, hard data about what works and what doesn’t. Sometimes it is difficult to convince others that one approach is best when you are simply relying on expertise or opinion, but if you can test out the idea, there’s no doubt about what performs better.
Another advantage is that you can maximize your website’s performance by continually improving the way it works. Whether you are trying to increase conversion rates or test out new designs, A / B testing will empower you with the necessary information to make smart choices.
But perhaps the most important advantage is that you gain insight into your visitors and thus into your organization. The more you test, the more you will learn about the behavior of your website’s users. Thus, you’ll be better able to serve them by understanding what they want and how they act on your website.






