VWO Testing
A/B Testing

A/B Testing Solutions to Maximize Your Website Conversions

Create and A/B test different versions of your website and its elements to continuously discover the best-performing versions that improve your conversions.

Know More
VWO GDPR Ready Badge
VWO CCPA Ready Badge
VWO G2Crowd Leader Spring Badge
VWO BS 10012 Certification Badge
SOC 2 logo
Follow us and stay on top of everything CRO
Related content:

15+ Most Helpful Best A/B Testing Resources in 2024 [including Free ones]

7 Min Read

*Note: This post has been recently updated.

A/B testing is not what it used to be in the past when businesses only focused on sustaining themselves in the market. This trend has changed in the last few years and the focus has shifted from merely sustaining to improving conversions through testing. Every business that has an online presence is either already A/B testing or planning to do it in the future.

Owing to this popularity, the demand for A/B testing resources has also increased. This post lists the best and free A/B testing, split URL testing, and multivariate testing tools, as well as some resources that can help you find testing solutions to improve user experience thereby increasing conversions.

Download Free: A/B Testing Guide

Research Tools for Testing

  1. Landing Page Analyzer: Test how effective your landing page is and get an actionable report on your landing page’s problem areas and recommendations on how to improve them. This free Landing Page Analyzer gives you comprehensive reports of your landing pages after measuring them on 5 parameters: Relevance, Propensity to take action, Persuasiveness, Motivation, and Focus on the goal.
  2. Google Analytics (GA): A free web analytics tool offered by Google, Google Analytics tracks your website traffic and enables you to get statistically significant insights on their behavior. Once set up, it automatically collects data on your website visitors and creates reports on them so you can use the insights to plan the success strategy for your business. Because of the ease of integration, you can integrate GA with other tools (like Google AdWords) to make them work together.  
  3. Significance Calculator: Use VWO’s A/B Significance Calculator test to calculate the statistical significance of your test results based on the number of visitors and conversion rates of both control and variation(s).
  4. Evan’s Awesome A/B tools: A collection of intuitive, visual and easy to use A/B testing tools to help you with statistical calculations for any test. It includes testing tools like  Two-Sample T-Test, Chi-Squared Test, and Sample Size Calculator, etc.
  5. ABtestbot: ABtestbot is an A/B testing tool developed by Slack, a workplace chat tool. With ABtestbot, you can easily calculate the results of your A/B test and its statistical significance.
  6. Duration Calculator: Calculate the duration for which you should run A/B tests using VWO’s free Duration Calculator. This free A/B test duration calculator estimates the duration for which you should run your test to conclude with statistical significance based on 5 parameters:
  • Estimated existing conversion rate
  • Minimum improvement in conversion rate you want to detect
  • Number of variations/combinations (including control)
  • The average number of daily visitors
  • Percentage of visitors included in the test?

Reading Resources for Testing

  1. The Complete Guide To A/B Testing: This comprehensive pillar page addresses all the questions revolving around A/B testing like how to A/B test, what to A/B test, common mistakes while A/B testing, and much more. In fact, this page also offers a free downloadable A/B testing calendar template that will help you while scaling your Testing program.
  2. Practical Guide to Controlled Experiments on the Web: This guide by Microsoft is an excellent paper on how testing should be done.
  3. Complete Guide To Conversion Rate Optimization: Read this pillar page to gather in-depth knowledge about CRO and its multiple aspects. Starting from what CRO is, this pillar page talks in detail about the benefits of CRO, its primary elements, the process, and so on.
  4. 8-Week CRO Planner: Hubspot and VWO joined hands and presented the first-ever edition of this ebook that takes you through each step of your CRO and A/B testing program and guides you to improve conversions in 60 days.
  5. The Advanced Guide To Scaling a Conversion Optimization Program: Taking the partnership ahead, Hubspot and VWO came together again this year to create a sequel to the 8 Week CRO PLanner ebook. This sequel ebook talks about what comes after you’ve set up a conversion optimization program.
  6. Data science you need to know! A/B testing:
    Get insights on A/B testing and know how to plan your own structured A/B testing program.
  7. Cracking A/B Testing in Your Product: A comprehensive blog taking you through the optimization journey of the “Travel Triangle” App that led to a 70% increase in in-app conversions.
  8. Make the Right Choice. A/B Testing for UX Improvement: Decide between two design options of web pages by A/B testing them. This article will take you through different aspects of A/B testing and show how designers improve UX through continuous A/B testing.
  9. VWO Resources: If you want an extensive reading repository that will help you understand real-life A/B testing use cases and success stories, or if you want to read top blogs on A/B testing best practices, blogs on everything CRO, etc then VWO resources is the place for you to be. We also have a collection of webinars that cover a vast expanse of topics on website optimization.
  10. Guess The Test: Guess The Test is a popular digital marketing resource base for everything CRO. It offers case studies in the form of games where you can take a guess on which test version you think won, and then learn about the results, and about how you can apply those findings to your own work. And the best part is that it is absolutely FREE. In fact, they also have a huge library of A/B testing case studies.

Download Free: A/B Testing Guide

Testing Tools

  1. Vanity: Vanity is an experiment-driven and datastore agnostic development framework for Rails.
  2. Genetify: Genetify is an unobtrusive way to A/B  testing and website optimization. It is based on an open-source JavaScript framework for A/B  testing.
  3. Django-lean: Django-lean is a split testing framework for implementing tests in JavaScript, Python, or Django template code. It also gives you administrative views for analyzing the results of those tests.
  4. Petri: Wix is a free website builder and Petri is its experimentation system. It offers many services like running A/B tests, defining your experiment’s sample, and much more.
  5. VWO Testing: VWO Testing is the world’s leading A/B testing tool. VWO Testing helps you improve your website’s conversion rates by enabling you to build an experimentation roadmap. VWO Testing’s connected platform allows you to conduct qualitative and quantitative visitor behavior research, A/B tests, split URL tests, and multivariate tests. With its Visual Editor, you can drag and drop any element from one position to another in real-time anywhere on the web pages.
  6. Wasabi A/B Testing Platform: Wasabi is an API-driven, real-time A/B testing service, that empowers users to use their own data and run experiments across all devices. Wasabi is the experimentation platform for TurboTax, QuickBooks, Mint.com, and other Intuit offerings.
  7. Five-Second Test: Five Second Test is a simple method of A/B testing images and designs to find out what information they are giving away within the first 5 seconds of viewing it. Multiple variations of an image or design are shown to visitors and a few questions are asked around them to measure which one conveys the closest message.

In September 2018, VWO ran a five-second test on the brand logo and changed the brand logo. This is what our previous logo looked like:

VWO Old Logo

We came across many instances where people were finding it difficult to understand the logo and decided to run an A/B test on it. And this is what our logo looks like now:

VWO New Logo

This list is in no way exhaustive. You can still lookout for more options and figure out what software can be used or build for A/B testing, what are the best tools to use for A/B testing or what is the best A/B testing tool that is not very expensive. Once you lock in on a testing platform, gather and analyze as much real-time website and visitor behavior data using research tools and then start testing.

If you have any other suggestions for additions to this list, we will be happy to add them. Please drop us an email at marketing@vwo.com!

Paras Chopra
Paras Chopra I started Wingify in early 2009 to enable businesses to design and deploy great customer experiences for their websites and apps. I have a background in machine learning and am a gold medalist from Delhi College of Engineering. I have been featured twice in the Forbes 30 under 30 list - India and Asia. I'm an entrepreneur by profession and my curiosity is wide-ranging. Follow me at @paraschopra on Twitter. You can email me at paras@wingify.com

Comments (15)

  1. @Richard – If I am not wrong, MixPanel does not provide A/B testing functionality out of the box. Correct me if I am wrong and I will be happy to add it in the list

    @Loïc Thanks for the suggestion but there are a lot of calculators on the net for A/B Testing; this list collects tools which allow you to do A/B testing

  2. Nice, I have many attorneys and clients asking about A/B testing so I can now just forward them this post. Getting them to try new stuff like this is like pulling teeth sometimes.

  3. A very useful resource in the making here guys! Based on our experience of running 1000s of tests over the years, we put together the article above; “Top 3 Most Profitable Pages for Multivariate Testing”.

    Each point is illustrated with a real-wold client success story. Hopefully it will be of interest to some of your readership who might be wondering where to start with their testing strategies!

  4. Instabir.com offers a jQuery plugin to do A/B (switch) testing.
    The plugin and neccesary server code is there. There is a commercial hosted server for those not wanting to mess with a server.

  5. Awesome list, thanks Paras! We’ve been working hard to put together a comprehensive list of resources on A/B testing, esp. when it comes to mobile app development.

    Here’s a list of what we’re currently covering – and you can expect a lot more to come:

    -A/B Testing for Mobile Apps
    -Interpreting A/B Test Results
    -A/B Testing and Personalization
    -Auto-Optimization (using bandit algorithms)

    Some things we’re working on for the near future:
    -Sample Size Calculator
    -Significance Calculator
    -Bayesian Bandit Simulator
    -Minimum Detectable Effect Calculator

    Would love to hear more about what you would like to see: What are your greatest pain points when A/B testing? What would make your life easier when A/B testing?

    You can check out the full set of resources here: http://splitforce.com/resources/mobile-ab-testing/. Enjoy!

  6. I know this post was published a while ago, but if anyone’s interested, we tried to put together a super comprehensive conversion optimization guide here. It’s free, not gated or any BS: conversionxl.com/conversion-optimization-guide/

Leave comment

Your email address will not be published. Required fields are marked *

Share
More from VWO on A/B Testing
Introducing Browse Mode: Create an A/B Test Behind the Login Walls of a Website

Introducing Browse Mode: Create an A/B Test Behind the Login Walls of a Website

Here at VWO, we get bored and frustrated if we think it has been too…

Read More
Paras Chopra

Paras Chopra

2 Min Read
How to Convert User Feedback Into A Goldmine for A/B Testing

How to Convert User Feedback Into A Goldmine for A/B Testing

We have finally learned to mock HiPPOs, as they no longer can serve as a…

Read More
Sezgin Hergul

Sezgin Hergul

7 Min Read
What You Really Need To Know About The Mathematics Of A/B Split Testing

What You Really Need To Know About The Mathematics Of A/B Split Testing

Recently, I published an A/B split testing case study where an eCommerce store reduced the…

Read More
Paras Chopra

Paras Chopra

5 Min Read

Scale your A/B testing and experimentation with VWO.

Start Free Trial Request Demo

DOWNLOAD A/B TESTING FREE E-BOOK