{"id":26896,"date":"2014-09-02T19:23:31","date_gmt":"2014-09-02T19:23:31","guid":{"rendered":"https:\/\/vwo.com\/blog\/?p=26896"},"modified":"2025-04-28T16:21:40","modified_gmt":"2025-04-28T10:51:40","slug":"the-world-has-moved-on-from-plain-vanilla-ab-testing-have-you","status":"publish","type":"post","link":"https:\/\/vwo.com\/blog\/the-world-has-moved-on-from-plain-vanilla-ab-testing-have-you\/","title":{"rendered":"The World Has Moved On From Plain Vanilla A\/B Testing. Have You?"},"content":{"rendered":"\n

10 years ago, when our CEO Paras wrote about A\/B testing<\/a> on Smashing Magazine<\/a>, it was a hit! A\/B testing was still a lesser known term then. Today, it is something data-driven marketers swear by. In one of our user surveys, someone also went on to call it \u201cthe bread and butter of his job\u201d.<\/p>\n\n\n\n

But do we do it right? Are we chasing the right metrics? Are our hypotheses strong enough?<\/p>\n\n\n\n

And importantly, are we still doing those plain vanilla A\/B tests? Tests such as changing button colors or tweaking some copy and waiting to see what happens. And the worst of all, testing a change with a view that since another website increased their conversions by making that change, it should work for us as well.<\/p>\n\n\n\n

Download Free: A\/B Testing Guide<\/em><\/span><\/a><\/h3>\n\n\n\n

No wonder, many of our A\/B tests fail and don\u2019t get us the desired results.<\/p>\n\n\n\n

This is partially because of the not-so-persuasive changes that we test. And partially because we still don\u2019t play it like a pro. To help you get better at A\/B testing and run tests that really affect the bottom-line<\/a> of your business and not just your website, I am outlining 6 tips here:<\/p>\n\n\n

6 Expert tips to elevate your A\/B testing game<\/strong><\/h2>\n\n

1) Have a well-thought-out hypothesis to test<\/h3>\n\n\n

Begin by looking at data from your analytic solution. Find out where most people are dropping off. Additionally, look at the pages where people are spending the most time and yet not completing the goals. These pages could be your starting points. To get even more insights, you could perform usability testing<\/a> and get real people to complete some tasks on your website<\/a> and see where they are getting stuck.<\/p>\n\n\n\n

Once you have found out some pain points that your visitors are facing, form hypotheses that will solve those problems.<\/p>\n\n\n\n

You can read this excellent post on how to form a winning hypothesis for A\/B testing<\/a>.<\/p>\n\n\n

2) Consider segmenting your traffic before testing<\/h3>\n\n\n

One common practice among marketers is to run tests on the entire website traffic. While for certain tests, this could be a necessity, most of the times, it\u2019s just setting up your tests for failure. Keep in mind that different people coming to your website have different motives and will thus behave differently.<\/p>\n\n\n\n

For example, people coming from search ads are very different from those coming from banner ads. While the former were actively searching for something, the latter found you when they were in the middle of another activity (like reading their favorite blog).<\/p>\n\n\n\n

To strengthen the point further, let\u2019s say you are an eCommerce store about to test the shiny new trust seals above the \u201cBuy Now\u201d button. While your loyal customers might just be indifferent to this change, what you really need to understand is, if adding the trust signals was able to improve the conversion rate of new visitors into customers. Thus, setting up such a test for everyone coming to the website will just skew the numbers and not give you accurate business results.<\/p>\n\n\n\n

Hence, it\u2019s smart to segment your traffic before setting up A\/B tests<\/a>. With VWO Testing, you can easily segment traffic based on 15+ options like location, referring URL, type of traffic and so on.<\/p>\n\n\n\n

Don\u2019t worry if you think segmenting traffic prior to running a test would lead to less visitors to test and hence the need to wait longer for results. With VWO Testing, you can even analyze your test results post completion (for enterprise customers) by various segments such as new visitors, returning visitors, visitors from mobile, visitors from desktop among others.<\/p>\n\n\n

\n
\"post-segmentation-feature-VWO\"<\/figure>\n<\/div>\n\n

3) Test one “business” element at a time<\/h3> ” id=”3-test-one-business-element-at-a-time” data-menu-id=”3-test-one-business-element-at-a-time” style=”text-align:left”>3) Test one “business” element at a time<\/h3>\n\n\n

It\u2019s generally considered a best practice to test one website element at a time to know the exact effect of the change.<\/p>\n\n\n\n

I would like to present a different perspective here. Most businesses don\u2019t have the time to change one element at a time, wait for the results and then test another change. This approach could take forever and put pressure on your development team to code such changes every now and then.<\/p>\n\n\n\n

Instead, focus on changing one \u201cbusiness\u201d element at a time.<\/p>\n\n\n\n

Let\u2019s suppose that you conduct a survey for the abandoning visitors on the checkout page of your eCommerce website by asking the question, \u201cWhat\u2019s stopping you from making this purchase?<\/em>\u201d. Going through the responses, you find out that new visitors are not completing the purchase due to a lack of trust. It makes complete sense to test a customer testimonial, trust seals, and quote a number and say something like \u201c5896 orders completed this month<\/em>\u201d. These are three website element changes, but only one business element change. This will help you understand the effect of one factor (trust, in the example above) on your goals.<\/p>\n\n\n

4) When choosing test goals or metrics to track, focus on those that move the needle<\/h3>\n\n\n

Often we chase goals that don\u2019t really affect our business. Or track two or more goals. It\u2019s quite likely that one of them will perform better in the variation than the control and vice-versa. Such tests end up being inconclusive and misleading.<\/p>\n\n\n\n

The goals you track determine what is of most importance to you. If you are an eCommerce store, I am assuming it\u2019s a purchase. Similarly for a SaaS business, tracking engagement (say, from homepage to pricing page) is a good goal, but measuring actual number of sign-ups is better.<\/p>\n\n\n\n

Since you are spending time, money and effort, why not measure what really matters.<\/p>\n\n\n\n

Of course, measuring many smaller goals (micro-conversions) doesn\u2019t hurt. But if these don\u2019t lead to changes in your business graph, you are wasting your time. Boils down again to the need for stronger hypotheses and smarter goals to track.<\/p>\n\n\n\n

Key is: if you choose smarter metrics<\/a> that really affect your business, you are more likely to test changes that will help you move the needle.<\/p>\n\n\n

5) Wait for your tests to achieve statistical significance<\/h3>\n\n\n

This is important. I will explain this with a very simple example. Let\u2019s say you toss a coin 10 times, 8 times out of which it shows head. Will you be able to confidently say if it\u2019s loaded? The answer is no.<\/p>\n\n\n\n

Let me scale the numbers up a bit: let\u2019s suppose I toss it for 100 times, and 70 times heads showed up. Now? Is it loaded? I am still not confident of a yes or no.<\/p>\n\n\n\n

Let\u2019s say 10,000 tosses and 7,800 heads. Now? Yes, I can confidently say it\u2019s loaded!<\/p>\n\n\n\n

If you notice clearly, the percentage of times heads showed in all the three cases was always between 70 and 80. But I was only confident of the results when I had enough data points. That is what makes statistics interesting.<\/p>\n\n\n\n

The more data points you have, the more trustworthy are the conclusions that you can draw out of them. However, sometimes interesting data points can turn out to be wrong<\/a>.<\/p>\n\n\n\n

The same is true for your A\/B testing results. It is more trustworthy when it has a good amount of data. The maths though, is slightly more complex than in the above example. But the good part is you can leave it to the tool you are using for A\/B testing<\/a>. In VWO’s test reports you will always see a value called Statistical Significance (or the chance to beat original). Let this value achieve a minimum of 95% to trust the results (Bonus learning for those who hate maths: 95% statistical significance means that there is only 5% probability that the increase in conversions you see in the test is by chance). Or best would be to pre-calculate the number of days for which you want to test using our simple A\/B-split testing duration calculator<\/a>.<\/p>\n\n\n\n

This way, you save yourself from making incorrect judgement by obsessively looking at the data each passing day.<\/p>\n\n\n\n

Download Free: A\/B Testing Guide<\/em><\/span><\/a><\/h3>\n\n\n

6) Analyze the bigger picture out of your test results<\/h3>\n\n\n

Often, we attribute the success of our tests too literally to the changes we make. For example, if reducing form fields increased our conversions, we fail to look at the bigger picture that people are still not ready to shell out too much information or share a specific piece of information. And take an incomplete learning, such as less fields equal to more submits, out of it.<\/p>\n\n\n\n

What you should really evaluate here is why removing certain fields made it easier to fill the form. In a later test, you could even swap the current fields with the removed fields and test the impact in a similar scenario to get stronger learning.<\/p>\n\n\n\n

Hence, always try to analyze test results more holistically. If it was a headline change, compare the control and test messages and not just the wordings. One of our customers A\/B tested the headlines<\/a>, \u201cStep by step plan for opening your internet store\u201d and \u201cOpen your internet store in one evening\u201d. The second headline won and increased the leads by 9.52%. The learning to derive from this test is that visitors on the website were more enticed by the fact that they could open an internet store so quickly, something which they might have previously thought of as a lengthy process.<\/p>\n\n\n

\n
\"Headline<\/figure>\n<\/div>\n\n\n

Understanding your test results also gives you a direction for further tests. For example, suppose adding a testimonial on a SaaS website<\/a> that reads \u201cThe product paid for itself in less than 3 months. I love it.<\/em>\u201d increased conversions. It is important to understand that this just doesn’t increase trust (as expected from a testimonial) but also takes into account the cost of the product. The next test in such a scenario can be based on the hypothesis that displaying the ROI of the product clearly on the website would lead to increase in conversions.<\/p>\n\n\n\n

The key here is to always aim for a learning from every test that we run, even from the failed ones.<\/p>\n\n\n\n

That\u2019s it for now. Now that you know these 6 tips, I will say, test often and test smarter!<\/p>\n\n\n\n

Let me know if you liked this post or if there is something I missed. Feel free to reach out to me at marketing@vwo.com<\/a>!<\/p>\n","protected":false},"excerpt":{"rendered":"

10 years ago, when our CEO Paras wrote about A\/B testing on Smashing Magazine, it was a hit! A\/B testing was still a lesser known term then. Today, it is something data-driven marketers swear by. In one of our user surveys, someone also went on to call it \u201cthe bread and butter of his job\u201d….<\/p>\n","protected":false},"author":33,"featured_media":56752,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"post_read_time":8,"footnotes":""},"categories":[10676],"tags":[],"feature":[1852,10526],"industry-type":[],"product":[],"role":[],"region":[],"class_list":["post-26896","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-a-b-testing","feature-ab-testing","feature-experimentation-platform"],"acf":[],"yoast_head":"\nGet Better At A\/B Testing & Run Tests That Impact The Bottom Line - VWO<\/title>\n<meta name=\"description\" content=\"Check these 6 tips that will help you do A\/B testing like a pro and test changes that really affect the bottom line of your business and not just your website.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/vwo.com\/blog\/the-world-has-moved-on-from-plain-vanilla-ab-testing-have-you\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Get Better At A\/B Testing & Run Tests That Impact The Bottom Line - VWO\" \/>\n<meta property=\"og:description\" content=\"Check these 6 tips that will help you do A\/B testing like a pro and test changes that really affect the bottom line of your business and not just your website.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/vwo.com\/blog\/the-world-has-moved-on-from-plain-vanilla-ab-testing-have-you\/\" \/>\n<meta property=\"og:site_name\" content=\"Blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/vwoofficial\/\" \/>\n<meta property=\"article:published_time\" content=\"2014-09-02T19:23:31+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-04-28T10:51:40+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/09\/OG-image_The-World-Has-Moved-On-From-Plain-Vanilla-AB-Testing.-Have-You.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"630\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Taruna\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@VWO\" \/>\n<meta name=\"twitter:site\" content=\"@VWO\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Taruna\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"9 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/vwo.com\/blog\/the-world-has-moved-on-from-plain-vanilla-ab-testing-have-you\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/vwo.com\/blog\/the-world-has-moved-on-from-plain-vanilla-ab-testing-have-you\/\"},\"author\":{\"name\":\"Taruna\",\"@id\":\"https:\/\/vwo.com\/blog\/#\/schema\/person\/e8ee12022fb89b94f4b39fca55df5488\"},\"headline\":\"The World Has Moved On From Plain Vanilla A\/B Testing. Have You?\",\"datePublished\":\"2014-09-02T19:23:31+00:00\",\"dateModified\":\"2025-04-28T10:51:40+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/vwo.com\/blog\/the-world-has-moved-on-from-plain-vanilla-ab-testing-have-you\/\"},\"wordCount\":1724,\"publisher\":{\"@id\":\"https:\/\/vwo.com\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/vwo.com\/blog\/the-world-has-moved-on-from-plain-vanilla-ab-testing-have-you\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/09\/Feature-image_The-World-Has-Moved-On-From-Plain-Vanilla-AB-Testing.-Have-You.png\",\"articleSection\":[\"A\/B Testing\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/vwo.com\/blog\/the-world-has-moved-on-from-plain-vanilla-ab-testing-have-you\/\",\"url\":\"https:\/\/vwo.com\/blog\/the-world-has-moved-on-from-plain-vanilla-ab-testing-have-you\/\",\"name\":\"Get Better At A\/B Testing & Run Tests That Impact The Bottom Line - VWO\",\"isPartOf\":{\"@id\":\"https:\/\/vwo.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/vwo.com\/blog\/the-world-has-moved-on-from-plain-vanilla-ab-testing-have-you\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/vwo.com\/blog\/the-world-has-moved-on-from-plain-vanilla-ab-testing-have-you\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/09\/Feature-image_The-World-Has-Moved-On-From-Plain-Vanilla-AB-Testing.-Have-You.png\",\"datePublished\":\"2014-09-02T19:23:31+00:00\",\"dateModified\":\"2025-04-28T10:51:40+00:00\",\"description\":\"Check these 6 tips that will help you do A\/B testing like a pro and test changes that really affect the bottom line of your business and not just your website.\",\"breadcrumb\":{\"@id\":\"https:\/\/vwo.com\/blog\/the-world-has-moved-on-from-plain-vanilla-ab-testing-have-you\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/vwo.com\/blog\/the-world-has-moved-on-from-plain-vanilla-ab-testing-have-you\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/vwo.com\/blog\/the-world-has-moved-on-from-plain-vanilla-ab-testing-have-you\/#primaryimage\",\"url\":\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/09\/Feature-image_The-World-Has-Moved-On-From-Plain-Vanilla-AB-Testing.-Have-You.png\",\"contentUrl\":\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/09\/Feature-image_The-World-Has-Moved-On-From-Plain-Vanilla-AB-Testing.-Have-You.png\",\"width\":1200,\"height\":700,\"caption\":\"The World Has Moved On From Plain Vanilla Ab Testing Have You?\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/vwo.com\/blog\/the-world-has-moved-on-from-plain-vanilla-ab-testing-have-you\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/vwo.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"A\/B Testing\",\"item\":\"https:\/\/vwo.com\/blog\/a-b-testing\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"The World Has Moved On From Plain Vanilla A\/B Testing. Have You?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/vwo.com\/blog\/#website\",\"url\":\"https:\/\/vwo.com\/blog\/\",\"name\":\"Blog\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/vwo.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/vwo.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/vwo.com\/blog\/#organization\",\"name\":\"VWO\",\"url\":\"https:\/\/vwo.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/vwo.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2018\/09\/VWOLogo.png\",\"contentUrl\":\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2018\/09\/VWOLogo.png\",\"width\":780,\"height\":492,\"caption\":\"VWO\"},\"image\":{\"@id\":\"https:\/\/vwo.com\/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/vwoofficial\/\",\"https:\/\/x.com\/VWO\",\"https:\/\/www.instagram.com\/vwoofficial\/\",\"https:\/\/www.linkedin.com\/company\/vwo\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/vwo.com\/blog\/#\/schema\/person\/e8ee12022fb89b94f4b39fca55df5488\",\"name\":\"Taruna\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/vwo.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2019\/08\/Taruna-150x150.jpg\",\"contentUrl\":\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2019\/08\/Taruna-150x150.jpg\",\"caption\":\"Taruna\"},\"description\":\"Tech product leader with 13+ years of experience driving B2B and B2C innovation across startups and global enterprises. Has built and scaled impactful products at Wingify, Swiggy, LinkedIn, and now at Microsoft. Currently focused on building fully autonomous AI agents for sales.\",\"sameAs\":[\"https:\/\/vwo.com\/\"],\"url\":\"https:\/\/vwo.com\/blog\/author\/taruna\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Get Better At A\/B Testing & Run Tests That Impact The Bottom Line - VWO","description":"Check these 6 tips that will help you do A\/B testing like a pro and test changes that really affect the bottom line of your business and not just your website.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/vwo.com\/blog\/the-world-has-moved-on-from-plain-vanilla-ab-testing-have-you\/","og_locale":"en_US","og_type":"article","og_title":"Get Better At A\/B Testing & Run Tests That Impact The Bottom Line - VWO","og_description":"Check these 6 tips that will help you do A\/B testing like a pro and test changes that really affect the bottom line of your business and not just your website.","og_url":"https:\/\/vwo.com\/blog\/the-world-has-moved-on-from-plain-vanilla-ab-testing-have-you\/","og_site_name":"Blog","article_publisher":"https:\/\/www.facebook.com\/vwoofficial\/","article_published_time":"2014-09-02T19:23:31+00:00","article_modified_time":"2025-04-28T10:51:40+00:00","og_image":[{"width":1200,"height":630,"url":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/09\/OG-image_The-World-Has-Moved-On-From-Plain-Vanilla-AB-Testing.-Have-You.png","type":"image\/png"}],"author":"Taruna","twitter_card":"summary_large_image","twitter_creator":"@VWO","twitter_site":"@VWO","twitter_misc":{"Written by":"Taruna","Est. reading time":"9 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/vwo.com\/blog\/the-world-has-moved-on-from-plain-vanilla-ab-testing-have-you\/#article","isPartOf":{"@id":"https:\/\/vwo.com\/blog\/the-world-has-moved-on-from-plain-vanilla-ab-testing-have-you\/"},"author":{"name":"Taruna","@id":"https:\/\/vwo.com\/blog\/#\/schema\/person\/e8ee12022fb89b94f4b39fca55df5488"},"headline":"The World Has Moved On From Plain Vanilla A\/B Testing. Have You?","datePublished":"2014-09-02T19:23:31+00:00","dateModified":"2025-04-28T10:51:40+00:00","mainEntityOfPage":{"@id":"https:\/\/vwo.com\/blog\/the-world-has-moved-on-from-plain-vanilla-ab-testing-have-you\/"},"wordCount":1724,"publisher":{"@id":"https:\/\/vwo.com\/blog\/#organization"},"image":{"@id":"https:\/\/vwo.com\/blog\/the-world-has-moved-on-from-plain-vanilla-ab-testing-have-you\/#primaryimage"},"thumbnailUrl":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/09\/Feature-image_The-World-Has-Moved-On-From-Plain-Vanilla-AB-Testing.-Have-You.png","articleSection":["A\/B Testing"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/vwo.com\/blog\/the-world-has-moved-on-from-plain-vanilla-ab-testing-have-you\/","url":"https:\/\/vwo.com\/blog\/the-world-has-moved-on-from-plain-vanilla-ab-testing-have-you\/","name":"Get Better At A\/B Testing & Run Tests That Impact The Bottom Line - VWO","isPartOf":{"@id":"https:\/\/vwo.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/vwo.com\/blog\/the-world-has-moved-on-from-plain-vanilla-ab-testing-have-you\/#primaryimage"},"image":{"@id":"https:\/\/vwo.com\/blog\/the-world-has-moved-on-from-plain-vanilla-ab-testing-have-you\/#primaryimage"},"thumbnailUrl":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/09\/Feature-image_The-World-Has-Moved-On-From-Plain-Vanilla-AB-Testing.-Have-You.png","datePublished":"2014-09-02T19:23:31+00:00","dateModified":"2025-04-28T10:51:40+00:00","description":"Check these 6 tips that will help you do A\/B testing like a pro and test changes that really affect the bottom line of your business and not just your website.","breadcrumb":{"@id":"https:\/\/vwo.com\/blog\/the-world-has-moved-on-from-plain-vanilla-ab-testing-have-you\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/vwo.com\/blog\/the-world-has-moved-on-from-plain-vanilla-ab-testing-have-you\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/vwo.com\/blog\/the-world-has-moved-on-from-plain-vanilla-ab-testing-have-you\/#primaryimage","url":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/09\/Feature-image_The-World-Has-Moved-On-From-Plain-Vanilla-AB-Testing.-Have-You.png","contentUrl":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/09\/Feature-image_The-World-Has-Moved-On-From-Plain-Vanilla-AB-Testing.-Have-You.png","width":1200,"height":700,"caption":"The World Has Moved On From Plain Vanilla Ab Testing Have You?"},{"@type":"BreadcrumbList","@id":"https:\/\/vwo.com\/blog\/the-world-has-moved-on-from-plain-vanilla-ab-testing-have-you\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/vwo.com\/blog\/"},{"@type":"ListItem","position":2,"name":"A\/B Testing","item":"https:\/\/vwo.com\/blog\/a-b-testing\/"},{"@type":"ListItem","position":3,"name":"The World Has Moved On From Plain Vanilla A\/B Testing. Have You?"}]},{"@type":"WebSite","@id":"https:\/\/vwo.com\/blog\/#website","url":"https:\/\/vwo.com\/blog\/","name":"Blog","description":"","publisher":{"@id":"https:\/\/vwo.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/vwo.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/vwo.com\/blog\/#organization","name":"VWO","url":"https:\/\/vwo.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/vwo.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2018\/09\/VWOLogo.png","contentUrl":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2018\/09\/VWOLogo.png","width":780,"height":492,"caption":"VWO"},"image":{"@id":"https:\/\/vwo.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/vwoofficial\/","https:\/\/x.com\/VWO","https:\/\/www.instagram.com\/vwoofficial\/","https:\/\/www.linkedin.com\/company\/vwo"]},{"@type":"Person","@id":"https:\/\/vwo.com\/blog\/#\/schema\/person\/e8ee12022fb89b94f4b39fca55df5488","name":"Taruna","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/vwo.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2019\/08\/Taruna-150x150.jpg","contentUrl":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2019\/08\/Taruna-150x150.jpg","caption":"Taruna"},"description":"Tech product leader with 13+ years of experience driving B2B and B2C innovation across startups and global enterprises. Has built and scaled impactful products at Wingify, Swiggy, LinkedIn, and now at Microsoft. Currently focused on building fully autonomous AI agents for sales.","sameAs":["https:\/\/vwo.com\/"],"url":"https:\/\/vwo.com\/blog\/author\/taruna\/"}]}},"_links":{"self":[{"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/posts\/26896","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/users\/33"}],"replies":[{"embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/comments?post=26896"}],"version-history":[{"count":47,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/posts\/26896\/revisions"}],"predecessor-version":[{"id":95856,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/posts\/26896\/revisions\/95856"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/media\/56752"}],"wp:attachment":[{"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/media?parent=26896"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/categories?post=26896"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/tags?post=26896"},{"taxonomy":"feature","embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/feature?post=26896"},{"taxonomy":"industry-type","embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/industry-type?post=26896"},{"taxonomy":"product","embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/product?post=26896"},{"taxonomy":"role","embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/role?post=26896"},{"taxonomy":"region","embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/region?post=26896"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}