{"id":38412,"date":"2016-08-29T15:22:04","date_gmt":"2016-08-29T15:22:04","guid":{"rendered":"https:\/\/vwo.com\/blog\/?p=38412"},"modified":"2025-05-05T17:34:55","modified_gmt":"2025-05-05T12:04:55","slug":"what-decision-makers-need-to-know-before-investing-in-cro-ab-testing","status":"publish","type":"post","link":"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/","title":{"rendered":"Investing in CRO or A\/B Testing Software? You (Decision Maker) Must Know This"},"content":{"rendered":"\n<p>You must have come across <a href=\"https:\/\/vwo.com\/ab-testing\/\">A\/B testing<\/a> before. While it might not always have seemed like a top priority due to its focus on gradual results, it&#8217;s now gaining momentum, with <a href=\"https:\/\/99firms.com\/blog\/ab-testing-statistics\/#:~:text=1.-,Some%2077%25%20of%20companies%20are%20running%20A%2FB%20testing%20on,fonts%2C%20images%2C%20or%20similar.\" target=\"_blank\" rel=\"noreferrer noopener\">77%<\/a> of companies now running A\/B tests on their websites.&nbsp;<\/p>\n\n\n\n<p>CRO, often mentioned alongside A\/B testing, is also crucial, as<a href=\"https:\/\/meetanshi.com\/blog\/conversion-rate-optimization-statistics\/\" target=\"_blank\" rel=\"noreferrer noopener\"> 55%<\/a> of businesses are increasing their CRO budgets.&nbsp;<\/p>\n\n\n\n<p>Are they the same? No.&nbsp;<\/p>\n\n\n\n<p>Think of it this way: if conversion optimization were a puzzle set, A\/B testing would be a vital missing piece.&nbsp;<\/p>\n\n\n\n<p>In this blog, we tell you how they&#8217;re different but also connected. This way, you&#8217;ll have all the info you need before deciding on CRO or <a href=\"https:\/\/vwo.com\/blog\/ab-testing-tools\/\">A\/B testing software.<\/a>&nbsp;<\/p>\n\n\n\n<h2 class=\"wp-block-heading has-text-align-center\"><em><a href=\"https:\/\/vwo.com\/ab-testing\/#guide-download\"><span style=\"text-decoration: underline\">Download Free: A\/B Testing Guide<\/span><\/a><\/em><\/h2>\n\n\n\n<p class=\"has-text-align-center\"><strong><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/lh7-eu.googleusercontent.com\/szt99FpzzRMjmnISA6mp_yh6J2Ws140_8qFBpcuSi2isI3xXFUxCiXmy6OpbUp1v56rn96NUNHF0RUHilxaOxx3sfVBgmd_2Jtq0O5jYbdlcjjZdZ0yCK42n1RDQLXPxTueRzVG_rMv-jCOs6c3eeZc\" width=\"624\" height=\"624\"><\/strong><\/p>\n\n\n<h2 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level1\" data-menu=\"1) A\/B testing and CRO aren\u2019t the same\" id=\"1-a-b-testing-and-cro-arent-the-same\" data-menu-id=\"1-a-b-testing-and-cro-arent-the-same\" style=\"text-align:left\"><strong>1) A\/B testing and CRO aren\u2019t the same<\/strong><\/h2>\n\n\n<p>A\/B testing is a technique, and CRO is the process that involves the technique.<\/p>\n\n\n\n<p>For sure, A\/B testing has revolutionized the way online businesses look at growth. It has enabled them to make decisions reliably to improve their <a href=\"https:\/\/vwo.com\/glossary\/conversion-rate\/\">conversion rates<\/a>. The reliability seemed magical.<br>However, the industry hit disillusionment and then realized that A\/B testing is only an enabler and not a panacea.<\/p>\n\n\n\n<p>A\/B testing is exactly what it says\u2014a test for ideas. It\u2019s not a magic wand nor a design roulette that works on luck.<\/p>\n\n\n\n<p>From the initial experience, a series of crucial realizations should follow:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>A\/B tests are only as good as the hypotheses they test.<\/li>\n\n\n\n<li>Hypotheses are only as good as the research behind them.<\/li>\n\n\n\n<li>Sustainable business growth is only as good as the management of this entire process called CRO.<\/li>\n<\/ul>\n\n\n\n<p>A\/B testing is an indispensable component of CRO, but it\u2019s only one component. Below we outline the CRO process and how an A\/B test fits into its overall framework:<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter\"><img decoding=\"async\" src=\"https:\/\/lh7-eu.googleusercontent.com\/X0kohrc-TiQ8-Z_LnW_A8MlAd-ByHPUaJkpvcDjBWuoJrx0e88ilekfIOXtHbz1GjMnNmd-7mSc2MpAMHElsdymx7fpSnp21iYvMgZ73H0-PKQYi5qv1nwHG1_WJgSWviCet-_E9aGfWEErbJH1i36w\" alt=\"CRO process\" \/><figcaption class=\"wp-element-caption\">Image source: <a href=\"https:\/\/99firms.com\/blog\/ab-testing-statistics\/#:~:text=1.-,Some%2077%25%20of%20companies%20are%20running%20A%2FB%20testing%20on,fonts%2C%20images%2C%20or%20similar.\" target=\"_blank\" rel=\"noreferrer noopener\">99firms<\/a><\/figcaption><\/figure>\n<\/div>\n\n<h3 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level2\" data-menu=\"1. Generate ideas through research\" id=\"1-generate-ideas-through-research\" data-menu-id=\"1-generate-ideas-through-research\" style=\"text-align:left\"><strong>1. Generate ideas through research<\/strong><\/h3>\n\n\n<p>The initial step in conversion rate optimization testing is to gather ideas through research. Many marketers jump straight into CRO testing without this crucial step. Without research-backed ideas and usability testing, it&#8217;s challenging to understand what might be wrong with your website or app and how to fix it.&nbsp;<\/p>\n\n\n\n<p>Where to start? Leverage quantitative analytics tools like <a href=\"https:\/\/vwo.com\/glossary\/heatmap\/#:~:text=Heatmaps%20are%20colourful%20depictions%20of,and%20least%20popular%20(cold).\">heatmaps<\/a> and user<a href=\"https:\/\/vwo.com\/glossary\/session-recording\/\"> recordings<\/a>. These tools help you delve into user behavior and form hypotheses that lead to the creation of impactful tests.&nbsp;&nbsp;<\/p>\n\n\n<h3 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level2\" data-menu=\"2. Prioritize your ideas\" id=\"2-prioritize-your-ideas\" data-menu-id=\"2-prioritize-your-ideas\" style=\"text-align:left\"><strong>2. Prioritize your ideas<\/strong><\/h3>\n\n\n<p>Once you&#8217;ve generated a bunch of test ideas, it&#8217;s time to prioritize. Focus on the ideas that have the most significant impact on your core business metrics, such as purchases or form submissions. Define your objective for the CRO test, the hypothesis detailing what you expect to happen, the metric you&#8217;re measuring, and the expected outcome.<\/p>\n\n\n<h3 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level2\" data-menu=\"3. Plan and run the test\" id=\"3-plan-and-run-the-test\" data-menu-id=\"3-plan-and-run-the-test\" style=\"text-align:left\"><strong>3. Plan and run the test<\/strong><\/h3>\n\n\n<p>With your ideas prioritized, it&#8217;s time to plan and run the test. Determine the test type, and the pages where it will run, design the control and variant, estimate the duration, and determine statistical significance. Use a testing tool like VWO, which offers a comprehensive testing platform &#8211; from research and test execution to results analysis and results documentation. <a href=\"#free-trial\">Take a free trial and explore the features<\/a>.&nbsp;<\/p>\n\n\n\n<p>Further, ensure the test is ready for launch by performing the final checks. Notify stakeholders about the CRO test, as it may impact other teams and their metrics. This also provides an additional set of eyes to identify any issues.<\/p>\n\n\n<h3 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level2\" data-menu=\"4. Analyze the results\" id=\"4-analyze-the-results\" data-menu-id=\"4-analyze-the-results\" style=\"text-align:left\"><strong>4. Analyze the results<\/strong><\/h3>\n\n\n<p>Once your test reaches statistical significance, analyze the results. Examine how your metrics were affected, confirm whether your hypothesis held true, and identify key insights. If the variation you tested won, proceed with implementing it. If not, consider it an opportunity to learn valuable insights about your target audience.<\/p>\n\n\n<h3 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level2\" data-menu=\"5. Optimize based on insights\" id=\"5-optimize-based-on-insights\" data-menu-id=\"5-optimize-based-on-insights\" style=\"text-align:left\"><strong>5. Optimize based on insights<\/strong><\/h3>\n\n\n<p>Use the insights gained from your results to optimize your website or app. For example, if your data shows that scrolling is more effective than clicks for improving add-to-cart and transactions, implement the scrolling experience for all visitors. This iterative process ensures ongoing improvement and user satisfaction.<\/p>\n\n\n\n<p>Does the distinction make sense now?<a href=\"https:\/\/vwo.com\/conversion-rate-optimization\/cro-guide-for-marketers\/\"> Conversion rate optimization<\/a> test is a process that needs to be repeated, but A\/B testing is a technique \u2014 a statistical tool. Both these terms are often confused for good reason. For seasoned, successful testers, good CRO tests are inconceivable without a good process.<\/p>\n\n\n\n<p>Watch this video to understand how CRO can lead to increased revenue growth. <\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Thinking beyond A\/B testing - Maximizing Your Revenue With CRO (Webinar)\" width=\"690\" height=\"388\" src=\"https:\/\/www.youtube.com\/embed\/0TytQ5LZ33Y?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><figcaption class=\"wp-element-caption\">VWO webinar on CRO for revenue growth<\/figcaption><\/figure>\n\n\n<h2 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level1\" data-menu=\"2) You need more than an A\/B testing tool\" id=\"2-you-need-more-than-an-a-b-testing-tool\" data-menu-id=\"2-you-need-more-than-an-a-b-testing-tool\" style=\"text-align:left\"><strong>2) You need more than an A\/B testing tool<\/strong><\/h2>\n\n\n<p>We have already established that whether you talk about \u201cA\/B testing\u201d or \u201c<a href=\"https:\/\/vwo.com\/conversion-rate-optimization\/\">Conversion Optimization<\/a>\u201d in your internal discussions, what you need in the end is a process. A systematic approach to hunt down barriers to <a href=\"https:\/\/vwo.com\/conversion-rate-optimization\/conversion-rate-optimisation-tips\/\">improve conversion rates on your website<\/a> and eliminate these barriers. Such an approach requires:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/vwo.com\/blog\/ab-testing-hypothesis\/\">Research to construct testable hypotheses<\/a><\/li>\n\n\n\n<li>Prioritization of hypotheses to decide what to test first<\/li>\n\n\n\n<li><a href=\"https:\/\/vwo.com\/blog\/ab-test-results-analysis\/\">Testing and Analysis of results to derive learning for future tests<\/a><\/li>\n<\/ul>\n\n\n\n<p>There are multiple tools that will help accomplish specific aspects of this process.<a href=\"https:\/\/www.g2crowd.com\/categories\/project-management\"> Also, there are project management tools that help you set up a process for integrating these steps<\/a>.<\/p>\n\n\n\n<p>Here is a list of the stages involved in making a sound business decision.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/lh7-eu.googleusercontent.com\/lfGqJXuUVzUNA64j8A2VxxqDtl5cqQpPyKJPAorify3JubW9RIG8oL_Hyv3Czo8LbwQsTgSrvi94kTmQI2Wkcd9u4pkQ7LmLYqTH8I7Bef-hdzuc9rnaA0fhsdHVT7VaH8o9gfFuNJo0C9rzFUuSGEo\" alt=\"decision making\" \/><figcaption class=\"wp-element-caption\">Image Source: <a href=\"https:\/\/courses.lumenlearning.com\/principlesmanagement\/chapter\/11-2-understanding-decision-making\/\" target=\"_blank\" rel=\"noreferrer noopener\">Lumen Learning<\/a><\/figcaption><\/figure>\n\n\n\n<p>The primary objective of such a detailed process is to ensure \u201csound\u201d decisions. These decisions minimize the probability of loss and maximize the probability of gain from your CRO test.<\/p>\n\n\n\n<p>You need to perform all the steps in one place with unrestricted access to data collection, manipulation, and validation.<\/p>\n\n\n\n<p>A system that enables you to make such decisions requires a platform with connected capabilities. Think of any <a href=\"https:\/\/reviews.financesonline.com\/p\/hubspot-marketing\/\">marketing automation software such as Hubspot<\/a>, Marketo, or Eloqua. These are all platforms with a network of tools that communicate with each other such as email, social media, content, and paid channels.<\/p>\n\n\n<h2 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level1\" data-menu=\"3) Decide what you want to know through A\/B testing\" id=\"3-decide-what-you-want-to-know-through-a-b-testing\" data-menu-id=\"3-decide-what-you-want-to-know-through-a-b-testing\" style=\"text-align:left\"><strong>3) Decide what you want to know through A\/B testing<\/strong><\/h2>\n\n\n<p>Until some time ago, conversion rate optimization split testing or<a href=\"https:\/\/vwo.com\/blog\/ab-testing-tools\/\"> A\/B testing tools<\/a> ran tests the same way. The underlying statistical framework used to interpret numbers and choose a \u201cwinning variation\u201d was the same. Currently, A\/B testing tools and <a href=\"https:\/\/vwo.com\/conversion-rate-optimization\/conversion-rate-optimisation-tools\/\">CRO platforms<\/a> such as VWO offer you a choice. With choice comes the responsibility to evaluate the pros and cons and then choose what best suits your needs.<\/p>\n\n\n\n<p>The choices are:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Frequentist method of computing<\/li>\n\n\n\n<li><a href=\"https:\/\/vwo.com\/glossary\/bayesian\/\">Bayesian<\/a> method of computing<\/li>\n<\/ul>\n\n\n\n<p>Both these methods present different approaches to testing and ask different questions from the data they collect. Therefore, these methods fundamentally affect the level of optimization you <em>can <\/em>achieve with existing data.<\/p>\n\n\n\n<p>Are you looking to find the infallible truth, or are you looking to make the smartest business decision based on your conversion rate optimization tests?<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter\"><img decoding=\"async\" src=\"https:\/\/lh7-eu.googleusercontent.com\/IsMKRDW6czZdzLbi5yL4lQmLcbrsbVBWY00o_4DyoEFuHSJEKp24raqWQc4bh7Zp1TMZxBIyTfQzHztDmCtJzDrSZbze6msdaUb1W9Gurb3xQPSchBmJ68VK4RmTFL40pBJU4lfbuWFilBVxxEufVyc\" alt=\"Bayesian - Cartoon\" \/><figcaption class=\"wp-element-caption\">Image Source: <a href=\"https:\/\/www.pinterest.com\/pin\/385128205607786465\/\" target=\"_blank\" rel=\"noreferrer noopener\">Pinterest<\/a><\/figcaption><\/figure>\n<\/div>\n\n\n<p><strong>What the image says<\/strong>: The former conclusion of 16.6% (5 times\/30 days) that \u201cGlasses\u201d found out first is the Frequentist way to look at things. (The example is a bit wrong because 5 times is probably too low to be statistically significant, but it works to demonstrate the thinking.) The latter conclusion of 75% is Bayesian reasoning. This reasoning considers supplementary information (that Glasses complimented her eyes) that was available. Which one seems a smarter, yet very reasonable, conclusion?<\/p>\n\n\n\n<p>Let\u2019s consider that your team sets up a test between a control (A) and a variation (B).<\/p>\n\n\n\n<p>Here\u2019s what these two methods find out for you:<\/p>\n\n\n<h3 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level2\" data-menu=\"Frequentist method\" id=\"frequentist-method\" data-menu-id=\"frequentist-method\" style=\"text-align:left\"><strong>Frequentist method<\/strong><\/h3>\n\n\n<p>\u201cWhat are the chances of observing a result at least as large as this, if the test was done between A and an identical copy of A and on the same sample size?\u201d<\/p>\n\n\n\n<p>This question doesn\u2019t sound very straightforward, because it is not.<\/p>\n\n\n\n<p>This method helps statisticians and truth-seekers, incrementally reduce the improbability of a wrong conclusion to help arrive at the \u201ctruth.\u201d The Frequentist method was designed to understand the probability of drawing the wrong conclusion. It is a cautious, and somewhat slower, approach to arrive at \u201cthe truth.\u201d<\/p>\n\n\n\n<p>Let\u2019s say the p-value for a test is computed as 0.03. When the test is stopped, the conversion rates of A and B are Ca and Cb.<\/p>\n\n\n\n<p>Frequentist testing tools interpret this figure and display the result as \u201cChance to beat A is 97%.\u201d However, what the p-value indicates is that if you had conducted the same test a 1000 times between A and a copy of A, at 30 instances, you would observe a result at least as extreme as the difference between Cb and Ca.<\/p>\n\n\n\n<p>This is not the same as saying \u201cB will beat A by a margin of <em>Cb minus Ca<\/em> 97% of the times.\u201d All that the p-value represents is the <strong>improbability <\/strong>of A and B to be identical.<\/p>\n\n\n\n<p>The p-value does not discuss the probability of the variations being different, or by how much. This value also does not tell you what you should do, although these are probably what you want to know.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter\"><img decoding=\"async\" src=\"https:\/\/lh7-eu.googleusercontent.com\/-u9FV0YiuKr1reMHqMsE0SvGy9MMTpU-vhsnGwLkZdqrDN1Af2OBK68EfhSCwBUGg2VczEAPvEeMceHQXLBJlPE0NMc1TWkhVEXffAc_pgY3MP2kXa0PxRiGDOTxOD0_uRyUR098G-ynJ7XcBqLmAEk\" alt=\"profile picture for Bradley Effron\" \/><\/figure>\n<\/div>\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p>The frequentist aims for universally acceptable conclusions, ones that will stand up to adversarial scrutiny. The FDA for example doesn\u2019t care about Pfizer\u2019s prior opinion of how well its new drug will work, it wants objective proof. Pfizer, on the other hand, may care very much about its own opinions in planning future drug development.<\/p>\n<cite><strong><em>Bradley Effron<\/em><\/strong><em> <\/em>explains the Frequentist vs Bayesian thinking in his presidential address at the American Sociological Association.<\/cite><\/blockquote>\n\n\n\n<p>This analysis does not mean that the Frequentist results have no meaning in a business setup. These comparative results let you be fairly sure that one choice is better than another. However, that\u2019s an indirect way of saying it, and any attempt to understand \u201cby how much\u201d leads to hidden fallacies.<\/p>\n\n\n<h3 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level2\" data-menu=\"Bayesian method\" id=\"bayesian-method\" data-menu-id=\"bayesian-method\" style=\"text-align:left\"><strong>Bayesian method<\/strong><\/h3>\n\n\n<p>Bayesian lets you ask the question:<\/p>\n\n\n\n<p><strong>\u201c<\/strong>What choice should I make right now to make the most money? Continue the test, stop the test with A, or stop the test with B?\u201d<\/p>\n\n\n\n<p>This is made possible because Bayesian approaches the outcome\u2014\u201cconversion rate\u201d\u2014as a fluctuating variable. With additional data that it gathers, Bayesian updates the probability of the outcome\u2014the conversion rate\u2014to lie between a range.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter\"><img decoding=\"async\" src=\"https:\/\/lh7-eu.googleusercontent.com\/-r6YhPM2X8kCJS2JGDU5Q0FxWECgbt23azg5-KFPD2Hc7TqhnAWlX9rES--aUflqGbzk-gE0kgu8HEGAxx2NUOzNNGZadJJlLrqSpZcEl-gJkiK1zJPRhag-VRTwVMlhVc0XEEZAcqgIkKoWv_YIRgA\" alt=\"profile picture of Chris Stucchio, Director of Data Sciences at VWO\" \/><\/figure>\n<\/div>\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p><em>For example, before observing any data, one might think all conversion rates (for two variations A and B) are equally likely. At this time, both A and B would have a 50% chance of being the winner.<\/em><\/p>\n\n\n\n<p><em>At this time, the financial <\/em><strong><em>risk<\/em><\/strong><em> is also high\u2014it\u2019s totally plausible that B has a 20% conversion rate and A has a 5% conversion rate, so choosing A would be a bad decision! The opposite situation is also very plausible, in which case B is a bad decision. At this point, we should just wait and continue the test.<\/em><\/p>\n\n\n\n<p><em>Then when new information is updated (such as an A\/B test), that opinion changes. After obtaining data, we become confident that B has a 90% chance of beating A. We also come to believe that A has a conversion rate between, for example, 3% and 6%, while B has a conversion rate between 5.9% and 9%.<\/em><\/p>\n\n\n\n<p><em>At this point, we\u2019ve eliminated the <\/em><strong><em>risk<\/em><\/strong><em> involved in choosing B. It\u2019s still theoretically possible that A is better\u2014A might have a 5.97% conversion rate while B has only 5.93%. But the <\/em><strong><em>financial cost<\/em><\/strong><em> of that possibility is very low, so choosing B is a very safe <\/em><strong><em>business decision<\/em><\/strong><em>. Not the truth maybe, but a wise business decision.<\/em><\/p>\n<cite><strong><em>Chris Stucchio,<\/em><\/strong> Former Director of Data Sciences at VWO<\/cite><\/blockquote>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter\"><img decoding=\"async\" src=\"https:\/\/lh7-eu.googleusercontent.com\/geaVum8-n8kUw47Ksj1tSKcqMTBuY05mpRTgu89EsHydXLfwls9ucTSvacVXEsqUaqK3Epprt8savLyI5tUsiZPOWjcb3KQTo1LGsSssoTHsyPB_5eag5t9zc2JWUlmwOeR1DksBAJsczpXn2RDZeWw\" alt=\"bayesian vs frequentist\" \/><figcaption class=\"wp-element-caption\">Image Source: <a href=\"https:\/\/99firms.com\/blog\/ab-testing-statistics\/#:~:text=1.-,Some%2077%25%20of%20companies%20are%20running%20A%2FB%20testing%20on,fonts%2C%20images%2C%20or%20similar.\" target=\"_blank\" rel=\"noreferrer noopener\">99firms<\/a><\/figcaption><\/figure>\n<\/div>\n\n\n<p>Bradley needs to be quoted again where he summarizes the differences in the approach:<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter\"><img decoding=\"async\" src=\"https:\/\/lh7-eu.googleusercontent.com\/DQHScWWOAm3S4w95qAzUoSLQul-ja2HtMvxMCkUaUN5BkyK4U1BmNNMn95vQnwo-8YN6YX5XIz_Yjz3DxolBbnGBzzGGxPZIS_LYUDFGY_WpsWA9KGsb3ybVyvqLB7hOP38Hd2WtGEvkIRZJLjW08IM\" alt=\"profile picture for Bradley Effron\" \/><\/figure>\n<\/div>\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p><br><em>The Bayesian-Frequentist debate reflects two different attitudes to the process of doing science, both quite legitimate. Bayesian statistics is well suited to individual researchers, or a research group, trying to use all the information at its disposal to make the quickest possible progress. In pursuing progress, Bayesians tend to be aggressive and optimistic with their modeling assumptions. Frequentist statisticians are more cautious and defensive.<\/em><\/p>\n<\/blockquote>\n\n\n\n<p>Most tools in the market make use of Frequentist, while some like VWO have graduated to Bayesian; still others use both in conjunction.<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p><em>One is mathematical\u2014it\u2019s the difference between \u201cproving\u201d a scientific hypothesis and making a business decision. There are many cases where the statistics strongly support \u201cchoose B\u201d in order to make money, but only weakly support \u201cB is the best is a true statement\u201d. B has a 50% chance of beating A by a lot (say B is 15% better) and a 50% chance of being approximately the same (say 0.25% worse to 0.25% better). In that case, it\u2019s a great business decision to choose B\u2014maybe you win something, maybe you lose nothing.<\/em><\/p>\n<cite><strong><em>Chris Stucchio,<\/em><\/strong><em> explains on ConversionXL<\/em> <a href=\"https:\/\/cxl.com\/blog\/bayesian-frequentist-ab-testing\/\"><em>why Bayesian trumps the Frequentist approach<\/em><\/a><em> when it comes to making business decisions, where the onus is not on finding the \u2018truth\u2019 but on making the most rational business decision. <\/em><\/cite><\/blockquote>\n\n\n\n<p>On the business front, here\u2019s how <a href=\"https:\/\/vwo.com\/why-us\/technology\/bayesian-statistics\/\">VWO SmartStats<\/a>, VWO\u2019s Bayesian engine fares against our older Frequentist engine.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/lh7-eu.googleusercontent.com\/16po5M5O9Kdqr38nxRDSCmr9DklfiiS_0WxQMVYvO4JD1dxC7roHjr7uRFh2dDvb8R2EuTv8T3Es_RExd0IvITnEsEHYLOQFsoeaoDN2073ONCdC7nwiwhXox1mreWf-NYHOYcJeT1QDCvIARDHxKbw\" alt=\"Bayesian Ab Testing The Complete Guide\" \/><\/figure>\n\n\n\n<p>If you are interested in learning more about the Bayesian approach, you can find a detailed and intuitive approach to understanding the Bayesian method<a href=\"https:\/\/betterexplained.com\/articles\/an-intuitive-and-short-explanation-of-bayes-theorem\/\"> here<\/a>.<\/p>\n\n\n\n<p>And here\u2019s Chris explaining the inherent limitation of Frequentist and how Bayesian saves the day.<\/p>\n\n\n\n<h2 class=\"wp-block-heading has-text-align-center\"><a href=\"https:\/\/vwo.com\/ab-testing\/#guide-download\"><strong><em>Download Free: A\/B Testing Guide<\/em><\/strong><\/a><\/h2>\n\n\n<h2 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level1\" data-menu=\"4) You will need more than a platform; You need people\" id=\"4-you-will-need-more-than-a-platform-you-need-people\" data-menu-id=\"4-you-will-need-more-than-a-platform-you-need-people\" style=\"text-align:left\"><strong>4) You will need more than a platform; You need people<\/strong><\/h2>\n\n\n<p>Someday, we might have platforms that don\u2019t just enable you to make decisions but also make decisions for your CRO testing. Until then, you need more than just platforms\u2014a set of people who possess a unique set of skills to use the platform and move the needle.<\/p>\n\n\n\n<p>The skills that a CRO team must possess can be broadly grouped into the following:<\/p>\n\n\n<h3 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level2\" data-menu=\"Strategy development\" id=\"strategy-development\" data-menu-id=\"strategy-development\" style=\"text-align:left\"><strong>Strategy development<\/strong><\/h3>\n\n\n<p>You will need a plan for your CRO tests from determining the goals or key metrics of the program prioritizing activities such as hypothesis building to A\/B testing to leveraging the learning to fuel further tests. Such ownership requires context about your business and at the very least, your organization\u2019s conversion funnels.<\/p>\n\n\n<h3 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level2\" data-menu=\"Data analysis\" id=\"data-analysis\" data-menu-id=\"data-analysis\" style=\"text-align:left\"><strong>Data analysis<\/strong><\/h3>\n\n\n<p>CRO is as much about being proactive as it is about reacting to obvious conversion issues. Data analysis involves monitoring of website data and user behavior to identify areas of improvement\u2014leaks and areas of friction in your conversion funnel. A data analyst needs to make sense of CRO jargon and ensure that everyone in the team understands the test results in simple terms.<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/lh7-eu.googleusercontent.com\/Gi-g5eh9PC7GOKcgmTZ1vqudMJ4vk-pCCzb6BtMvxGBnNi7mzRMWJ1yNDBi8fJwQ6Qy_z0OoKuTyFrJaEDNSu3uKUfQlrZhtohqrbryf3C25bF1hf0sJGbl9GrEzNPygxke8JOXuhYGNPXQEiXH97II\" alt=\"\" \/><figcaption class=\"wp-element-caption\">Image source: <a href=\"https:\/\/www.linkedin.com\/pulse\/people-over-process-tools-lilian-sao-de-rivera\" target=\"_blank\" rel=\"noreferrer noopener\">LinkedIn<\/a><\/figcaption><\/figure>\n\n\n<h3 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level2\" data-menu=\"Conversion-centered designing\" id=\"conversion-centered-designing\" data-menu-id=\"conversion-centered-designing\" style=\"text-align:left\"><strong>Conversion-centered designing<\/strong><\/h3>\n\n\n<p><a href=\"https:\/\/vwo.com\/blog\/design-principles-increase-conversions\/\">Design is a crucial aspect of CRO<\/a>, as it is the culmination of the proposed changes and acts as the interface between your understanding of your users and their interaction with your business. Such responsibility requires you to have knowledge of persuasive design principles and psychological triggers.<\/p>\n\n\n<h3 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level2\" data-menu=\"Persuasive copywriting\" id=\"persuasive-copywriting\" data-menu-id=\"persuasive-copywriting\" style=\"text-align:left\"><strong>Persuasive copywriting<\/strong><\/h3>\n\n\n<p>Copy is the other element that your website visitors interact with apart from design, and it requires just as much thought and expertise.<a href=\"https:\/\/copyhackers.com\/cc101-2019\/\"> Some key aspects of conversion optimization that persuasive copy can help with are reducing visitors&#8217; anxieties, reflecting their motivation, and delighting them<\/a>.<\/p>\n\n\n<h3 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level2\" data-menu=\"Web development\" id=\"web-development\" data-menu-id=\"web-development\" style=\"text-align:left\"><strong>Web development<\/strong><\/h3>\n\n\n<p>You also need a web developer. Translating your design and copy into an error-free experience lies in the hands of this developer. From creating variations and setting up and tracking events and goals to transferring data from one system to another, the developer\u2019s role in a CRO test is indispensable.<\/p>\n\n\n\n<p>To provide an in-depth and comprehensive account of what it takes to run a successful optimization program, check out our<a href=\"https:\/\/www.linkedin.com\/in\/michalparizek\"> interview with Michal Parizek<\/a>, senior eCommerce and Optimization Specialist at Avast.<\/p>\n\n\n<h3 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level2\" data-menu=\"CRO course &amp; certification\" id=\"cro-course-certification\" data-menu-id=\"cro-course-certification\" style=\"text-align:left\"><strong>CRO course &amp; certification<\/strong><\/h3>\n\n\n<p>Consider investing in upskilling your existing team by exploring conversion rate optimization courses. These courses can provide exposure to the <a href=\"https:\/\/vwo.com\/conversion-rate-optimization\/cro-best-practices\/\">best CRO practices<\/a> and insights into how CRO experts tackle challenges. To choose the right course for your team, here are some pointers:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Evaluate your team&#8217;s current expertise and identify weak points. Seek courses that specifically address these areas.<\/li>\n\n\n\n<li>Check the recency of the courses and ensure their relevance to current marketing conditions.<\/li>\n\n\n\n<li>Look for courses that offer hands-on training with CRO tools or provide assignments that allow learners to apply their knowledge in practical situations.<\/li>\n\n\n\n<li>Assess the domain expertise and authority of the course creators. Consider their professional experience and the brands they&#8217;ve collaborated with in the past.<\/li>\n<\/ul>\n\n\n\n<p>If you&#8217;ve got in-house CRO experts, leverage their knowledge to create a conversion rate optimization training kit for your team. This tailored resource serves as a customized roadmap for upskilling, aligning with your specific business needs. To ensure ongoing proficiency, consider organizing periodic conversion rate optimization training tests. These tests not only help gauge your team&#8217;s grasp of domain knowledge but also provide opportunities for continuous improvement.<\/p>\n\n\n\n<p>Recognizing that conversion optimization training is a crucial element in honing your team&#8217;s skillset, investing in it becomes imperative. The dividends you&#8217;ll reap from more effective CRO campaigns make this investment not just worthwhile but integral to the success of your business.<\/p>\n\n\n<h2 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level1\" data-menu=\"Brands that benefited from full-fledged CRO campaigns\u00a0\" id=\"brands-that-benefited-from-full-fledged-cro-campaigns\" data-menu-id=\"brands-that-benefited-from-full-fledged-cro-campaigns\" style=\"text-align:left\"><strong>Brands that benefited from full-fledged CRO campaigns\u00a0<\/strong><\/h2>\n\n<h3 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level2\" data-menu=\"Bear Mattress\" id=\"bear-mattress\" data-menu-id=\"bear-mattress\" style=\"text-align:left\"><strong>Bear Mattress<\/strong><\/h3>\n\n\n<p>Bear Mattress, a New Jersey-based company, had a clear goal &#8211; to increase revenue by optimizing its product page&#8217;s <a href=\"https:\/\/vwo.com\/blog\/use-upsell-cross-sell\/\">cross-sell<\/a> section. Through behavioral analysis, they observed poor visitor engagement with the &#8216;Frequently Bought with Mattress&#8217; cross-sell listings.&nbsp; They also found that the &#8220;Frequently Bought with Mattress&#8221; section lacked pictures, making it less interesting for customers.&nbsp;<\/p>\n\n\n\n<p>The hypothesis was that a variation addressing these issues would enhance engagement and revenue. In a 19-day A\/B test, the variation outperformed the control, leading to a remarkable 24.18% increase in purchases and a <a href=\"https:\/\/vwo.com\/success-stories\/bear-mattress\/\">16.21% revenue rise<\/a>.&nbsp;<\/p>\n\n\n\n<p>The team analyzed the results and found that a user-friendly interface in a niche like sports mattresses not only enhances upselling opportunities but also improves the overall user experience.<\/p>\n\n\n\n<p>Bear Mattress&#8217;s success story showcases the effectiveness of a structured optimization program in increasing revenue. It&#8217;s about making informed decisions, testing hypotheses, and delivering measurable results while keeping the user experience at the forefront.&nbsp;<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/lh7-eu.googleusercontent.com\/J1v6cNIrRrEr9_pFiVtqzK8ZnEF7et9o3_COPC8Fj3ENFriMgHb9xkvm-bnT1aPQk-Ot07HUqmiLVZoMbClkeSJhZA9-NKoaln0WZbiF-lanYw5KTPoweV-Qs3wxyZZxlnEnoJ15qdHWX-UF3LT-ZDc\" alt=\"\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/lh7-eu.googleusercontent.com\/NoaHfKUllVUUMj1_SApA9T2M9dT50Wdkbmh_mHfM5YNr6fYUmLrWpzf5kry3mgmvwwNJ8WAe62j8CTqMlwzUxg4kD8-KGnUIa2Y88pBGC6ijp3fW9mrWdfr6mkpuO9tkainOEyXhxrQx7WD7Arkw72Q\" alt=\"\" \/><figcaption class=\"wp-element-caption\">Variation<\/figcaption><\/figure>\n\n\n<h3 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level2\" data-menu=\"RuneScape\" id=\"runescape\" data-menu-id=\"runescape\" style=\"text-align:left\"><strong>RuneScape<\/strong><\/h3>\n\n\n<p>RuneScape is a popular online role-playing game with 250 million players globally. Its CRO team devised an optimization campaign that aimed to increase revenue by boosting purchases.&nbsp;<\/p>\n\n\n\n<p>Upon reviewing the Treasure Hunter page, the team found that many website visitors were clicking on the &#8220;Get Keys&#8221; section, even though it wasn&#8217;t clickable.<\/p>\n\n\n\n<p>They assumed users wanted direct access to keys or sought more information. Session recordings revealed that website visitors returned to the Treasure Hunter page from the Payment page. This suggested inadequate information about treasure chest packages. The hypothesis emerged that offering package details on the Treasure Hunter page would enhance Payment page conversions.<\/p>\n\n\n\n<p>To test the hypothesis, a variation was created, featuring four treasure chest packages. In an A\/B test, the variation outperformed the original, <a href=\"https:\/\/vwo.com\/success-stories\/runescape\/\">increasing purchases by nearly 10%<\/a>.&nbsp;<\/p>\n\n\n\n<p>Encouraged by this success, the team introduced a &#8220;Recommended&#8221; package variation, which also outperformed the original, leading to a further 6% increase in purchases.<\/p>\n\n\n\n<figure class=\"wp-block-image is-resized\"><img decoding=\"async\" src=\"https:\/\/lh7-eu.googleusercontent.com\/OIxQgB7jqdNUq9GZGnVOhgqouW2m39iKkDuEJvWkgp9NlZ2Uaboy6CxtcpAq0w5SL1QvH0J4EkeZgWAlULkMrm_XCsf8JDryU9rGr5QO8kxRRsBw2F2ZOpIhIaPhJ3e7ZNndqMgqOJIua8kkXLD7Ffw\" alt=\"\" style=\"aspect-ratio:0.84375;width:840px;height:auto\" \/><figcaption class=\"wp-element-caption\">Control<\/figcaption><\/figure>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter\"><img decoding=\"async\" src=\"https:\/\/lh7-eu.googleusercontent.com\/S-m_zwLzILvUy2XokGCh3zqNauCdsGDtWHM4JHXcUgWMA_ScOwmjzBXuo9T1ZfgXBb8Grfx5_cogmg3wT-ELiEsEcP56urNsaC89GBFcTgMTjjtHPGy3d1dOmXk6SnZY8cvfhlMTvi5oDS9ZAFrDYqM\" alt=\"\" \/><figcaption class=\"wp-element-caption\">Variation<\/figcaption><\/figure>\n<\/div>\n\n<h3 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level2\" data-menu=\"Truckstop\u00a0\" id=\"truckstop\" data-menu-id=\"truckstop\" style=\"text-align:left\"><strong>Truckstop\u00a0<\/strong><\/h3>\n\n\n<p>Truckstop, a well-known manufacturing company in the US, embraced continuous optimization, with VWO serving as a cornerstone for cultivating an experimentation culture.&nbsp;<\/p>\n\n\n\n<p>Their dedicated CRO team leveraged session recording to understand user behavior. They analyzed over 1000 recordings to gather valuable insights and came up with a campaign idea.&nbsp;<\/p>\n\n\n\n<p>It was hypothesized that a pop-up demo form on the existing page would boost the generation of MQLs. The goal was to increase the number of demo requests. To achieve this, the team introduced a pop-up demo request form to the broker load board page. The variation outperformed the control and resulted in a <a href=\"https:\/\/vwo.com\/success-stories\/truckstop\/\">26% increase in conversions<\/a>.<\/p>\n\n\n\n<p>A structured CRO program encompasses visitor research, hypothesis formulation, prioritization, testing, deployment, and learning from CRO tests. Truckstop.com shows us a good example of how to do this right.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter\"><img decoding=\"async\" src=\"https:\/\/lh7-eu.googleusercontent.com\/YnrGz4dMAva7NRTIEq_UtRhSj0oHcCSEXuEHQh5rb4sIiLvEjqsC7AaTnZc8hfpJlUeuUnPbkpTtgpf4nTDPSZhtZrB9LeULpYy-MHGG7eF0O-ayZzjYo9JOcKII2_O48RQsfkKKG8-zbf0k64kUYrQ\" alt=\"\" \/><figcaption class=\"wp-element-caption\">Revised demo form<\/figcaption><\/figure>\n<\/div>\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter\"><img decoding=\"async\" src=\"https:\/\/lh7-eu.googleusercontent.com\/DXNzdKXSYj7fntqWBJl7JhQkPzg8w72yVrMBEfJZggc6ldcWVyG4dIouMJ27ogGlkQLnK8lF6QrIZF34JyKaD0XRhploFzABjY4xZoi-1FdGeOXsrYboyZ7MMNJTKsDjIrE4G29pUQGP_vIZ8pFYqH0\" alt=\"\" \/><figcaption class=\"wp-element-caption\">The pop-up<\/figcaption><\/figure>\n<\/div>\n\n<h2 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level1\" data-menu=\"Can you run other types of tests in your CRO program?\" id=\"can-you-run-other-types-of-tests-in-your-cro-program\" data-menu-id=\"can-you-run-other-types-of-tests-in-your-cro-program\" style=\"text-align:left\"><strong>Can you run other types of tests in your CRO program?<\/strong><\/h2>\n\n\n<p>As mentioned earlier, the test is just one component of your CRO campaign, and it comes in various types. If you assumed it was only about CRO split testing or A\/B testing, you&#8217;d be mistaken. Here are some other tests you can plan and launch as part of your CRO process.<\/p>\n\n\n<h3 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level2\" data-menu=\"\u00a0A\/B\/n test\" id=\"a-b-n-test\" data-menu-id=\"a-b-n-test\" style=\"text-align:left\"><strong>\u00a0A\/B\/n test<\/strong><\/h3>\n\n\n<p>In an A\/B\/n test, multiple alternative versions (n) are compared to the original (A) to determine the best-performing variation. Each variation represents a different complete version of the web page, landing page or email. And the variations can include different headlines, images, layouts, or other substantial changes.<\/p>\n\n\n\n<p>However, it comes with challenges, such as a reduced sample size for each variation, longer testing durations, and the need to carefully analyze results to attribute changes to specific elements accurately.<\/p>\n\n\n<h3 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level2\" data-menu=\"Multivariate test\" id=\"multivariate-test\" data-menu-id=\"multivariate-test\" style=\"text-align:left\"><strong>Multivariate test<\/strong><\/h3>\n\n\n<p>Multivariate testing is a type of CRO test for figuring out which combinations of different page elements work best together. This approach is quite efficient because it allows you to test many combinations at the same time, which saves time and resources.&nbsp;<\/p>\n\n\n\n<p>But here\u2019s the catch about conversion rate optimization multivariate testing. Testing numerous elements simultaneously can demand substantial website traffic, potentially extending the testing duration to achieve trustworthy results.<\/p>\n\n\n<h3 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level2\" data-menu=\"Multi-armed bandit test\" id=\"multi-armed-bandit-test\" data-menu-id=\"multi-armed-bandit-test\" style=\"text-align:left\"><strong>Multi-armed bandit test<\/strong><\/h3>\n\n\n<p>A <a href=\"https:\/\/vwo.com\/blog\/multi-armed-bandit-algorithm\/\">multi-armed bandit test<\/a> uses machine learning to dynamically steer traffic towards variations that are doing well and reduce traffic to those underperforming. This approach delivers quicker results as you don&#8217;t have to wait for a single winning variation to emerge.<\/p>\n\n\n\n<p>Further, in <a href=\"https:\/\/vwo.com\/website-optimization\/\">website optimization<\/a>, contextual bandits take things up a notch by considering real-time user context data. For example, if you know a customer has made a previous purchase, you can use contextual bandits to offer them a discount for more purchases.<\/p>\n\n\n\n<p>There are some downsides to these CRO tests as well. It isn&#8217;t easy to reach statistical significance with MAB tests. They&#8217;re not the best for optimizing multiple metrics. Plus, post-test analysis can be tricky when there isn&#8217;t enough data for the low-performing variations.<\/p>\n\n\n\n<p>Are you wondering how to pick the perfect CRO tool for your business in this sea of options? With so many choices flooding the market, it&#8217;s easy to feel overwhelmed and hesitant about where to invest. We&#8217;ve delved into the nitty-gritty of <a href=\"https:\/\/vwo.com\/conversion-rate-optimization\/conversion-rate-optimisation-tools\/\">selecting the ideal CRO tool<\/a> in our blog post. Get your answer and make the right choice!<\/p>\n\n\n<h2 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level1\" data-menu=\"Wrapping up\" id=\"wrapping-up\" data-menu-id=\"wrapping-up\" style=\"text-align:left\"><strong>Wrapping up<\/strong><\/h2>\n\n\n<p>A\/B testing is a test; CRO is a potent growth discipline.<\/p>\n\n\n\n<p>Here\u2019s what we covered in this post:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>The difference between A\/B testing and Conversion Rate Optimization<\/li>\n\n\n\n<li>For sustained growth, you\u2019ll need a connected platform rather than an A\/B testing tool<\/li>\n\n\n\n<li>Different CRO&nbsp; testing platforms answer different questions, so choose what you need to be answered<\/li>\n\n\n\n<li>CRO doesn\u2019t end with a platform, you\u2019ll need people who can run CRO<\/li>\n<\/ul>\n\n\n\n<p>Currently, most organizations that believe they are doing CRO are only doing patchy A\/B testing. With time, it will evolve into the discipline it needs to be. When it becomes that, where do you want to be\u2014in the gallery or in the race?<br>Carpe diem.<\/p>\n\n\n\n<figure class=\"wp-block-image is-resized\"><a href=\"#free-trial\"><img decoding=\"async\" src=\"https:\/\/lh7-eu.googleusercontent.com\/tpgOemuptIUJWRUVbMvA-tNSS-6pH76NaC3oO7H_GZSSNFotHJuUSxqTy8sTX8E9s1rG6kopznsv-SEYpW9gei9bITjYMVn4PJ9Me5d5hPDpT0xQ5SP1d5LfZxRE5RMDlAqaQnw2EAq1wd6olvWWDBE\" alt=\"banner promoting the free trial for the VWO platform\" style=\"aspect-ratio:2.8444444444444446;width:840px;height:auto\" \/><\/a><\/figure>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\" \/>\n\n\n<h2 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level1\" data-menu=\"Frequently asked questions\" id=\"frequently-asked-questions\" data-menu-id=\"frequently-asked-questions\" style=\"text-align:left\">Frequently asked questions<\/h2>\n\n\n<div class=\"schema-faq wp-block-yoast-faq-block\"><div class=\"schema-faq-section\" id=\"faq-question-1698743562221\"><strong class=\"schema-faq-question\"><strong>How do CRO and AB testing work together?<\/strong><\/strong> <p class=\"schema-faq-answer\">CRO and A\/B testing go hand in hand in the world of digital marketing. A CRO test is all about improving website or app performance to increase user actions like clicks, sign-ups, or purchases. A\/B testing is part of CRO, allowing for comparing different versions of a webpage or element to determine which one performs better. <br \/><br \/>This CRO test helps identify what changes can positively impact an app&#8217;s or website&#8217;s conversion rate. CRO and A\/B testing work together to refine user experiences, boost engagement, and ultimately, drive conversions.<\/p> <\/div> <div class=\"schema-faq-section\" id=\"faq-question-1698743586677\"><strong class=\"schema-faq-question\"><strong>What are the benefits of CRO A\/B testing?<\/strong><\/strong> <p class=\"schema-faq-answer\">CRO and A\/B testing are two distinct but related strategies. CRO is a broader approach to improving user experiences and conversion rates, whereas A\/B testing is a specific tactic within CRO. A\/B testing, part of CRO, involves comparing two or more versions of a page to identify which performs better in terms of conversions.\u00a0<br \/><br \/>The benefits of CRO A\/B testing include enabling data-driven decision-making, leading to improved user experiences, increased revenue, continuous optimization, a deeper understanding of customer behavior, and reduced risk of implementing changes.<br \/><\/p> <\/div> <div class=\"schema-faq-section\" id=\"faq-question-1698743605750\"><strong class=\"schema-faq-question\"><strong>How to choose the right metrics for CRO A\/B testing?<\/strong><\/strong> <p class=\"schema-faq-answer\">Selecting the right metrics for CRO A\/B testing is crucial. Begin by defining the primary goals of your CRO test, whether it&#8217;s increasing sales or sign-ups. Identify the corresponding KPIs that align with your objectives, ensuring changes directly impact the desired outcomes. Choose metrics like conversion rate, click-through rate, page visits, revenue per visitor, and average order value, ensuring alignment with your broader business goals.<br \/><\/p> <\/div> <\/div>\n","protected":false},"excerpt":{"rendered":"<p>You must have come across A\/B testing before. While it might not always have seemed like a top priority due to its focus on gradual results, it&#8217;s now gaining momentum, with 77% of companies now running A\/B tests on their websites.&nbsp; CRO, often mentioned alongside A\/B testing, is also crucial, as 55% of businesses are&#8230;<\/p>\n","protected":false},"author":59,"featured_media":56323,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"post_read_time":11,"footnotes":""},"categories":[1850],"tags":[],"feature":[1852,10526],"industry-type":[],"product":[],"role":[],"region":[],"class_list":["post-38412","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-conversion-rate-optimization","feature-ab-testing","feature-experimentation-platform"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v26.9 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>What Do You Need to Know When Investing in CRO and A\/B Testing?<\/title>\n<meta name=\"description\" content=\"There are many things to consider before you blindly invest in software for A\/B Testing and CRO. Find out here.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"What Do You Need to Know When Investing in CRO and A\/B Testing?\" \/>\n<meta property=\"og:description\" content=\"There are many things to consider before you blindly invest in software for A\/B Testing and CRO. Find out here.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/\" \/>\n<meta property=\"og:site_name\" content=\"Blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/vwoofficial\/\" \/>\n<meta property=\"article:author\" content=\"https:\/\/www.facebook.com\/SharanThis\" \/>\n<meta property=\"article:published_time\" content=\"2016-08-29T15:22:04+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-05-05T12:04:55+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2016\/08\/OG-image_Investing-in-CRO-or-AB-Testing-Software-You-Decision-Maker-Must-Know-This.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"630\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Sharan Suresh\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@https:\/\/twitter.com\/SharanTheSuresh\" \/>\n<meta name=\"twitter:site\" content=\"@VWO\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Sharan Suresh\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"20 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/\"},\"author\":{\"name\":\"Sharan Suresh\",\"@id\":\"https:\/\/vwo.com\/blog\/#\/schema\/person\/bd364afc95b53aee03d9d3838e4c304e\"},\"headline\":\"Investing in CRO or A\/B Testing Software? You (Decision Maker) Must Know This\",\"datePublished\":\"2016-08-29T15:22:04+00:00\",\"dateModified\":\"2025-05-05T12:04:55+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/\"},\"wordCount\":4131,\"publisher\":{\"@id\":\"https:\/\/vwo.com\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2016\/08\/Feature-image_Investing-in-CRO-or-AB-Testing-Software-You-Decision-Maker-Must-Know-This.png\",\"articleSection\":[\"Conversion Rate Optimization\"],\"inLanguage\":\"en-US\"},{\"@type\":[\"WebPage\",\"FAQPage\"],\"@id\":\"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/\",\"url\":\"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/\",\"name\":\"What Do You Need to Know When Investing in CRO and A\/B Testing?\",\"isPartOf\":{\"@id\":\"https:\/\/vwo.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2016\/08\/Feature-image_Investing-in-CRO-or-AB-Testing-Software-You-Decision-Maker-Must-Know-This.png\",\"datePublished\":\"2016-08-29T15:22:04+00:00\",\"dateModified\":\"2025-05-05T12:04:55+00:00\",\"description\":\"There are many things to consider before you blindly invest in software for A\/B Testing and CRO. Find out here.\",\"breadcrumb\":{\"@id\":\"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/#breadcrumb\"},\"mainEntity\":[{\"@id\":\"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/#faq-question-1698743562221\"},{\"@id\":\"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/#faq-question-1698743586677\"},{\"@id\":\"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/#faq-question-1698743605750\"}],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/#primaryimage\",\"url\":\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2016\/08\/Feature-image_Investing-in-CRO-or-AB-Testing-Software-You-Decision-Maker-Must-Know-This.png\",\"contentUrl\":\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2016\/08\/Feature-image_Investing-in-CRO-or-AB-Testing-Software-You-Decision-Maker-Must-Know-This.png\",\"width\":1200,\"height\":700,\"caption\":\"Investing In Cro Or Ab Testing Software? You (decision Maker) Must Know This\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/vwo.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Conversion Rate Optimization\",\"item\":\"https:\/\/vwo.com\/blog\/conversion-rate-optimization\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Investing in CRO or A\/B Testing Software? You (Decision Maker) Must Know This\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/vwo.com\/blog\/#website\",\"url\":\"https:\/\/vwo.com\/blog\/\",\"name\":\"Blog\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/vwo.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/vwo.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/vwo.com\/blog\/#organization\",\"name\":\"VWO\",\"url\":\"https:\/\/vwo.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/vwo.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2018\/09\/VWOLogo.png\",\"contentUrl\":\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2018\/09\/VWOLogo.png\",\"width\":780,\"height\":492,\"caption\":\"VWO\"},\"image\":{\"@id\":\"https:\/\/vwo.com\/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/vwoofficial\/\",\"https:\/\/x.com\/VWO\",\"https:\/\/www.instagram.com\/vwoofficial\/\",\"https:\/\/www.linkedin.com\/company\/vwo\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/vwo.com\/blog\/#\/schema\/person\/bd364afc95b53aee03d9d3838e4c304e\",\"name\":\"Sharan Suresh\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/vwo.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/0dbb35d9e8b062452ff089454d67b370e3b6cc6e16bf7bdf3d447960645a4931?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/0dbb35d9e8b062452ff089454d67b370e3b6cc6e16bf7bdf3d447960645a4931?s=96&d=mm&r=g\",\"caption\":\"Sharan Suresh\"},\"description\":\"Marketing | SaaS | Product. Loves words, people, images, and experiences.\",\"sameAs\":[\"https:\/\/vwo.com\/\",\"https:\/\/www.facebook.com\/SharanThis\",\"https:\/\/www.linkedin.com\/in\/thesharansuresh\",\"https:\/\/x.com\/https:\/\/twitter.com\/SharanTheSuresh\"],\"url\":\"https:\/\/vwo.com\/blog\/author\/sharan\/\"},{\"@type\":\"Question\",\"@id\":\"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/#faq-question-1698743562221\",\"position\":1,\"url\":\"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/#faq-question-1698743562221\",\"name\":\"How do CRO and AB testing work together?\",\"answerCount\":1,\"acceptedAnswer\":{\"@type\":\"Answer\",\"text\":\"CRO and A\/B testing go hand in hand in the world of digital marketing. A CRO test is all about improving website or app performance to increase user actions like clicks, sign-ups, or purchases. A\/B testing is part of CRO, allowing for comparing different versions of a webpage or element to determine which one performs better. <br \/><br \/>This CRO test helps identify what changes can positively impact an app's or website's conversion rate. CRO and A\/B testing work together to refine user experiences, boost engagement, and ultimately, drive conversions.\",\"inLanguage\":\"en-US\"},\"inLanguage\":\"en-US\"},{\"@type\":\"Question\",\"@id\":\"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/#faq-question-1698743586677\",\"position\":2,\"url\":\"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/#faq-question-1698743586677\",\"name\":\"What are the benefits of CRO A\/B testing?\",\"answerCount\":1,\"acceptedAnswer\":{\"@type\":\"Answer\",\"text\":\"CRO and A\/B testing are two distinct but related strategies. CRO is a broader approach to improving user experiences and conversion rates, whereas A\/B testing is a specific tactic within CRO. A\/B testing, part of CRO, involves comparing two or more versions of a page to identify which performs better in terms of conversions.\u00a0<br \/><br \/>The benefits of CRO A\/B testing include enabling data-driven decision-making, leading to improved user experiences, increased revenue, continuous optimization, a deeper understanding of customer behavior, and reduced risk of implementing changes.<br \/>\",\"inLanguage\":\"en-US\"},\"inLanguage\":\"en-US\"},{\"@type\":\"Question\",\"@id\":\"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/#faq-question-1698743605750\",\"position\":3,\"url\":\"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/#faq-question-1698743605750\",\"name\":\"How to choose the right metrics for CRO A\/B testing?\",\"answerCount\":1,\"acceptedAnswer\":{\"@type\":\"Answer\",\"text\":\"Selecting the right metrics for CRO A\/B testing is crucial. Begin by defining the primary goals of your CRO test, whether it's increasing sales or sign-ups. Identify the corresponding KPIs that align with your objectives, ensuring changes directly impact the desired outcomes. Choose metrics like conversion rate, click-through rate, page visits, revenue per visitor, and average order value, ensuring alignment with your broader business goals.<br \/>\",\"inLanguage\":\"en-US\"},\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"What Do You Need to Know When Investing in CRO and A\/B Testing?","description":"There are many things to consider before you blindly invest in software for A\/B Testing and CRO. Find out here.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/","og_locale":"en_US","og_type":"article","og_title":"What Do You Need to Know When Investing in CRO and A\/B Testing?","og_description":"There are many things to consider before you blindly invest in software for A\/B Testing and CRO. Find out here.","og_url":"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/","og_site_name":"Blog","article_publisher":"https:\/\/www.facebook.com\/vwoofficial\/","article_author":"https:\/\/www.facebook.com\/SharanThis","article_published_time":"2016-08-29T15:22:04+00:00","article_modified_time":"2025-05-05T12:04:55+00:00","og_image":[{"width":1200,"height":630,"url":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2016\/08\/OG-image_Investing-in-CRO-or-AB-Testing-Software-You-Decision-Maker-Must-Know-This.png","type":"image\/png"}],"author":"Sharan Suresh","twitter_card":"summary_large_image","twitter_creator":"@https:\/\/twitter.com\/SharanTheSuresh","twitter_site":"@VWO","twitter_misc":{"Written by":"Sharan Suresh","Est. reading time":"20 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/#article","isPartOf":{"@id":"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/"},"author":{"name":"Sharan Suresh","@id":"https:\/\/vwo.com\/blog\/#\/schema\/person\/bd364afc95b53aee03d9d3838e4c304e"},"headline":"Investing in CRO or A\/B Testing Software? You (Decision Maker) Must Know This","datePublished":"2016-08-29T15:22:04+00:00","dateModified":"2025-05-05T12:04:55+00:00","mainEntityOfPage":{"@id":"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/"},"wordCount":4131,"publisher":{"@id":"https:\/\/vwo.com\/blog\/#organization"},"image":{"@id":"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/#primaryimage"},"thumbnailUrl":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2016\/08\/Feature-image_Investing-in-CRO-or-AB-Testing-Software-You-Decision-Maker-Must-Know-This.png","articleSection":["Conversion Rate Optimization"],"inLanguage":"en-US"},{"@type":["WebPage","FAQPage"],"@id":"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/","url":"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/","name":"What Do You Need to Know When Investing in CRO and A\/B Testing?","isPartOf":{"@id":"https:\/\/vwo.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/#primaryimage"},"image":{"@id":"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/#primaryimage"},"thumbnailUrl":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2016\/08\/Feature-image_Investing-in-CRO-or-AB-Testing-Software-You-Decision-Maker-Must-Know-This.png","datePublished":"2016-08-29T15:22:04+00:00","dateModified":"2025-05-05T12:04:55+00:00","description":"There are many things to consider before you blindly invest in software for A\/B Testing and CRO. Find out here.","breadcrumb":{"@id":"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/#breadcrumb"},"mainEntity":[{"@id":"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/#faq-question-1698743562221"},{"@id":"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/#faq-question-1698743586677"},{"@id":"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/#faq-question-1698743605750"}],"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/#primaryimage","url":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2016\/08\/Feature-image_Investing-in-CRO-or-AB-Testing-Software-You-Decision-Maker-Must-Know-This.png","contentUrl":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2016\/08\/Feature-image_Investing-in-CRO-or-AB-Testing-Software-You-Decision-Maker-Must-Know-This.png","width":1200,"height":700,"caption":"Investing In Cro Or Ab Testing Software? You (decision Maker) Must Know This"},{"@type":"BreadcrumbList","@id":"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/vwo.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Conversion Rate Optimization","item":"https:\/\/vwo.com\/blog\/conversion-rate-optimization\/"},{"@type":"ListItem","position":3,"name":"Investing in CRO or A\/B Testing Software? You (Decision Maker) Must Know This"}]},{"@type":"WebSite","@id":"https:\/\/vwo.com\/blog\/#website","url":"https:\/\/vwo.com\/blog\/","name":"Blog","description":"","publisher":{"@id":"https:\/\/vwo.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/vwo.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/vwo.com\/blog\/#organization","name":"VWO","url":"https:\/\/vwo.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/vwo.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2018\/09\/VWOLogo.png","contentUrl":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2018\/09\/VWOLogo.png","width":780,"height":492,"caption":"VWO"},"image":{"@id":"https:\/\/vwo.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/vwoofficial\/","https:\/\/x.com\/VWO","https:\/\/www.instagram.com\/vwoofficial\/","https:\/\/www.linkedin.com\/company\/vwo"]},{"@type":"Person","@id":"https:\/\/vwo.com\/blog\/#\/schema\/person\/bd364afc95b53aee03d9d3838e4c304e","name":"Sharan Suresh","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/vwo.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/0dbb35d9e8b062452ff089454d67b370e3b6cc6e16bf7bdf3d447960645a4931?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/0dbb35d9e8b062452ff089454d67b370e3b6cc6e16bf7bdf3d447960645a4931?s=96&d=mm&r=g","caption":"Sharan Suresh"},"description":"Marketing | SaaS | Product. Loves words, people, images, and experiences.","sameAs":["https:\/\/vwo.com\/","https:\/\/www.facebook.com\/SharanThis","https:\/\/www.linkedin.com\/in\/thesharansuresh","https:\/\/x.com\/https:\/\/twitter.com\/SharanTheSuresh"],"url":"https:\/\/vwo.com\/blog\/author\/sharan\/"},{"@type":"Question","@id":"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/#faq-question-1698743562221","position":1,"url":"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/#faq-question-1698743562221","name":"How do CRO and AB testing work together?","answerCount":1,"acceptedAnswer":{"@type":"Answer","text":"CRO and A\/B testing go hand in hand in the world of digital marketing. A CRO test is all about improving website or app performance to increase user actions like clicks, sign-ups, or purchases. A\/B testing is part of CRO, allowing for comparing different versions of a webpage or element to determine which one performs better. <br \/><br \/>This CRO test helps identify what changes can positively impact an app's or website's conversion rate. CRO and A\/B testing work together to refine user experiences, boost engagement, and ultimately, drive conversions.","inLanguage":"en-US"},"inLanguage":"en-US"},{"@type":"Question","@id":"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/#faq-question-1698743586677","position":2,"url":"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/#faq-question-1698743586677","name":"What are the benefits of CRO A\/B testing?","answerCount":1,"acceptedAnswer":{"@type":"Answer","text":"CRO and A\/B testing are two distinct but related strategies. CRO is a broader approach to improving user experiences and conversion rates, whereas A\/B testing is a specific tactic within CRO. A\/B testing, part of CRO, involves comparing two or more versions of a page to identify which performs better in terms of conversions.\u00a0<br \/><br \/>The benefits of CRO A\/B testing include enabling data-driven decision-making, leading to improved user experiences, increased revenue, continuous optimization, a deeper understanding of customer behavior, and reduced risk of implementing changes.<br \/>","inLanguage":"en-US"},"inLanguage":"en-US"},{"@type":"Question","@id":"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/#faq-question-1698743605750","position":3,"url":"https:\/\/vwo.com\/blog\/what-decision-makers-need-to-know-before-investing-in-cro-ab-testing\/#faq-question-1698743605750","name":"How to choose the right metrics for CRO A\/B testing?","answerCount":1,"acceptedAnswer":{"@type":"Answer","text":"Selecting the right metrics for CRO A\/B testing is crucial. Begin by defining the primary goals of your CRO test, whether it's increasing sales or sign-ups. Identify the corresponding KPIs that align with your objectives, ensuring changes directly impact the desired outcomes. Choose metrics like conversion rate, click-through rate, page visits, revenue per visitor, and average order value, ensuring alignment with your broader business goals.<br \/>","inLanguage":"en-US"},"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/posts\/38412","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/users\/59"}],"replies":[{"embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/comments?post=38412"}],"version-history":[{"count":92,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/posts\/38412\/revisions"}],"predecessor-version":[{"id":88777,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/posts\/38412\/revisions\/88777"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/media\/56323"}],"wp:attachment":[{"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/media?parent=38412"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/categories?post=38412"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/tags?post=38412"},{"taxonomy":"feature","embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/feature?post=38412"},{"taxonomy":"industry-type","embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/industry-type?post=38412"},{"taxonomy":"product","embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/product?post=38412"},{"taxonomy":"role","embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/role?post=38412"},{"taxonomy":"region","embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/region?post=38412"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}