{"id":32693,"date":"2015-10-06T00:00:09","date_gmt":"2015-10-06T00:00:09","guid":{"rendered":"https:\/\/vwo.com\/blog\/?p=32693"},"modified":"2025-05-05T17:45:31","modified_gmt":"2025-05-05T12:15:31","slug":"smartstats-testing-for-truth","status":"publish","type":"post","link":"https:\/\/vwo.com\/blog\/smartstats-testing-for-truth\/","title":{"rendered":"VWO SmartStats: Testing for Truth Versus Maximizing Revenue"},"content":{"rendered":"\n<p class=\"has-text-align-left\">In my career I\u2019ve worked in two different worlds. The first is the world of science &#8211; clever people running careful experiments and seeking truth. The ultimate goal is to publish papers that reveal truths.<\/p>\n\n\n\n<p><span style=\"font-weight: 400\">The second place I\u2019ve worked is the world of finance &#8211; clever people trying to make choices in the face of uncertainty that have a high probability of making money. <\/span><\/p>\n\n\n\n<p><span style=\"font-weight: 400\">Most <a href=\"https:\/\/vwo.com\/blog\/ab-testing-tools\/\">A\/B testing tools<\/a> use hypothesis tests designed for the science world. SmartStats is an A\/B testing statistics engine&nbsp;inspired by the financial world and designed to make money even in the face of uncertainty. &nbsp;<\/span><\/p>\n\n\n\n<h2 class=\"wp-block-heading has-text-align-center\"><a href=\"https:\/\/vwo.com\/ab-testing\/#guide-download\"><em><span style=\"text-decoration: underline\">Download Free: A\/B Testing Guide<\/span><\/em><\/a><\/h2>\n\n\n\n<p><span style=\"font-weight: 400\">As a scientist I\u2019ll formulate a hypothesis &#8211; for example, \u2018blue webpages convert more than red ones\u2019. I\u2019ll then design an experiment like exposing visitors to red and blue webpages and measuring <a href=\"https:\/\/vwo.com\/glossary\/conversion-rate\/\">conversion rates<\/a>. The experiment is run, and the number of correct guesses (and the number of failures) is tallied. <\/span><\/p>\n\n\n\n<p><span style=\"font-weight: 400\">As a scientist, I want to know that the effect I just observed &#8211; let\u2019s say blue converts better than blue &#8211; is real. So I\u2019ll assume the <a href=\"https:\/\/vwo.com\/glossary\/null-hypothesis\/\">null hypothesis<\/a>&nbsp;&#8211; in this case that red and blue are the same &#8211; and try to disprove it. I\u2019ll run a hypothesis test and compute the probability of seeing the experimental results \u2018that I just saw\u2019 assuming the null hypothesis (basically the \u201copposite\u201d of the result I\u2019m looking for) is false. If this probability is low, I\u2019ll conclude that this is strong evidence against the <a href=\"https:\/\/vwo.com\/glossary\/hypothesis\/\">hypothesis<\/a>. If the probability is high, then this is weak &nbsp;evidence against the null hypothesis. <\/span><\/p>\n\n\n\n<p><span style=\"font-weight: 400\">My goal here is to avoid publishing false results. If blue webpages don\u2019t convert more than red ones, I don\u2019t want to publish a paper saying it does. Publishing a lot of papers that can\u2019t be replicated will make me look dumb. Frequentist hypothesis testing &nbsp;is a great fit for this use case. <\/span><\/p>\n\n\n<h2 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level1\" data-menu=\"Businesses Need Actionable Answers\" id=\"businesses-need-actionable-answers\" data-menu-id=\"businesses-need-actionable-answers\" style=\"text-align:left\">Businesses Need Actionable Answers<\/h2>\n\n\n<p><span style=\"font-weight: 400\">If I were trading stocks, I don\u2019t necessarily care about truth. If I buy a stock at $10, it stays flat, and then I sell it at $10, I\u2019ve lost nothing (ignoring &nbsp;transaction costs). If I do this 10 times, and the stock goes up half the time and stays flat the other half the time, I win &#8211; I made money 5 times and didn\u2019t lose money the other 5 times.<\/span><\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p>\u201cConversion rate optimization is a lot more like trading stocks than like publishing science papers.\u201d<\/p>\n<\/blockquote>\n\n\n\n<p><span style=\"font-weight: 400\">I believe that <a href=\"https:\/\/vwo.com\/conversion-rate-optimization\/\">conversion rate optimization<\/a> is a lot more like trading stocks than like publishing science papers. Coming back to our earlier test of red versus blue webpages, suppose now that I\u2019m 50% certain that blue pages convert better and 50% certain that they are equal to red ones. If I were a scientist, I\u2019d wait for certainty before publishing. <\/span><\/p>\n\n\n\n<p><span style=\"font-weight: 400\">When businesses A\/B test, either the red webpage or the blue webpage will be deployed. The only question to answer is, \u2018which one?\u2019 <\/span><\/p>\n\n\n\n<p><span style=\"font-weight: 400\">So if I\u2019m 50% certain that the new blue webpage converts 10% more than the current red page, and 50% certain they are both the same, I\u2019ll deploy the blue page right away.<\/span><\/p>\n\n\n\n<p><span style=\"font-weight: 400\">The blue webpage is a smart business decision, even if it\u2019s not a proven scientific hypothesis. The blue webpage might be a win, but it\u2019s definitely not a loss. <\/span><\/p>\n\n\n\n<p><span style=\"font-weight: 400\">The tradeoff we made while designing <a href=\"https:\/\/vwo.com\/why-us\/technology\/bayesian-statistics\/\">SmartStats<\/a> is that instead of trying to find the absolute truth, SmartStats looks for the better choice. The benefit of this is that we can get results in much less time. We risk getting more false positives, but only false positives that won\u2019t hurt the bottom line. SmartStats is designed to give you more intelligent answers quickly so that you get more time to increase your conversions and more time to test more ideas. Also, if you want to be really, really sure, there\u2019s also a High Certainty mode that takes longer and tests more samples to get really accurate.<\/span><\/p>\n\n\n<h2 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level1\" data-menu=\"Reducing your Potential Loss\" id=\"reducing-your-potential-loss\" data-menu-id=\"reducing-your-potential-loss\" style=\"text-align:left\">Reducing your Potential Loss<\/h2>\n\n\n<p><span style=\"font-weight: 400\">The way we deal with false positives is by ensuring that we minimize the cost of any mistake. <a href=\"https:\/\/vwo.com\/blog\/thinking-like-a-bayesian\/\">The potential loss of page A is the lift you would lose by deploying A when in fact B was better<\/a>. <\/span><\/p>\n\n\n\n<p><span style=\"font-weight: 400\">For example, suppose there is a 50% chance that A is 10% better than B, and a 50% chance that B is 10% better than A. The potential loss from choosing A is 50% x 10% = 5%, and the potential loss from choosing B is 50% x 10% = 5%. This is pretty high, so your best bet is to continue testing.<\/span><\/p>\n\n\n\n<p><span style=\"font-weight: 400\">Potential loss can become small (very close to zero) in two ways. The first way, and most common, is for one variation to be not worse (but possibly not better) than the other variation. The second is for both variations to be identical, and thus nothing is lost by choosing one or the other. If one variation is known to be definitively better than the other, this case also applies. <\/span><\/p>\n\n\n\n<h2 class=\"wp-block-heading has-text-align-center\"><a href=\"https:\/\/vwo.com\/ab-testing\/#guide-download\"><em><span style=\"text-decoration: underline\">Download Free: A\/B Testing Guide<\/span><\/em><\/a><\/h2>\n\n\n<h2 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level1\" data-menu=\"More Accurate Calculations\" id=\"more-accurate-calculations\" data-menu-id=\"more-accurate-calculations\" style=\"text-align:left\">More Accurate Calculations<\/h2>\n\n\n<p class=\"has-text-align-left\"><span style=\"font-weight: 400\">Our new calculations are also more accurate than our old ones. Our old method used a common trick the <\/span><span style=\"font-weight: 400\"><a href=\"https:\/\/en.wikipedia.org\/wiki\/Central_limit_theorem\">Central Limit Theorem &nbsp;<\/a><\/span><span style=\"font-weight: 400\">and approximated the true statistical distribution by a normal distribution. This approximation works very well if you have a lot of samples. That\u2019s not possible for all customers, so it became clear to us that we needed to find a better way to get more accurate answers.<\/span><\/p>\n\n\n\n<p><span style=\"font-weight: 400\">Let\u2019s look at a couple of graphs that illustrate the problem. We\u2019ll consider an A\/B test with a 5% conversion rate. When we have 10,000 visitors, the true distribution and the normal approximation line up perfectly:<\/span><\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter\"><img loading=\"lazy\" decoding=\"async\" width=\"625\" height=\"291\" src=\"https:\/\/static.wingify.com\/vwo\/uploads\/sites\/3\/2015\/09\/Screenshot-2015-09-10-19.01.46.png\" alt=\"True distribution and normal approximation align perfectly\" class=\"wp-image-32695\" srcset=\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2015\/09\/Screenshot-2015-09-10-19.01.46.png 625w, https:\/\/static.wingify.com\/vwo\/uploads\/sites\/3\/2015\/09\/Screenshot-2015-09-10-19.01.46.png?tr=w-375 375w\" sizes=\"(max-width: 625px) 100vw, 625px\" \/><\/figure>\n<\/div>\n\n\n<p><span style=\"font-weight: 400\">That\u2019s great for anyone who has tens of thousands of visitors reaching the end of their funnel every week. <\/span><\/p>\n\n\n\n<p><span style=\"font-weight: 400\">In contrast, as you can see in the graph below, when we have only 100 visitors the green and the blue line differ significantly.<\/span><\/p>\n\n\n\n<figure class=\"wp-block-image\"><img loading=\"lazy\" decoding=\"async\" width=\"562\" height=\"272\" src=\"https:\/\/static.wingify.com\/vwo\/uploads\/sites\/3\/2015\/09\/Screenshot-2015-09-10-19.22.56.png\" alt=\"True distribution vs normal approximation deviation\" class=\"wp-image-32699\" srcset=\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2015\/09\/Screenshot-2015-09-10-19.22.56.png 562w, https:\/\/static.wingify.com\/vwo\/uploads\/sites\/3\/2015\/09\/Screenshot-2015-09-10-19.22.56.png?tr=w-375 375w\" sizes=\"(max-width: 562px) 100vw, 562px\" \/><\/figure>\n\n\n\n<p class=\"has-text-align-center\"><\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\">\n<p>\u201cThe true calculations are more difficult for both our math geeks and our computers, but it gives more accurate and faster results.\u201d<\/p>\n<\/blockquote>\n\n\n\n<p><span style=\"font-weight: 400\">Our old method used the approximation (the green line) in our calculations whereas our new method uses the true distribution (blue line) itself. (For the more technically inclined, the true posterior is a beta distribution<\/span><span style=\"font-weight: 400\">) It\u2019s more work for us &#8211; the true calculations are more difficult for both our math geeks and our computers &#8211; but it gives more accurate and faster results. <\/span><\/p>\n\n\n\n<p><i><span style=\"font-weight: 400\">Fun fact: <a href=\"https:\/\/vwo.com\/blog\/errors-in-ab-testing\/\">A lot of statistical techniques tell you something like \u201cthis method is only accurate<\/a> if number of conversions &gt; 3 sqrt(num_conversions x <a href=\"https:\/\/vwo.com\/glossary\/click-through-rate\/\">ctr<\/a> x (1-ctr))\u201d or something along those lines. This kind of \u2018rule of thumb\u2019 is there to ensure that the green and blue lines agree with each other. As a result of using exact calculations, SmartStats does not require any such rules. <\/span><\/i><\/p>\n\n\n<h2 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level1\" data-menu=\"Take a Fresh Approach to Testing with SmartStats\" id=\"take-a-fresh-approach-to-testing-with-smartstats\" data-menu-id=\"take-a-fresh-approach-to-testing-with-smartstats\" style=\"text-align:left\">Take a Fresh Approach to Testing with SmartStats<\/h2>\n\n\n<p><span style=\"font-weight: 400\">SmartStats doesn\u2019t change your fundamental testing process. You still need to <a href=\"https:\/\/vwo.com\/blog\/ab-testing-hypothesis\/\">identify a good hypothesis<\/a>, run tests and wait for the results. <\/span><\/p>\n\n\n\n<p><span style=\"font-weight: 400\">SmartStats just cuts down your waiting time, drastically. Finding intelligent answers quickly can widen your pipeline. You can run more tests, learn faster and improve conversions quickly. That\u2019s a certainty which many will value.<\/span><\/p>\n\n\n\n<p><em>Note: The author owns screenshots in the blog.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>In my career I\u2019ve worked in two different worlds. The first is the world of science &#8211; clever people running careful experiments and seeking truth. The ultimate goal is to publish papers that reveal truths. The second place I\u2019ve worked is the world of finance &#8211; clever people trying to make choices in the face&#8230;<\/p>\n","protected":false},"author":87,"featured_media":56641,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"post_read_time":6,"footnotes":""},"categories":[10676],"tags":[],"feature":[],"industry-type":[],"product":[],"role":[],"region":[],"class_list":["post-32693","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-a-b-testing"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v26.9 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Test More Samples To Get Really Accurate Stats With VWO Smartstats<\/title>\n<meta name=\"description\" content=\"Learn how VWO SmartStats helps you run more tests, learn faster and improve conversions quickly with more accurate calculations.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/vwo.com\/blog\/smartstats-testing-for-truth\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Test More Samples To Get Really Accurate Stats With VWO Smartstats\" \/>\n<meta property=\"og:description\" content=\"Learn how VWO SmartStats helps you run more tests, learn faster and improve conversions quickly with more accurate calculations.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/vwo.com\/blog\/smartstats-testing-for-truth\/\" \/>\n<meta property=\"og:site_name\" content=\"Blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/vwoofficial\/\" \/>\n<meta property=\"article:published_time\" content=\"2015-10-06T00:00:09+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-05-05T12:15:31+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2015\/10\/OG-image_VWO-SmartStats-Testing-for-Truth-Versus-Maximizing-Revenue.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"630\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Chris Stucchio\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@VWO\" \/>\n<meta name=\"twitter:site\" content=\"@VWO\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Chris Stucchio\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/vwo.com\/blog\/smartstats-testing-for-truth\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/vwo.com\/blog\/smartstats-testing-for-truth\/\"},\"author\":{\"name\":\"Chris Stucchio\",\"@id\":\"https:\/\/vwo.com\/blog\/#\/schema\/person\/1eef8b5bf2a821a5559ac611a6cd91d7\"},\"headline\":\"VWO SmartStats: Testing for Truth Versus Maximizing Revenue\",\"datePublished\":\"2015-10-06T00:00:09+00:00\",\"dateModified\":\"2025-05-05T12:15:31+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/vwo.com\/blog\/smartstats-testing-for-truth\/\"},\"wordCount\":1244,\"publisher\":{\"@id\":\"https:\/\/vwo.com\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/vwo.com\/blog\/smartstats-testing-for-truth\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2015\/10\/Feature-image_VWO-SmartStats-Testing-for-Truth-Versus-Maximizing-Revenue.png\",\"articleSection\":[\"A\/B Testing\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/vwo.com\/blog\/smartstats-testing-for-truth\/\",\"url\":\"https:\/\/vwo.com\/blog\/smartstats-testing-for-truth\/\",\"name\":\"Test More Samples To Get Really Accurate Stats With VWO Smartstats\",\"isPartOf\":{\"@id\":\"https:\/\/vwo.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/vwo.com\/blog\/smartstats-testing-for-truth\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/vwo.com\/blog\/smartstats-testing-for-truth\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2015\/10\/Feature-image_VWO-SmartStats-Testing-for-Truth-Versus-Maximizing-Revenue.png\",\"datePublished\":\"2015-10-06T00:00:09+00:00\",\"dateModified\":\"2025-05-05T12:15:31+00:00\",\"description\":\"Learn how VWO SmartStats helps you run more tests, learn faster and improve conversions quickly with more accurate calculations.\",\"breadcrumb\":{\"@id\":\"https:\/\/vwo.com\/blog\/smartstats-testing-for-truth\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/vwo.com\/blog\/smartstats-testing-for-truth\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/vwo.com\/blog\/smartstats-testing-for-truth\/#primaryimage\",\"url\":\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2015\/10\/Feature-image_VWO-SmartStats-Testing-for-Truth-Versus-Maximizing-Revenue.png\",\"contentUrl\":\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2015\/10\/Feature-image_VWO-SmartStats-Testing-for-Truth-Versus-Maximizing-Revenue.png\",\"width\":1200,\"height\":700,\"caption\":\"Vwo Smartstats: Testing For Truth Versus Maximizing Revenue\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/vwo.com\/blog\/smartstats-testing-for-truth\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/vwo.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"A\/B Testing\",\"item\":\"https:\/\/vwo.com\/blog\/a-b-testing\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"VWO SmartStats: Testing for Truth Versus Maximizing Revenue\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/vwo.com\/blog\/#website\",\"url\":\"https:\/\/vwo.com\/blog\/\",\"name\":\"Blog\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/vwo.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/vwo.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/vwo.com\/blog\/#organization\",\"name\":\"VWO\",\"url\":\"https:\/\/vwo.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/vwo.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2018\/09\/VWOLogo.png\",\"contentUrl\":\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2018\/09\/VWOLogo.png\",\"width\":780,\"height\":492,\"caption\":\"VWO\"},\"image\":{\"@id\":\"https:\/\/vwo.com\/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/vwoofficial\/\",\"https:\/\/x.com\/VWO\",\"https:\/\/www.instagram.com\/vwoofficial\/\",\"https:\/\/www.linkedin.com\/company\/vwo\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/vwo.com\/blog\/#\/schema\/person\/1eef8b5bf2a821a5559ac611a6cd91d7\",\"name\":\"Chris Stucchio\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/vwo.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/f2ff77ef7289c001d483036f17bd3f9e4f7b2f31995ce768e8e8bbba1e6c089c?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/f2ff77ef7289c001d483036f17bd3f9e4f7b2f31995ce768e8e8bbba1e6c089c?s=96&d=mm&r=g\",\"caption\":\"Chris Stucchio\"},\"description\":\"Chris Stucchio has completed his Ph.D. from Rutgers University in Quantum Physics and has worked in medical imaging, predictive algorithms for eCommerce.\",\"sameAs\":[\"https:\/\/chrisstucchio.com\"],\"url\":\"https:\/\/vwo.com\/blog\/author\/chris-wingify\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Test More Samples To Get Really Accurate Stats With VWO Smartstats","description":"Learn how VWO SmartStats helps you run more tests, learn faster and improve conversions quickly with more accurate calculations.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/vwo.com\/blog\/smartstats-testing-for-truth\/","og_locale":"en_US","og_type":"article","og_title":"Test More Samples To Get Really Accurate Stats With VWO Smartstats","og_description":"Learn how VWO SmartStats helps you run more tests, learn faster and improve conversions quickly with more accurate calculations.","og_url":"https:\/\/vwo.com\/blog\/smartstats-testing-for-truth\/","og_site_name":"Blog","article_publisher":"https:\/\/www.facebook.com\/vwoofficial\/","article_published_time":"2015-10-06T00:00:09+00:00","article_modified_time":"2025-05-05T12:15:31+00:00","og_image":[{"width":1200,"height":630,"url":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2015\/10\/OG-image_VWO-SmartStats-Testing-for-Truth-Versus-Maximizing-Revenue.png","type":"image\/png"}],"author":"Chris Stucchio","twitter_card":"summary_large_image","twitter_creator":"@VWO","twitter_site":"@VWO","twitter_misc":{"Written by":"Chris Stucchio","Est. reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/vwo.com\/blog\/smartstats-testing-for-truth\/#article","isPartOf":{"@id":"https:\/\/vwo.com\/blog\/smartstats-testing-for-truth\/"},"author":{"name":"Chris Stucchio","@id":"https:\/\/vwo.com\/blog\/#\/schema\/person\/1eef8b5bf2a821a5559ac611a6cd91d7"},"headline":"VWO SmartStats: Testing for Truth Versus Maximizing Revenue","datePublished":"2015-10-06T00:00:09+00:00","dateModified":"2025-05-05T12:15:31+00:00","mainEntityOfPage":{"@id":"https:\/\/vwo.com\/blog\/smartstats-testing-for-truth\/"},"wordCount":1244,"publisher":{"@id":"https:\/\/vwo.com\/blog\/#organization"},"image":{"@id":"https:\/\/vwo.com\/blog\/smartstats-testing-for-truth\/#primaryimage"},"thumbnailUrl":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2015\/10\/Feature-image_VWO-SmartStats-Testing-for-Truth-Versus-Maximizing-Revenue.png","articleSection":["A\/B Testing"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/vwo.com\/blog\/smartstats-testing-for-truth\/","url":"https:\/\/vwo.com\/blog\/smartstats-testing-for-truth\/","name":"Test More Samples To Get Really Accurate Stats With VWO Smartstats","isPartOf":{"@id":"https:\/\/vwo.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/vwo.com\/blog\/smartstats-testing-for-truth\/#primaryimage"},"image":{"@id":"https:\/\/vwo.com\/blog\/smartstats-testing-for-truth\/#primaryimage"},"thumbnailUrl":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2015\/10\/Feature-image_VWO-SmartStats-Testing-for-Truth-Versus-Maximizing-Revenue.png","datePublished":"2015-10-06T00:00:09+00:00","dateModified":"2025-05-05T12:15:31+00:00","description":"Learn how VWO SmartStats helps you run more tests, learn faster and improve conversions quickly with more accurate calculations.","breadcrumb":{"@id":"https:\/\/vwo.com\/blog\/smartstats-testing-for-truth\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/vwo.com\/blog\/smartstats-testing-for-truth\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/vwo.com\/blog\/smartstats-testing-for-truth\/#primaryimage","url":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2015\/10\/Feature-image_VWO-SmartStats-Testing-for-Truth-Versus-Maximizing-Revenue.png","contentUrl":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2015\/10\/Feature-image_VWO-SmartStats-Testing-for-Truth-Versus-Maximizing-Revenue.png","width":1200,"height":700,"caption":"Vwo Smartstats: Testing For Truth Versus Maximizing Revenue"},{"@type":"BreadcrumbList","@id":"https:\/\/vwo.com\/blog\/smartstats-testing-for-truth\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/vwo.com\/blog\/"},{"@type":"ListItem","position":2,"name":"A\/B Testing","item":"https:\/\/vwo.com\/blog\/a-b-testing\/"},{"@type":"ListItem","position":3,"name":"VWO SmartStats: Testing for Truth Versus Maximizing Revenue"}]},{"@type":"WebSite","@id":"https:\/\/vwo.com\/blog\/#website","url":"https:\/\/vwo.com\/blog\/","name":"Blog","description":"","publisher":{"@id":"https:\/\/vwo.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/vwo.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/vwo.com\/blog\/#organization","name":"VWO","url":"https:\/\/vwo.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/vwo.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2018\/09\/VWOLogo.png","contentUrl":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2018\/09\/VWOLogo.png","width":780,"height":492,"caption":"VWO"},"image":{"@id":"https:\/\/vwo.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/vwoofficial\/","https:\/\/x.com\/VWO","https:\/\/www.instagram.com\/vwoofficial\/","https:\/\/www.linkedin.com\/company\/vwo"]},{"@type":"Person","@id":"https:\/\/vwo.com\/blog\/#\/schema\/person\/1eef8b5bf2a821a5559ac611a6cd91d7","name":"Chris Stucchio","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/vwo.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/f2ff77ef7289c001d483036f17bd3f9e4f7b2f31995ce768e8e8bbba1e6c089c?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/f2ff77ef7289c001d483036f17bd3f9e4f7b2f31995ce768e8e8bbba1e6c089c?s=96&d=mm&r=g","caption":"Chris Stucchio"},"description":"Chris Stucchio has completed his Ph.D. from Rutgers University in Quantum Physics and has worked in medical imaging, predictive algorithms for eCommerce.","sameAs":["https:\/\/chrisstucchio.com"],"url":"https:\/\/vwo.com\/blog\/author\/chris-wingify\/"}]}},"_links":{"self":[{"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/posts\/32693","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/users\/87"}],"replies":[{"embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/comments?post=32693"}],"version-history":[{"count":49,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/posts\/32693\/revisions"}],"predecessor-version":[{"id":97660,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/posts\/32693\/revisions\/97660"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/media\/56641"}],"wp:attachment":[{"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/media?parent=32693"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/categories?post=32693"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/tags?post=32693"},{"taxonomy":"feature","embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/feature?post=32693"},{"taxonomy":"industry-type","embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/industry-type?post=32693"},{"taxonomy":"product","embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/product?post=32693"},{"taxonomy":"role","embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/role?post=32693"},{"taxonomy":"region","embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/region?post=32693"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}