{"id":316,"date":"2023-11-21T09:46:44","date_gmt":"2023-11-21T09:46:44","guid":{"rendered":"https:\/\/vwo.com\/stats-blog\/?p=316"},"modified":"2023-11-21T09:46:45","modified_gmt":"2023-11-21T09:46:45","slug":"the-relationship-behind-statistical-significance","status":"publish","type":"post","link":"https:\/\/vwo.com\/stats-blog\/the-relationship-behind-statistical-significance\/","title":{"rendered":"The Relationship Behind Statistical Significance"},"content":{"rendered":"<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"582\" src=\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_cover_image-1024x582.png\" alt=\"\" class=\"wp-image-317\" srcset=\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_cover_image-1024x582.png 1024w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_cover_image-300x171.png 300w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_cover_image-768x437.png 768w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_cover_image-1536x873.png 1536w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_cover_image-703x400.png 703w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_cover_image.png 1792w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\">Generated via Open AI Dall-E 3<\/figcaption><\/figure>\n<\/div>\n\n\n<p>A logician and a statistician were walking through a forest when they came across a river. A safety sign near the river said &#8211; <em>the river is 4 feet deep on average<\/em>. The logician reasoned that he is about 6 feet tall, and hence should be able to cross the river with ease. The logician walked in and drowned, while the statistician returned. Why did the statistician choose not to cross the river?<\/p>\n\n\n\n<p>When faced with randomness, the immediate instinct of most is to ask for what happens on average. However, the statistician knows that the average can often be a convenient answer to hide the truth. The truth about how good or how bad things can be on the extreme. Some metrics deviate only slightly around the average, whereas others show big deviations on both sides that render the average meaningless. The statistician chose not to cross the river because it could have been very shallow in some places and very deep in others, still being <em>4 feet deep on average<\/em>.<\/p>\n\n\n\n<p>Most statistical methods hence take into consideration the standard deviation which has come to be the accepted measure for the spread of data. If the standard deviation is high, the data is widely spread. If the standard deviation is low, the data is tightly bound around the average. The average represents the central tendency of the metric if all the randomness were to be stripped apart. The standard deviation represents the chaos that renders the randomness in the first place.<\/p>\n\n\n\n<p>The standard deviation plays a pivotal role in determining the statistical significance as it acts as the yardstick to compare the effect-size against. While <a href=\"https:\/\/vwo.com\/stats-blog\/the-forces-behind-statistical-significance\/\">the previous post explained<\/a> the three forces behind statistical significance, this post will intuitively explain the relationship between these three forces. All that statistical significance is can be broken down into the following relationship:<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"207\" src=\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_relationship_of_statsig_0-1024x207.png\" alt=\"\" class=\"wp-image-318\" srcset=\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_relationship_of_statsig_0-1024x207.png 1024w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_relationship_of_statsig_0-300x61.png 300w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_relationship_of_statsig_0-768x155.png 768w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_relationship_of_statsig_0-800x162.png 800w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_relationship_of_statsig_0.png 1416w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n<\/div>\n\n\n<p>To build an intuition of the relationship above, we need to break it down into two parts and explore it piece by piece.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>Effect Size &#8211; Standard Deviation Ratio<\/strong><\/h2>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"628\" src=\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_relationship_of_statsig_1-1024x628.jpeg\" alt=\"\" class=\"wp-image-319\" srcset=\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_relationship_of_statsig_1-1024x628.jpeg 1024w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_relationship_of_statsig_1-300x184.jpeg 300w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_relationship_of_statsig_1-768x471.jpeg 768w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_relationship_of_statsig_1-652x400.jpeg 652w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_relationship_of_statsig_1-rotated.jpeg 1444w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\">Self-drawn<\/figcaption><\/figure>\n<\/div>\n\n\n<p>Let us start by reminding ourselves that the purpose of statistical significance is to tell us if the observed difference between two groups is statistically significant or not. In other words, is the difference larger than what you would expect purely by chance?<\/p>\n\n\n\n<p>It is worth noting here that any two groups of random samples can never show exactly the same average (assuming the group is large enough). So, whenever you calculate the average of the two groups, there will be some difference between the two averages. The question is if this difference is large enough. Answering this question, demands a yard-stick to compare the difference. This yard-stick is the standard deviation.<\/p>\n\n\n\n<p>For understanding, observe the sketch above. The blue signal represents the variation and the red signal represents the control. There are two cases shown. Both have the same average value of control and variation (10 and 12 respectively) and the same average difference as well (2). However, the upper one has a much greater standard deviation of 5, whereas the lower one has a lesser standard deviation of 1. Now visually zoom out and judge, which of the two signals seem well separated.<\/p>\n\n\n\n<p>Note that even when the averages are the same, the one with the lower standard deviation seems to be well separated and hence the effect size of 2 seems more statistically significant in the second case. The ratio between the effect-size and the standard deviation is the fundamental determinant behind statistical significance. As this ratio rises, the effect-size becomes more statistically significant. As this ratio falls, the effect-size becomes less statistically significant.<\/p>\n\n\n\n<p>But wait, where does sample size fit in?<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>The Standard Deviation of the Mean<\/strong><\/h2>\n\n\n\n<p>To understand the role of sample sizes in statistical significance, we need to first understand the difference between the standard deviation of the <em>samples<\/em> and the standard deviation of the <em>mean<\/em>. Note that while measuring statistical significance, we essentially intend to compare the means of the two populations and not exactly the samples. Statistical significance aims to calculate the chance that the two groups behave differently<em> \u2018on average\u2019<\/em>.&nbsp;<\/p>\n\n\n\n<p>To understand further, suppose you are running an A\/B test and want to test if the variant improves the revenue per sale on your website. Note that every visitor will give some revenue on your website. <strong>You do not intend to improve the revenue given by every visitor, you only intend to improve the revenue per sale on average. <\/strong>This means that if a visitor on average gives a 5$ revenue on control, and 5.1$ on variation, you will still consider the variation to be a winner. This may include many visitors on variation who give a lesser revenue than many visitors on control. But what matters is that <em>on average<\/em> the variation performed better.<\/p>\n\n\n\n<p>Note that the standard deviation we understand is that of the <em>samples. <\/em>So, if the revenue samples vary between 3$ &#8211; 7$, it represents the spread of the <em>samples<\/em> and not that of the <em>mean<\/em>.<\/p>\n\n\n\n<p>In the effect-size vs standard deviation ratio, what should come in the denominator is not the standard deviation of the samples but rather that of the mean. Calculating the standard deviation of the samples is straightforward, but to calculate the standard deviation of the <em>mean<\/em>, we need to understand the perspective of sampling theory.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>The Population Mean and The Sample Mean<\/strong><\/h2>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"982\" height=\"1024\" src=\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_relationship_of_statsig_2-982x1024.jpeg\" alt=\"\" class=\"wp-image-320\" srcset=\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_relationship_of_statsig_2-982x1024.jpeg 982w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_relationship_of_statsig_2-288x300.jpeg 288w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_relationship_of_statsig_2-768x801.jpeg 768w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_relationship_of_statsig_2-384x400.jpeg 384w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_relationship_of_statsig_2-rotated.jpeg 1120w\" sizes=\"(max-width: 982px) 100vw, 982px\" \/><figcaption class=\"wp-element-caption\">Self-drawn<\/figcaption><\/figure>\n<\/div>\n\n\n<p>Sampling Theory is an integral part of statistics because to resolve randomness in any process, a statistician first needs a sample to work with. Sampling Theory starts by first differentiating the sample from the population. The population is the entire set of entities that you are concerned with. For instance, in the case of an A\/B test, this population is the set of all the visitors that your website will ever have. <\/p>\n\n\n\n<p>However, you can only observe a <em>sample<\/em>, and never the entire population. But on the contrary, what you are really interested in is the population mean which is latent and unobservable. What you get is the sample mean which will change slightly every time you collect a random sample.<\/p>\n\n\n\n<p>Sampling Theory gives us the relationship between the population mean and the sample mean. Let us imagine a flat 2-dimensional pie that represents the entire population. Let us also assume that the center of the pie represents the population mean and the width of the pie represents the spread of the data. So, if the metric of interest is widely spread around the mean, the wider will be the pie. Hence, the width of the pie corresponds to the standard deviation of the <em>samples<\/em>.<\/p>\n\n\n\n<p>Now suppose you collect a sample on the pie, which is sort of like some randomly placed blueberries on the surface. These blueberries are the samples whose positions are known. You now calculate the center of all these blueberries which is the <em>sample<\/em> mean. <strong>The question is, how far is the center of the blueberries (the sample mean) from the center of the pie (the population mean)<\/strong>? (Observe the sketch drawn above).<\/p>\n\n\n\n<p>Sampling Theory tells us that the difference between the sample mean and the population mean depends on two things: Firstly, the overall width of the pie (the standard deviation of the <em>samples<\/em>) and the secondly, the number of blueberries (the sample size). <\/p>\n\n\n\n<p>The difference between the sample mean and the population mean is the standard deviation of the <em>mean<\/em> and is also called the standard error. Since, the population mean in reality is unobservable, the standard error reports the uncertainty in the sample mean. The exact formula can be observed in the sketch drawn.<\/p>\n\n\n\n<p>If you substitute the standard deviation of the mean in the effect-size vs standard deviation ratio, you see that the formula given in the introduction emerges. Take a minute to observe how both ideas come together to define statistical significance.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>Conclusion<\/strong><\/h2>\n\n\n\n<p>There are various procedures in statistics for determining statistical significance in different contexts. However, the core intuition of all procedures boils down to the same three factors in different contexts. A very interesting debate in statistics is that of the Frequentists and the Bayesians and how they calculate statistical significance using their own assumptions. Frequentist and Bayesian are two ways of looking at the same thing and in practice rely on the same relationship that has been explained in this post.<\/p>\n\n\n\n<p>However, both perspectives are interesting in their own right and the difference between them is critical once you understand it. Bayesians introduce a fourth variable in statistical significance, the prior. The prior is something that is neither easy to estimate nor easy to refute but as we will see it does matter depending on how philosophically you choose to see the world.<\/p>\n\n\n\n<p>In the upcoming posts, we will carry the exploration forward with this fourth variable and then dive deep into the debate between the Frequentists and the Bayesians.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"425\" src=\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_relationship_of_statsig_3-1024x425.png\" alt=\"\" class=\"wp-image-321\" srcset=\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_relationship_of_statsig_3-1024x425.png 1024w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_relationship_of_statsig_3-300x125.png 300w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_relationship_of_statsig_3-768x319.png 768w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_relationship_of_statsig_3-800x332.png 800w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_relationship_of_statsig_3.png 1163w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\">Source: <a href=\"http:\/\/unbiasedresearch.blogspot.com\/2016\/04\/its-not-you-its-p.html\">Unbiased Research<\/a><\/figcaption><\/figure>\n<\/div>","protected":false},"excerpt":{"rendered":"<p>The statistical explanation behind how the different forces of statistical significance are related to each other.<\/p>\n","protected":false},"author":528,"featured_media":317,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[6],"tags":[],"class_list":["post-316","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-statistics"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v26.9 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>The Relationship Behind Statistical Significance - VWO Stats Blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/vwo.com\/stats-blog\/the-relationship-behind-statistical-significance\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"The Relationship Behind Statistical Significance - VWO Stats Blog\" \/>\n<meta property=\"og:description\" content=\"The statistical explanation behind how the different forces of statistical significance are related to each other.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/vwo.com\/stats-blog\/the-relationship-behind-statistical-significance\/\" \/>\n<meta property=\"og:site_name\" content=\"VWO Stats Blog\" \/>\n<meta property=\"article:published_time\" content=\"2023-11-21T09:46:44+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-11-21T09:46:45+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_cover_image-1024x582.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"582\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Ishan Goel\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Ishan Goel\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"8 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/vwo.com\/stats-blog\/the-relationship-behind-statistical-significance\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/vwo.com\/stats-blog\/the-relationship-behind-statistical-significance\/\"},\"author\":{\"name\":\"Ishan Goel\",\"@id\":\"https:\/\/vwo.com\/stats-blog\/#\/schema\/person\/e2b5d8a142dd1f391ee6a9aee14caf72\"},\"headline\":\"The Relationship Behind Statistical Significance\",\"datePublished\":\"2023-11-21T09:46:44+00:00\",\"dateModified\":\"2023-11-21T09:46:45+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/vwo.com\/stats-blog\/the-relationship-behind-statistical-significance\/\"},\"wordCount\":1486,\"commentCount\":0,\"image\":{\"@id\":\"https:\/\/vwo.com\/stats-blog\/the-relationship-behind-statistical-significance\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_cover_image.png\",\"articleSection\":[\"Statistics\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/vwo.com\/stats-blog\/the-relationship-behind-statistical-significance\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/vwo.com\/stats-blog\/the-relationship-behind-statistical-significance\/\",\"url\":\"https:\/\/vwo.com\/stats-blog\/the-relationship-behind-statistical-significance\/\",\"name\":\"The Relationship Behind Statistical Significance - VWO Stats Blog\",\"isPartOf\":{\"@id\":\"https:\/\/vwo.com\/stats-blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/vwo.com\/stats-blog\/the-relationship-behind-statistical-significance\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/vwo.com\/stats-blog\/the-relationship-behind-statistical-significance\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_cover_image.png\",\"datePublished\":\"2023-11-21T09:46:44+00:00\",\"dateModified\":\"2023-11-21T09:46:45+00:00\",\"author\":{\"@id\":\"https:\/\/vwo.com\/stats-blog\/#\/schema\/person\/e2b5d8a142dd1f391ee6a9aee14caf72\"},\"breadcrumb\":{\"@id\":\"https:\/\/vwo.com\/stats-blog\/the-relationship-behind-statistical-significance\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/vwo.com\/stats-blog\/the-relationship-behind-statistical-significance\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/vwo.com\/stats-blog\/the-relationship-behind-statistical-significance\/#primaryimage\",\"url\":\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_cover_image.png\",\"contentUrl\":\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_cover_image.png\",\"width\":1792,\"height\":1019},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/vwo.com\/stats-blog\/the-relationship-behind-statistical-significance\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/vwo.com\/stats-blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"The Relationship Behind Statistical Significance\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/vwo.com\/stats-blog\/#website\",\"url\":\"https:\/\/vwo.com\/stats-blog\/\",\"name\":\"VWO Stats Blog\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/vwo.com\/stats-blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/vwo.com\/stats-blog\/#\/schema\/person\/e2b5d8a142dd1f391ee6a9aee14caf72\",\"name\":\"Ishan Goel\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/vwo.com\/stats-blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/6117b4ba8d739a72b4b89659e16d0e34e11ce78a6718d78b71743eee5628bc9d?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/6117b4ba8d739a72b4b89659e16d0e34e11ce78a6718d78b71743eee5628bc9d?s=96&d=mm&r=g\",\"caption\":\"Ishan Goel\"},\"description\":\"Ishan Goel leads research in statistical significance at VWO. In the past few years, he has researched over the most pressing problems of experimentation and designed a new stats engine at VWO. He actively shares his learnings on the VWO Stats Blog with the broader experimentation community.\",\"sameAs\":[\"https:\/\/www.linkedin.com\/in\/i-goel\/\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"The Relationship Behind Statistical Significance - VWO Stats Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/vwo.com\/stats-blog\/the-relationship-behind-statistical-significance\/","og_locale":"en_US","og_type":"article","og_title":"The Relationship Behind Statistical Significance - VWO Stats Blog","og_description":"The statistical explanation behind how the different forces of statistical significance are related to each other.","og_url":"https:\/\/vwo.com\/stats-blog\/the-relationship-behind-statistical-significance\/","og_site_name":"VWO Stats Blog","article_published_time":"2023-11-21T09:46:44+00:00","article_modified_time":"2023-11-21T09:46:45+00:00","og_image":[{"width":1024,"height":582,"url":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_cover_image-1024x582.png","type":"image\/png"}],"author":"Ishan Goel","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Ishan Goel","Est. reading time":"8 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/vwo.com\/stats-blog\/the-relationship-behind-statistical-significance\/#article","isPartOf":{"@id":"https:\/\/vwo.com\/stats-blog\/the-relationship-behind-statistical-significance\/"},"author":{"name":"Ishan Goel","@id":"https:\/\/vwo.com\/stats-blog\/#\/schema\/person\/e2b5d8a142dd1f391ee6a9aee14caf72"},"headline":"The Relationship Behind Statistical Significance","datePublished":"2023-11-21T09:46:44+00:00","dateModified":"2023-11-21T09:46:45+00:00","mainEntityOfPage":{"@id":"https:\/\/vwo.com\/stats-blog\/the-relationship-behind-statistical-significance\/"},"wordCount":1486,"commentCount":0,"image":{"@id":"https:\/\/vwo.com\/stats-blog\/the-relationship-behind-statistical-significance\/#primaryimage"},"thumbnailUrl":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_cover_image.png","articleSection":["Statistics"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/vwo.com\/stats-blog\/the-relationship-behind-statistical-significance\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/vwo.com\/stats-blog\/the-relationship-behind-statistical-significance\/","url":"https:\/\/vwo.com\/stats-blog\/the-relationship-behind-statistical-significance\/","name":"The Relationship Behind Statistical Significance - VWO Stats Blog","isPartOf":{"@id":"https:\/\/vwo.com\/stats-blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/vwo.com\/stats-blog\/the-relationship-behind-statistical-significance\/#primaryimage"},"image":{"@id":"https:\/\/vwo.com\/stats-blog\/the-relationship-behind-statistical-significance\/#primaryimage"},"thumbnailUrl":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_cover_image.png","datePublished":"2023-11-21T09:46:44+00:00","dateModified":"2023-11-21T09:46:45+00:00","author":{"@id":"https:\/\/vwo.com\/stats-blog\/#\/schema\/person\/e2b5d8a142dd1f391ee6a9aee14caf72"},"breadcrumb":{"@id":"https:\/\/vwo.com\/stats-blog\/the-relationship-behind-statistical-significance\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/vwo.com\/stats-blog\/the-relationship-behind-statistical-significance\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/vwo.com\/stats-blog\/the-relationship-behind-statistical-significance\/#primaryimage","url":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_cover_image.png","contentUrl":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/20\/2023\/11\/10_cover_image.png","width":1792,"height":1019},{"@type":"BreadcrumbList","@id":"https:\/\/vwo.com\/stats-blog\/the-relationship-behind-statistical-significance\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/vwo.com\/stats-blog\/"},{"@type":"ListItem","position":2,"name":"The Relationship Behind Statistical Significance"}]},{"@type":"WebSite","@id":"https:\/\/vwo.com\/stats-blog\/#website","url":"https:\/\/vwo.com\/stats-blog\/","name":"VWO Stats Blog","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/vwo.com\/stats-blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/vwo.com\/stats-blog\/#\/schema\/person\/e2b5d8a142dd1f391ee6a9aee14caf72","name":"Ishan Goel","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/vwo.com\/stats-blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/6117b4ba8d739a72b4b89659e16d0e34e11ce78a6718d78b71743eee5628bc9d?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/6117b4ba8d739a72b4b89659e16d0e34e11ce78a6718d78b71743eee5628bc9d?s=96&d=mm&r=g","caption":"Ishan Goel"},"description":"Ishan Goel leads research in statistical significance at VWO. In the past few years, he has researched over the most pressing problems of experimentation and designed a new stats engine at VWO. He actively shares his learnings on the VWO Stats Blog with the broader experimentation community.","sameAs":["https:\/\/www.linkedin.com\/in\/i-goel\/"]}]}},"_links":{"self":[{"href":"https:\/\/vwo.com\/stats-blog\/wp-json\/wp\/v2\/posts\/316","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/vwo.com\/stats-blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/vwo.com\/stats-blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/vwo.com\/stats-blog\/wp-json\/wp\/v2\/users\/528"}],"replies":[{"embeddable":true,"href":"https:\/\/vwo.com\/stats-blog\/wp-json\/wp\/v2\/comments?post=316"}],"version-history":[{"count":7,"href":"https:\/\/vwo.com\/stats-blog\/wp-json\/wp\/v2\/posts\/316\/revisions"}],"predecessor-version":[{"id":337,"href":"https:\/\/vwo.com\/stats-blog\/wp-json\/wp\/v2\/posts\/316\/revisions\/337"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/vwo.com\/stats-blog\/wp-json\/wp\/v2\/media\/317"}],"wp:attachment":[{"href":"https:\/\/vwo.com\/stats-blog\/wp-json\/wp\/v2\/media?parent=316"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/vwo.com\/stats-blog\/wp-json\/wp\/v2\/categories?post=316"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/vwo.com\/stats-blog\/wp-json\/wp\/v2\/tags?post=316"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}