{"id":22247,"date":"2014-05-16T22:49:17","date_gmt":"2014-05-16T17:19:17","guid":{"rendered":"https:\/\/vwo.com\/blog\/?p=22247"},"modified":"2025-05-05T17:58:48","modified_gmt":"2025-05-05T12:28:48","slug":"ab-testing-results-that-surprised-experts","status":"publish","type":"post","link":"https:\/\/vwo.com\/blog\/ab-testing-results-that-surprised-experts\/","title":{"rendered":"5 A\/B Testing Results that Surprised the Experts"},"content":{"rendered":"\n<p>One of the things I absolutely love about split testing is its inherent ability to humble the opinions of even the most seasoned marketers. Sometimes even the most <a href=\"https:\/\/vwo.com\/blog\/ab-testing-hypothesis\/\">well-researched hypotheses<\/a> fail.<\/p>\n\n\n\n<p>This is the strongest reason why companies must <a href=\"https:\/\/vwo.com\/testing\/\">test everything<\/a> from offer copy to page design, instead of relying on gut instinct or personal preference. In this post, I\u2019ll share success stories that either saw huge opinion disparity among the WhichTestWon community, or whose results absolutely shocked our editorial team and Testing Awards\u2019 judges.<\/p>\n\n\n\n<h2 class=\"wp-block-heading has-text-align-center\"><em><a href=\"https:\/\/vwo.com\/ab-testing\/#guide-download\"><span style=\"text-decoration: underline\">Download Free: A\/B Testing Guide<\/span><\/a><\/em><\/h2>\n\n\n<h2 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level1\" data-menu=\"1. Social proof is not necessarily the be-all and end-all\" id=\"1-social-proof-is-not-necessarily-the-be-all-and-end-all\" data-menu-id=\"1-social-proof-is-not-necessarily-the-be-all-and-end-all\" style=\"text-align:left\"><strong>1. Social proof is not necessarily the be-all and end-all<\/strong><\/h2>\n\n\n<p>Can you guess which of these two versions of a product page generated more sales for Finland-based eCommerce hardware store Taloon?<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1897\" height=\"1046\" src=\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2021\/09\/Artboard.png\" alt=\"taloon a\/b test\" class=\"wp-image-60155\" srcset=\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2021\/09\/Artboard.png 1897w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2021\/09\/Artboard.png?tr=w-1600 1600w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2021\/09\/Artboard.png?tr=w-1366 1366w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2021\/09\/Artboard.png?tr=w-1024 1024w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2021\/09\/Artboard.png?tr=w-768 768w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2021\/09\/Artboard.png?tr=w-640 640w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2021\/09\/Artboard.png?tr=w-375 375w\" sizes=\"(max-width: 1897px) 100vw, 1897px\" \/><\/figure>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"564\" height=\"207\" src=\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2021\/09\/Artboard-2.png\" alt=\"taloon a\/b test\" class=\"wp-image-60157\" srcset=\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2021\/09\/Artboard-2.png 564w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2021\/09\/Artboard-2.png?tr=w-375 375w\" sizes=\"(max-width: 564px) 100vw, 564px\" \/><\/figure>\n<\/div>\n\n\n<p>Like many people, you probably would guess the one with the <a href=\"https:\/\/vwo.com\/glossary\/social-proof\/\">social proof<\/a>. When I present this kind of comparison to live audiences at conferences, usually 90-95% of attendees pick the social proof version.<\/p>\n\n\n\n<p>However, they\u2019re all wrong. <a href=\"https:\/\/vwo.com\/success-stories\/taloon\/\">Taloon tested<\/a> the two versions using <a href=\"https:\/\/vwo.com\/testing\/?utm_source=page&amp;utm_medium=website&amp;utm_campaign=interlinking\">VWO Testing<\/a>, and the variation on the right \u2014 without the social proof \u2014 saw nearly 12% more purchases than its social proof counterpart.<\/p>\n\n\n\n<p>Normally we see companies just add social proof without testing it because virtually every blog post and \u2018social media expert\u2019 has told them it will help conversions. Thankfully the team at this site tested this before implementation, or they would have missed out on a lot of purchases.<\/p>\n\n\n\n<p>Don\u2019t get me wrong, there is a ton of value in social proof. For one, it is great at reducing a visitor\u2019s anxiety and can give your brand a sense of authority. The trick is finding out where it is best to publish your social stats and what exactly is worth sharing. Should you post newsletter subscribers, Facebook likes, awards, or all of the above? Simply put: test it out.<\/p>\n\n\n\n<p>The best part: <a href=\"https:\/\/vwo.com\/testing\/\">VWO Testing<\/a> makes this really simple.<\/p>\n\n\n\n<p>So, never add something blindly; you don\u2019t know how it will impact the bottom line.<\/p>\n\n\n<h2 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level1\" data-menu=\"2. Icons may be trending, but they might hurt conversions\" id=\"2-icons-may-be-trending-but-they-might-hurt-conversions\" data-menu-id=\"2-icons-may-be-trending-but-they-might-hurt-conversions\" style=\"text-align:left\"><strong>2. Icons may be trending, but they might hurt conversions<\/strong><\/h2>\n\n\n<p>Icons have been making a major comeback in web design. Overall, icons are incredibly useful, especially when they are used as a replacement for bullets in stylized lists. The team at Build.com wanted to find out whether icons would be a useful navigational tool\u2026the results surprised them.<\/p>\n\n\n\n<p>Here are the two versions of the header they tested, one with icons and one without:<\/p>\n\n\n\n<figure class=\"wp-block-image centered\"><img decoding=\"async\" src=\"https:\/\/static.wingify.com\/vwo\/uploads\/sites\/3\/2014\/05\/without_icons.png\" alt=\"Build.com a\/b test\" title=\"Without icons\" \/><\/figure>\n\n\n<div class=\"wp-block-image centered\">\n<figure class=\"aligncenter\"><img decoding=\"async\" src=\"https:\/\/static.wingify.com\/vwo\/uploads\/sites\/3\/2014\/05\/with_icons.png\" alt=\"Build.com a\/b test\" title=\"With icons\" \/><figcaption class=\"wp-element-caption\">Image source: <a href=\"http:\/\/www.build.com\" target=\"_blank\" rel=\"noreferrer noopener\">Build.com<\/a><br><\/figcaption><\/figure>\n<\/div>\n\n\n<p>The challenger variation included icons that represented different category pages on the site. The team believed that an increased focus on navigation with their most visited categories would increase interactions and sales. However, the version without the icons saw 21% more product purchases.<\/p>\n\n\n\n<p>Why? We suspect that although the icons provided a sleek navigation pane, overall they likely added more clutter that confused the visitor.<\/p>\n\n\n<h2 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level1\" data-menu=\"3. Security seal on a lead generation form test\" id=\"3-security-seal-on-a-lead-generation-form-test\" data-menu-id=\"3-security-seal-on-a-lead-generation-form-test\" style=\"text-align:left\"><strong>3. Security seal on a lead generation form test<\/strong><\/h2>\n\n\n<p>The highest point of friction on any lead generation page is the form itself. You need to identify the optimal number of form fields, choose an intuitive design, and add visible privacy policies and\/or security icons to reduce anxiety.<\/p>\n\n\n\n<p>These are well-known best practices that all lead gen marketers understand, and that\u2019s probably why 74% of the WhichTestWon community guessed the wrong winner for this <a href=\"https:\/\/vwo.com\/ab-testing\/\">A\/B test<\/a>.<\/p>\n\n\n<div class=\"wp-block-image centered\">\n<figure class=\"aligncenter\"><img decoding=\"async\" src=\"https:\/\/static.wingify.com\/vwo\/uploads\/sites\/3\/2014\/05\/without_trust_logo.png\" alt=\"Without trust seal\" title=\"Without trust seal\" \/><\/figure>\n<\/div>\n\n<div class=\"wp-block-image centered\">\n<figure class=\"aligncenter\"><img decoding=\"async\" src=\"https:\/\/static.wingify.com\/vwo\/uploads\/sites\/3\/2014\/05\/with_trust_logo.png\" alt=\"With trust seal\" title=\"With trust seal\" \/><\/figure>\n<\/div>\n\n\n<p>The variation without the TRUSTe logo got 12.6% more completed forms. Yes, the \u2018submit\u2019 button did shrink to accommodate the TRUSTe logo; but, we strongly suspect the primary cause for this lift has to do with the logo itself.<\/p>\n\n\n\n<p>Trust seals can be essential to your conversion rate; the real trick is knowing where and when to place them.<\/p>\n\n\n\n<p>In this particular circumstance, the TRUSTe logo was the wrong security seal at the wrong time. Visitors are used to seeing this seal, and others like it, directly in a shopping cart; not on a top-funnel lead generation form. It\u2019s quite likely that many of them suspected, or subconsciously sensed, a payment transaction when they saw the trust seal here.<\/p>\n\n\n\n<p>Instead of using a security seal, the team could have tested providing assurance by adding a simple fine-print text link to the privacy policy.<\/p>\n\n\n\n<p>Remember, context is key!<\/p>\n\n\n<h2 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level1\" data-menu=\"4. If conversion rates are falling, should you put on a happy face?\" id=\"4-if-conversion-rates-are-falling-should-you-put-on-a-happy-face\" data-menu-id=\"4-if-conversion-rates-are-falling-should-you-put-on-a-happy-face\" style=\"text-align:left\"><strong>4. If conversion rates are falling, should you put on a happy face?<\/strong><\/h2>\n\n\n<p><a href=\"https:\/\/vwo.com\/blog\/how-to-hire-cro\/\">CRO specialists<\/a> and designers love using faces! I get it; faces are the first thing the eye identifies when it looks at a web page. Numerous <a href=\"https:\/\/vwo.com\/blog\/eye-tracking-website-optimization\/\">eye-tracking studies<\/a> support this claim.<\/p>\n\n\n\n<p>However, sometimes a human face can actually be a distraction from the action you want the user to complete. So, always test when you add faces to your page to make sure they aren\u2019t competing with your important headlines and calls to action (CTAs).<\/p>\n\n\n\n<p>Here\u2019s an example:<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"973\" height=\"489\" src=\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/05\/Hubspot-case-study.png\" alt=\"Hubspot Case Study\" class=\"wp-image-60164\" srcset=\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/05\/Hubspot-case-study.png 973w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/05\/Hubspot-case-study.png?tr=w-768 768w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/05\/Hubspot-case-study.png?tr=w-640 640w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/05\/Hubspot-case-study.png?tr=w-375 375w\" sizes=\"(max-width: 973px) 100vw, 973px\" \/><figcaption class=\"wp-element-caption\">Image source: <a href=\"http:\/\/www.hubspot.com\">Hubspot<\/a><br><\/figcaption><\/figure>\n\n\n\n<p>The version without the image won 24% more form completions. This wasn\u2019t a perfectly clean test. There were some slight alterations in the copy but nothing too dramatic. To tell you the truth, I\u2019m more of a fan of the story behind this test than the actual unexpected results. However, it\u2019s not the first or the last test we\u2019ve seen where removing a face increased conversions.<\/p>\n\n\n\n<p>By the way: I am happy that the team used the photo of an actual employee rather than a stock photo. Models and stock photos tend to get <a href=\"https:\/\/vwo.com\/success-stories\/spectrum\/\">even worse conversions<\/a> than \u201creal\u201d people.<\/p>\n\n\n\n<p>What\u2019s perhaps most amazing is that at the time of this split test HubSpot was about to make it a mandatory practice to include a person\u2019s image on each of their landing pages. On some level this makes sense, as they had found that some of their pages performed better with people\u2019s pictures. However, what\u2019s true for some pages may not always be true for all pages. Luckily, this test cast a seed of doubt and Hubspot changed their design mandate.<\/p>\n\n\n\n<p>Before you create any new landing page or design policies, always <a href=\"https:\/\/vwo.com\/blog\/landing-page-testing\/\">test beforehand<\/a>. You have no idea just how many conversions you could leave on the table.<\/p>\n\n\n\n<h2 class=\"wp-block-heading has-text-align-center\"><em><a href=\"https:\/\/vwo.com\/ab-testing\/#guide-download\"><span style=\"text-decoration: underline\">Download Free: A\/B Testing Guide<\/span><\/a><\/em><\/h2>\n\n\n<h2 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level1\" data-menu=\"5. Video icons: product-centric or person-centric?\" id=\"5-video-icons-product-centric-or-person-centric\" data-menu-id=\"5-video-icons-product-centric-or-person-centric\" style=\"text-align:left\"><strong>5. Video icons: product-centric or person-centric?<\/strong><\/h2>\n\n\n<p>Here is another case that tests whether using a face is appropriate.<\/p>\n\n\n<div class=\"wp-block-image centered\">\n<figure class=\"aligncenter\"><img decoding=\"async\" src=\"https:\/\/static.wingify.com\/vwo\/uploads\/sites\/3\/2014\/05\/video_icons_1.png\" alt=\"Person-centric video thumbnails\" title=\"Person-centric video thumbnails\" \/><\/figure>\n<\/div>\n\n<div class=\"wp-block-image centered\">\n<figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"748\" height=\"240\" src=\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/05\/video_icons_2.png\" alt=\"Product-centric video thumbnails\" class=\"wp-image-22328\" title=\"Product-centric video thumbnails\" srcset=\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/05\/video_icons_2.png 748w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/05\/video_icons_2.png?tr=w-640 640w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/05\/video_icons_2.png?tr=w-375 375w\" sizes=\"(max-width: 748px) 100vw, 748px\" \/><figcaption class=\"wp-element-caption\">Image source: <a href=\"https:\/\/www.autodesk.com.au\/products\/autocad\/overview\" target=\"_blank\" rel=\"noreferrer noopener\">AutoCAD<\/a><br><\/figcaption><\/figure>\n<\/div>\n\n\n<p>The version of this Autodesk product page that used faces got 50% fewer video clicks. Nothing else on this page changed except for the video preview image. I am not anti-faces on websites; I simply want you to test before you implement!<\/p>\n\n\n\n<p>Needless to say, the testing team was surprised by the results. So they ran a user survey to try to figure it out. The responses showed that Autodesk\u2019s prospective buyers were more interested in seeing how the product worked over individuals talking about the product.<\/p>\n\n\n\n<p>This just comes down to a case of knowing your audience and that best practice is not one-size-fits-all!<\/p>\n\n\n<h2 class=\"js-cro-guide-subheading gtm_heading \" data-level=\"level1\" data-menu=\"In summary\" id=\"in-summary\" data-menu-id=\"in-summary\" style=\"text-align:left\"><strong>In summary<\/strong><\/h2>\n\n\n<p>Leaders in the testing field have all been stumped by the <a href=\"https:\/\/vwo.com\/blog\/leverage-bad-ab-test-results\/\">unexpected A\/B test results before<\/a>, and will be stumped again in the future. The trick is to understand what to do after your test goes counter to your hypothesis or flat-lines.<\/p>\n\n\n\n<p>Your next steps may include evaluating a litany of things such as your hypothesis, technology, source traffic, device, etc. You need to learn if the test itself was flawed, or if your understanding of what your visitors really want from the page was flawed. Either way, you\u2019ve learned something valuable.<\/p>\n\n\n\n<p>Remember that testing is an evolving process, future iterations are borne from our successes and our failures. Knowledge and insight is built over time.<\/p>\n\n\n\n<p>So<a href=\"https:\/\/vwo.com\/blog\/returns-from-ab-testing\/\"> keep testing <\/a>my friends! There are so many variables to consider while running a test, it is no wonder that we often see lifts or losses where we least expect them.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><a href=\"#free-trial\"><img loading=\"lazy\" decoding=\"async\" width=\"2400\" height=\"1256\" src=\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/05\/End-Banner_Your-Intuition-is-Wrong-\u2013-AB-Testing-Results-that-Surprised-the-Experts.png\" alt=\"Banner Ab Testing \" class=\"wp-image-60162\" srcset=\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/05\/End-Banner_Your-Intuition-is-Wrong-\u2013-AB-Testing-Results-that-Surprised-the-Experts.png 2400w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/05\/End-Banner_Your-Intuition-is-Wrong-\u2013-AB-Testing-Results-that-Surprised-the-Experts.png?tr=w-1600 1600w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/05\/End-Banner_Your-Intuition-is-Wrong-\u2013-AB-Testing-Results-that-Surprised-the-Experts.png?tr=w-1366 1366w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/05\/End-Banner_Your-Intuition-is-Wrong-\u2013-AB-Testing-Results-that-Surprised-the-Experts.png?tr=w-1024 1024w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/05\/End-Banner_Your-Intuition-is-Wrong-\u2013-AB-Testing-Results-that-Surprised-the-Experts.png?tr=w-768 768w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/05\/End-Banner_Your-Intuition-is-Wrong-\u2013-AB-Testing-Results-that-Surprised-the-Experts.png?tr=w-640 640w, https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/05\/End-Banner_Your-Intuition-is-Wrong-\u2013-AB-Testing-Results-that-Surprised-the-Experts.png?tr=w-375 375w\" sizes=\"(max-width: 2400px) 100vw, 2400px\" \/><\/a><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>One of the things I absolutely love about split testing is its inherent ability to humble the opinions of even the most seasoned marketers. Sometimes even the most well-researched hypotheses fail. This is the strongest reason why companies must test everything from offer copy to page design, instead of relying on gut instinct or personal&#8230;<\/p>\n","protected":false},"author":39,"featured_media":56818,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"post_read_time":7,"footnotes":""},"categories":[10676],"tags":[],"feature":[1852,10526],"industry-type":[],"product":[10626],"role":[10632],"region":[],"class_list":["post-22247","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-a-b-testing","feature-ab-testing","feature-experimentation-platform"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v26.9 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>5 A\/B Testing Results that Surprised the Experts | VWO<\/title>\n<meta name=\"description\" content=\"The best part about A\/B testing is its ability to humble the opinions of even the most seasoned testers. This post is a compilation of such surprising test results.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/vwo.com\/blog\/ab-testing-results-that-surprised-experts\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"5 A\/B Testing Results that Surprised the Experts | VWO\" \/>\n<meta property=\"og:description\" content=\"The best part about split testing is its inherent ability to humble opinions of even the most seasoned testers. This post is a compilation of such surprising results.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/vwo.com\/blog\/ab-testing-results-that-surprised-experts\/\" \/>\n<meta property=\"og:site_name\" content=\"Blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/vwoofficial\/\" \/>\n<meta property=\"article:published_time\" content=\"2014-05-16T17:19:17+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-05-05T12:28:48+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/05\/OG-image_Your-Intuition-is-Wrong-\u2013-AB-Testing-Results-that-Surprised-the-Experts.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"630\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Justin Rondeau\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@VWO\" \/>\n<meta name=\"twitter:site\" content=\"@VWO\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Justin Rondeau\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"8 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/vwo.com\/blog\/ab-testing-results-that-surprised-experts\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/vwo.com\/blog\/ab-testing-results-that-surprised-experts\/\"},\"author\":{\"name\":\"Justin Rondeau\",\"@id\":\"https:\/\/vwo.com\/blog\/#\/schema\/person\/a9f4f5b32e08564cefb226c2a4d15364\"},\"headline\":\"5 A\/B Testing Results that Surprised the Experts\",\"datePublished\":\"2014-05-16T17:19:17+00:00\",\"dateModified\":\"2025-05-05T12:28:48+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/vwo.com\/blog\/ab-testing-results-that-surprised-experts\/\"},\"wordCount\":1300,\"publisher\":{\"@id\":\"https:\/\/vwo.com\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/vwo.com\/blog\/ab-testing-results-that-surprised-experts\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/05\/Feature-image_Your-Intuition-is-Wrong-\u2013-AB-Testing-Results-that-Surprised-the-Experts.png\",\"articleSection\":[\"A\/B Testing\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/vwo.com\/blog\/ab-testing-results-that-surprised-experts\/\",\"url\":\"https:\/\/vwo.com\/blog\/ab-testing-results-that-surprised-experts\/\",\"name\":\"5 A\/B Testing Results that Surprised the Experts | VWO\",\"isPartOf\":{\"@id\":\"https:\/\/vwo.com\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/vwo.com\/blog\/ab-testing-results-that-surprised-experts\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/vwo.com\/blog\/ab-testing-results-that-surprised-experts\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/05\/Feature-image_Your-Intuition-is-Wrong-\u2013-AB-Testing-Results-that-Surprised-the-Experts.png\",\"datePublished\":\"2014-05-16T17:19:17+00:00\",\"dateModified\":\"2025-05-05T12:28:48+00:00\",\"description\":\"The best part about A\/B testing is its ability to humble the opinions of even the most seasoned testers. This post is a compilation of such surprising test results.\",\"breadcrumb\":{\"@id\":\"https:\/\/vwo.com\/blog\/ab-testing-results-that-surprised-experts\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/vwo.com\/blog\/ab-testing-results-that-surprised-experts\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/vwo.com\/blog\/ab-testing-results-that-surprised-experts\/#primaryimage\",\"url\":\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/05\/Feature-image_Your-Intuition-is-Wrong-\u2013-AB-Testing-Results-that-Surprised-the-Experts.png\",\"contentUrl\":\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/05\/Feature-image_Your-Intuition-is-Wrong-\u2013-AB-Testing-Results-that-Surprised-the-Experts.png\",\"width\":1200,\"height\":700,\"caption\":\"Your Intuition Is Wrong \u2013 Ab Testing Results That Surprised The Experts\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/vwo.com\/blog\/ab-testing-results-that-surprised-experts\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/vwo.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"A\/B Testing\",\"item\":\"https:\/\/vwo.com\/blog\/a-b-testing\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"5 A\/B Testing Results that Surprised the Experts\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/vwo.com\/blog\/#website\",\"url\":\"https:\/\/vwo.com\/blog\/\",\"name\":\"Blog\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/vwo.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/vwo.com\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/vwo.com\/blog\/#organization\",\"name\":\"VWO\",\"url\":\"https:\/\/vwo.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/vwo.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2018\/09\/VWOLogo.png\",\"contentUrl\":\"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2018\/09\/VWOLogo.png\",\"width\":780,\"height\":492,\"caption\":\"VWO\"},\"image\":{\"@id\":\"https:\/\/vwo.com\/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/vwoofficial\/\",\"https:\/\/x.com\/VWO\",\"https:\/\/www.instagram.com\/vwoofficial\/\",\"https:\/\/www.linkedin.com\/company\/vwo\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/vwo.com\/blog\/#\/schema\/person\/a9f4f5b32e08564cefb226c2a4d15364\",\"name\":\"Justin Rondeau\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/vwo.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/e6ed3c50be7c6bbe5c0c8c13915be8801c435625d2cf31f1671a6312ed1866e8?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/e6ed3c50be7c6bbe5c0c8c13915be8801c435625d2cf31f1671a6312ed1866e8?s=96&d=mm&r=g\",\"caption\":\"Justin Rondeau\"},\"description\":\"I\u2019m a tech-savvy marketer that runs toward change and loves puzzles. Bridging the gap between sales and marketing is a business puzzle worth tackling and I approach it with data, creativity, and technology.\",\"url\":\"https:\/\/vwo.com\/blog\/author\/justin-r\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"5 A\/B Testing Results that Surprised the Experts | VWO","description":"The best part about A\/B testing is its ability to humble the opinions of even the most seasoned testers. This post is a compilation of such surprising test results.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/vwo.com\/blog\/ab-testing-results-that-surprised-experts\/","og_locale":"en_US","og_type":"article","og_title":"5 A\/B Testing Results that Surprised the Experts | VWO","og_description":"The best part about split testing is its inherent ability to humble opinions of even the most seasoned testers. This post is a compilation of such surprising results.","og_url":"https:\/\/vwo.com\/blog\/ab-testing-results-that-surprised-experts\/","og_site_name":"Blog","article_publisher":"https:\/\/www.facebook.com\/vwoofficial\/","article_published_time":"2014-05-16T17:19:17+00:00","article_modified_time":"2025-05-05T12:28:48+00:00","og_image":[{"width":1200,"height":630,"url":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/05\/OG-image_Your-Intuition-is-Wrong-\u2013-AB-Testing-Results-that-Surprised-the-Experts.png","type":"image\/png"}],"author":"Justin Rondeau","twitter_card":"summary_large_image","twitter_creator":"@VWO","twitter_site":"@VWO","twitter_misc":{"Written by":"Justin Rondeau","Est. reading time":"8 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/vwo.com\/blog\/ab-testing-results-that-surprised-experts\/#article","isPartOf":{"@id":"https:\/\/vwo.com\/blog\/ab-testing-results-that-surprised-experts\/"},"author":{"name":"Justin Rondeau","@id":"https:\/\/vwo.com\/blog\/#\/schema\/person\/a9f4f5b32e08564cefb226c2a4d15364"},"headline":"5 A\/B Testing Results that Surprised the Experts","datePublished":"2014-05-16T17:19:17+00:00","dateModified":"2025-05-05T12:28:48+00:00","mainEntityOfPage":{"@id":"https:\/\/vwo.com\/blog\/ab-testing-results-that-surprised-experts\/"},"wordCount":1300,"publisher":{"@id":"https:\/\/vwo.com\/blog\/#organization"},"image":{"@id":"https:\/\/vwo.com\/blog\/ab-testing-results-that-surprised-experts\/#primaryimage"},"thumbnailUrl":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/05\/Feature-image_Your-Intuition-is-Wrong-\u2013-AB-Testing-Results-that-Surprised-the-Experts.png","articleSection":["A\/B Testing"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/vwo.com\/blog\/ab-testing-results-that-surprised-experts\/","url":"https:\/\/vwo.com\/blog\/ab-testing-results-that-surprised-experts\/","name":"5 A\/B Testing Results that Surprised the Experts | VWO","isPartOf":{"@id":"https:\/\/vwo.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/vwo.com\/blog\/ab-testing-results-that-surprised-experts\/#primaryimage"},"image":{"@id":"https:\/\/vwo.com\/blog\/ab-testing-results-that-surprised-experts\/#primaryimage"},"thumbnailUrl":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/05\/Feature-image_Your-Intuition-is-Wrong-\u2013-AB-Testing-Results-that-Surprised-the-Experts.png","datePublished":"2014-05-16T17:19:17+00:00","dateModified":"2025-05-05T12:28:48+00:00","description":"The best part about A\/B testing is its ability to humble the opinions of even the most seasoned testers. This post is a compilation of such surprising test results.","breadcrumb":{"@id":"https:\/\/vwo.com\/blog\/ab-testing-results-that-surprised-experts\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/vwo.com\/blog\/ab-testing-results-that-surprised-experts\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/vwo.com\/blog\/ab-testing-results-that-surprised-experts\/#primaryimage","url":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/05\/Feature-image_Your-Intuition-is-Wrong-\u2013-AB-Testing-Results-that-Surprised-the-Experts.png","contentUrl":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2014\/05\/Feature-image_Your-Intuition-is-Wrong-\u2013-AB-Testing-Results-that-Surprised-the-Experts.png","width":1200,"height":700,"caption":"Your Intuition Is Wrong \u2013 Ab Testing Results That Surprised The Experts"},{"@type":"BreadcrumbList","@id":"https:\/\/vwo.com\/blog\/ab-testing-results-that-surprised-experts\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/vwo.com\/blog\/"},{"@type":"ListItem","position":2,"name":"A\/B Testing","item":"https:\/\/vwo.com\/blog\/a-b-testing\/"},{"@type":"ListItem","position":3,"name":"5 A\/B Testing Results that Surprised the Experts"}]},{"@type":"WebSite","@id":"https:\/\/vwo.com\/blog\/#website","url":"https:\/\/vwo.com\/blog\/","name":"Blog","description":"","publisher":{"@id":"https:\/\/vwo.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/vwo.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/vwo.com\/blog\/#organization","name":"VWO","url":"https:\/\/vwo.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/vwo.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2018\/09\/VWOLogo.png","contentUrl":"https:\/\/static.wingify.com\/gcp\/uploads\/sites\/3\/2018\/09\/VWOLogo.png","width":780,"height":492,"caption":"VWO"},"image":{"@id":"https:\/\/vwo.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/vwoofficial\/","https:\/\/x.com\/VWO","https:\/\/www.instagram.com\/vwoofficial\/","https:\/\/www.linkedin.com\/company\/vwo"]},{"@type":"Person","@id":"https:\/\/vwo.com\/blog\/#\/schema\/person\/a9f4f5b32e08564cefb226c2a4d15364","name":"Justin Rondeau","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/vwo.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/e6ed3c50be7c6bbe5c0c8c13915be8801c435625d2cf31f1671a6312ed1866e8?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/e6ed3c50be7c6bbe5c0c8c13915be8801c435625d2cf31f1671a6312ed1866e8?s=96&d=mm&r=g","caption":"Justin Rondeau"},"description":"I\u2019m a tech-savvy marketer that runs toward change and loves puzzles. Bridging the gap between sales and marketing is a business puzzle worth tackling and I approach it with data, creativity, and technology.","url":"https:\/\/vwo.com\/blog\/author\/justin-r\/"}]}},"_links":{"self":[{"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/posts\/22247","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/users\/39"}],"replies":[{"embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/comments?post=22247"}],"version-history":[{"count":34,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/posts\/22247\/revisions"}],"predecessor-version":[{"id":87877,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/posts\/22247\/revisions\/87877"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/media\/56818"}],"wp:attachment":[{"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/media?parent=22247"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/categories?post=22247"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/tags?post=22247"},{"taxonomy":"feature","embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/feature?post=22247"},{"taxonomy":"industry-type","embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/industry-type?post=22247"},{"taxonomy":"product","embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/product?post=22247"},{"taxonomy":"role","embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/role?post=22247"},{"taxonomy":"region","embeddable":true,"href":"https:\/\/vwo.com\/blog\/wp-json\/wp\/v2\/region?post=22247"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}