Follow us and stay on top of everything CRO
Webinar

Front-End Development For A/B Testing: How To Get It Right

Duration - 45 minutes

Key Takeaways

  • The webinar emphasized the importance of experimentation in development. Instead of building 10 features, build tests for those 10 features and only fully develop the ones that prove valuable.
  • It's more cost-effective to build and run an experiment in an AB testing platform than to fully build a feature in production. This is because there are more processes involved in building into production that aren't necessary when building an AB test.
  • The speaker highlighted the concept of a "painted door test" - a minimal, cost-effective way to test an idea. For example, instead of fully integrating PayPal or Klarna, you can simply add a button for these services and monitor who clicks on it.
  • The webinar stressed the importance of breaking down potentially large builds into smaller, testable components. This not only saves cost but also allows for more efficient testing and validation of ideas.
  • The speaker also discussed the idea of implementing product reviews on a website. Instead of building the entire functionality, you can start by testing the idea with a smaller, manageable feature.

Summary of the session

The webinar, led by Johnny from Journey Further, focused on the importance of AB testing and efficient front-end development. Johnny emphasized the need for testing small changes before investing in large-scale redesigns or new features. He suggested starting with basic functionality to test if a concept is worth pursuing, such as allowing users to submit reviews or investing in new product photography. 

Johnny stressed the importance of efficiency in AB testing, stating that it’s about quick testing to validate ideas and avoid wasting money on development. He also highlighted the need for developers to have a broad skill set, not just coding abilities. Developers should understand the wider implications of their work and have some design and creative skills. 

The webinar concluded with a Q&A session, where attendees had the opportunity to ask Johnny questions directly. Vivianz, the host, thanked Johnny for his insightful presentation and encouraged attendees to reach out with further questions. The webinar was a valuable resource for anyone interested in AB testing and efficient front-end development.

Webinar Video

Webinar Deck

Top questions asked by the audience

  • I'd love to hear a bit more from you about running multiple experiments concurrently with the same primary metric measuring the same primary metric and how you usually view the risk of cross interference, especially when you launch them at different times, and you close them at different times.

    - by Clement
    Booking.com is a great example of a company that runs thousands of experiments concurrently on a single page without worrying about interference. The majority of advanced companies don't worry about r ...unning concurrent experiments. From a statistical point of view, if your tool is randomizing things correctly and there are no technical flaws in how it's working, you are always controlling only for the one variable that the test is controlling for. The only risk is if your tests are polluting each other from the perspective of user experience. For example, one test might be telling users to click a button, and another test might remove that button. So, you need to have some guardrails and ways of checking that tests aren't interfering with each other from a user experience perspective.

Transcription

Disclaimer- Please be aware that the content below is computer-generated, so kindly disregard any potential errors or shortcomings.

Hello, everyone. Thank you so much for joining the vw webinar, where we always try to upgrade and inspire you with everything around experimentation, and conversion rate optimization. I’m your host, Vivianz. I’m a marketing manager at VW0A full funnel and experimentation platform. Today, we have a special guest, where ...