Results

Humans vs AI

A/B testing OpenAI's GPT-3

In this friendly competition, we tested AI-generated copy against human-written copy for participating websites. Check out the results of the ongoing competition below.

0

πŸ‘© Human Copy Wins

1

πŸ€– AI Copy Wins

0

πŸ‘© Human & πŸ€– AI Tie

13

Confirmed participants
(+ more expected soon)

11

Awaiting Results

1

Inconclusive

Sorted by recency of results

Website

Test Type

Industry

Uplift %

Statistical Significance

Winner

Soapbox

Website
Test Type

Headline

Industry

SaaS

Uplift %

-

Statistical Significance

-

Winner

πŸ€”Inconclusive

πŸ‘© Human Copy
Human Copy 1
Soapbox Human Copy
πŸ€– AI Copy
AI Variation 1
Soapbox Ai Copy

The test has been deemed inconclusive since it was paused by the participating website before achieving the statistical significance threshold of 90%.

Schneiders

Website
Test Type

Offer CTA

Industry

eCommerce

Uplift %

7.06%

Statistical Significance

91%

Winner

πŸ€–AI Copy

πŸ‘© Human Copy
Human Copy 1
Schneiders Human Copy 2x
πŸ€– AI Copy
AI Variation 1
Schneiders Ai Copy Variation 1 2x

Website 1

Test Type

Headline

Industry

Finance

Uplift %

-

Statistical Significance

-

Winner

⏱Awaiting Results

πŸ‘© Human Copy
Human Copy 1
Mogo Human Copy Blurred
πŸ€– AI Copy
AI Variation 1
Mogo Ai Copy Blurred

Website 2

Test Type

Headline

Industry

Travel & Hospitality

Uplift %

-

Statistical Significance

-

Winner

⏱Awaiting Results

πŸ‘© Human Copy
Human Copy 1
Rv Trader Human Copy Blurred
πŸ€– AI Copy
AI Variation 1
Rv Trader Ai Copy Blurred

Website 3

Test Type

Headline

Industry

Logistics

Uplift %

-

Statistical Significance

-

Winner

⏱Awaiting Results

πŸ‘© Human Copy
Human Copy 1
Eurosender Human Copy Blurred
πŸ€– AI Copy
AI Variation 1
Eurosender Ai Copy Variation 1 Blurred
AI Variation 2
Eurosender Ai Copy Variation 2 Blurred
AI Variation 3
Eurosender Ai Copy Variation 3 Blurred

Website 4

Test Type

Headline

Industry

SaaS

Uplift %

-

Statistical Significance

-

Winner

⏱Awaiting Results

πŸ‘© Human Copy
Human Copy 1
Trivia Human Copy Blurred
πŸ€– AI Copy
AI Variation 1
Trivia Ai Copy Blurred

Website 5

Test Type

Headline

Industry

eCommerce

Uplift %

-

Statistical Significance

-

Winner

⏱Awaiting Results

πŸ‘© Human Copy
Human Copy 1
Zinger Human Copy Blurred
πŸ€– AI Copy
AI Variation 1
Zinger Ai Copy Blurred

Website 6

Test Type

Headline

Industry

SaaS

Uplift %

-

Statistical Significance

-

Winner

⏱Awaiting Results

πŸ‘© Human Copy
Human Copy 1
Integrify Human Copy Control Blurred
πŸ€– AI Copy
AI Variation 1
Integrify Ai Copy Variation 1 Blurred
AI Variation 2
Integrify Ai Copy Variation 2 Blurred

Website 7

Test Type

Headline

Industry

Finance

Uplift %

-

Statistical Significance

-

Winner

⏱Awaiting Results

πŸ‘© Human Copy
Human Copy 1
Clark Germany Gmbh Human Copy Blurred
πŸ€– AI Copy
AI Variation 1
Clark Germany Gmbh Ai Copy Variation 1 Blurred
AI Variation 2
Clark Germany Gmbh Ai Copy Variation 2 Blurred
AI Variation 3
Clark Germany Gmbh Ai Copy Variation 3 Blurred

Website 8

Test Type

Page copy

Industry

eCommerce

Uplift %

-

Statistical Significance

-

Winner

⏱Awaiting Results

πŸ‘© Human Copy
Human Copy 1
Talleres De Ingenieria Human Copy Blurred
πŸ€– AI Copy
AI Variation 1
Talleres De Ingenieria Ai Copy Blurred

The team has made multiple changes on the home page.

Website 9

Test Type

CTA

Industry

Event

Uplift %

-

Statistical Significance

-

Winner

⏱Awaiting Results

πŸ‘© Human Copy
Human Copy 1
Adworld Human Copy Blurred
πŸ€– AI Copy
AI Variation 1
Adworld Ai Copy Variation 1 Blurred

Website 10

Test Type

Product Description

Industry

Automotive

Uplift %

-

Statistical Significance

-

Winner

⏱Awaiting Results

πŸ‘© Human Copy
Human Copy 1
Cargurus Human Copy Blurred
πŸ€– AI Copy
AI Variation 1
Cargurus Ai Copy Variation 1 Blurred

Website 11

Test Type

Product Description

Industry

Education

Uplift %

-

Statistical Significance

-

Winner

⏱Awaiting Results

πŸ‘© Human Copy
Human Copy 1
Prospects Human Copy
πŸ€– AI Copy
AI Variation 1
Prospects Ai Copy Variation 1
AI Variation 2
Prospects Ai Copy Variation 2

We have not shown the website name and clear screenshots for ongoing tests to avoid polluting the test data.
We will showcase them once we have statistically significant results.

Get notified as more results pour in

Simple leave your email below or follow us on @VWO to stay updated

Request access to AI that recommends web copy

If you'd like to get early access to the AI-enabled feature shown above, submit your details and we will help you set up a VWO account with this feature enabled. You can then try this feature on your own website and set up A/B tests to measure its effectiveness

You don't need developer help for using this feature or for implementing A/B tests in VWO.

If you have any feedback for us or have a query, shoot us an email at support@vwo.com