The ability to run mutually exclusive experiments is considered a key weapon in the arsenal of any experimentation team, the reasons being:
- The experimentation team can be confident about the reporting data of each experiment to be free from noise and bias of other experiments being run.
- As a side effect of 1, the experiment team can move with greater velocity – No longer do they need to run important experiments serially.
VWO Testing already has the ability to run mutually exclusive experiments, now with the same ability in VWO Fullstack our customers can make sure the experimentation program can run at a high velocity – More experiments in the same amount of time without worrying about the “Interaction effects”.
Concept of Mutually Exclusive experiment groups: To run mutually exclusive experiments in VWO FullStack, the experiments which can potentially influence each other are required to be added to a mutually Exclusive experiments group.
On doing the above, whenever VWO FullStack SDKs evaluate what experiment/variation combination is to be given as the output – It is made sure only one experiment is chosen randomly from the mutually exclusive experiment group.
Experiments can be added to a Mutually exclusive experiment group in 2 ways :
- Via VWO account settings. Go to Account settings > Campaign > Click on Mutually Exclusive Group
2. In the Advanced Options, while creating a VWO FullStack A/B Testing or Feature Testing campaign
Mutually exclusive experiments are LIVE in the following VWO FullStack SDKs:
- Node JS – Version 1.19.0
- PHP – Version 1.19.0
- Python – Version 1.20.0
- Java – Version 1.22.0
- Ruby – Version 1.22.0
- .NET – Version 1.23.0
If you have any questions or concerns, please feel free to reach out to support@vwo.com.
