#ab-testing

4 notes

• A/B Testing A/B testing is the online application of the randomized controlled trial (RCT), estimating causal effects by randomly exposing two or more variants to users.
• CUPED CUPED (Controlled-experiment Using Pre-Experiment Data) is a technique that leverages pre-experiment data to reduce the variance of A/B tests.
• Design Effect The Design Effect (DEFF) measures the impact of a complex sampling design on variance relative to simple random sampling.
• Statistical Power Statistical power is the probability of detecting an effect when it truly exists.