● mastered · kind paper · level 3 · 12h

Deng et al., ‘Improving the Sensitivity of Online Controlled Experiments’ — CUPED regresses out pre-experiment covariates to cut variance, buying large sensitivity gains at Booking and Netflix without extra traffic.

B Testing is a user-experience research method. A/B tests consist of a randomized experiment that usually involves two variants, although the concept can be also extended to multiple variants of the same variable. It includes application of statistical Hypothesis Testing or “two-sample Hypothesis Testing” as used in the field of Statistics. B Testing is employed to compare multiple versions of a single variable, for example by testing a subject’s response to variant A against variant B, and to determine which of the variants is more effective.

Enlaces

Fuentes