Bootstrap A/B Test
Estimate uncertainty in the difference between flights using resampling.
Sample size per group
Bootstrap resamples
What’s happening
1. We observe A and B groups
2. We resample each group independently
3. We compute Δ = mean(A) - mean(B)
4. Repeat many times
5. We build distribution of Δ
6. CI = 2.5th → 97.5th percentile
7. If our CI does not straddle the zero line - this is statistically significant