Use when designing an experiment or A/B test, writing or reviewing an experiment proposal or analysis plan, sizing a study (power, alpha, MDE), checking an A/A test, picking a unit of randomization, choosing between A/B, multi armed bandit, switchback, or a quasi experiment (difference in differences, regression discontinuity, instrumental variable, synthetic control), analyzing results with confidence intervals and multiple testing correction, interpreting lift, defining primary and guardrail metrics, running cohort or segmentation analysis, or writing a result memo with a decision recommendation.
