p=0.04 is significant. Is it shippable?
Your A/B test is significant at p=0.04 with two weeks of data. Should you ship?
Multiple choice · Answer in the app
Want the answer graded?
Daily PM gives you one prompt every weekday. Ten focused minutes. A graded answer back. The first three are free.
principle
Validate the read before investigating the cause; metric jumps are usually instrumentation first.