Experiment Planning Worksheet
Use when you need to answer: "What is the smallest test that would meaningfully change our confidence?"
Design the smallest reliable test for the riskiest assumption before committing further investment.
Core Question
-
What is the smallest test that would meaningfully change our confidence?
What to Document
-
Hypothesis: 'We believe [customer] will achieve [outcome] by using [solution]. We will consider this supported when [evidence] reaches [threshold] within [period].'
-
Riskiest assumption, target participants, method, procedure, timeline
-
Data to collect, pass threshold, fail threshold, decision rule
Common Mistake to Avoid
-
Running an experiment that produces interesting data but was never designed to end in a decision.
Illustrative Example
-
Pilot the follow-up suggestion feature with 10 account managers for 3 weeks; consider it supported if 24-hour follow-up completion improves meaningfully without excessive correction burden.