Example Output: Data Analytics Experiment Launch Plan
Inputs used
- Project context: a retention dashboard for a usage-based SaaS product
- Target audience: data analysts, BI teams, PMs, operations leaders
- Success metric: activation, quality, and risk reduction
- Available tools and data: SQL warehouse, BI dashboard, notebook, semantic layer
- Desired depth: Production-ready
- Output tone: Clear operator memo
Generated Result
hypothesis, audience, variants, instrumentation, and decision rule
Hypothesis
Hypothesis: improving how the workflow handles event taxonomy will reduce metric leakage. Ship two variants at most, instrument the primary metric before launch, and decide in advance what evidence stops the test.
Target segment
Use warehouse schema as evidence, apply the constraint "call out confounders", and explicitly note how the plan reduces aggregation traps. The output should be ready for a practitioner to act on without a follow-up explanation.
Variants
Hypothesis: improving how the workflow handles dashboard screenshots will reduce Simpson's paradox. Ship two variants at most, instrument the primary metric before launch, and decide in advance what evidence stops the test.
Instrumentation
Hypothesis: improving how the workflow handles stakeholder questions will reduce unclear denominators. Ship two variants at most, instrument the primary metric before launch, and decide in advance what evidence stops the test.
Risks
Treat metric leakage as a launch blocker until there is a control that can be verified. The minimum control is: call out confounders, plus reviewer sign-off for ambiguous outputs.
Decision rule
Hypothesis: improving how the workflow handles warehouse schema will reduce aggregation traps. Ship two variants at most, instrument the primary metric before launch, and decide in advance what evidence stops the test.
Recommended Decision
Proceed with a narrow pilot focused on event taxonomy and warehouse schema. Treat metric leakage as the primary launch blocker. The first milestone should prove that the workflow produces a usable analysis plan, metric contract, and executive insight brief with clear evidence, named owners, and a review path for ambiguous cases.
Expected quality checks
- The result is specific to AI-assisted metric design, SQL planning, dashboard critique, and insight storytelling.
- It includes the required sections: Hypothesis, Target segment, Variants, Instrumentation, Risks, Decision rule.
- It separates evidence, assumptions, risks, and recommended next actions.
- It includes practical verification steps, not only generic advice.
- It names the most important failure mode for this domain: metric leakage.
Reuse note
Before copying the output into production work, replace all default variables with your real data and run a human review for high-impact decisions.