Example Output: Data Analytics RAG Context Pack
Inputs used
- Project context: a retention dashboard for a usage-based SaaS product
- Target audience: data analysts, BI teams, PMs, operations leaders
- Success metric: activation, quality, and risk reduction
- Available tools and data: SQL warehouse, BI dashboard, notebook, semantic layer
- Desired depth: Production-ready
- Output tone: Clear operator memo
Generated Result
source policy, chunking plan, retrieval prompt, citation rules, and freshness checks
Source inventory
Rank sources by authority before retrieval. Chunk around task intent rather than page boundaries, and require every answer to cite the exact source segment used for event taxonomy.
Chunking strategy
Rank sources by authority before retrieval. Chunk around task intent rather than page boundaries, and require every answer to cite the exact source segment used for warehouse schema.
Retrieval query plan
Create at least 12 golden tasks: 6 normal cases, 3 edge cases, and 3 adversarial cases targeting Simpson's paradox. A passing result must cite the evidence source and state confidence.
Citation contract
Rank sources by authority before retrieval. Chunk around task intent rather than page boundaries, and require every answer to cite the exact source segment used for stakeholder questions.
Failure handling
Use event taxonomy as evidence, apply the constraint "call out confounders", and explicitly note how the plan reduces metric leakage. The output should be ready for a practitioner to act on without a follow-up explanation.
Evaluation set
Create at least 12 golden tasks: 6 normal cases, 3 edge cases, and 3 adversarial cases targeting aggregation traps. A passing result must cite the evidence source and state confidence.
Recommended Decision
Proceed with a narrow pilot focused on event taxonomy and warehouse schema. Treat metric leakage as the primary launch blocker. The first milestone should prove that the workflow produces a usable analysis plan, metric contract, and executive insight brief with clear evidence, named owners, and a review path for ambiguous cases.
Expected quality checks
- The result is specific to AI-assisted metric design, SQL planning, dashboard critique, and insight storytelling.
- It includes the required sections: Source inventory, Chunking strategy, Retrieval query plan, Citation contract, Failure handling, Evaluation set.
- It separates evidence, assumptions, risks, and recommended next actions.
- It includes practical verification steps, not only generic advice.
- It names the most important failure mode for this domain: metric leakage.
Reuse note
Before copying the output into production work, replace all default variables with your real data and run a human review for high-impact decisions.