Example Output: Education Learning Evaluation and Red-Team Harness
Inputs used
- Project context: a role-based AI literacy course for customer-facing teams
- Target audience: teachers, instructional designers, enablement teams, course creators
- Success metric: activation, quality, and risk reduction
- Available tools and data: LMS, rubric builder, quiz bank, content library
- Desired depth: Production-ready
- Output tone: Clear operator memo
Generated Result
eval matrix, adversarial cases, grading rubric, and release threshold
Success criteria
Create at least 12 golden tasks: 6 normal cases, 3 edge cases, and 3 adversarial cases targeting cognitive overload. A passing result must cite the evidence source and state confidence.
Golden tasks
Create at least 12 golden tasks: 6 normal cases, 3 edge cases, and 3 adversarial cases targeting unmeasurable objectives. A passing result must cite the evidence source and state confidence.
Adversarial tasks
Use course outline as evidence, apply the constraint "support accessibility", and explicitly note how the plan reduces biased examples. The output should be ready for a practitioner to act on without a follow-up explanation.
Rubric
Use assessment results as evidence, apply the constraint "align to learning objectives", and explicitly note how the plan reduces shallow assessment. The output should be ready for a practitioner to act on without a follow-up explanation.
Sampling plan
Release in three gates: internal dry run, limited pilot, then measured expansion. Each gate must show evidence that avoid answer-only tutoring is true in practice, not only in documentation.
Release decision
Release in three gates: internal dry run, limited pilot, then measured expansion. Each gate must show evidence that support accessibility is true in practice, not only in documentation.
Recommended Decision
Proceed with a narrow pilot focused on learner profile and skills rubric. Treat cognitive overload as the primary launch blocker. The first milestone should prove that the workflow produces a usable lesson plan, practice activity, and assessment rubric with clear evidence, named owners, and a review path for ambiguous cases.
Expected quality checks
- The result is specific to AI-assisted tutoring, assessment design, curriculum planning, and workplace learning.
- It includes the required sections: Success criteria, Golden tasks, Adversarial tasks, Rubric, Sampling plan, Release decision.
- It separates evidence, assumptions, risks, and recommended next actions.
- It includes practical verification steps, not only generic advice.
- It names the most important failure mode for this domain: cognitive overload.
Reuse note
Before copying the output into production work, replace all default variables with your real data and run a human review for high-impact decisions.