review-iteration

What problem does it solve?

This Skill provides a structured, read-only analysis of pipeline run results to help users understand failures, map recurring error patterns, and identify next investigative steps without modifying any files or code.

Core Features & Use Cases

• Structured Diagnosis: Aggregates pipeline outputs, codebook prompts, iteration logs, and success criteria to produce a concise pass/fail summary and root-cause hypotheses.
• Stage-specific Analysis: Performs tailored analyses for S1 behavioral tests, S2 zero-shot evaluation, and S3 error/ablation studies with example deep-dives and confusion patterns.
• Investigation Guidance: Ranks ablations and suggests high-leverage follow-ups so users can prioritize experiments or codebook edits.
• Use Case: After running the targets pipeline, run this Skill to determine which tests failed, why they failed, and what to investigate next before recording changes.

Quick Start

Ask the Skill to analyze codebook c1 at stage s2 and summarize failing metrics, dominant error patterns, and ranked next investigations.