grading-qa

Inspect grading outputs and summaries for quality issues across directories.

Updated Aug 27, 2026
One-click install
npx skills add https://github.com/AKCqhzdy/dse-subject-grading --skill grading-qa
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: grading-qa
Source: https://github.com/AKCqhzdy/dse-subject-grading/tree/main/skills-v3/grading-qa
Command: npx skills add https://github.com/AKCqhzdy/dse-subject-grading --skill grading-qa

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Phase 8 grading QA provides a structured, repeatable process to validate the accuracy and completeness of grading outputs, reducing risk of inconsistent scoring or missing files.

Core Features & Use Cases

  • Score distribution review: assess mean, median, stddev, and identify anomalies so instructors can trust reported results.
  • Spot-checks: automatically re-validate 2–3 random students via a sub-agent to confirm per-question marks align with rubrics.
  • Output completeness: verify that required files (final_scores.json, qa_summary.md) exist and are up-to-date, and that datasets across output/, rubric/, and extracted/ are coherent.
  • QA summary generation: produce a concise QA summary documenting findings and any remediation steps.

Quick Start

Run the grading-qa process on the current grading batch to generate the qa_summary.md.

Frequently Asked Questions about grading-qa

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
What is grading quality assurance and how does it verify score consistency?▼

Grading quality assurance systematically validates score consistency by performing random spot-checks on students, assessing score distributions, and verifying output file completeness. It flags significant cross-student disparities to ensure reported results are accurate and reliable.

How do I check if final_scores.json exists and validate grading output completeness?▼

To validate grading output completeness, the QA process checks that final_scores.json and qa_summary.md exist and are up-to-date. It also verifies data coherence across the output/, rubric/, and extracted/ directories.

How do I perform random spot-checks to confirm per-question marks align with rubrics?▼

You can perform random spot-checks by running a QA process that selects 2–3 students and uses a sub-agent to re-validate their per-question marks against the grading rubrics, ensuring scoring accuracy and consistency.

Can I assess score distribution anomalies for a yearly grading batch?▼

Yes, you can assess score distribution anomalies for a yearly grading batch. The QA process calculates mean, median, and standard deviation to identify outliers, helping instructors trust the reported results.

What is the best way to generate a qa_summary.md documenting grading findings?▼

The best way to generate a qa_summary.md is to run a structured grading QA process on your current batch. It automatically documents all quality findings, cross-student consistency checks, and any necessary remediation steps.

Why does my grading QA process flag significant cross-student disparities?▼

Your grading QA process flags significant cross-student disparities to enforce consistency requirements. It identifies quality issues where scoring outputs deviate significantly, reducing the risk of inconsistent grading across the dataset.