paper-reproduction

Orchestrates a seven-stage pipeline that reproduces machine learning paper results from cloned codebases.

Updated Aug 14, 2026
One-click install
npx skills add https://github.com/yyccbb/PaperReproduction-Skills --skill paper-reproduction-yyccbb
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: paper-reproduction
Source: https://github.com/yyccbb/PaperReproduction-Skills/tree/main/skills/paper-reproduction
Command: npx skills add https://github.com/yyccbb/PaperReproduction-Skills --skill paper-reproduction-yyccbb

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Reproducing a machine learning paper's results end to end involves many fragile steps — scoping experiments, downloading datasets, building environments, validating runs, launching full training, and auditing outcomes — and losing track of any one of them invalidates the whole effort. This Skill drives that entire pipeline in order, gating each stage on the previous stage's written report so the work survives context loss and can be verified by a human afterward. ## Core Features & Use Cases - Sequential stage orchestration: Invokes experiment-scoping, resource-download, environment-setup, run-validation, run-experiment, baseline-reproduction, result-analysis, and reproduction-audit one at a time, never concurrently. - Report-based state tracking: Reads existing reports under .paper-reproduction/ to resume where a previous run stopped instead of re-running completed stages. - Cost gating and honest stopping: Pauses for user approval before GPU-intensive full runs and baseline reproduction, and always runs the final audit even when an earlier stage fails. - Use Case: You clone a paper's repository, drop the PDF inside, and say "reproduce this paper" — the pipeline scopes the experiments, fetches assets, builds the conda environment, validates with mock runs, launches full runs, compares metrics against the paper, and delivers an audit verdict. ## Quick Start Clone the paper's codebase, place the paper's PDF inside it, and ask the agent to reproduce this paper end to end.

Frequently Asked Questions about paper-reproduction

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I reproduce a machine learning paper's results end to end?▼

Clone the paper's codebase, place the paper's PDF inside it, and invoke the reproduction pipeline from that directory. It runs seven stages in order — scoping, downloads, environment setup, validation, full runs, analysis, and audit — each leaving a markdown report under .paper-reproduction/.

What happens if a paper reproduction stage fails?▼

A stage that ends with a negative verdict stops the pipeline, and the failure is treated as a result rather than retried or worked around. The reproduction-audit stage still runs and reports how far the pipeline got and what would unblock it.

Can I resume a paper reproduction after an interruption?▼

Yes. The pipeline lists .paper-reproduction/ before running anything, and any stage whose report already exists is treated as done and skipped. Work resumes at the first stage without a report, so completed evidence is never overwritten.

Does the pipeline run full training experiments without asking?▼

No. It pauses for explicit user approval before stage 5 full runs, which can take hours to days of GPU time, and before the optional baseline-reproduction stage that clones and runs baseline repositories.

When should I not use the full paper-reproduction pipeline?▼

Do not use it when you only need a single named stage such as environment setup or result analysis, or to redo work a stage has already recorded. Invoke the individual stage skill directly in those cases.