baseline-reproduction

Orchestrates reproduction of baseline comparison methods in cloned sibling repositories.

Updated Aug 14, 2026
One-click install
npx skills add https://github.com/yyccbb/PaperReproduction-Skills --skill baseline-reproduction-yyccbb
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: baseline-reproduction
Source: https://github.com/yyccbb/PaperReproduction-Skills/tree/main/skills/baseline-reproduction
Command: npx skills add https://github.com/yyccbb/PaperReproduction-Skills --skill baseline-reproduction-yyccbb

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Reproducing a machine learning paper's results is incomplete without the baseline rows in its tables and figures, but each baseline lives in a different repository with its own environment and entry points. This Skill automates that cross-repo work: it finds each baseline's official code, clones it beside the main repo, and drives the existing reproduction pipeline stages inside it, scoped to exactly the datapoints the paper's comparisons need. ## Core Features & Use Cases - Baseline manifest and scoping: Reads the main pipeline's experiment-scoping and run-experiment reports to decide which baselines and which exact table/figure datapoints must be reproduced, then writes a scope.md contract per baseline repo. - Sequential sub-pipeline orchestration: Spawns one subagent per baseline repo to run experiment-scoping, resource-download, environment-setup, run-validation, and run-experiment, reusing downloaded assets and the main conda environment where possible. - Auditable index output: Writes .paper-reproduction/baselines.md with per-baseline provenance, per-datapoint statuses, pending user actions, and comparability caveats for the result-analysis stage. - Use Case: After reproducing a paper's main method, run this Skill to also reproduce the L2X and INVASE baseline numbers for Table 1, each in its own cloned repo, without re-downloading shared datasets. ## Quick Start Reproduce the baseline methods for the experiments already completed in this paper's codebase.

Frequently Asked Questions about baseline-reproduction

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I reproduce baseline methods from a machine learning paper?▼

Locate each baseline's official code from the paper's citations or bibliography, clone it as a sibling repo, and run the reproduction pipeline stages inside it scoped to the exact datapoints the paper's tables report. This Skill automates that orchestration and indexes results in baselines.md.

When should baseline-reproduction run in the reproduction pipeline?▼

It runs as stage 5.5, only after run-experiment finishes the main method's full runs, because baseline repos compete for the same GPU. It requires the experiment-scoping and run-experiment reports and stops if either is missing.

Does it reimplement baselines when no official code exists?▼

No. If no official or credible third-party implementation is found, the baseline is marked NOT FOUND with the search record. Third-party reimplementations are used only as a last resort and flagged as unofficial comparability caveats.

Can it reuse datasets and environments from the main reproduction?▼

Yes. The main repo's resource-download report is passed to each baseline's download stage so shared datasets resolve to existing paths, and the main conda environment is reused only when it passes with zero modifications.

What happens if one baseline fails during reproduction?▼

A hard failure ends only that baseline's sub-pipeline; the status and failing stage's verdict are recorded and the queue continues. Baselines blocked on manual-access assets are marked PENDING-USER and resumed after the user acts.