resource-download

Verifies hardware feasibility and downloads datasets and checkpoints for planned ML experiments.

Updated Aug 14, 2026
One-click install
npx skills add https://github.com/yyccbb/PaperReproduction-Skills --skill resource-download-yyccbb
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: resource-download
Source: https://github.com/yyccbb/PaperReproduction-Skills/tree/main/skills/resource-download
Command: npx skills add https://github.com/yyccbb/PaperReproduction-Skills --skill resource-download-yyccbb

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Reproducing a machine learning paper requires fetching the right datasets and model checkpoints before any experiment can run, and downloading tens of gigabytes of weights only to discover they cannot fit in VRAM wastes bandwidth and time. This Skill checks hardware feasibility per experiment first, then fetches, verifies, and records an absolute on-disk path for every asset the experiment plan needs. ## Core Features & Use Cases - Hardware feasibility checks: Probes GPU VRAM, RAM, and free disk, then computes per-experiment memory requirements (fp16 inference vs. training with optimizer states) with auditable arithmetic before downloading anything. - Asset downloading and cache pre-seeding: Fetches Hugging Face models and datasets, plain-URL files, and pre-seeds framework caches (e.g. keras MNIST at ~/.keras/datasets/) so later stages run deterministically and offline-safe. - Escalation for gated assets: For license-walled or registration-required datasets, it exhausts autonomous routes, then hands the user a concrete task (exact URL, destination path) and iterates across turns until the asset is obtained or the user explicitly gives up. - Use Case: After scoping a paper's experiments, run this stage to confirm a 124M-parameter GPT-2 fine-tune fits on a 24 GB GPU, download the PyTorch weights and E2E NLG dataset, and produce a placeholder mapping table the next pipeline stage consumes mechanically. ## Quick Start Run stage 2 of the reproduction pipeline: check this machine's hardware against the experiments in .paper-reproduction/experiment-scoping.md, download the datasets and checkpoints they need, and write a report with an absolute verified path for every asset.

Frequently Asked Questions about resource-download

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I download Hugging Face models and datasets for an experiment?▼

Use hf download <repo_id> --local-dir <target> for models and add --repo-type dataset for datasets, or call huggingface_hub.snapshot_download from Python. This Skill fetches only the weight format the experiment needs and records verified absolute paths.

How do I check if a model checkpoint fits in my GPU VRAM?▼

Estimate fp16/bf16 inference at roughly 2 bytes per parameter plus about 20% activation overhead; training with Adam needs several times that for optimizer states and gradients. The Skill probes VRAM with nvidia-smi and shows this arithmetic per experiment before downloading.

What happens when a dataset is gated or requires registration?▼

The Skill first tries mirrors, alternate hosting, and repo download scripts, then pauses and gives the user a concrete task: the exact portal URL, what artifact to bring back, and the absolute destination path. It marks an asset BLOCKED only when the user explicitly gives up.

Does this tool set up conda environments or run experiments?▼

No. It only checks feasibility and moves bytes; environment setup and experiment execution are separate pipeline stages. It installs nothing beyond what downloading itself requires, such as huggingface_hub.

How are downloaded files verified before being recorded?▼

Each asset is checked for existence at the recorded path, size on disk is compared against the expected size, and archives are spot-checked with tar -tf, unzip -l, or magic-bytes checks. The contract is that every path in the report must resolve with ls.