Scaffold Experiment

What problem does it solve?

Manually creating directories, configuring YAML files, and generating SLURM scripts for multiple LLM fine-tuning runs is repetitive and prone to human error. This Skill automates the entire setup process, ensuring consistency and saving significant preparation time, so your experiments are ready to launch.

Core Features & Use Cases

• Automated Directory Creation: Sets up a structured directory for each experiment run based on your experiment_summary.md.
• Config File Generation: Creates setup_finetune.yaml for each run, pre-populated with specific parameters.
• SLURM Script Generation: Automatically generates finetune.yaml and finetune.slurm files, making each run ready for job submission.
• Use Case: After designing an experiment with 10 different fine-tuning runs, use this skill to automatically generate all 10 run directories, their specific configurations, and SLURM submission scripts in minutes, rather than hours of manual copying and editing.

Quick Start

Assuming an experiment_summary.md exists in the current directory:

claude scaffold-experiment

The skill will create subdirectories for each run,

populate them with config files, and generate SLURM scripts,

preparing your experiment for submission.