run-pipeline

Community

Run Snakemake pipelines for datasets and models.

AuthorRobertFrenken
Version1.0.0
Installs0

System Documentation

What problem does it solve?

Orchestrates end-to-end Snakemake-based KD-GAT workflows to run dataset- and model-configuration pipelines, simplifying experiment orchestration.

Core Features & Use Cases

  • Parse and validate the dataset and optional target from ARGUMENTS and apply the appropriate pipeline configuration.
  • Verify dataset existence, preview the workflow with a dry run, and determine the expected outputs.
  • Submit to SLURM with a dedicated profile, while capturing SLURM logs and MLflow tracking for experiment provenance.
  • Support common targets such as teacher_fusion, student_fusion, student_fusion_kd, and the per-dataset targets (teachers, students_nokd, students) across all datasets.

Quick Start

Run the KD-GAT Snakemake pipeline for dataset hcrl_sa with target teachers.

Dependency Matrix

Required Modules

None required

Components

Standard package

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: run-pipeline
Download link: https://github.com/RobertFrenken/DQN-Fusion/archive/main.zip#run-pipeline

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 223,000+ vetted skills library on demand.