domino-flows

What problem does it solve?

This Skill streamlines the creation and management of complex, multi-stage machine learning pipelines, ensuring reproducibility and providing clear lineage.

Core Features & Use Cases

• DAG Orchestration: Define workflows as directed acyclic graphs for clear task dependencies.
• Reproducibility & Lineage: Track data and model provenance automatically.
• Heterogeneous Environments: Use different compute environments for each task.
• Use Case: Build an end-to-end ML pipeline that ingests data, preprocesses it, trains multiple models, evaluates them, and deploys the best performing one, all within a single, version-controlled workflow.

Quick Start

Use the domino-flows skill to create a basic training pipeline with preprocess and train tasks.