skills.rest
mathisdrn
mathisdrnCOMMUNITY
Explore all skills by this author →
WebsiteGitHub

dagster-expert

Provides expert guidance for building and managing Dagster data pipelines with the dg CLI.

9|Updated Feb 16, 2026
Search Tags:#automation#components#data pipeline#assets#dagster#data orchestration#dg cli
One-click install
npx skills add https://github.com/mathisdrn/orca --skill dagster-expert-mathisdrn
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: dagster-expert
Source: https://github.com/mathisdrn/orca/tree/main/.agents/skills/dagster-expert
Command: npx skills add https://github.com/mathisdrn/orca --skill dagster-expert-mathisdrn

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve? Working with Dagster requires deep knowledge of its asset model, components, automation approaches, and the dg CLI, and guessing at APIs or commands leads to broken pipelines and wasted debugging time. ## Core Features & Use Cases - Dagster Project Workflows: Create projects with create-dagster, scaffold definitions, validate with dg check, and launch runs locally or on Dagster Plus. - Asset & Automation Guidance: Define assets, dependencies, partitions, schedules, sensors, and declarative automation conditions using current best practices. - Integration & Component Design: Integrate 40+ tools (dbt, Fivetran, Snowflake, AWS, etc.) via existing components, subclassing, or custom state-backed components. - Use Case: Ask how to add a dbt project to your Dagster pipeline, and the Skill reads the dagster-dbt integration reference, scaffolds the component with dg, and configures it correctly. ## Quick Start Ask the assistant to help you create a new Dagster asset, schedule, or integration using the dg CLI.

Frequently Asked Questions about dagster-expert

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a new Dagster project from scratch?▼

Use the create-dagster command: run uvx create-dagster project <name> --uv-sync to scaffold a project with proper structure and dependencies. Never create a Dagster project manually, as it will likely be misconfigured.

How do I integrate dbt or Fivetran with Dagster?▼

Install the corresponding dagster-* library, then run dg list components to discover available components and dg scaffold defs to add an instance. Always prefer the component over Pythonic integrations like @dbt_assets when one exists.

Should I use schedules, sensors, or declarative automation in Dagster?▼

Use schedules for fixed time-based execution, sensors for event-driven triggers like file arrivals, and declarative automation (AutomationCondition) for asset-centric logic depending on upstream state or freshness. The choosing-automation reference provides a decision tree.

How do I filter Dagster assets by tag or group in the CLI?▼

Use the asset selection syntax with dg commands, for example dg launch --assets "tag:priority=high and kind:dbt". The same string syntax works in the UI search bar and via AssetSelection.from_coercible() in Python.

When should I build a custom Dagster component instead of using an integration?▼

Only build a custom component when no published dagster-* library exists for the external tool. If definitions require fetching external state, use StateBackedComponent; otherwise subclass the existing integration component to customize behavior.

Related Skills

Explore More Data & Analytics Skills→
AeyeOpsAeyeOps
3

python-data-engineering

Automate API-to-PostgreSQL data pipelines with SQLAlchemy 2.0 patterns.

Official
Advanced
bbvch-aibbvch-ai
9

debug-pipeline

Diagnose Dagster pipeline failures using Dagster MCP tools.

Official
Advanced
LeandroBenjaminLLeandroBenjaminL

data-validation

Validate data schemas and quality using Pandera and Great Expectations.

Community
Advanced
Claude-Code-Community-IrelandClaude-Code-Community-Ireland
10

airflow-dag-patterns

Provides design, operator, sensor, testing, and deployment patterns for Apache Airflow DAGs.

Official
Intermediate