alternative-data-pipeline

What problem does it solve?

This Skill addresses the challenges of managing alternative data pipelines by ensuring reproducible research, explicit controls, and deployable outputs, focusing on schema contracts, freshness tracking, and lineage completeness.

Core Features & Use Cases

• Schema Contract Definition: Define and enforce schema versions and freshness objectives for data sources.
• Deterministic Ingestion & Validation: Ingest data with replay support and validate keys, timestamps, and join behavior.
• Quality Monitoring & Control: Continuously monitor quality metrics, quarantine degraded feeds, and enforce release criteria.
• Use Case: When onboarding a new alternative data feed, use this Skill to define its schema contract, set up ingestion and validation scripts, and establish continuous monitoring to ensure data quality and lineage before it's used in production models.

Quick Start

Use the alternative-data-pipeline skill to run diagnostics on input.csv and save the output to diagnostics.json.