data-ingestion-builder

Community

Bootstrap new data providers with registry-driven loaders.

Authorzazu-22
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill automates the creation of data ingestion providers following FF Analytics registry patterns. It covers registry design, provider packages, loaders, storage integration, primary key tests, and sampling tools to streamline adding new data sources.

Core Features & Use Cases

  • Registry-driven provider scaffolding and metadata
  • Production-ready package structure (loader, registry, tests)
  • Guidance on writing primary key tests and sampling
  • End-to-end integration with Parquet storage and metadata sidecars

Quick Start

Use the provider scaffold to add a new data source by creating src/ingest/{provider}/ with registry.py, loader.py, and tests, following the provided templates.

Dependency Matrix

Required Modules

None required

Components

assetsreferences

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: data-ingestion-builder
Download link: https://github.com/zazu-22/ff_data_analytics/archive/main.zip#data-ingestion-builder

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository