Skills
.Work. You
Rest

Start Initial Ingestion

Community

Kickstart ingestion of a new DataSurface model.

Data & Analytics#kubernetes#ingestion#airflow#tagging#data-pipeline#datasurface
Authorbillynewport
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill guides teams to initiate the initial data ingestion pipeline after deploying a new DataSurface Yellow model, ensuring tagging, secret setup, and DAG activation are completed correctly.

Core Features & Use Cases

  • Tagging & Release Management: Ensures the model version is properly tagged for ingestion.
  • Secret & Credential Setup: Guides the creation of required Kubernetes secrets for source access.
  • DAG Activation & Orchestration: Provides steps to unpause and trigger ingestion DAGs in Airflow for a repeatable workflow.

Quick Start

  • git tag v1.0.1-demo
  • git push origin v1.0.1-demo
  • kubectl create secret generic customer-source-credential --from-literal=USER=postgres --from-literal=PASSWORD=password -n demo1
  • kubectl exec -n demo1 deployment/airflow-api-server -- airflow dags unpause scd2__CustomerDB_ingestion
  • kubectl exec -n demo1 deployment/airflow-api-server -- airflow dags trigger scd2__CustomerDB_ingestion

Dependency Matrix

Required Modules

None required

Components

Standard package

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: Start Initial Ingestion
Download link: https://github.com/billynewport/demo_cokub_model/archive/main.zip#start-initial-ingestion

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 223,000+ vetted skills library on demand.