check-data-impact

Analyze downstream dependencies impacted by changing csv or parquet data files.

3|Updated Jun 3, 2022
One-click install
npx skills add https://github.com/Hohlas/SoSimple --skill check-data-impact
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: check-data-impact
Source: https://github.com/Hohlas/SoSimple/tree/main/.kilocode/skills/check-data-impact
Command: npx skills add https://github.com/Hohlas/SoSimple --skill check-data-impact

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Analyze downstream dependencies when changing data formats to prevent breaking changes in the pipeline.

Core Features & Use Cases

  • Read the target file's header to identify outputs.
  • Locate scripts that use these outputs by inspecting MODULE_INDEX.md.
  • Recursively resolve downstream dependencies to generate a dependency graph.
  • Provide a clear map of impacted data and scripts for impact assessment.

Quick Start

Run the check-data-impact on a sample data file to view affected downstream scripts and outputs.

Frequently Asked Questions about check-data-impact

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I analyze downstream dependencies before changing a data file format?▼

To analyze downstream dependencies, this Skill reads file headers, locates script references in MODULE_INDEX.md, and recursively resolves impacted outputs to generate a dependency graph. This maps affected scripts and data before you change a data file format.

How do I find which pipeline scripts will break when modifying a CSV header?▼

Finding impacted pipeline scripts involves inspecting your MODULE_INDEX.md recipes to locate references of the modified CSV outputs. It then recursively resolves these downstream dependencies and renders a clear map of affected scripts and outputs.

Can I trace downstream data pipeline impact for parquet inputs?▼

Yes, you can trace downstream data pipeline impact for parquet inputs. The analysis is applicable to data pipelines built with csv or parquet inputs, mapping impact within MODULE_INDEX.md recipes and reporting affected scripts and outputs.

What is a dependency graph for data pipeline impact assessment?▼

A dependency graph for data pipeline impact assessment visually maps the downstream dependencies affected by changing a data file. It recursively resolves script references found in MODULE_INDEX.md to report impacted data and scripts for impact assessment.

Do I need a MODULE_INDEX.md file to map downstream data dependencies?▼

Yes, you need a MODULE_INDEX.md file to map downstream data dependencies. The tool locates scripts that use your data outputs by inspecting MODULE_INDEX.md recipes to recursively resolve downstream dependencies and render the impact graph.