check-data-impact

Analyze downstream dependencies impacted by changing csv or parquet data files.

3|Updated Jun 3, 2022
One-click install
npx skills add https://github.com/Hohlas/SoSimple --skill check-data-impact
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: check-data-impact
Source: https://github.com/Hohlas/SoSimple/tree/main/.kilocode/skills/check-data-impact
Command: npx skills add https://github.com/Hohlas/SoSimple --skill check-data-impact

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Analyze downstream dependencies when changing data formats to prevent breaking changes in the pipeline.

Core Features & Use Cases

  • Read the target file's header to identify outputs.
  • Locate scripts that use these outputs by inspecting MODULE_INDEX.md.
  • Recursively resolve downstream dependencies to generate a dependency graph.
  • Provide a clear map of impacted data and scripts for impact assessment.

Quick Start

Run the check-data-impact on a sample data file to view affected downstream scripts and outputs.

Frequently Asked Questions about check-data-impact

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I analyze downstream dependencies before changing a data file format?

To analyze downstream dependencies, this Skill reads file headers, locates script references in MODULE_INDEX.md, and recursively resolves impacted outputs to generate a dependency graph. This maps affected scripts and data before you change a data file format.

How do I find which pipeline scripts will break when modifying a CSV header?

Finding impacted pipeline scripts involves inspecting your MODULE_INDEX.md recipes to locate references of the modified CSV outputs. It then recursively resolves these downstream dependencies and renders a clear map of affected scripts and outputs.

Can I trace downstream data pipeline impact for parquet inputs?

Yes, you can trace downstream data pipeline impact for parquet inputs. The analysis is applicable to data pipelines built with csv or parquet inputs, mapping impact within MODULE_INDEX.md recipes and reporting affected scripts and outputs.

What is a dependency graph for data pipeline impact assessment?

A dependency graph for data pipeline impact assessment visually maps the downstream dependencies affected by changing a data file. It recursively resolves script references found in MODULE_INDEX.md to report impacted data and scripts for impact assessment.

Do I need a MODULE_INDEX.md file to map downstream data dependencies?

Yes, you need a MODULE_INDEX.md file to map downstream data dependencies. The tool locates scripts that use your data outputs by inspecting MODULE_INDEX.md recipes to recursively resolve downstream dependencies and render the impact graph.