ingest

Orchestrate gated data pipelines for PDF, Excel, and CSV sources.

1|1|Updated Mar 26, 2026

Search Tags:#validation #ETL #pipeline #gate #scrape #ingest

Ready to run

npx skills add https://github.com/Soria-Inc/soria-stack --skill ingest-soria-inc

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: ingest
Source: https://github.com/Soria-Inc/soria-stack/tree/main/ingest
Command: npx skills add https://github.com/Soria-Inc/soria-stack --skill ingest-soria-inc

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Build and run data pipelines with governance gates that require human review at each step, preventing costly mistakes during ingestion, transformation, and loading.

Core Features & Use Cases

Gate-driven pipeline orchestration: scrape, organize, extract, validate, and publish with built-in checks.
Supports PDFs, Excel, and CSV inputs, with refresh mode for re-running pipelines when new data drops.
CLI-guided workflow (soria) and git-native development model, enabling auditable, reproducible pipelines.

Quick Start

Use this skill to orchestrate ingestion of data pipelines; run /env to set up your environment, then run /plan to outline the workflow, and finally invoke /ingest to execute the gated process.

Frequently Asked Questions about ingest

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I build a data pipeline with human validation gates?▼

Build a gated data pipeline by orchestrating extraction, transformation, and validation steps that require human review before promotion. Use the CLI to enforce per-gate commits, ensuring auditable and reproducible PDF, Excel, and CSV data ingestion workflows.

How do I orchestrate ETL workflows for PDF and Excel files?▼

Orchestrate ETL workflows for PDF and Excel files by applying gate-based pipeline stages from scraping to loading. The process enforces per-gate commits and guarded promotions, preventing costly transformation mistakes before publishing the validated data.

Can I refresh an ETL pipeline automatically when new CSV data drops?▼

You can refresh an ETL pipeline when new CSV data drops by utilizing the pipeline's refresh mode. This re-runs the gated ingestion workflow, applying the same validation and transformation checks to the updated data sources.

What is the best way to prevent costly mistakes during data ingestion?▼

The best way to prevent costly mistakes during data ingestion is to use gate-driven pipeline orchestration. This approach enforces human review at each scraping, transforming, and loading step, requiring per-gate commits and guarded promotions before data is published.

Does the gated ingestion workflow support git-native development?▼

The gated ingestion workflow supports git-native development by enforcing per-gate commits throughout the data pipeline. This CLI-guided process ensures that every transformation and validation step is auditable and reproducible across your data sources.