skills.rest
Soria-Inc
Soria-IncOFFICIAL
Explore all skills by this author →
GitHub

ingest

Orchestrate gated data pipelines for PDF, Excel, and CSV sources.

1|1|Updated Mar 26, 2026
Search Tags:#validation#ETL#pipeline#gate#scrape#ingest
One-click install
npx skills add https://github.com/Soria-Inc/soria-stack --skill ingest-soria-inc
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: ingest
Source: https://github.com/Soria-Inc/soria-stack/tree/main/ingest
Command: npx skills add https://github.com/Soria-Inc/soria-stack --skill ingest-soria-inc

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Build and run data pipelines with governance gates that require human review at each step, preventing costly mistakes during ingestion, transformation, and loading.

Core Features & Use Cases

  • Gate-driven pipeline orchestration: scrape, organize, extract, validate, and publish with built-in checks.
  • Supports PDFs, Excel, and CSV inputs, with refresh mode for re-running pipelines when new data drops.
  • CLI-guided workflow (soria) and git-native development model, enabling auditable, reproducible pipelines.

Quick Start

Use this skill to orchestrate ingestion of data pipelines; run /env to set up your environment, then run /plan to outline the workflow, and finally invoke /ingest to execute the gated process.

Frequently Asked Questions about ingest

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I build a data pipeline with human validation gates?▼

Build a gated data pipeline by orchestrating extraction, transformation, and validation steps that require human review before promotion. Use the CLI to enforce per-gate commits, ensuring auditable and reproducible PDF, Excel, and CSV data ingestion workflows.

How do I orchestrate ETL workflows for PDF and Excel files?▼

Orchestrate ETL workflows for PDF and Excel files by applying gate-based pipeline stages from scraping to loading. The process enforces per-gate commits and guarded promotions, preventing costly transformation mistakes before publishing the validated data.

Can I refresh an ETL pipeline automatically when new CSV data drops?▼

You can refresh an ETL pipeline when new CSV data drops by utilizing the pipeline's refresh mode. This re-runs the gated ingestion workflow, applying the same validation and transformation checks to the updated data sources.

What is the best way to prevent costly mistakes during data ingestion?▼

The best way to prevent costly mistakes during data ingestion is to use gate-driven pipeline orchestration. This approach enforces human review at each scraping, transforming, and loading step, requiring per-gate commits and guarded promotions before data is published.

Does the gated ingestion workflow support git-native development?▼

The gated ingestion workflow supports git-native development by enforcing per-gate commits throughout the data pipeline. This CLI-guided process ensures that every transformation and validation step is auditable and reproducible across your data sources.

Related Skills

Explore More Data & Analytics Skills→
perlowjaperlowja
9

portfolio-analysis

Consolidate portfolio data from CSV, Excel, PDFs, and images into holdings and dashboards.

Community
Advanced
edwinhuedwinhu
19

ds-delegate

Delegate data analysis steps to specialized subagents with output verification.

Community
Advanced
MoRen9527MoRen9527

tmux

Send keystrokes and scrape output from tmux sessions.

Community
Intermediate
wilsonkichoiwilsonkichoi
3

auto

Run the execute-review-fix-verify pipeline for a wave or milestone.

Community
Advanced