skills.rest
BauplanLabs
BauplanLabsOFFICIAL
Explore all skills by this author →
WebsiteGitHub

wap-ingestion

Ingest S3 parquet data into Bauplan using the Write-Audit-Publish pattern.

14|3|Updated Aug 3, 2025
Search Tags:#workflow#ingestion#branch#S3#data-quality#atomic#wap
Ready to run
npx skills add https://github.com/BauplanLabs/bauplan-mcp-server --skill wap-ingestion
💬 Prompt for ChatGPT / Claude Chat▼
Please help me install this Agent Skill.
Skill: wap-ingestion
Source: https://github.com/BauplanLabs/bauplan-mcp-server/tree/main/skills/wap
Command: npx skills add https://github.com/BauplanLabs/bauplan-mcp-server --skill wap-ingestion

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires bauplan.

What problem does it solve?

Ingest data from S3 into Bauplan using the Write-Audit-Publish pattern to ensure safe, atomic data loads and easy rollback.

Core Features & Use Cases

  • Write-Audit-Publish workflow: Ingest to a temporary branch, audit quality, and publish to main atomically.
  • Atomic multi-table operations: Merge branch changes in a single operation to ensure consistency.
  • Use Case: Ingest a new parquet dataset from S3, validate rows, then merge into main without partial updates.

Quick Start

Run the wap_template example with your table name and S3 path to create a temporary branch and publish results based on success/failure preferences. After completion, inspect or merge as needed.