Stage files from landing to pending areas with decompression and ACK verification.
npx skills add https://github.com/starlake-ai/starlake --skill stage
Please help me install this Agent Skill. Skill: stage Source: https://github.com/starlake-ai/starlake/tree/main/.agent/skills/stage Command: npx skills add https://github.com/starlake-ai/starlake --skill stage
Moving files from the landing area to the pending area is error-prone when done manually, especially when decompression and ACK validation are required to ensure data integrity before processing.
Stage all eligible files from the landing area to the pending area using default settings.
High-intent search queries and answers about installing and using this skill.
You can automate file movement by staging files from the landing area to the pending area, which handles decompression and ACK verification automatically to ensure data integrity before downstream processing.
ACK verification in data ingestion pipelines is a validation check that confirms files are complete and uncorrupted before they advance from the landing area to the pending staging area.
Yes, you can scope file staging behavior to specific domains and tables using option substitutions, allowing you to organize ingestion workflows across multiple data domains effectively.
You prevent corrupted data from advancing by using a staging process that enforces automatic ACK checks and proper decompression, ensuring only validated files move to the pending area.
The best way to prepare files is to stage them from the landing area to the pending area with automatic decompression and ACK validation, ensuring data is safe for downstream transforms and loading.
Manual file staging is error-prone and can cause data integrity issues, which is why automated decompression and ACK validation are required to safely move files to the pending area.
Simon-Copilot-StudioIngest sources into an interlinked markdown knowledge base with cross-links.
AradotsoAutomate ETL workflows with Snowflake, dbt, and Streamlit.
manastalukdarPoll logs, error rates, and endpoints to verify post-deployment health.
pegasus-isiGenerate Python or shell wrapper scripts for Pegasus workflow pipeline steps.
