DataPrepLead

Manage OMI data scraping, transformation, and artifact generation pipelines.

Updated Aug 23, 2026
One-click install
npx skills add https://github.com/Ghabs95/agents --skill datapreplead
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: DataPrepLead
Source: https://github.com/Ghabs95/agents/tree/main/casit-agents/.agent/skills/data_prep_lead
Command: npx skills add https://github.com/Ghabs95/agents --skill datapreplead

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill automates the complex and time-consuming process of preparing and scraping data for the OMI platform, ensuring accuracy and traceability.

Core Features & Use Cases

  • Data Scraping: Maintains and executes spiders for efficient data ingestion.
  • Data Transformation: Normalizes, derives, and validates datasets from raw inputs.
  • Ecosystem Integration: Produces artifacts for consumption by other services like casit-be.
  • Use Case: Automatically ingest new zone data from external OMI sources, transform it into a standardized CSV format, and validate its accuracy against official specifications.

Quick Start

Use the DataPrepLead skill to scrape and prepare the latest zone data from the specified OMI source.

Frequently Asked Questions about DataPrepLead

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate data scraping and preparation for OMI sources?

Automating OMI data preparation involves executing spiders for data ingestion and applying transformations for normalization. This process ensures accuracy and traceability while generating artifacts for downstream services.

What is the best way to normalize raw data into a standardized CSV format?

Normalizing raw data into a standardized CSV format requires applying data transformation operations that derive and validate datasets. This ensures the output conforms to official specifications and is ready for downstream consumption.

How do data pipelines handle validation and traceability during ingestion?

Data pipelines handle validation and traceability by applying transformation rules to raw inputs and tracking the data ingestion process. This ensures accuracy and maintains automated traceability throughout the data preparation lifecycle.

Does this data preparation approach work with downstream services like casit-be?

Yes, the data preparation process produces artifacts specifically designed for consumption by downstream services. It generates validated, standardized outputs that integrate seamlessly with ecosystem services like casit-be.

What are the limitations of using spiders for data ingestion in automated pipelines?

Spiders for data ingestion require raw inputs to be accurately structured for subsequent normalization and validation. Limitations arise when external sources deviate from expected formats, requiring transformation adjustments to maintain pipeline accuracy.