skills.rest
CleanExpo
CleanExpoCOMMUNITY
Explore all skills by this author →
WebsiteGitHub

Data Transform

Codify data transformation patterns for NodeJS-Starter-V1 with typed mappers and ETL pipelines.

1|Updated Sep 14, 2025
Search Tags:#pydantic#python#streaming#data transformation#etl#data mapping
One-click install
npx skills add https://github.com/CleanExpo/DR-NRPG --skill data-transform-cleanexpo
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: Data Transform
Source: https://github.com/CleanExpo/DR-NRPG/tree/main/.skills/custom/data-transform
Command: npx skills add https://github.com/CleanExpo/DR-NRPG --skill data-transform-cleanexpo

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill addresses the complexities of moving and reshaping data between different formats and systems, ensuring consistency and reducing manual transformation errors.

Core Features & Use Cases

  • Data Mapping: Define typed transformations between API and database models.
  • ETL Pipelines: Build step-by-step processes for data import and export.
  • Case Conversion: Automatically convert between snake_case and camelCase.
  • Streaming Transforms: Process large datasets efficiently without high memory usage.
  • Provider Normalisation: Unify data formats from different AI providers.
  • Use Case: Automatically convert incoming API data from snake_case to the camelCase format expected by your frontend application, and then map it to your internal database models.

Quick Start

Use the data-transform skill to map user data from a database format to an API response format.

Frequently Asked Questions about Data Transform

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I convert API data from snake_case to camelCase for my frontend application?▼

You can build ETL pipelines with validation to map data between API and database models. This approach codifies data transformation patterns, ensuring consistent mapping and reducing manual transformation errors between different application layers.

What is the best way to normalize responses from different AI providers into a unified format?▼

Streaming transforms allow you to process large datasets efficiently without high memory usage. By applying streaming data transformation patterns, the system handles large volumes incrementally rather than loading everything into memory at once.

Can I use Pydantic model transformations to validate data in an ETL pipeline?▼

The Data Transform Skill codifies data transformation patterns including typed data mappers, ETL pipelines, streaming transforms, and Pydantic model transformations to solve inconsistent data formats between application layers and external services.

How do I map data between API layers and database models without losing type safety?▼

You map data between API and database models without losing type safety by defining typed data mappers. This enforces structured mapping and validation, ensuring data consistency while converting between different naming conventions like snake_case and camelCase.

Related Skills

Explore More Software Engineering Skills→
romankovsvromankovsv

pydantic-patterns

Validate and serialize Python data structures with Pydantic v2 models and validators.

Community
Advanced
hung-phanhung-phan

bff

Create dedicated API layers for each client type with data shaping.

Community
Advanced
IndustrialIndustrial

data-engineering-data-pipeline

Design and implement batch and streaming data pipelines with ETL, dbt, Spark, Airflow, and Delta Lake.

Community
Advanced
MarioDeFelipeMarioDeFelipe
25

datasphere-data-flows

Orchestrate SAP Datasphere replication, transformation, and task chain flows.

Community
Advanced