csv-processor

Stream CSV parsing and generation with Zod and Pydantic validation.

1|Updated Sep 14, 2025
One-click install
npx skills add https://github.com/CleanExpo/DR-NRPG --skill csv-processor-cleanexpo
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: csv-processor
Source: https://github.com/CleanExpo/DR-NRPG/tree/main/.skills/custom/csv-processor
Command: npx skills add https://github.com/CleanExpo/DR-NRPG --skill csv-processor-cleanexpo

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill tackles the challenges of handling large CSV files efficiently and accurately, ensuring data integrity and correct formatting for both frontend and backend applications.

Core Features & Use Cases

  • Large File Handling: Processes CSVs row-by-row to prevent memory issues.
  • Data Validation: Validates each row against defined schemas using Zod (frontend) and Pydantic (backend).
  • Locale-Specific Formatting: Supports Australian date (DD/MM/YYYY) and currency (AUD) formats.
  • Use Case: Import a large CSV of contractor details, validate each entry, and export a filtered list with Australian-formatted dates.

Quick Start

Use the csv-processor skill to import contractor data from the file 'contractors.csv'.

Frequently Asked Questions about csv-processor

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I process large CSV files without running out of memory?

Streaming CSV parsing processes files row-by-row to prevent memory exhaustion when handling large datasets. This approach enables memory-safe chunked processing for both import and export scenarios across Next.js and FastAPI applications.

How do I validate CSV data row by row in Next.js and FastAPI?

You can validate CSV data row by row in Next.js and FastAPI using Zod and Pydantic schemas respectively. This enforces data integrity during streaming CSV import by rejecting invalid rows before they enter your system.

Does this CSV streaming approach support Australian locale formatting?

Yes, this CSV streaming approach supports Australian locale formatting for dates and currency. It automatically handles DD/MM/YYYY date formats and AUD currency formatting during both CSV import parsing and export generation.

What is the best way to import a large CSV of contractor details and export a filtered list?

The best way to import a large CSV of contractor details is using row-by-row streaming with schema validation, then exporting a filtered list with locale-formatted dates. This ensures memory safety and data integrity across the full workflow.

Can I use Zod and Pydantic for CSV row validation across frontend and backend?

Yes, you can use Zod for frontend CSV row validation and Pydantic for backend validation within a streaming pipeline. This dual validation ensures data integrity across Next.js and FastAPI environments during import.