csv-pipeline

Process CSV, TSV, JSON, and JSON Lines files into cleaned, transformed, and summarized outputs.

2|1|Updated Mar 2, 2026
One-click install
npx skills add https://github.com/albertdobmeyer/opentrapp --skill csv-pipeline-albertdobmeyer
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: csv-pipeline
Source: https://github.com/albertdobmeyer/opentrapp/tree/main/workloads/skills/skills/csv-pipeline
Command: npx skills add https://github.com/albertdobmeyer/opentrapp --skill csv-pipeline-albertdobmeyer

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill removes the manual effort of cleaning, reshaping, and summarizing tabular data so you can move from raw files to usable results faster.

Core Features & Use Cases

  • Inspect and clean data: Review headers, row counts, missing values, and common formatting issues in CSV, TSV, JSON, and JSON Lines files.
  • Transform and combine datasets: Filter rows, sort records, deduplicate entries, convert formats, and join related tables for analysis-ready output.
  • Aggregate and report: Compute sums, averages, counts, and grouped summaries, then generate concise Markdown reports for sharing or review.
  • Use case: A sales analyst can combine customer and order exports, clean inconsistent fields, and produce a monthly summary report without leaving the terminal.

Quick Start

Use the csv-pipeline skill to clean the attached CSV file, deduplicate rows, and generate a grouped summary report.

Frequently Asked Questions about csv-pipeline

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I clean and deduplicate rows in a large CSV file?

To clean and deduplicate CSV data, you can process tabular files using standard-library parsing with streaming support for large files. This approach filters rows, removes duplicates, and outputs cleaned data deterministically without requiring external dependencies beyond Python 3.

Can I join multiple CSV tables and generate a grouped summary report?

Yes, you can join related CSV tables and compute grouped summaries including sums, averages, and counts. The process transforms combined datasets into analysis-ready outputs and generates concise Markdown reports for sharing or review.

Does this approach work with JSON and JSON Lines files or only CSV?

This tabular data processing works with CSV, TSV, JSON, and JSON Lines files. It handles format conversion between these types, allowing you to parse, clean, and transform any supported tabular data format into your desired output.

What is the best way to aggregate and summarize tabular data without external dependencies?

The best way to aggregate tabular data without external dependencies is using a standard-library Python 3 approach. It applies deterministic transformations to compute grouped summaries, count records, and identify missing values directly in command-line workflows.

How do I convert JSON data to a cleaned CSV format for analysis?

You can convert JSON or JSON Lines data to cleaned CSV by applying tabular transformations that validate rows and restructure fields. This format conversion process ensures the output CSV is analysis-ready and free of common formatting issues.

Do I need to install external Python libraries to filter and sort TSV files?

No, you do not need external Python libraries to filter and sort TSV files. The processing relies entirely on Python 3 standard-library parsing, ensuring deterministic tabular transformations without any additional dependencies.