cas-bigdatalabOfficial·150 Agent Skills Included

piflow

Clean, validate, and transform research data with AI pipelines

Automates research data processing: extract PDF text and tables, clean messy CSV/Excel files, validate quality with threshold and consistency checks, and split or merge datasets. Eliminates manual spreadsheet cleanup, encoding fixes, and repetitive quality-control marking across large data files. Chains individual operators into full DAG pipelines so your AI agent completes end-to-end data workflows from plain-language requests.

541|171

↗

npx skills add cas-bigdatalab/piflow --all -g -y

All Skills in This Repository (150)

Pure Emerald Level Indicators

📦 In Repo

cas-bigdatalab

pdf_metadata_extract

Extract metadata from PDF files into structured JSON using pypdf.

pdf_text_extract

Extract text from PDF files and save it as text files.

csv_formatter

Convert CSV files to JSONL format using the data_juicer library.

DC1_Blank_Line_Clean

Remove blank lines from CSV, TSV, Excel, and SPSS files using Python.

sink_stop

Terminate a Dataflow Graph at a specified node and save output to a path.

llm_file_transform_stop

Transform text files using OpenAI compatible APIs.

source_stop

Configure the initial data source for a DAG workflow with a file path.

stacked_symbol_cleaner

Remove decorative symbols and line separators from text data using Python regex.

systematic_sampler

Sample time-series data from JSONL files at specified intervals or counts.

ingest_archive_tar_extractor

Extract TAR archives from a directory and output a JSON report.

pipeline-minus

Subtract 5 from an integer input and return the result.

QC5_BatchThresholdCheck

Compare data points against predefined thresholds and flag outliers.

Official

Intermediate

Frequently Asked Questions

FAQPage Schema

How to install piflow?▼

Run `npx skills add cas-bigdatalab/piflow --all -g -y` in your terminal to install all skills in this suite globally.

What data tasks can piflow automate?▼

It covers data collection, cleaning, deduplication, quality validation, format conversion, and PDF/DOCX parsing, all chainable into automated pipelines.

Can piflow clean messy CSV or Excel files?▼

Yes. It includes operators for blank-line removal, missing-value handling, encoding repair, outlier detection, and threshold-based quality checks.

Does piflow work with AI agents like Claude Code?▼

Yes. Every operator follows the standard SKILL.md format, so agents can discover and run them directly from natural-language requests.

Can I use piflow without coding experience?▼

Yes. You describe the task in plain language, and the agent picks and runs the right data-processing skills for you.