text_collector
OfficialAutomate text collection from files and directories.
Data & Analytics#data management#text extraction#research automation#file processing#text collection
Authorcas-bigdatalab
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill streamlines the process of collecting and structuring text data from various file types and directories, providing a quick and efficient solution for managing textual information.
Core Features & Use Cases
- Text Collection: Gather text content from .txt, .md, .rst, .log, and .text files.
- Directory Handling: Collect text from a directory, with options for recursive processing.
- File Encoding: Auto-detect or specify file encoding for accurate content extraction.
- Metadata Addition: Optionally include file metadata in the output for better record-keeping.
- Output Format: Export collected text in JSONL, JSON, CSV, or auto-detected format.
- Use Case: Ideal for data journalists, researchers, or anyone needing to collect and organize large text datasets from multiple sources.
Quick Start
Use the text_collector skill to collect text from the 'input_folder' directory and output to 'output_file.jsonl'.
Dependency Matrix
Required Modules
None requiredComponents
scripts
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: text_collector Download link: https://github.com/cas-bigdatalab/piflow/archive/main.zip#text-collector Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 620,000+ vetted skills library on demand.