batch_collector

Scan local files or directories and generate a file inventory with metadata.

541|171|Updated May 3, 2018
One-click install
npx skills add https://github.com/cas-bigdatalab/piflow --skill batch-collector
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: batch_collector
Source: https://github.com/cas-bigdatalab/piflow/tree/main/workspace/skills/batch_collector
Command: npx skills add https://github.com/cas-bigdatalab/piflow --skill batch-collector

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

This Skill automates the process of generating a file inventory for batch processing tasks, saving time and reducing manual effort.

Core Features & Use Cases

  • Batch File Scanning: Scan one or more local files/directories or load paths from a task list.
  • Generate File Inventory: Create a metadata list of supported file extensions for further text, table, document, and image collection processes.
  • Use Case: Ideal for users needing to inventory incoming files, generate local file manifests, or prepare file lists for subsequent collection operators.

Quick Start

Run the batch_collector skill with the input directory and output file as arguments.

Frequently Asked Questions about batch_collector

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I generate a file inventory for batch processing tasks?

To generate a file inventory for batch processing, run the batch_collector skill by passing your target input directory and desired output file as arguments, which scans local paths and compiles metadata for supported extensions.

Can I load file paths from a task list to create a local file manifest?

Yes, you can load file paths from a task list to create a local file manifest, or you can directly scan one or more local files and directories to gather the necessary metadata for your batch processing operations.

Do I need to install additional dependencies for file scanning and metadata collection?

No, you do not need to install additional dependencies for file scanning and metadata collection, because this process requires only built-in Python standard libraries to scan directories and compile file extension metadata.

What is the best way to prepare a file list for subsequent data collection operations?

The best way to prepare a file list for subsequent data collection operations is to compile a metadata inventory of supported file extensions, ensuring the output manifest is ready for text, table, document, and image collection.

Does batch file scanning support compiling metadata for document and image files?

Yes, batch file scanning supports compiling metadata for document and image files, generating a comprehensive inventory that prepares these specific file extensions for further downstream collection processes.