doc-shard-manager

What problem does it solve?

Large documents (Markdown/JSON) often exceed token limits, forcing costly workarounds. This skill introduces shard groups to split big files into small, independently loadable parts and maintain a lightweight index stub for efficient reassembly and validation.

Core Features & Use Cases

• Core tool: tools_node/shard-manager.js, with per-group configuration (.shardrc.json) to orchestrate shifting large content into shard directories, rebuilds, and validations.
• Workflow coverage: maintenance of existing shards, creating new shard groups for new large files, and auto-splitting when shards exceed thresholds; supports scan for new files and automated partitioning.
• Practical scenario: break a 100 KB Markdown spec into 4 shards to keep per-part size under token limits, then progressively load shards as needed.

Quick Start

Run a shard operation on a new large file to split it into shard folders and update the index.