archive-crawler

Crawl allow-listed personal archives and convert high-signal content into brain pages.

1|Updated May 9, 2026
One-click install
npx skills add https://github.com/weiping/gbrain-cn --skill archive-crawler
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: archive-crawler
Source: https://github.com/weiping/gbrain-cn/tree/main/skills/archive-crawler
Command: npx skills add https://github.com/weiping/gbrain-cn --skill archive-crawler

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

archive-crawler turns scattered personal files (writing, ideas, relationships, and meaningful conversations) into searchable brain pages without you manually sorting through every folder and document.

Core Features & Use Cases

  • Universal archive crawling across local mounts, Dropbox/B2-style storage, Gmail takeouts, and mailbox/PST exports to discover “gold” content inside large personal collections.
  • Gold filtering with noise skipping so it focuses on user-authored writing, ideas, relationship material, and origin stories while avoiding low-value items like system/config files, spam, and binary-heavy artifacts unless you ask.
  • Explicit safety allow-list enforcement that refuses to run unless gbrain.yml defines archive-crawler.scan_paths: to prevent over-scoping sensitive content.
  • Manifest-driven triage and review loop that inventories the tree, proposes a priority queue, captures exact user reactions, ingests approved items, and never re-shows already triaged content.

Quick Start

Tell the agent: "crawl my archive and surface the writing worth keeping," after you set archive-crawler.scan_paths: in gbrain.yml to your allowed folders.

Frequently Asked Questions about archive-crawler

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract personal writing and ideas from large file archives?

Extracting personal writing from large file archives involves crawling allow-listed directories across local drives, Dropbox, and Gmail takeouts to filter for user-authored gold content while skipping system files and spam.

Can I crawl Gmail takeout or mbox exports for high-signal content?

Yes, you can crawl Gmail takeout and mbox or PST exports for high-signal content. The crawler inventories mailbox exports, filters for meaningful conversations, and proposes items for interactive review.

How do I start crawling personal file archives safely?

To start crawling personal file archives safely, define your allowed folders in an explicit gbrain.yml allow-list under archive-crawler.scan_paths, then tell the agent to crawl your archive and surface writing worth keeping.

Does archive crawling require an explicit allow-list to run?

Yes, archive crawling requires an explicit allow-list to run safely. The crawler refuses to start unless gbrain.yml defines archive-crawler.scan_paths to prevent over-scoping sensitive content across your personal directories.

How does file triage work when crawling personal archives?

File triage during archive crawling works through a manifest-driven loop that inventories the directory tree, proposes a priority queue of gold content, captures user reactions, and never re-shows already triaged items.

What kind of files are skipped during archive crawling?

During archive crawling, low-value items like system files, configuration files, spam, and binary-heavy artifacts are skipped unless explicitly requested, focusing only on user-authored writing and origin stories.