archive-crawler

To find personal writing and ideas in your archives, you can use a crawler to scan your personal archives and filter for high-value content like journal entries, letters, and creative work. It surfaces this content quickly for interactive review and tagging.

Yes, you can scan Dropbox and Gmail takeout for personal content. The archive crawler supports universal archive sources including Dropbox, B2, Gmail-takeout, and local mounts to surface high-value personal writing and relationships.

To safely configure archive scanning for specific file systems, you must explicitly allow-list scan paths in the gbrain.yml configuration file. This explicit allow-listing requirement ensures the crawler only accesses authorized directories for safety.

The best way to organize and retrieve data from personal archives is using a gold filter that focuses specifically on personal writing, ideas, and relationships. This approach filters out noise and surfaces only high-value content for interactive review.

No, the archive crawler does not automatically search all local mounts. For safety, it requires explicit allow-listing of scan paths in the gbrain.yml file before it can scan any local mounts or other connected file systems.