gbrain-ingest

Ingest URLs, files, and documents into gbrain with entity extraction and cross-linking.

1|Updated Jun 21, 2026
One-click install
npx skills add https://github.com/tapway/shogun-os --skill gbrain-ingest-tapway
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: gbrain-ingest
Source: https://github.com/tapway/shogun-os/tree/main/skills/gbrain/gbrain-ingest
Command: npx skills add https://github.com/tapway/shogun-os --skill gbrain-ingest-tapway

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve? External content like URLs, PDFs, images, code files, and email threads often ends up scattered and disconnected from your knowledge base. This Skill imports that content into gbrain with automatic type detection, entity extraction, correct filing paths, and back-links so nothing becomes an orphaned, invisible page. ## Core Features & Use Cases - Multi-type ingestion pipeline: Handles URLs, PDFs, images, code files, email threads, and bulk directories, each routed to the correct brain path such as references/, projects/, or decisions/. - Entity extraction and cross-linking: Scans content for people, companies, and projects, resolves them against existing brain pages, and creates back-links from every mentioned entity. - Bulk import support: Imports 500+ files via gbrain import with a subagent batching pattern that avoids out-of-memory crashes on large directories. - Use Case: You receive a PDF contract from a vendor. The Skill extracts the text, identifies entities like the company and signatory, writes the page under references/contracts/, and links it back to the existing company and people pages. ## Quick Start Import this PDF contract into the brain, extract the key entities, and cross-link it to the relevant company and people pages.

Frequently Asked Questions about gbrain-ingest

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I import a large directory of markdown files into gbrain?

Use `gbrain import <dir> --no-embed --workers N` for bulk imports. For 500+ files, split files into batch directories of about 200 files using hardlinks, then run subagents with `--workers 1` to avoid exhausting system RAM.

How do I ingest a PDF document into a knowledge base?

Extract the PDF text with OCR tools like pymupdf or marker-pdf, identify key entities such as people and companies, then write the page under the correct brain path and add back-links from each entity page to the new page.

Why does gbrain import run out of memory on large directories?

The default `--workers 8` setting can consume 14GB+ RSS on thousands of files due to connection pools and JIT heap, not the file data itself. Fix it by batching files into smaller directories and importing with `--workers 1` per subagent.

Why are my symlinked files skipped during gbrain import?

The gbrain import walker explicitly skips symlinks as a defense against symlink cycles, and there is no override flag. Use hardlinks via `os.link` or plain file copies when building batch directories.

When should I not use a general ingest pipeline?

Avoid it for media content needing transcripts or OCR (use a media ingest skill), external articles needing summarization (use an idea ingest skill), and original user thoughts, which belong in a capture workflow instead.