two-tier-extraction

Routes corpus items to utility, reasoning, or deep model tiers by content value during bulk extraction.

Updated Aug 17, 2026
One-click install
npx skills add https://github.com/AMC-JTC/gbrain-1 --skill two-tier-extraction-amc-jtc
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: two-tier-extraction
Source: https://github.com/AMC-JTC/gbrain-1/tree/main/plugin/skills/two-tier-extraction
Command: npx skills add https://github.com/AMC-JTC/gbrain-1 --skill two-tier-extraction-amc-jtc

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Processing large archives (email dumps, transcript libraries, document collections) with a single model forces a bad tradeoff: a cheap model misses nuance on important content, while an expensive model on everything costs 10-50x more on a corpus that is mostly noise. ## Core Features & Use Cases - Tiered model routing: A utility-tier model triages and classifies each item in about 2 seconds, a gate escalates high-value items to the deep tier, and the reasoning tier handles the default deep read. - Deterministic privacy wall: Named-entity and sensitive-pattern matching strips or diverts private content before any LLM call, with ambiguous items failing closed to human review. - Single-pass pipeline with checkpointing: Triage, gate, deep read, and immediate brain-page write happen in one pass with progress saved every 25 items for crash resilience. - Use Case: Processing a 16,000-item email archive where roughly 70% is noise — triage everything cheaply, deep-read only the significant threads, and cut cost roughly in half versus running the best model on everything. ## Quick Start Use two-tier extraction to process my email archive so only the significant threads get the deep-tier model.

Frequently Asked Questions about two-tier-extraction

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I process a large email archive with LLMs without high cost?

Use tiered extraction: a cheap utility-tier model triages each item in about 2 seconds, a gate escalates only high-value items to the deep tier, and noise is skipped. Donor-observed runs saved roughly 50-70% versus running the most expensive model on everything.

What is the difference between triage and deep read prompts?

The triage prompt is a minimal classifier returning only routing fields like filing category and significance scores. The deep read prompt is a full extraction asking for summaries, entities, concepts, takes, emotional significance, and relationship signals.

How does the privacy wall protect sensitive content before LLM calls?

A deterministic pass using exact-match contact lists and fixed regex pattern classes runs on raw content before any LLM call. Matched items are stripped, diverted to local-only filing, or sent to human review when ambiguous — never adjudicated by a model.

When should I escalate an item to the deep model tier?

Escalate when the item contains the user's own writing, personal correspondence, original thinking, or high emotional or business significance scores. The hard rule is: when in doubt, escalate a tier, since missing important content costs more than an extra deep-tier call.

Why avoid extracting to intermediate JSONL files in bulk processing?

Two-pass pipelines double latency and create stale intermediate state for zero quality gain. The pattern writes each item to the brain immediately after extraction and checkpoints progress every 25 items for crash resilience.

Can this pattern work for transcripts and chat archives?

Yes, the skill includes adaptations for transcripts, documents, social media archives, and chat threads. Each content type gets its own triage question, gate criteria, and deep-read extraction focus, such as coaching patterns for calls or relationship signals for chats.