prompt-cache

What problem does it solve?

Reduces redundant prompt processing and compute costs by explicitly caching stable portions of multi-turn dispatch prompts and associated telemetry data, improving latency and predictability in large prompt pipelines.

Core Features & Use Cases

• Breakpoint-driven assembly: fix four deterministic cache breakpoints (system prompt, root AGENTS.md, council AGENTS.md, and skill SKILL.md) to maximize cache hit potential.
• TTL and telemetry policy: explicit TTL choices, per-project telemetry, and observability to monitor cache effectiveness and savings.
• Workspace isolation and invalidation: safe cache invalidation when source prompts change to prevent cross-project bleed.
• Use Case: accelerate repeated prompts across long-running dispatch workflows with stable content.

Quick Start

Initialize prompt-cache with a plan that declares breakpoints, TTL, and telemetry endpoints, then enable caching for repeated prompts to observe savings.