mithril-cache-agent

Reduce torch.compile cold starts with a content-addressable cache.

1|Updated Dec 30, 2025
One-click install
npx skills add https://github.com/gar-ai/mallorn --skill mithril-cache-agent
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: mithril-cache-agent
Source: https://github.com/gar-ai/mallorn/tree/main/.claude/skills/mithril-cache-agent
Command: npx skills add https://github.com/gar-ai/mallorn --skill mithril-cache-agent

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Build mithril-cache to reduce torch.compile cold starts by providing a content-addressable storage layer and cache-management primitives.

Core Features & Use Cases

  • Content-addressable storage (CAS) for artifacts and intermediate results.
  • Cache key generation and eviction using a simple LRU policy.
  • Framework integration via environment hooks to redirect Torch cache directories.
  • MVP focused on minimal dependencies with a clear upgrade path.

Quick Start

Configure and run the mithril-cache-agent to initialize the content-addressable cache for torch.compile.

Frequently Asked Questions about mithril-cache-agent

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I reduce torch.compile cold starts?

Reduce torch.compile cold starts by integrating a content-addressable storage layer that caches artifacts. This approach intercepts cache directory requests to reuse intermediate results, avoiding recompilation delays.

What is content-addressable storage for PyTorch caching?

Content-addressable storage for PyTorch caching is a mechanism that stores compiled artifacts using hashes as keys. It ensures deterministic retrieval of intermediate results, preventing redundant compilations across runs.

How do I set up cache eviction for torch.compile artifacts?

Set up cache eviction for torch.compile artifacts by applying a least recently used policy. This approach automatically removes outdated cache entries, managing storage limits while keeping frequently accessed data available.

Can I redirect Torch cache directories using environment hooks?

Yes, you can redirect Torch cache directories using environment hooks. This integration intercepts standard framework requests and reroutes them to a custom content-addressable storage backend.

Does the mithril-cache-agent require external dependencies?

No, the mithril-cache-agent operates with minimal dependencies. It provides an MVP strategy using Rust and Python components without requiring external libraries, ensuring a clear upgrade path for future integration.