auto-caching

What problem does it solve?

Caching discipline improves performance and reliability by preventing stampedes, avoiding cached errors, ensuring proper invalidation, stale-while-revalidate, and observability.

Core Features & Use Cases

• Stampede protection (single-flight) ensures concurrent misses coalesce into a single fetch.
• Never cache errors; uses short negative cache and clear invalidation strategy.
• Invalidation strategy to ensure data freshness and predictable TTL.
• Stale-while-revalidate to serve data while refreshing in background.
• Observability with metrics for hits, misses, evictions, and fetch latency.

Quick Start

Implement a cache wrapper that prevents stampede, avoids caching errors, includes invalidation, and exposes observability for an API call.