What problem does it solve?
Unreliable Solana webhook streams and activity feeds are prone to duplicates, out-of-order processing, and data loss. This Skill enforces idempotent processing, strict ordering, and reliable retries to ensure every event is processed exactly once and in the correct sequence.
Core Features & Use Cases
- Idempotent processing: Safe replay of events by design.
- Dedupe and offset tracking: Use composite keys (slot+signature+index) to prevent duplicates and handle reorgs.
- Ordered processing with backpressure: Process events by slot then index while handling bursts with a queue and backpressure.
- Retries and DLQ: Exponential backoff with a dead-letter queue for poison messages and alerting.
- Backfill and catch-up: Reconcile missing slots on startup to keep state in sync.
- Monitoring: Metrics for queue depth, latency, failure rate; alerting rules.
Quick Start
Set up a webhook ingestion service that validates signatures, enqueues messages with slot, signature, and index; implement dedupe by slot:signature:index; configure a queue and DLQ; run a test feed to verify end-to-end processing.