model-theft

What problem does it solve?

Prevents unauthorized replication of proprietary models through API abuse. Unauthenticated or unthrottled inference endpoints enable attackers to query a model and potentially distill a clone, risking IP loss and exposure of business logic.

Core Features & Use Cases

• Enforces authentication on all inference endpoints to ensure only authorized clients can query the model.
• Applies per-user or per-API-key rate limits and monitors for extraction patterns to detect abuse.
• Strips sensitive signals from responses (e.g., logprobs, embeddings) and logs metadata for after-the-fact investigation.
• Use Case: Deploying an LLM service in production where protecting IP and preventing model theft is critical.

Quick Start

Integrate model-theft protections by enabling API key authentication, per-user rate limiting, and safe response handling on your inference endpoints.