tech/cloudflare/ai

What problem does it solve?

This Skill Unit provides advanced AI services for edge inference, unified proxying, and vector databases, addressing the need for efficient and scalable AI solutions at the edge.

Core Features & Use Cases

• Edge Inference: Perform LLM inference at the edge with zero cold starts, classifying intent or routing requests before calling Claude.
• AI Gateway: Serve as a unified proxy for Claude, OpenAI, and Workers AI, enabling token metering, caching, and rate limiting.
• Vector Database: Implement semantic search and RAG (Retrieval-Augmented Generation) for efficient knowledge retrieval and skill discovery.
• Use Case: Imagine a scenario where you need to classify user queries at the edge, retrieve relevant context from a vast knowledge base, and generate responses using Claude. This Skill Unit provides the tools to do all of this seamlessly.

Quick Start

Use the tech/cloudflare/ai skill to classify user queries and retrieve relevant context for a response.