What problem does it solve?
This Skill helps you configure Azure API Management (APIM) to act as an AI Gateway, enabling governance and management of AI models, tools, and agents.
Core Features & Use Cases
- Model Governance: Implement semantic caching, token limits, content safety, and load balancing for AI models.
- Tool Governance: Apply rate limiting, convert APIs to MCP tools, and manage access to tools.
- Agent Governance: Ensure content safety, detect jailbreak attempts, and filter harmful content.
- Configuration: Add Azure OpenAI backend, configure AI backend, and set token metrics.
- Testing: Test AI gateway and call OpenAI through the gateway.
- Use Case: For a company using Azure OpenAI, this Skill can help set up and manage AI services, ensuring they are secure, cost-effective, and performant.
Quick Start
Use the azure-aigateway skill to configure an AI gateway for your Azure OpenAI model.