sentry-setup-ai-monitoring

Configure Sentry AI monitoring for JavaScript and Python projects.

10|Updated Jan 7, 2026

Search Tags:#python #javascript #tracing #sentry #ai monitoring #llm observability

Ready to run

npx skills add https://github.com/troykelly/codex-skills --skill sentry-setup-ai-monitoring-troykelly

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: sentry-setup-ai-monitoring
Source: https://github.com/troykelly/codex-skills/tree/main/external/skills/sentry-setup-ai-monitoring
Command: npx skills add https://github.com/troykelly/codex-skills --skill sentry-setup-ai-monitoring-troykelly

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This skill helps you integrate Sentry's AI Agent Monitoring into your project, allowing you to track and analyze your AI/LLM calls, monitor agent executions, and understand token consumption.

Core Features & Use Cases

Automated SDK Detection: Automatically detects installed AI SDKs (OpenAI, Anthropic, LangChain, etc.) and configures the appropriate Sentry integration.
Comprehensive Monitoring: Tracks LLM calls, agent executions, tool usage, and token consumption.
Use Case: You've built an AI-powered chatbot and want to ensure its performance, monitor costs, and debug issues. This skill helps you set up Sentry to gain visibility into every AI interaction.

Quick Start

Use the sentry-setup-ai-monitoring skill to set up AI monitoring for your project.

Frequently Asked Questions about sentry-setup-ai-monitoring

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I set up Sentry AI monitoring for my Python or JavaScript project?▼

To set up Sentry AI monitoring, you need the Sentry SDK installed alongside your AI libraries. The skill automatically detects installed SDKs like OpenAI or LangChain and configures the appropriate Sentry integration to instrument LLM calls.

What AI SDKs are supported for Sentry LLM observability?▼

Sentry LLM observability supports JavaScript and Python projects using AI SDKs such as OpenAI, Anthropic, and LangChain. The skill detects these installed libraries and applies the correct integration for tracking agent executions and tool usage.

How does Sentry tracing work for AI agent executions and token consumption?▼

Sentry tracing for AI agent executions works by instrumenting your LLM calls and tool usage through specific integrations. This allows you to monitor performance, track token consumption, and analyze every AI interaction within your application.

Do I need a specific Sentry integration to monitor LLM calls?▼

Yes, you need the correct Sentry integration applied to your project. This skill identifies your installed AI libraries and automatically applies the matching Sentry integration required to capture LLM calls, agent executions, and token data.

Can I use Sentry to debug an AI chatbot and monitor costs?▼

Yes, Sentry AI monitoring helps you debug AI chatbots by tracking agent executions and LLM calls. It provides visibility into every AI interaction, allowing you to monitor performance, understand token consumption, and analyze operational costs.

Why is my Sentry AI monitoring not capturing LLM calls?▼

Sentry AI monitoring fails to capture LLM calls if the correct integration is not applied or if the Sentry SDK and relevant AI libraries are missing. This skill resolves that by detecting installed SDKs and configuring the appropriate integration automatically.