dt-obs-genai

Analyzes GenAI observability signals from customer applications using DQL.

Updated Jun 18, 2026
One-click install
npx skills add https://github.com/mf-dynatrace/dt-mcp-workspace --skill dt-obs-genai
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: dt-obs-genai
Source: https://github.com/mf-dynatrace/dt-mcp-workspace/tree/main/skills/dt-obs-genai
Command: npx skills add https://github.com/mf-dynatrace/dt-mcp-workspace --skill dt-obs-genai

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires DQL, and includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

This Skill provides in-depth analysis of AI Observability signals from customer GenAI applications, using DQL to identify and address issues with golden signals, LLM signals, token and cost analytics, agent signals, conversation analytics, guardrails, and evaluation quality.

Core Features & Use Cases

  • Golden Signals Analysis: Monitor traffic, errors, latency, and saturation for GenAI applications.
  • LLM Signals Analysis: Track LLM performance, provider latency, model performance, and token consumption.
  • Cost and Tokens Analysis: Estimate costs based on token consumption and identify cost spikes.
  • Agent Signals Analysis: Monitor tool usage, failing agents, step latency, loop/runaway detection, and Smartscape topology.
  • Conversation Analytics: Analyze conversation sessions, cost per conversation, and session error rate.
  • Guardrails and Safety: Monitor blocked and truncated responses, content filtering, and safety evaluations.
  • Evaluation Quality: Assess quality scores, failed evaluations, and root-cause analysis for failed responses.
  • Use Case: Consider a scenario where an application is experiencing token spikes. Use this Skill to identify the highest-spend model-provider combinations, detect token-burn spikes, and estimate costs based on token usage.

Quick Start

Use the dt-obs-genai skill to analyze the token usage by model for the last 24 hours.

Frequently Asked Questions about dt-obs-genai

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I analyze GenAI application observability signals for token consumption and cost spikes?

To analyze GenAI observability signals for token consumption and cost spikes, you can use DQL to read OpenTelemetry GenAI spans and LLM evaluation bizevents. This identifies highest-spend model-provider combinations and estimates costs based on token usage.

What is the best way to monitor LLM performance and provider latency using DQL?

Monitoring LLM performance and provider latency with DQL involves analyzing LLM signals from GenAI applications. It tracks model performance, provider latency, and token consumption to help identify bottlenecks in your LLM operations.

How do I track agent signals like tool usage and step latency in GenAI applications?

Tracking agent signals like tool usage and step latency in GenAI applications requires analyzing observability data with DQL. It detects failing agents, loop or runaway conditions, and maps Smartscape topology for your agents.

Can I use DQL to monitor guardrails and safety evaluations for LLM responses?

Yes, you can use DQL to monitor guardrails and safety evaluations for LLM responses. It analyzes observability signals to track blocked and truncated responses, content filtering, and overall safety evaluations.

Does this GenAI observability analysis require OpenTelemetry spans?

Yes, GenAI observability analysis requires OpenTelemetry GenAI spans and LLM evaluation bizevents. The Skill reads these observability signals using DQL to identify golden signals, agent signals, and evaluation quality metrics.

How do I assess conversation analytics and cost per conversation for GenAI apps?

To assess conversation analytics and cost per conversation for GenAI apps, analyze observability signals with DQL. It evaluates conversation sessions, calculates session error rates, and determines the cost per conversation.