datarobot-external-agent-monitoring

Instrument external AI agents to export OpenTelemetry traces, logs, and metrics into DataRobot.

24|22|Updated Dec 14, 2025
One-click install
npx skills add https://github.com/datarobot-oss/datarobot-agent-skills --skill datarobot-external-agent-monitoring
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: datarobot-external-agent-monitoring
Source: https://github.com/datarobot-oss/datarobot-agent-skills/tree/main/skills/datarobot-external-agent-monitoring
Command: npx skills add https://github.com/datarobot-oss/datarobot-agent-skills --skill datarobot-external-agent-monitoring

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires datarobot, and includes scripts (resource) components.

What problem does it solve?

This Skill instruments external AI agents so their traces, logs, and metrics are visible in DataRobot for monitoring and governance.

Core Features & Use Cases

  • OpenTelemetry instrumentation: Adds an OpenTelemetry setup that routes traces, logs, and metrics to DataRobot using OTLP over HTTP.
  • DataRobot telemetry sink deployment: Creates a DataRobot shell deployment that receives external agent telemetry.
  • Framework-aware wiring: Detects common agent frameworks (e.g., LangChain, LangGraph, CrewAI, LlamaIndex, PydanticAI, Google ADK) and applies the appropriate instrumentation approach.

Quick Start

Instrument your agent at the project directory by giving the instruction: Instrument my agent in ./my_agent for DataRobot monitoring.

Frequently Asked Questions about datarobot-external-agent-monitoring

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I monitor external AI agents using OpenTelemetry traces?

You instrument the agent code to export OpenTelemetry traces, logs, and metrics into DataRobot via OTLP over HTTP. This requires creating a DataRobot shell deployment to act as the telemetry sink and configuring the appropriate exporters.

Can I instrument my LangChain or CrewAI agent for DataRobot observability?

Yes, the monitoring framework detects common agent frameworks including LangChain, LangGraph, CrewAI, LlamaIndex, PydanticAI, and Google ADK, applying the appropriate instrumentation to route their telemetry into DataRobot.

What environment variables are needed to configure OTLP telemetry export?

Configuring OTLP telemetry export requires environment-variable-driven endpoint and authentication wiring. You must set up additive tracer, log, and metric exporters without conflicting OTEL_EXPORTER_OTLP_* variables to ensure proper routing.

Why are my OpenTelemetry traces not showing up in DataRobot?

OpenTelemetry traces may fail to show up in DataRobot if conflicting OTEL_EXPORTER_OTLP_* environment variables override the additive exporter configuration, preventing proper routing to the DataRobot shell deployment telemetry sink.

Do I need a DataRobot deployment to start monitoring my agents?

Yes, creating a DataRobot shell deployment is required to act as the telemetry sink that receives external agent traces, logs, and metrics before the instrumentation can successfully route observability data.