instrumenting-with-mlflow-tracing

Instrument Python and TypeScript code with MLflow Tracing for LLM calls and agent decisions.

1|1|Updated Nov 9, 2025
One-click install
npx skills add https://github.com/Paldom/databricks-apps-streamlit-vibe-coding-starter --skill instrumenting-with-mlflow-tracing-paldom
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: instrumenting-with-mlflow-tracing
Source: https://github.com/Paldom/databricks-apps-streamlit-vibe-coding-starter/tree/main/.agents/skills/instrumenting-with-mlflow-tracing
Command: npx skills add https://github.com/Paldom/databricks-apps-streamlit-vibe-coding-starter --skill instrumenting-with-mlflow-tracing-paldom

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill simplifies the process of adding MLflow Tracing to Python and TypeScript codebases, enabling better observability and debugging for AI applications and agents.

Core Features & Use Cases

  • Code Instrumentation: Automatically adds tracing logic to LLM calls, retrieval operations, tool usage, and agent decisions.
  • Framework Support: Provides specific guidance for Python and TypeScript projects, including popular frameworks like LangGraph, LangChain, OpenAI, DSPy, CrewAI, and AutoGen.
  • Use Case: You've built an AI agent that uses LangChain and interacts with an external API. Use this Skill to instrument the agent's decision-making process and the API calls to understand latency and debug errors.

Quick Start

Instrument my Python agent with MLflow Tracing.

Frequently Asked Questions about instrumenting-with-mlflow-tracing

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I add MLflow Tracing to a Python AI agent?

MLflow Tracing instruments Python and TypeScript code by integrating with the MLflow tracing SDK to log LLM calls, retrieval operations, tool usage, and agent decisions for enhanced observability and debugging.

Does MLflow Tracing work with LangChain and LangGraph frameworks?

MLflow Tracing supports LangChain and LangGraph frameworks, providing specific instrumentation guidance for logging LLM calls and agent decisions in Python and TypeScript projects.

Can I use MLflow Tracing to debug latency in TypeScript LLM applications?

Yes, you can use MLflow Tracing to debug latency in TypeScript LLM applications by instrumenting code to trace agent decision-making processes and external API calls, helping you understand latency and debug errors.

What is the best way to monitor LLM calls and tool usage in AI agents?

The best way to monitor LLM calls and tool usage in AI agents is using MLflow Tracing to automatically add tracing logic to LLM calls, retrieval operations, tool usage, and agent decisions for better observability.

Do I need the MLflow tracing SDK to instrument my code?

Yes, you need the MLflow tracing SDK to instrument your code. Integration with the SDK is required to automatically add tracing logic to LLM calls, retrieval operations, tool usage, and agent decisions in your applications.