experiment-tracking

Log ML experiment parameters, metrics, and artifacts across MLflow, Weights & Biases, and Neptune.

1|Updated Nov 18, 2025
One-click install
npx skills add https://github.com/pluginagentmarketplace/custom-plugin-mlops --skill experiment-tracking
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: experiment-tracking
Source: https://github.com/pluginagentmarketplace/custom-plugin-mlops/tree/main/skills/experiment-tracking
Command: npx skills add https://github.com/pluginagentmarketplace/custom-plugin-mlops --skill experiment-tracking

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires pyyaml, and includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

This Skill consolidates and standardizes the tracking of ML experiments to ensure reproducibility across teams and platforms, reducing drift and enabling reliable comparisons.

Core Features & Use Cases

  • Experiment logging: Log parameters, metrics, artifacts, and environment metadata across MLflow, Weights & Biases, Neptune, and model registries.
  • Model registry integration: Versioned models with promotion and deployment tracking.
  • Collaboration & auditability: Compare runs, share dashboards, and maintain reproducible experiment histories.

Quick Start

Example setup: configure a tracking URI and log a simple run using MLflow, WANDB, or Neptune from a Python script.

Frequently Asked Questions about experiment-tracking

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I track ML experiments across MLflow, Weights & Biases, and Neptune simultaneously?

Tracking ML experiments across platforms involves logging parameters, metrics, and artifacts to MLflow, wandb, and Neptune. This Skill standardizes cross-platform experiment logging to ensure reproducibility and enable reliable run comparisons across teams.

What is the best way to maintain reproducibility and auditability for ML model training?

Reproducibility and auditability are maintained by logging environment metadata, parameters, and artifacts end-to-end. This Skill consolidates experiment histories and integrates with model registries to track versioned models, reducing drift and enabling reliable comparisons.

Can I use this to log model registry versions and track deployment promotion?

Yes, model registry integration supports versioned models with promotion and deployment tracking. This Skill connects experiment runs to model registries, enabling you to log, version, and promote models directly from your MLflow, wandb, or Neptune workflows.

Do I need a specific Python environment to run cross-platform experiment tracking?

Yes, cross-platform experiment tracking requires a Python environment with client libraries for MLflow, wandb, and Neptune installed. You also need an accessible model registry to fulfill logging and versioning needs for your tracked experiments.

How do I compare ML runs and share dashboards across different tracking platforms?

Comparing ML runs and sharing dashboards is achieved by consolidating logged parameters and metrics into a standardized format. This Skill applies to cross-platform workflows, allowing teams to compare runs and maintain reproducible experiment histories.

Why does experiment tracking fail to ensure reproducibility when switching between MLOps platforms?

Reproducibility fails when environment metadata and artifacts are not consistently logged across platforms. This Skill solves the problem by standardizing parameter and metric logging across MLflow, Weights & Biases, and Neptune, reducing drift and enabling reliable comparisons.