weights-and-biases

Log ML experiment metrics, hyperparameters, and artifacts to W&B.

247|22|Updated Dec 11, 2024
One-click install
npx skills add https://github.com/graniet/kheish --skill weights-and-biases-graniet
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: weights-and-biases
Source: https://github.com/graniet/kheish/tree/main/skills/mlops/evaluation/weights-and-biases
Command: npx skills add https://github.com/graniet/kheish --skill weights-and-biases-graniet

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill eliminates the tedious, error-prone manual work of tracking ML experiments, comparing hyperparameter runs, and managing model versions across teams, which often leads to lost results, unreproducible training, and disjointed collaboration for MLOps workflows.

Core Features & Use Cases

  • Automated Experiment Tracking: Automatically log metrics, hyperparameters, and artifacts for every ML training run, with real-time visualization of training progress in the W&B dashboard.
  • Hyperparameter Optimization: Run automated sweeps using grid, random, or Bayesian search to find optimal model configurations without manual trial and error.
  • Model Registry & Team Collaboration: Version and track models with full lineage, share runs with team members, and manage deployment stages (development, staging, production) for production models.
  • Use Case: A data science team training multiple image classification models can use this Skill to automatically log all training metrics, run hyperparameter sweeps to find the optimal learning rate and batch size, and version the best model in a shared registry for deployment.

Quick Start

Use the weights-and-biases skill to track your PyTorch image classification training run, log training and validation metrics every epoch, and save the best model to your W&B project.

Frequently Asked Questions about weights-and-biases

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I track machine learning experiments and hyperparameter trials for PyTorch or TensorFlow?

You can track machine learning experiments by automatically logging metrics, hyperparameters, and artifacts to a dashboard for real-time visualization. This eliminates manual tracking and reproducibility gaps for PyTorch and TensorFlow projects.

What is the best way to run hyperparameter sweeps without manual trial and error?

Running hyperparameter sweeps is best handled by executing automated grid, random, or Bayesian searches to find optimal model configurations. This removes manual trial and error when tuning learning rates and batch sizes.

Do I need W&B API credentials to log model artifacts and sweep configurations?

Yes, you need valid W&B API credentials and the wandb Python library to log metrics, artifacts, and sweep configurations. These credentials connect your training scripts to cloud-hosted or self-hosted W&B instances.

Can I version models and manage deployment stages for production machine learning workflows?

Yes, you can version models and manage deployment stages like development, staging, and production in a shared model registry. This tracks full lineage and enables team collaboration across deployment stages.

Does experiment tracking work with HuggingFace model training projects?

Yes, experiment tracking works with HuggingFace model training projects alongside PyTorch and TensorFlow. It logs training and validation metrics every epoch and saves the best models directly to your project.

Why does manual tracking cause collaboration friction for MLOps workflows?

Manual tracking causes collaboration friction because it is tedious and error-prone, leading to lost results and unreproducible training. Disjointed teams struggle to compare hyperparameter runs and manage model versions effectively.