weights-and-biases

Call wandb.init with your project name and config, then call wandb.log with metrics like loss and accuracy inside your training loop. Finish with wandb.finish, and use wandb.save or Artifacts to upload model checkpoints.

Define a sweep config with a search method (grid, random, or bayes), a target metric, and parameter distributions, then create it with wandb.sweep. Launch one or more agents with wandb.agent pointing to your training function to execute trials.

Yes, set report_to="wandb" in TrainingArguments and the HuggingFace Trainer automatically logs metrics, evaluation results, and checkpoints to W&B. You can also add custom WandbCallback subclasses for additional logging.

Artifacts version any file-based object such as datasets or models with automatic lineage tracking between runs. The Model Registry is a curated layer where model artifacts are linked and promoted through stages like staging and production using aliases.

Yes, set WANDB_MODE=offline before initializing your run and all metrics are stored locally. Later, run wandb sync on the run directory to upload the logged data to the W&B servers.

Use Bayesian optimization for expensive training runs since it learns from previous trials and is most sample-efficient. Use grid search for a few discrete parameters needing full coverage, and random search for quick exploration across many parameters.