benchmark-runner

Automate image and video augmentation benchmarks across libraries with YAML configs.

95|3|Updated Oct 25, 2024
One-click install
npx skills add https://github.com/albumentations-team/benchmark --skill benchmark-runner-albumentations-team
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: benchmark-runner
Source: https://github.com/albumentations-team/benchmark/tree/main/.cursor/skills/benchmark-runner
Command: npx skills add https://github.com/albumentations-team/benchmark --skill benchmark-runner-albumentations-team

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Automates running image and video augmentation benchmarks across multiple libraries, providing validated results, cross-library comparisons, and automatic documentation updates to speed up performance evaluation.

Core Features & Use Cases

  • Standardized configuration-driven benchmarking using the benchmark CLI to run single-library or multi-library comparisons.
  • Automatic result validation, report generation, and documentation updates to keep results current.
  • Suitable for local and cloud runs, integration with YAML configs, and reuse of sample configurations for repeatable experiments.

Quick Start

Run a local RGB micro CPU benchmark using a YAML config.

Frequently Asked Questions about benchmark-runner

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate image and video augmentation benchmarks across multiple libraries?

Automate image and video augmentation benchmarks by using configuration-driven YAML files to orchestrate single-library or multi-library comparisons, validating results and generating standardized cross-library reports automatically.

Can I compare augmentation library performance on both local and cloud environments?

Yes, you can run augmentation library performance comparisons on both local and cloud environments by applying standardized YAML configurations and the benchmark CLI workflow to ensure repeatable experiments.

How do I validate benchmark results and keep documentation updated automatically?

Validate benchmark results and update documentation automatically by enforcing standardized result structures through Python tooling like pyperf, which triggers report generation and documentation updates after each run.

What is the best way to run a micro CPU benchmark for RGB image augmentations?

Run a micro CPU benchmark for RGB image augmentations by executing a local benchmark using a predefined YAML configuration, leveraging the benchmark CLI to orchestrate the test and output standardized performance metrics.

Do I need YAML configs to run multi-library augmentation comparisons?

Yes, YAML configs are required to drive multi-library augmentation comparisons, providing the standardized configuration needed to orchestrate runs, validate outputs, and integrate seamlessly with the benchmark CLI workflow.