codec-rd-eval

Automate BD-PSNR and BD-rate comparisons across encoder configurations.

43|9|Updated Feb 25, 2026
One-click install
npx skills add https://github.com/babyworm/rtl-agent-team --skill codec-rd-eval
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: codec-rd-eval
Source: https://github.com/babyworm/rtl-agent-team/tree/main/skills/codec-rd-eval
Command: npx skills add https://github.com/babyworm/rtl-agent-team --skill codec-rd-eval

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires numpy, hjson, boto3, and includes scripts (resource) components.

What problem does it solve?

Automates the tedious, error-prone process of building reference C encoders, running encoding experiments across multiple sequences and QP points, and producing quantitative rate-distortion comparisons (BD-PSNR / BD-rate) so teams can objectively compare codec algorithm candidates.

Core Features & Use Cases

  • Build ref C encoders from refc/ using a reproducible C11 gcc build step or existing binaries.
  • Parallel encoding orchestration: local ProcessPoolExecutor or optional AWS Batch submission for large-scale evaluations.
  • BD-PSNR / BD-rate calculation using VCEG-M33 polynomial fitting with 3+ QP point support and N-candidate comparisons.
  • Configurable parsing and metrics: custom encoder CLI templates, regex output parsing, and opt-in SSIM/VMAF via ffmpeg.
  • Artifacts & reporting: caches raw results under .rat/scratch/rd-eval/, computes per-sequence and aggregate metrics, and renders a markdown report from a template.
  • Use Cases: algorithm selection during DSE, fixed-point precision impact analysis, N-way candidate ranking, and regression tracking.

Quick Start

Run codec-rd-eval with a completed HJSON test-config to build encoders, execute encodes, compute BD metrics, and generate the RD evaluation report.

Frequently Asked Questions about codec-rd-eval

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate BD-rate calculations for multiple codec algorithm candidates?

You can automate BD-rate calculations by running encoding jobs across multiple sequences and QP points using a HJSON configuration, then computing BD-PSNR and BD-rate metrics via VCEG-M33 polynomial fitting to objectively rank N codec candidates.

Can I use AWS Batch for large-scale rate-distortion evaluation?

Yes, rate-distortion evaluation supports parallel encoding orchestration via AWS Batch submission using boto3, allowing large-scale evaluations across configurable sequences and QP points instead of relying solely on local ProcessPoolExecutor.

Do I need ffmpeg to compute SSIM and VMAF metrics during RD comparisons?

ffmpeg is an optional dependency required only if you want to opt-in to computing SSIM and VMAF metrics during your rate-distortion comparisons, while numpy and hjson are required for core BD-rate processing.

How do I build reference C encoders for fixed-point precision impact analysis?

You can build reference C encoders from a refc/ directory using a reproducible C11 gcc build step, or supply prebuilt encoder binaries, to analyze fixed-point precision impacts and execute design-space exploration studies.

What is the best way to compare encoder configurations across different QP points?

The best way to compare encoder configurations is using VCEG-M33 polynomial fitting with three or more QP points, generating per-sequence and aggregate BD-PSNR or BD-rate metrics rendered into a markdown report.

Why does my rate-distortion evaluation require a specific HJSON test configuration?

A HJSON test configuration is required to define custom encoder CLI templates, regex output parsing rules, configurable sequences, and QP points, ensuring reproducible automated encoding and metric computation across candidates.