skills.rest
babyworm
babywormCOMMUNITY
Explore all skills by this author →
WebsiteGitHub

codec-conformance-eval

Evaluate C reference decoders against official conformance bitstreams with MD5 or bitexact checks.

43|9|Updated Feb 25, 2026
Search Tags:#c#psnr#decoder#conformance#md5#bitexact#aws-batch
One-click install
npx skills add https://github.com/babyworm/rtl-agent-team --skill codec-conformance-eval
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: codec-conformance-eval
Source: https://github.com/babyworm/rtl-agent-team/tree/main/skills/codec-conformance-eval
Command: npx skills add https://github.com/babyworm/rtl-agent-team --skill codec-conformance-eval

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires hjson, numpy, boto3, ffmpeg, gcc, make, and includes scripts (resource) components.

What problem does it solve?

Ensures C reference model decoders correctly implement codec standards by automating the tedious process of building the ref C decoder, running hundreds of official conformance bitstreams, and verifying bitexact or quality-based matches against golden outputs so algorithmic bugs are detected early.

Core Features & Use Cases

  • Automated Build: Builds ref C decoder sources (C11, gcc) with Makefile fallback and configurable C flags.
  • Parallel Execution: Runs large conformance sets locally with ProcessPoolExecutor or submits jobs to AWS Batch for large-scale evaluation.
  • Flexible Comparison Modes: Supports MD5, byte-for-byte bitexact, PSNR threshold checks, and opt-in SSIM/VMAF quality metrics.
  • Reporting & Coverage: Produces per-stream PASS/FAIL reports, profile/level coverage matrix, and a templated conformance report for documentation.
  • Use Cases: Algorithm verification during Research/Architecture phases, pre-RTL conformance gatekeeping, and third-party conformance validation.

Quick Start

Run the codec-conformance-eval skill to build the reference C decoder, run parallel MD5 or bitexact conformance checks for the chosen standard/profile, and generate the conformance report.

Frequently Asked Questions about codec-conformance-eval

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I validate a C decoder against official conformance bitstreams?▼

You can validate a C decoder by building the ref C decoder with gcc, running parallel conformance bitstream decoding locally or via AWS Batch, and comparing decoded outputs using MD5, bitexact, or PSNR checks.

What is the best way to automate codec conformance testing for a reference C decoder?▼

Automating codec conformance testing involves running parallel decoding jobs across official bitstreams via ProcessPoolExecutor or AWS Batch, verifying MD5, bitexact, and PSNR matches, and generating templated coverage reports.

How do I check PSNR and bitexact conformance for decoded video streams?▼

Checking PSNR and bitexact conformance requires running decoded video streams against golden outputs, applying byte-for-byte bitexact checks, PSNR threshold validation, and optional SSIM or VMAF quality metrics to ensure algorithmic compliance.

Can I run large-scale conformance evaluation jobs using AWS Batch?▼

Yes, you can run large-scale conformance evaluation jobs using AWS Batch by submitting official bitstream sets for parallel decoding, allowing you to evaluate hundreds of C decoder outputs for MD5 and PSNR compliance at scale.

Does the conformance evaluation tool generate profile and level coverage reports?▼

Yes, the conformance evaluation generates per-stream PASS or FAIL reports, a profile and level coverage matrix, and a templated conformance report for documentation, with optional profile and level filtering during bitstream processing.

What limitations exist when using PSNR thresholds instead of bitexact matching for decoder verification?▼

When using PSNR thresholds instead of bitexact matching, limitations include not detecting exact byte-level discrepancies, requiring careful threshold configuration, and potentially missing subtle algorithmic bugs that bitexact or MD5 verification would catch.

Related Skills

Explore More Software Engineering Skills→
bdgscotlandbdgscotland
30

build-amiga

Cross-compile AmigaOS C source with bebbo-gcc or VBCC inside Docker.

Community
Intermediate
babywormbabyworm
43

rtl-conformance-test

Compare RTL-generated bitstreams against JM/HM reference decoder outputs.

Community
Advanced
babywormbabyworm
43

codec-rd-eval

Automate BD-PSNR and BD-rate comparisons across encoder configurations.

Community
Advanced
babywormbabyworm
43

rtl-p5s-func-verify

Run cocotb multi-seed regressions comparing RTL outputs to reference models.

Community
Advanced