adapter

To convert external benchmarks into BenchFlow, you use a multi-layer routing process that classifies the source and generates a deterministic adapter. This scaffolds the directory and ensures high-fidelity reproduction of the original benchmark behavior.

Benchmark parity verification automates side-by-side and reward-distribution checks to ensure converted benchmarks behave exactly like their originals. It validates that the structural conversion maintains the original scoring logic and task format.

You standardize diverse evaluation task formats by routing them through native, translated, or as-is layers. This classification ensures the most efficient integration path and generates structural validation for the specific benchmark.

Yes, automated adapters can process as-is benchmark formats through the routing layer. The system classifies the benchmark source and applies the appropriate integration layer to facilitate verifiable porting into the BenchFlow environment.

The best way to scaffold a benchmark converter directory is to use an automated generation process that classifies the source format and creates the necessary structural files. This ensures the conversion path is deterministic and verifiable.

If benchmark scoring logic changes after conversion, the structural validation or parity gate may have failed. Running side-by-side parity checks verifies that the deterministic adapter accurately reproduces the original behavior.