benchmark-evaluator

Name: benchmark-evaluator
Availability: InStock
Author: just-it

Orchestrate KernelBench tasks and collect results via SubAgent execution.

33|51|Updated Mar 12, 2026

Search Tags:#automation #orchestration #latency #benchmark #kernel #results

Ready to run

npx skills add https://github.com/Just-it/AscendOpGenAgent --skill benchmark-evaluator

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: benchmark-evaluator
Source: https://github.com/Just-it/AscendOpGenAgent/tree/main/skills/benchmark-evaluator
Command: npx skills add https://github.com/Just-it/AscendOpGenAgent --skill benchmark-evaluator

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Kernel benchmarks require consistent orchestration across multiple tasks; this skill automates scanning, dispatching, and aggregating results via a SubAgent workflow.

Core Features & Use Cases

Schedule and orchestrate KernelBench tasks
Dispatch kernelgen-workflow SubAgent to generate, verify, and benchmark per task
Persist per-task results and generate a final summary for the scheduling Agent

Quick Start

Provide the required inputs and run the evaluator to scan tasks, dispatch SubAgent for each task, and save per-task results to the output path.

Frequently Asked Questions about benchmark-evaluator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I automate KernelBench task orchestration and result collection?▼

KernelBench orchestration automates scanning, dispatching, and aggregating results via a SubAgent workflow. It coordinates serial, level-by-level task execution and reports results back to the scheduler in real time.

What is the best way to run serial kernel benchmarking tasks?▼

Serial kernel benchmarking is best handled by orchestrating tasks individually through a SubAgent. This evaluator dispatches each task sequentially, validates parameters, and enforces a production-grade workflow for per-task reporting.

How does a SubAgent workflow coordinate kernel benchmark evaluation?▼

A SubAgent workflow coordinates kernel benchmark evaluation by invoking a defined task tool interface for each kernel. The scheduler dispatches the SubAgent to generate, verify, and benchmark per task, then collects the results.

Do I need any dependencies to run automated kernel benchmark orchestration?▼

No external dependencies are required to run automated kernel benchmark orchestration. You only need to provide the required inputs and define the output path to start scanning tasks and dispatching the SubAgent workflow.

How are per-task benchmark results saved and summarized?▼

Per-task benchmark results are saved directly to a specified output path during execution. After all tasks finish, the orchestrator generates a final summary report for the scheduling Agent to review the aggregated benchmark data.

Why does my kernel benchmark scheduler enforce parameter validation?▼

Parameter validation is enforced to maintain a production-grade workflow during kernel benchmark scheduling. It ensures that every SubAgent invocation receives correct inputs before task execution and result reporting begins.