benchmark-execution

Enforce strict execution protocols for agentic benchmark tasks with final state verification.

58|16|Updated May 14, 2026
One-click install
npx skills add https://github.com/NVIDIA-NeMo/nemo-platform --skill benchmark-execution-nvidia-nemo
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: benchmark-execution
Source: https://github.com/NVIDIA-NeMo/nemo-platform/tree/main/agents/nemo-agent-local/src/nemo_agent/skills/benchmark-execution
Command: npx skills add https://github.com/NVIDIA-NeMo/nemo-platform --skill benchmark-execution-nvidia-nemo

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This skill ensures that agentic benchmark tasks are executed consistently and reliably, preventing incomplete plans and ensuring that final states are verified before concluding a task.

Core Features & Use Cases

  • Contract Enforcement: Mandates that agents complete all numbered requirements defined in the task instruction.
  • Direct Execution: Forces the agent to perform tool calls directly rather than providing a plan-only response.
  • State Verification: Requires a final verification step (such as a retrieve or list call) to confirm the end state of a task before responding.
  • Use Case: Use this skill when running automated agentic evaluations to ensure that the agent's performance can be accurately scored by the platform's canonical gate.

Quick Start

Execute the benchmark task by following the instructions in the provided instruction.md file and performing a final verification call to confirm the required end state.

Frequently Asked Questions about benchmark-execution

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I enforce strict execution protocols for agentic benchmark tasks?

To enforce strict execution protocols for agentic benchmark tasks, you need a framework that mandates direct tool invocation and final state verification. This skill enforces those protocols by requiring agents to complete all numbered requirements and perform a final verification call before concluding.

Why does my agentic evaluation fail the pass-rate gate with incomplete plans?

Agentic evaluations fail the pass-rate gate when agents provide plan-only responses or skip final state verification. This skill prevents incomplete plans by forcing direct tool execution and requiring a final retrieve or list call to confirm the end state before responding.

What is the best way to standardize automated testing environments for agentic tasks?

The best way to standardize automated testing environments for agentic tasks is to apply a contract enforcement mechanism. This skill mandates that agents complete all numbered task requirements and validate final states, ensuring performance can be accurately scored by the platform's canonical gate.

Do I need to perform a final verification call to validate agentic task end states?

Yes, you need to perform a final verification call to validate agentic task end states. This skill requires a final retrieve or list call to confirm the required end state of a task before responding, ensuring the agent's performance satisfies the canonical pass-rate gate.

Can I use this skill for automated agentic evaluations to ensure accurate scoring?

Yes, you can use this skill for automated agentic evaluations to ensure accurate scoring. It enforces strict execution protocols by mandating direct tool calls and state verification, allowing the platform's canonical gate to reliably score the agent's verifiable performance metrics.