dec-bench-quickstart

Validate DEC Bench prerequisites and execute the first benchmark scenario.

1|2|Updated Feb 22, 2026
One-click install
npx skills add https://github.com/514-labs/agent-evals --skill dec-bench-quickstart
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: dec-bench-quickstart
Source: https://github.com/514-labs/agent-evals/tree/main/.claude/skills/dec-bench-quickstart
Command: npx skills add https://github.com/514-labs/agent-evals --skill dec-bench-quickstart

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Validate a developer's ability to set up and run DEC Bench by ensuring prerequisites are met and the first scenario executes.

Core Features & Use Cases

  • Preflight validation of Docker, CLI, repository structure, and API keys to prevent setup failures.
  • One-click initiation of a first benchmark scenario to verify the end-to-end workflow from build to results.
  • Suitable for onboarding new users and teams adopting DEC Bench to demonstrate a quick-start experience.

Quick Start

Run dec-bench build --scenario foo-bar-csv-ingest and then dec-bench run --scenario foo-bar-csv-ingest to execute your first benchmark.

Frequently Asked Questions about dec-bench-quickstart

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I validate my benchmark environment setup before running a scenario?

To validate a benchmark environment setup, check prerequisites like Docker, CLI, repository path, and API keys. Preflight validation ensures these components are present to prevent setup failures before executing the first benchmark scenario.

What is the best way to run a first benchmark scenario for quick onboarding?

The best way to run a first benchmark scenario is using a one-click initiation command. Execute `dec-bench build --scenario [name]` followed by `dec-bench run --scenario [name]` to verify the end-to-end workflow from build to results.

Do I need Docker and API keys to execute DEC Bench scenarios?

Yes, you need Docker and API keys to execute DEC Bench scenarios. Environment prerequisites including Docker, CLI, repository structure, and valid API keys must be present to successfully build and run benchmark workflows.

Why does my benchmark scenario fail to start during execution?

A benchmark scenario fails to start if environment prerequisites are missing. Ensure Docker, CLI, repository path, and API keys pass preflight validation to prevent setup failures and allow the end-to-end workflow to execute.

How do benchmark scenarios produce repeatable results and verifiable artifacts?

Benchmark scenarios produce repeatable results and verifiable artifacts by applying a standardized execution workflow across a single scenario. This ensures consistent outputs from the build phase through to the final results verification.