skills.rest
514-labs
514-labsOFFICIAL
Explore all skills by this author →
Website𝕏@514hqGitHub

dec-bench-local-override

Substitute a locally-built artifact into a DEC Bench scenario image using --override during build and run.

1|2|Updated Feb 22, 2026
Search Tags:#scenarios#harness#override#artifact-management#container-testing#local-artifacts#dec-bench
One-click install
npx skills add https://github.com/514-labs/agent-evals --skill dec-bench-local-override
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: dec-bench-local-override
Source: https://github.com/514-labs/agent-evals/tree/main/.claude/skills/dec-bench-local-override
Command: npx skills add https://github.com/514-labs/agent-evals --skill dec-bench-local-override

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Substitute a locally-built artifact into a DEC Bench scenario image so changes can be tested end-to-end without publishing a release.

Core Features & Use Cases

  • Allows substituting a local binary, a directory, or a JSON fragment into a DEC Bench scenario image.
  • Supports multiple override targets (moose, moose-lib, moose-templates, clickhouse, claude-skills, and 514) and coordinates with the harness to validate changes in isolation.
  • Example: iterate on a patched binary or an updated skill inside a scenario without releasing new software.

Quick Start

Place the locally-built artifact at a path and run the build and run steps with --override to apply it in the target DEC Bench scenario.

Frequently Asked Questions about dec-bench-local-override

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I test local artifacts in a DEC Bench scenario without publishing a release?▼

You can test local artifacts in a DEC Bench scenario without publishing by substituting a locally-built binary, directory, or JSON fragment into the scenario image using the --override mechanism during build and run steps.

What is artifact override in container testing harnesses?▼

Artifact override in container testing is the process of swapping a locally-built artifact into a scenario image to validate changes in isolation, preserving default behavior when overrides are not applied.

Can I substitute a directory or JSON fragment into DEC Bench targets like moose or clickhouse?▼

Yes, you can substitute a directory or JSON fragment into supported DEC Bench override targets including moose, moose-lib, moose-templates, clickhouse, claude-skills, and 514 to validate changes.

How do I apply local artifact overrides during DEC Bench build and run steps?▼

To apply local artifact overrides during DEC Bench build and run steps, place the locally-built artifact at a known path and execute both steps with the --override flag to swap the artifact into the harness pipeline.

Does using local artifact overrides change the default behavior of the DEC Bench harness?▼

No, using local artifact overrides does not change the default behavior of the DEC Bench harness; overrides are isolated in the pipeline and default behavior is fully preserved when overrides are not used.

Related Skills

Explore More Software Engineering Skills→
514-labs514-labs
1

dec-bench-local-test

Compile the DEC Bench CLI from source and run scenario tests in Docker containers.

Official
Intermediate
514-labs514-labs
1

dec-bench-quickstart

Validate DEC Bench prerequisites and execute the first benchmark scenario.

Official
Intermediate
514-labs514-labs
1

dec-bench-create-scenario

Scaffold DEC Bench evaluation scenarios with directory structure and CLI tooling.

Official
Advanced
Charles5277Charles5277
45

nuxt-modules

Create, test,CI/CD-publish Nuxt modules with defineNuxtModule and hooks.

Community
Advanced