Scaffold NeMo-Gym benchmarks with resources servers, data pipelines, and YAML configs.
npx skills add https://github.com/NVIDIA/skills --skill add-benchmark
Please help me install this Agent Skill. Skill: add-benchmark Source: https://github.com/NVIDIA/skills/tree/main/skills/NeMo-Gym/add-benchmark Command: npx skills add https://github.com/NVIDIA/skills --skill add-benchmark
This Skill provides a complete, end-to-end workflow for adding a new benchmark to NeMo-Gym, including scaffolding a resources server, preparing data, configuring resources, and validating end-to-end rollouts.
Run the NeMo-Gym scaffold and wire datasets, configs, and tests to add a new benchmark.
High-intent search queries and answers about installing and using this skill.
You add a NeMo-Gym benchmark by scaffolding a resources server, defining data pipelines in JSONL format, and setting up YAML configurations. The workflow guides you from data preparation through validation tests and baselining.
Gym JSONL format defines data structures for reproducible benchmark experiments in NeMo-Gym. It enforces consistent data preparation aligned with Gym patterns for validation tests and baselining.
Scaffolding a resources server generates a consistent project structure for NeMo-Gym benchmarks. It establishes the foundation to wire datasets, YAML configurations, and binary reward schema validation tests.
NeMo-Gym benchmark validation uses a binary reward schema within integrated test and baseline workflows. It performs end-to-end smoke tests and reward profiling to validate new benchmark integrations.
YAML configurations define test patterns and resource settings for reproducible NeMo-Gym benchmark experiments. They ensure consistent validation workflows and baseline profiling across integration runs.
Validating end-to-end rollouts uses NeMo-Gym's integrated test and baseline workflow with smoke tests and reward profiling. This confirms the new benchmark adheres to Gym patterns and produces correct results.
yo-stevenIntegrate new NeMo-Gym benchmarks with JSONL data and verify() rewards.
yo-stevenJoin materialized inputs with rollout results for Nemo Gym reward profiling.
SivanwolCreate Spatie Laravel Data DTOs with nested structures, formatters, and test factories.
TheBushidoCollectiveTest React Native Web components with Jest and React Native Testing Library.
