design-environment

Design castform BaseEnv training environments for reinforcement-learning workflows.

49|3|Updated Jun 27, 2025
One-click install
npx skills add https://github.com/castform-ai/benchmax --skill design-environment
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: design-environment
Source: https://github.com/castform-ai/benchmax/tree/main/src/benchmax/cli/scaffold/skills/design-environment
Command: npx skills add https://github.com/castform-ai/benchmax --skill design-environment

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill helps you design and implement a castform reinforcement-learning environment that can be trained, validated, and launched with clear reward logic and a correct rollout flow.

Core Features & Use Cases

  • Environment Design: Define a BaseEnv subclass with the right system prompt, tool surface, and reward structure.
  • Training Readiness: Set up discriminating rewards, dataset preprocessing, and validation-friendly behavior for reliable runs.
  • Use Case: Create a single-turn environment for a custom assistant, or build a multi-turn setup for tool use, RAG search, or trace imitation.

Quick Start

Create a castform environment by writing a BaseEnv subclass in run.py with a clear system prompt, a discriminating reward, and the correct dataset preprocessing for your training task.

Frequently Asked Questions about design-environment

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I build a reinforcement learning environment for custom assistant training?

To build a reinforcement learning environment for custom assistant training, you define a BaseEnv subclass in run.py with a clear system prompt, discriminating reward logic, and correct dataset preprocessing. This ensures your training job is validated and ready for reliable runs.

What is a discriminating reward in reinforcement learning environment design?

A discriminating reward in reinforcement learning environment design is validation-friendly reward logic that accurately differentiates successful model outputs from failures. It is essential for setting up reliable training runs and ensuring correct behavior during single-turn or multi-turn rollouts.

Can I set up multi-turn training environments for tool use and RAG search?

Yes, you can set up multi-turn training environments for tool use and RAG search. The environment design supports multi-turn setups for tool-driven tasks, retrieval-augmented generation, and trace imitation by configuring the correct tool surface and dataset preprocessing in your BaseEnv subclass.

Does this approach support single-turn training jobs and trace imitation?

Yes, this approach supports both single-turn training jobs and trace imitation. You can configure your custom run.py environment to handle single-turn assistant tasks or build multi-turn setups specifically designed for imitating traces with validated dependency handling.

Best way to validate tool handling and dependencies in an RL training environment?

The best way to validate tool handling and dependencies in an RL training environment is to implement correct tool or dependency handling within your BaseEnv subclass. This ensures training readiness and prevents rollout failures during tool-driven multi-turn tasks.

Why does my RL training job require dataset preprocessing before launch?

Your RL training job requires dataset preprocessing before launch to ensure training readiness and validation-friendly behavior. Correct preprocessing aligns the data with your discriminating reward structure, guaranteeing reliable rollout flows for single-turn and multi-turn tasks.