abx-reinforcement-learning

Configure warm sandbox pools and run RL rollouts on AgentBox with the E2B SDK.

11|Updated Apr 30, 2026
One-click install
npx skills add https://github.com/scitix/Agent-Sandbox --skill abx-reinforcement-learning-scitix
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: abx-reinforcement-learning
Source: https://github.com/scitix/Agent-Sandbox/tree/main/plugin/skills/abx-reinforcement-learning
Command: npx skills add https://github.com/scitix/Agent-Sandbox --skill abx-reinforcement-learning-scitix

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? RL training rollouts stall when sandbox capacity is mis-sized: pools built for the wrong concurrency queue claims, autoscaling ceilings get mistaken for requests, and quota limits surface only mid-run. This Skill walks through sizing a warm pool to the trainer's actual peak concurrency and driving sandboxes correctly so episodes start in about a second instead of a minute. ## Core Features & Use Cases - Concurrency-first pool sizing: Asks for peak concurrent sandboxes (not total episodes), then sets replica targets, minReplicas floors, and autoscaling ceilings with abx scale and scaling-group updates. - E2B SDK rollout loop: Provisions capacity once with abx, then claims, runs, and discards sandboxes per episode through the standard E2B SDK, with env docs providing the API URL, domain, and scheme. - Stall diagnosis: Covers the three failure modes in order — pools stuck below demand, quota ceilings, and sandbox runtimes failing to start — with the command to check each. - Use Case: A trainer needs 10,000 episodes at 64 concurrent environments. Scale the pool to 64, set minReplicas to the steady-state floor, point the E2B SDK at the env's documented endpoint, and tag each sandbox so runs stay distinguishable. ## Quick Start Ask the assistant to set up an AgentBox warm pool sized for your peak concurrency and write an E2B SDK rollout loop that claims a sandbox per episode.

Frequently Asked Questions about abx-reinforcement-learning

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I size a sandbox pool for RL rollouts?

Size the pool to peak concurrent sandboxes, not total episodes — 10,000 episodes at 64 in flight needs 64 replicas. Use `abx scale envs <env> pools <pool> --replicas 64`, then leave autoscaling on with maxReplicas at your peak.

How do I run RL rollouts with the E2B SDK on AgentBox?

Provision the pool once with abx, then use the standard E2B SDK for the run: create a Sandbox with the env name as the template, run commands per episode, and kill it. Run `abx envs <env> docs` first to get the API URL, domain, and scheme.

Should I use SWE ReX or E2B for sandbox rollouts?

Use E2B. SWE ReX is deprecated on AgentBox, and the platform serves the E2B-compatible API, so the standard E2B SDK works unchanged for claiming, running, and discarding sandboxes.

Why is my rollout loop stalling on sandbox creation?

Stalls come from three causes in order: the pool is stuck asking for more than the cluster can place (reduce the replica target and grow again), quota is the ceiling (check `abx quotas`), or the sandbox runtime failed to start (check `abx sandboxes <id> logs`).

When should I set minReplicas on a scaling group?

Set minReplicas to the steady-state floor when your trainer ramps faster than the scale-up cooldown. The autoscaler then only handles the tail, and claims stop queueing while the pool catches up.