abx-reinforcement-learning

Configure warm sandbox pools and run RL rollouts on AgentBox with the E2B SDK.

11|Updated Apr 30, 2026
One-click install
npx skills add https://github.com/scitix/Agent-Sandbox --skill abx-reinforcement-learning-scitix
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: abx-reinforcement-learning
Source: https://github.com/scitix/Agent-Sandbox/tree/main/plugin/skills/abx-reinforcement-learning
Command: npx skills add https://github.com/scitix/Agent-Sandbox --skill abx-reinforcement-learning-scitix

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? RL training rollouts stall when sandbox capacity is mis-sized: pools built for the wrong concurrency queue claims, autoscaling ceilings get mistaken for requests, and quota limits surface only mid-run. This Skill walks through sizing a warm pool to the trainer's actual peak concurrency and driving sandboxes correctly so episodes start in about a second instead of a minute. ## Core Features & Use Cases - Concurrency-first pool sizing: Asks for peak concurrent sandboxes (not total episodes), then sets replica targets, minReplicas floors, and autoscaling ceilings with abx scale and scaling-group updates. - E2B SDK rollout loop: Provisions capacity once with abx, then claims, runs, and discards sandboxes per episode through the standard E2B SDK, with env docs providing the API URL, domain, and scheme. - Stall diagnosis: Covers the three failure modes in order — pools stuck below demand, quota ceilings, and sandbox runtimes failing to start — with the command to check each. - Use Case: A trainer needs 10,000 episodes at 64 concurrent environments. Scale the pool to 64, set minReplicas to the steady-state floor, point the E2B SDK at the env's documented endpoint, and tag each sandbox so runs stay distinguishable. ## Quick Start Ask the assistant to set up an AgentBox warm pool sized for your peak concurrency and write an E2B SDK rollout loop that claims a sandbox per episode.

Frequently Asked Questions about abx-reinforcement-learning

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I size a sandbox pool for RL rollouts?▼

Size the pool to peak concurrent sandboxes, not total episodes — 10,000 episodes at 64 in flight needs 64 replicas. Use `abx scale envs <env> pools <pool> --replicas 64`, then leave autoscaling on with maxReplicas at your peak.

How do I run RL rollouts with the E2B SDK on AgentBox?▼

Provision the pool once with abx, then use the standard E2B SDK for the run: create a Sandbox with the env name as the template, run commands per episode, and kill it. Run `abx envs <env> docs` first to get the API URL, domain, and scheme.

Should I use SWE ReX or E2B for sandbox rollouts?▼

Use E2B. SWE ReX is deprecated on AgentBox, and the platform serves the E2B-compatible API, so the standard E2B SDK works unchanged for claiming, running, and discarding sandboxes.

Why is my rollout loop stalling on sandbox creation?▼

Stalls come from three causes in order: the pool is stuck asking for more than the cluster can place (reduce the replica target and grow again), quota is the ceiling (check `abx quotas`), or the sandbox runtime failed to start (check `abx sandboxes <id> logs`).

When should I set minReplicas on a scaling group?▼

Set minReplicas to the steady-state floor when your trainer ramps faster than the scale-up cooldown. The autoscaler then only handles the tail, and claims stop queueing while the pool catches up.