slime-user

Automate end-to-end RL training workflows for language models with SLIME.

141|11|Updated Jan 7, 2026
One-click install
npx skills add https://github.com/yzlnew/infra-skills --skill slime-user
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: slime-user
Source: https://github.com/yzlnew/infra-skills/tree/main/slime-user
Command: npx skills add https://github.com/yzlnew/infra-skills --skill slime-user

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

SLIME User Guide provides a structured, extensible workflow for RL training of language models, unifying rollout, reward modeling, and backend integrations to reduce setup complexity and accelerate experimentation.

Core Features & Use Cases

  • Multi-backend training with Megatron and FSDP backends for scalable RL training.
  • Multi-turn interactions and tool calling with custom generation and reward functions.
  • Dynamic sampling and partial rollout to improve sample efficiency across datasets.
  • Data management with JSONL prompts, labels, and metadata for RL tasks.
  • Troubleshooting and customization hooks for bespoke RL workflows. Use cases include training language models with RL, evaluating reward models, and deploying tool-enabled generation.

Quick Start

Launch a SLIME training session with a minimal setup and provide a dataset and HF checkpoint path.

Frequently Asked Questions about slime-user

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I orchestrate multi-turn RL training for language models with tool calling?

Multi-turn RL training with tool calling is orchestrated by automating rollout, reward modeling, and backend integrations. This workflow supports custom generation and reward functions for interactive language model training.

What is the best way to set up distributed RL training using Megatron or FSDP backends?

Distributed RL training using Megatron or FSDP backends is set up through a unified argument schema. This configuration supports scalable training across single or multi-node clusters while loading HF-backed model checkpoints.

Can I use dynamic sampling and partial rollout to improve RL training sample efficiency?

Yes, dynamic sampling and partial rollout can be used to improve sample efficiency across datasets during RL training. This approach optimizes data management with JSONL prompts, labels, and metadata for RL tasks.

Does SLIME support modular customization of reward functions and generation workflows?

Yes, SLIME supports modular customization of generation and reward functions alongside troubleshooting hooks for bespoke RL workflows. This extensibility reduces setup complexity and accelerates experimentation.

What data format is required for launching a minimal RL training session?

JSONL data formatting is required for prompts, labels, and metadata to launch a minimal RL training session. You must provide a dataset and an HF checkpoint path to initiate the SLIME training workflow.