slime-rl-training

Orchestrate end-to-end RL post-training for LLMs with Megatron-LM and SGLang.

150|25|Updated Apr 20, 2026
One-click install
npx skills add https://github.com/Devsoul2026/Hermes-One-Click --skill slime-rl-training-devsoul2026
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: slime-rl-training
Source: https://github.com/Devsoul2026/Hermes-One-Click/tree/main/hermes-agent/optional-skills/mlops/slime
Command: npx skills add https://github.com/Devsoul2026/Hermes-One-Click --skill slime-rl-training-devsoul2026

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

slime enables end-to-end reinforcement learning post-training for large language models by integrating Megatron-LM training with SGLang rollout generation.

Core Features & Use Cases

  • End-to-end RL training for large language models using Megatron-LM and SGLang
  • High-throughput rollout generation and data buffering for efficient training
  • Supports multiple RL algorithms and model families (GLM, Qwen, Llama)

Quick Start

Pull the slime Docker image and start a GPU-enabled container, then install in editable mode to begin RL training.

Frequently Asked Questions about slime-rl-training

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run end-to-end RL post-training for large language models using Megatron-LM and SGLang?

End-to-end RL post-training integrates Megatron-LM training with SGLang rollout generation to orchestrate scalable, high-throughput workflows for large language models. It targets researchers needing production-ready RL pipelines.

What RL algorithms can I configure for LLM post-training with slime?

Configurable RL algorithms for LLM post-training include GRPO, GPO, and PPO. These algorithms operate within a production-ready workflow that utilizes a reusable data buffer for efficient rollout generation and training.

Does slime RL training support model families like GLM, Qwen, and Llama?

RL training supports multiple model families including GLM, Qwen3, and Llama. It provides scalable, high-throughput reinforcement learning workflows tailored for these architectures on Linux or macOS environments.

What is the best way to generate high-throughput rollouts during reinforcement learning?

High-throughput rollout generation is achieved by integrating SGLang with Megatron-LM training. This setup uses a reusable data buffer to efficiently manage and feed rollout data back into the training loop.

Can I use slime for RL post-training on macOS, or do I need a Linux GPU container?

RL post-training targets both Linux and macOS environments. The quick start process involves pulling a Docker image to start a GPU-enabled container, then installing the framework in editable mode to begin training.