slime-rl-training

Guide RL post-training of GLM-scale LLMs with Megatron-LM and SGLang workflows.

Updated Aug 23, 2026
One-click install
npx skills add https://github.com/t2ance/dr-claw-plugin --skill slime-rl-training-t2ance
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: slime-rl-training
Source: https://github.com/t2ance/dr-claw-plugin/tree/main/plugins/ml-training-stack/skills/post-training/slime
Command: npx skills add https://github.com/t2ance/dr-claw-plugin --skill slime-rl-training-t2ance

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

slime provides a guided framework to perform RL-based post-training for large language models using Megatron-LM and SGLang, enabling researchers to structure data pipelines and training workflows with reproducible configuration.

Core Features & Use Cases

  • End-to-end RL post-training workflow for GLM-family models.
  • Data generation, rollout routing, and multi-turn tool integration with SGLang.
  • Use case: researchers can set up a reproducible post-training loop to optimize reward models for RLHF-like objectives.

Quick Start

Run slime to kick off an RL post-training workflow for your GLM model using Megatron-LM and SGLang with your dataset.

Frequently Asked Questions about slime-rl-training

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I perform RL post-training for LLMs using Megatron-LM and SGLang?

RL post-training for LLMs is structured by configuring YAML frontmatter, dependencies, and optional scripts to build reproducible data pipelines and training workflows using Megatron-LM and SGLang.

What is the best way to set up a reproducible RL post-training loop for GLM models?

A reproducible RL post-training loop for GLM-family models is established by using a YAML frontmatter configuration to manage custom data generation, rollout routing, and multi-turn tool integration. This enables researchers to optimize reward models for RLHF-like objectives.

Does this RL training framework support multi-turn tool integration with SGLang?

Yes, SGLang supports multi-turn tool integration within the RL post-training workflow. The framework applies across GLM-scale models to manage rollouts and route data generation effectively during training.

How do I manage rollout routing and custom data generation for LLM reinforcement learning?

Rollout routing and custom data generation are managed through the framework's structured YAML configuration and optional scripts. This setup allows you to define dependencies and orchestrate training pipelines across Megatron-LM and SGLang workflows.

Can I use this to optimize reward models for RLHF-like objectives?

Yes, you can optimize reward models for RLHF-like objectives by running the guided end-to-end RL post-training workflow. It structures your data pipelines to align with GLM-family model training requirements.

What are the limitations when configuring RL training pipelines with YAML frontmatter?

The YAML frontmatter configures metadata, scripts, references, and dependencies for training pipelines. Limitations depend on your specific Megatron-LM and SGLang environment setup and the scale of your GLM-family model integration.