slime-rl-training

Automate RL post-training for LLMs using slime with Megatron and SGLang.

Updated Aug 27, 2026
One-click install
npx skills add https://github.com/objval/hermes-agent --skill slime-rl-training-objval
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: slime-rl-training
Source: https://github.com/objval/hermes-agent/tree/main/optional-skills/mlops/slime
Command: npx skills add https://github.com/objval/hermes-agent --skill slime-rl-training-objval

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

slime provides a production-grade framework for reinforcement-learning based post-training of large language models, enabling automated improvement, memory-driven workflows, and tool-assisted reasoning in scalable pipelines.

Core Features & Use Cases

  • End-to-end RL post-training for GLM, Qwen3, DeepSeek V3/R1, and Llama 3 using Megatron-LM with SGLang rollout.
  • Data buffering, rollout routing, and multi-turn tool-use capabilities for research and production use.
  • Evaluation, monitoring, and deployment-ready workflows for reproducibility and automation.

Quick Start

Run the slime training workflow with your model and data to start RL post-training.

Frequently Asked Questions about slime-rl-training

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run RL post-training for large language models using slime?

RL post-training with slime automates building, tuning, and evaluating reinforcement learning training pipelines across GLM, Qwen3, DeepSeek, and Llama 3 models. You configure Megatron-LM, SGLang, and slime settings, then execute the workflow with your model and data to start automated improvement.

Can I use slime for multi-turn tool-use and rollout routing in LLM training?

Yes, slime supports multi-turn tool-use capabilities, data buffering, and rollout routing for both research and production use cases. These features enable scalable, memory-driven workflows and tool-assisted reasoning within reinforcement learning pipelines for large language models.

Does slime RL training work with Megatron-LM and SGLang for model rollout?

Yes, slime integrates Megatron-LM for training and SGLang for rollout to execute end-to-end RL post-training workflows. This combination requires configuring three specific categories—Megatron, SGLang, and slime—to establish the training pipeline and evaluate large language models.

What is the best way to configure a slime training pipeline for DeepSeek or Llama 3?

Configuring a slime training pipeline requires setting parameters across three categories: Megatron, SGLang, and slime. You can customize and extend workflows for DeepSeek V3/R1 or Llama 3 by incorporating optional scripts, references, and assets into your configuration.

How does reinforcement learning post-training improve large language models?

Reinforcement learning post-training enables automated improvement, memory-driven workflows, and tool-assisted reasoning in large language models. slime provides a production-grade framework to apply these techniques in scalable pipelines, offering evaluation, monitoring, and deployment-ready workflows for reproducibility.

Are there limitations when using slime for RL training with different model architectures?

slime currently supports GLM, Qwen3, DeepSeek V3/R1, and Llama 3 architectures for RL post-training. Users must ensure dependencies listed in the skill frontmatter are met and properly configure Megatron-LM and SGLang environments to avoid workflow execution issues.