What problem does it solve?
The Relax Skill Unit simplifies development and debugging for the Relax reinforcement learning project, providing streamlined workflows for code changes and remote training job validation.
Core Features & Use Cases
- Streamlined Development: Ensures minimal code changes and maintains existing code style for refactoring.
- Remote Training Validation: Enables running training jobs on a remote Ray cluster with monitoring and error handling.
- Elastic Rollout Scaling: Dynamically scales inference engines for efficient training execution.
- Rich Algorithm Suite: Offers a variety of algorithms out of the box with flexible reward systems and LLM-as-judge mode.
- Megatron + SGLang Backends: Leverages powerful training and inference backends for optimal performance.
- Use Case: A developer is making changes to the Relax project and needs to validate these changes by running a training job on a remote Ray cluster.
Quick Start
To start debugging the Relax project, use the command: ray serve shutdown -y && bash scripts/entrypoint/ray-job.sh scripts/training/text/<run-script>.sh