nemo-rl-e2e-testing

What problem does it solve?

It helps teams confidently validate that a Megatron-Bridge model/provider change works end-to-end when driven by NeMo-RL’s external RL training loop, catching integration failures that Bridge-only tests can miss.

Core Features & Use Cases

• Downstream NeMo-RL compatibility validation: Runs NeMo-RL Megatron policy GRPO/SFT jobs from the current Bridge checkout to verify rollout, reward/logprob wiring, and policy setup end-to-end.
• Coverage levels for real change types: Supports increasing validation depth from a Level 0 short GRPO smoke to LoRA/checkpoint variants, non-colocated vLLM refits, optional Megatron generation backend paths, parallelism stress, architecture-specific runs, and learning-signal checks.
• Evidence-focused reporting: Produces metrics outputs (including metrics.json), records how NeMo-RL resolves the Bridge checkout (via import path), and enables pass/fail assessment with explicit pass criteria.

Quick Start

Run a Level 0 NeMo-RL external-loop GRPO Megatron smoke using the maintained wrapper command: uv run bash tests/functional/grpo_megatron.sh