rlxp-analyze-run

Compare reinforcement-learning run metrics against an incumbent and classify the decision.

1|Updated May 14, 2026
One-click install
npx skills add https://github.com/junhyekh/rlxp --skill rlxp-analyze-run
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: rlxp-analyze-run
Source: https://github.com/junhyekh/rlxp/tree/main/plugins/rl-experiment-assistant/skills/rlxp-analyze-run
Command: npx skills add https://github.com/junhyekh/rlxp --skill rlxp-analyze-run

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill helps you evaluate a completed reinforcement-learning run with evidence instead of guesswork, so you can tell whether a baseline or candidate truly improved and why.

Core Features & Use Cases

  • Compares primary, guardrail, and diagnostic metrics against the current incumbent.
  • Classifies the run as accept, reject, inconclusive, or debug and records the failure mode.
  • Produces reward-focused reflections when needed, including saturation, domination, and suspected hacking signals.
  • Use it after a training or evaluation job finishes, when a study needs a decision, or when you want to update the run evidence trail.

Quick Start

Use the rlxp-analyze-run skill to review the completed run against the active contract and determine the correct decision outcome.

Frequently Asked Questions about rlxp-analyze-run

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I analyze a completed reinforcement learning run to decide if it improved?

To analyze a completed reinforcement learning run, compare primary and guardrail metrics against an incumbent baseline to classify the run as accept, reject, inconclusive, or debug based on evidence.

What is baseline comparison in reinforcement learning experiment validation?

Baseline comparison in reinforcement learning experiment validation evaluates primary, guardrail, and diagnostic metrics against the current incumbent to produce an evidence-based decision rather than relying on guesswork.

How do I diagnose failure modes in a finished RL training job?

Diagnose failure modes in a finished RL training job by validating the active contract, extracting approved metrics, and recording whether the outcome is reject, inconclusive, or debug.

When do I need reward reflection for a reinforcement learning run?

You need reward reflection for a reinforcement learning run when analyzing reward-focused studies to detect signals like saturation, domination, or suspected reward hacking that impact the final decision.

Can I use this approach to update the run evidence trail after training?

Yes, you can use this approach to update the run evidence trail after training by generating structured outputs including metrics summaries, analysis notes, and ledger updates for the study.

What are the limitations of automated run analysis for RL experiments?

Automated run analysis for RL experiments requires contract validation and approved metric extraction before classifying outcomes, meaning it cannot produce valid decisions if these prerequisites are missing.