rlxp-reward-reflection

Generate a reward reflection JSON with component diagnosis and next action.

1|Updated May 14, 2026
One-click install
npx skills add https://github.com/junhyekh/rlxp --skill rlxp-reward-reflection
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: rlxp-reward-reflection
Source: https://github.com/junhyekh/rlxp/tree/main/plugins/rl-experiment-assistant/skills/rlxp-reward-reflection
Command: npx skills add https://github.com/junhyekh/rlxp --skill rlxp-reward-reflection

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill helps you explain why a reward-related reinforcement learning run succeeded or failed by grounding the analysis in local task metrics and reward-component trends instead of training reward alone.

Core Features & Use Cases

  • Evidence-backed diagnosis: Detect saturated, inactive, dominating, or conflicting reward terms from local artifacts.
  • Scope-aware analysis: Confirm the run belongs to the approved task or study contract before drawing conclusions.
  • Next-step guidance: Decide whether the next move should be scalar reward tuning, reward-code changes, or a different validation path.
  • Use case: After a reward-engineering run, use this Skill to compare reward behavior against the task metric and guardrails, then write a structured reflection for the next iteration.

Quick Start

Ask the assistant to analyze the local run artifacts for the active RLXP contract and produce a reward reflection JSON with the diagnosis and next recommended action.

Frequently Asked Questions about rlxp-reward-reflection

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I diagnose why a reinforcement learning reward run failed using local metrics?

To diagnose a reinforcement learning reward run, you analyze local task metrics and reward-component trends to detect saturated, inactive, dominating, or conflicting reward terms. This evidence-backed reflection grounds the analysis in local artifacts rather than training rewards alone.

How do I create a reward reflection JSON for an RLXP run?

You create a reward reflection JSON by analyzing local run artifacts for the active RLXP contract and generating a structured output with the diagnosis and next recommended action. This confirms the run scope and compares reward behavior against approved guardrails.

What is reward engineering reflection and when do I need it?

Reward engineering reflection is the process of explaining why a reward-related run succeeded or failed using local task metrics. You need it after a reward-engineering run to decide whether the next iteration requires scalar reward tuning, reward-code changes, or a different validation path.

Can I use local task metrics to detect dominating or conflicting reward terms?

Yes, you can use local task metrics to detect dominating or conflicting reward terms. The analysis evaluates reward-component trends from local artifacts to identify inactive or saturated terms and compare them against task metrics and approved guardrails.

Do I need a local metrics artifact to diagnose reward-component trends?

Yes, you need a local metrics artifact along with run and contract context and known reward keys. These inputs are required to perform scope-aware analysis and generate a structured reward reflection with a recommended next action.

What are the limitations of diagnosing reward runs without approved guardrails?

Diagnosing reward runs without approved guardrails limits your ability to confirm the run belongs to the correct task or study contract. Without these guardrails and a local metrics artifact, the reflection cannot reliably validate reward behavior or recommend the next change.