rlxp-reward-reflection

Generate a reward reflection JSON with component diagnosis and next action.

1|Updated May 14, 2026
One-click install
npx skills add https://github.com/junhyekh/rlxp --skill rlxp-reward-reflection
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: rlxp-reward-reflection
Source: https://github.com/junhyekh/rlxp/tree/main/plugins/rl-experiment-assistant/skills/rlxp-reward-reflection
Command: npx skills add https://github.com/junhyekh/rlxp --skill rlxp-reward-reflection

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill helps you explain why a reward-related reinforcement learning run succeeded or failed by grounding the analysis in local task metrics and reward-component trends instead of training reward alone.

Core Features & Use Cases

  • Evidence-backed diagnosis: Detect saturated, inactive, dominating, or conflicting reward terms from local artifacts.
  • Scope-aware analysis: Confirm the run belongs to the approved task or study contract before drawing conclusions.
  • Next-step guidance: Decide whether the next move should be scalar reward tuning, reward-code changes, or a different validation path.
  • Use case: After a reward-engineering run, use this Skill to compare reward behavior against the task metric and guardrails, then write a structured reflection for the next iteration.

Quick Start

Ask the assistant to analyze the local run artifacts for the active RLXP contract and produce a reward reflection JSON with the diagnosis and next recommended action.

Frequently Asked Questions about rlxp-reward-reflection

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I diagnose why a reinforcement learning reward run failed using local metrics?▼

To diagnose a reinforcement learning reward run, you analyze local task metrics and reward-component trends to detect saturated, inactive, dominating, or conflicting reward terms. This evidence-backed reflection grounds the analysis in local artifacts rather than training rewards alone.

How do I create a reward reflection JSON for an RLXP run?▼

You create a reward reflection JSON by analyzing local run artifacts for the active RLXP contract and generating a structured output with the diagnosis and next recommended action. This confirms the run scope and compares reward behavior against approved guardrails.

What is reward engineering reflection and when do I need it?▼

Reward engineering reflection is the process of explaining why a reward-related run succeeded or failed using local task metrics. You need it after a reward-engineering run to decide whether the next iteration requires scalar reward tuning, reward-code changes, or a different validation path.

Can I use local task metrics to detect dominating or conflicting reward terms?▼

Yes, you can use local task metrics to detect dominating or conflicting reward terms. The analysis evaluates reward-component trends from local artifacts to identify inactive or saturated terms and compare them against task metrics and approved guardrails.

Do I need a local metrics artifact to diagnose reward-component trends?▼

Yes, you need a local metrics artifact along with run and contract context and known reward keys. These inputs are required to perform scope-aware analysis and generate a structured reward reflection with a recommended next action.

What are the limitations of diagnosing reward runs without approved guardrails?▼

Diagnosing reward runs without approved guardrails limits your ability to confirm the run belongs to the correct task or study contract. Without these guardrails and a local metrics artifact, the reflection cannot reliably validate reward behavior or recommend the next change.