process-feedback

Convert failing model transcripts into generalized skill and eval update proposals.

4|Updated May 12, 2026
One-click install
npx skills add https://github.com/Guria/reatom-skill --skill process-feedback-guria
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: process-feedback
Source: https://github.com/Guria/reatom-skill/tree/main/.agents/skills/process-feedback
Command: npx skills add https://github.com/Guria/reatom-skill --skill process-feedback-guria

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

It helps maintainers convert real model failures, transcripts, and correction threads into durable, repo-safe updates to skill text, references, and evals.

Core Features & Use Cases

  • Feedback intake and diagnosis: preserves the evidence sequence, separates claims from proof, and identifies the misconception and instruction-shape failure.
  • Repository-safe maintenance workflow: focuses on generalized fixes without leaking project-specific details, with explicit read-only git exploration rules.
  • Durable prevention: drafts targeted edits, recommends eval updates for reproducible failures, and audits nearby skills for wording leakage and posture drift.

Quick Start

Use process-feedback to analyze a provided transcript where the model failed to follow Reatom skill guidance, then extract generalized skill update proposals and eval changes that prevent recurrence.

Frequently Asked Questions about process-feedback

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I turn model transcript failures into durable skill improvements?

To turn model transcript failures into durable skill improvements, you analyze failing transcripts to extract generalized skill update proposals, preventing recurrence without leaking project-specific details. This preserves evidence sequences and maps misconceptions to instruction-shape taxonomy constraints for safe maintenance updates.

What is root-cause analysis for instruction tuning failures?

Root-cause analysis for instruction tuning failures identifies why a model fails to follow skill guidance by examining phase ordering, proof verification, recovery behavior, and instruction-shape constraints. It separates claims from proof in transcripts to pinpoint the exact mechanic requiring a correction.

How do I perform feedback triage on failing AI model transcripts?

You perform feedback triage on failing AI model transcripts by preserving the evidence sequence, separating claims from proof, and mapping the identified misconception to a generalized wording fix. This workflow drafts targeted edits and recommends eval updates for reproducible failures.

Can I use read-only git exploration for skill maintenance updates?

Yes, you can use read-only git exploration for skill maintenance updates. The workflow requires read-only repository exploration to audit nearby skills for wording leakage and posture drift, ensuring generalized fixes are drafted safely without modifying project-specific details during analysis.

How do I design eval updates for reproducible model failures?

You design eval updates for reproducible model failures by converting correction threads into targeted test cases that prevent recurrence. The process drafts eval changes that specifically address the identified instruction-shape constraints and misconception taxonomy failures found in the transcript.

What are the limitations of using generalized wording for skill maintenance?

The limitation of using generalized wording for skill maintenance is that it strictly avoids leaking project-specific details from the original transcripts. This means fixes are constrained to broad instruction-shape adjustments and taxonomy mapping, potentially missing highly contextual edge cases.