methodology-review

Run periodic ablation tests comparing Stream Coding methodology components for code quality.

Updated Aug 27, 2026
One-click install
npx skills add https://github.com/Pyl-Tech/stream-coding --skill methodology-review
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: methodology-review
Source: https://github.com/Pyl-Tech/stream-coding/tree/main/.agents/skills/methodology-review
Command: npx skills add https://github.com/Pyl-Tech/stream-coding --skill methodology-review

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

It prevents an AI-assisted coding methodology from silently degrading as model capabilities change, by periodically validating which gates, rules, and workflow steps still meaningfully improve output quality.

Core Features & Use Cases

  • Ablation-driven review: Tests whether removing or simplifying a component degrades correctness, completeness, and spec conformance, so you only cut what you’ve proven is redundant.
  • Evidence-first verdicts: Produces a structured LOAD-BEARING / PARTIALLY REDUNDANT / NOT NEEDED / UNCERTAIN outcome to guide concrete updates and documentation.
  • Learning loop integration: Logs findings to the repository learnings artifact and optionally submits methodology-applicable lessons to a Learnings Hub for reuse across projects.
  • Scope-appropriate routing guidance: Helps decide whether new checks should live in rules, workflows, skills, or scripts based on how they’re invoked and enforced.

Quick Start

Run /methodology-review during a quarterly maintenance window to test one suspected component via the /experiment workflow and decide whether to keep, simplify, or remove it based on A/B evidence.

Frequently Asked Questions about methodology-review

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I test if my AI coding quality gates are still load-bearing?

To test if AI coding quality gates are load-bearing, run ablation testing via controlled A/B comparisons to measure whether removing a specific gate degrades correctness, completeness, or spec conformance. This yields a structured verdict to keep, simplify, or remove the component.

When should I review my AI coding workflow methodology?

Review your AI coding workflow methodology when upgrading model generations, after repeated zero-findings outcomes, or on a regular quarterly cadence. This prevents your methodology from silently degrading as model capabilities change over time.

What is ablation testing for AI-generated code quality?

Ablation testing for AI-generated code quality is a periodic validation process that measures whether removing or simplifying a workflow component degrades correctness, completeness, or spec conformance, ensuring you only cut rules that are proven redundant.

How do I update methodology documentation after a workflow review?

Update methodology documentation by logging ablation testing findings to your repository learnings artifact without tag-filtering, outputting a structured LOAD-BEARING or NOT NEEDED verdict, and optionally submitting universal lessons to a Learnings Hub for reuse.

How do I decide where new AI coding checks should live?

Decide where new AI coding checks should live by evaluating routing guidance based on how they are invoked and enforced. Scope-appropriate routing determines whether new checks should live in rules, workflows, skills, or scripts.

Can I run methodology reviews without external dependencies?

Yes, you can run methodology reviews without external dependencies. The review process operates independently to inventory learnings, run controlled A/B comparisons for detection and false positives, and output structured verdicts without requiring external modules.