self-validation-loop

Automate self-validation loops for triadic color systems comparing predictions against observations.

60|13|Updated Dec 22, 2025
One-click install
npx skills add https://github.com/plurigrid/asi --skill self-validation-loop
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: self-validation-loop
Source: https://github.com/plurigrid/asi/tree/main/skills/self-validation-loop
Command: npx skills add https://github.com/plurigrid/asi --skill self-validation-loop

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Enables evaluation of triadic color systems by comparing predicted colors against observed colors, then aggregating accuracy and surprise to guide learning.

Core Features & Use Cases

  • Prediction vs observation: efference copy vs actual color perception.
  • Metric reporting: accuracy, surprise, and JSON logs for auditing.
  • Gay MCP tools integration: compatible with efference_copy, color_at, and comparator modules.

Quick Start

Run a self-validation loop over indices 1..20 and report accuracy and surprise.

Frequently Asked Questions about self-validation-loop

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I validate triadic color predictions against observed colors?

Triadic color validation compares predicted colors from a color system against actual observed values using a self-validation loop. Feed seed, indices, and color sources (splitmix_ternary, xoroshiro_3color, gay_mcp) into the loop with a comparator to measure accuracy and surprise, outputting a structured log with error metrics and pass/fail results based on your threshold.

What does accuracy and surprise mean in color system evaluation?

Accuracy measures how closely predictions match observations; surprise quantifies unexpected deviations. The self-validation loop aggregates both metrics across evaluations to guide learning, enforcing thresholds like accuracy ≥ 0.99 or zero surprise to determine whether the color system passes validation.

Can I use this with splitmix_ternary, xoroshiro_3color, and gay_mcp color sources?

Yes. The self-validation loop is designed to work with indices-driven color streams from these three sources. It applies reafference or a comparator module to measure prediction accuracy and surprise across all three, generating auditable JSON logs for each evaluation run.

How do I set up inputs for a self-validation loop?

Provide seed (random initialization), indices (range to validate, e.g., 1..20), color sources (splitmix_ternary, xoroshiro_3color, or gay_mcp), and a comparator to measure predicted vs. observed alignment. The loop outputs accuracy, surprise, errors, and a pass/fail decision based on your threshold.

What output does the self-validation loop produce?

A structured JSON log containing seed, indices, predicted colors, observed colors, error values, accuracy percentage, surprise metric, and a pass/fail result. This auditable record enables tracking validation performance and refining color system parameters.

When should I use self-validation for color systems instead of manual testing?

Automate validation when you need repeatable, metric-driven evaluation across multiple indices and color sources. Self-validation loops enforce consistent pass thresholds and generate comparable logs, scaling beyond manual spot-checks to catch systemic prediction drift.