exp-eval

Evaluate completed experiments and update wiki knowledge graphs with verdicts.

Updated Jun 16, 2026
One-click install
npx skills add https://github.com/KITTran/pinn-ndt-sim --skill exp-eval-kittran
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: exp-eval
Source: https://github.com/KITTran/pinn-ndt-sim/tree/main/i18n/zh/skills/exp-eval
Command: npx skills add https://github.com/KITTran/pinn-ndt-sim --skill exp-eval-kittran

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill automates the evaluation of completed experiments and updates the wiki knowledge graph and related pages (claims, ideas, and graph edges) by applying impartial cross-model review to determine how results affect the target claim.

Core Features & Use Cases

  • Impartial verdicts via cross-model review: supported, partially_supported, not_supported, or inconclusive.
  • Automated wiki updates: adjust claims confidence and status, update ideas status, refresh experiment summaries, and reconstruct graph context and open questions.
  • End-to-end workflow support: auto-update via --auto, with logging, graph edge creation, and next-step planning.

Quick Start

Run the exp-eval workflow on a completed experiment slug to automatically update the wiki.

Frequently Asked Questions about exp-eval

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate experiment evaluation and update my wiki knowledge graph?

Automating experiment evaluation requires a workflow that applies cross-model review to completed experiments, derives supported or inconclusive verdicts, and writes confidence adjustments, graph edges, and status updates directly to wiki pages.

What is cross-model review for determining if experimental claims are supported?

Cross-model review is an impartial evaluation mechanism that assesses experiment results against target claims, assigning verdicts of supported, partially_supported, not_supported, or inconclusive to ensure objective knowledge graph updates.

How do I automatically update claim confidence and idea status after an experiment?

Using an automated evaluation workflow with an --auto flag, you can process a completed experiment slug to adjust claim confidence, update idea status, refresh experiment summaries, and reconstruct graph context without manual intervention.

Does the experiment evaluation workflow support automated graph edge creation?

Yes, the experiment evaluation workflow supports automated graph edge creation, logging, and next-step planning as part of its end-to-end process for updating wiki knowledge graphs and related pages.

Can I use this automated wiki update process for inconclusive experiment results?

Yes, the automated wiki update process handles inconclusive experiment results by assigning the inconclusive verdict, updating the experiment summary, and refreshing open questions within the knowledge graph context accordingly.

What is the best way to evaluate completed experiments and reconstruct graph context?

The best way to evaluate completed experiments is running an automated cross-model review workflow that derives verdicts, updates claim status, and reconstructs knowledge graph context and open questions directly on wiki pages.