ara-rigor-reviewer

Reviews Agent-Native Research Artifacts across six epistemic dimensions and writes a severity-ranked JSON report.

Updated Aug 28, 2026
One-click install
npx skills add https://github.com/Its-Atharva-Gupta/forge-researcher --skill ara-rigor-reviewer-its-atharva-gupta
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ara-rigor-reviewer
Source: https://github.com/Its-Atharva-Gupta/forge-researcher/tree/main/skills/rigor_reviewer
Command: npx skills add https://github.com/Its-Atharva-Gupta/forge-researcher --skill ara-rigor-reviewer-its-atharva-gupta

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve? Research artifacts often pass structural checks while still containing weak evidence, unfalsifiable claims, or incoherent arguments. This Skill performs a semantic peer review of an Agent-Native Research Artifact (ARA) so authors get an objective, calibrated epistemic critique before publication or release. ## Core Features & Use Cases - Six-Dimension Scoring: Scores evidence relevance, falsifiability, scope calibration, argument coherence, exploration integrity, and methodological rigor on a 1-5 scale with documented anchors. - Severity-Ranked Findings: Produces critical/major/minor/suggestion findings with verbatim evidence spans, reasoning, and constructive fixes, then maps the mean score to a Strong Accept-to-Reject grade. - Structured Report Output: Writes a complete level2_report.json at the artifact root, including per-dimension strengths, weaknesses, questions for authors, and the read order. - Use Case: After Level 1 structural validation passes on an ARA containing claims, experiments, and an exploration tree, run this review to catch a causal claim supported only by correlational evidence before the artifact is published. ## Quick Start Review the ARA in my artifact directory with the rigor reviewer and generate the level2_report.json epistemic assessment.

Frequently Asked Questions about ara-rigor-reviewer

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I review a research artifact for epistemic rigor?

Run the ARA Seal Level 2 review on the artifact directory after Level 1 structural validation passes. It reads PAPER.md, claims, experiments, and the exploration tree, scores six dimensions, and writes level2_report.json with findings and an overall grade.

What does the Level 2 rigor review evaluate?

It evaluates six semantic dimensions: evidence relevance, falsifiability quality, scope calibration, argument coherence, exploration integrity, and methodological rigor. Each is scored 1-5 with documented anchors, strengths, weaknesses, and suggestions.

Does the rigor reviewer execute code or check external sources?

No. The review operates entirely through file reading and writing tools, taking the artifact's reported evidence at face value. It does not execute code, fetch URLs, or consult external sources, and it does not re-check structural validation.

How is the overall review grade calculated?

The grade maps from the mean of the six dimension scores: Strong Accept requires mean at least 4.5 with no dimension below 3, Accept requires 3.8, Weak Accept 3.0, and any dimension scoring 1 forces a Reject.

When should I not use the Level 2 semantic review?

Do not use it before Level 1 structural validation passes, since it assumes references resolve and fields exist. It also cannot verify experimental results empirically, so use actual re-execution pipelines when reproducibility testing is required.