quality-gate

Validates research papers through layered quality gates with automated runner scripts and repair loops.

6|1|Updated May 11, 2026
One-click install
npx skills add https://github.com/yakeworld/Synthos --skill quality-gate-yakeworld
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: quality-gate
Source: https://github.com/yakeworld/Synthos/tree/main/skills/core/quality-gate
Command: npx skills add https://github.com/yakeworld/Synthos --skill quality-gate-yakeworld

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve? Scientific papers often contain unverifiable numbers, fabricated citations, fake DOIs, and inconsistent values across sections. This Skill enforces a fixed multi-layer quality gate pipeline (L0 direction check, L0.5 data honesty, G1-G7 pipeline gates, L4 content review) so every claim in a paper is traced to a source file before submission. ## Core Features & Use Cases - Layered Gate Architecture: Runs G1-G7 gates (identity, compilation, citation integrity, constitution compliance, citation quality, impact mapping, content review) plus an L0.5 data honesty gate with one-vote veto power. - Deterministic Runner: All checks execute through quality-gate-runner.py in full or fast mode, producing a structured quality_report.json with per-gate scores, issues, and P0/P1/P2 severity classification. - Repair Loop: Failed gates trigger prioritized fixes (patch paper.tex, clean bib files, recompile LaTeX) with up to three retry cycles before escalating to human review. - Use Case: Given a LaTeX paper directory with experiment JSON outputs and a references.bib file, run the full gate to verify every numeric claim traces to a source file, every DOI resolves, and compilation succeeds with zero undefined citations. ## Quick Start Run the quality gate on my paper directory outputs/papers/pima-crispdm in full mode and generate the quality report.

Frequently Asked Questions about quality-gate

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run a quality check on a LaTeX research paper?

Run quality-gate-runner.py with the --paper-dir argument pointing to the directory containing paper.tex, using --mode full for all G1-G7 gates or --mode fast for a G1+G2+L0.5 precheck. The runner outputs a quality_report.json with per-gate scores and an overall pass/fail verdict.

What does the quality gate check in a research paper?

It checks identity manifest validity, LaTeX compilation success, citation-to-bibliography match rate, constitution compliance, citation quality including DOI resolution, methodology description, structural completeness, and data honesty verifying every numeric claim traces to a source file.

How do I detect fake DOIs in a bibliography file?

Send an HTTP HEAD request to doi.org for each DOI in the bib file using curl. A 302 or 200 response indicates a real reference, while 404 indicates a fabricated DOI that must be replaced or removed. Checking only that a DOI field exists in the bib entry is insufficient.

Why does the quality gate report no .tex files found?

The runner expects --paper-dir to point at the 01-manuscript directory containing the .tex files, not the paper root directory. Its G2 and G3 checks use non-recursive directory listing, so passing the parent folder causes this error.

What happens when a paper fails the quality gate?

Issues are sorted by severity (P0, P1, P2) and repaired in order, such as patching paper.tex values, cleaning the bib file, and recompiling. The gate reruns after fixes, and after three consecutive failures the case escalates for human intervention.

What are the limitations of automated paper quality checks?

The gate does not verify that scientific claims are true, that experiments are reproducible, or that a journal will accept the paper. Citation appropriateness beyond format checks requires reading full PDF text, which needs human or model-based judgment.