ai-novel-audit

Evaluates narrative text for AI-generation likelihood using quantitative scripts and six-dimension evidence scoring.

116|21|Updated Jul 6, 2026
One-click install
npx skills add https://github.com/Xiaoyangy/novel-studio --skill ai-novel-audit-xiaoyangy
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ai-novel-audit
Source: https://github.com/Xiaoyangy/novel-studio/tree/main/skills/review
Command: npx skills add https://github.com/Xiaoyangy/novel-studio --skill ai-novel-audit-xiaoyangy

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Writers, editors, and publishers need to know how likely a piece of narrative text was generated by AI, but single-score detectors are unreliable and can falsely accuse human authors. This Skill produces a probabilistic, evidence-backed AI-authorship assessment instead of a black-and-white verdict. ## Core Features & Use Cases - Quantitative signal scripts: Runs local Python scripts (aigc_value.py, text_signals.py, paragraph_dup.py, content_lint.py) to measure sentence-length burstiness, cliche density, paragraph-level duplication, and content-integrity issues. - Six-dimension qualitative scoring: Scores syntax/rhythm, diction, emotional handling, detail specificity, metaphor organicity, and voice consistency on 0-5 scales with quoted evidence, then synthesizes an AI-authorship percentage range with confidence level. - Publication gate checks: Enforces hard delivery thresholds (AIGC value under 4%, zero paragraph duplication, risk score at or below 35/100) and records external platform spot-check values bound to exact text SHA. - Use Case: A web-novel studio pastes a 3,000-character chapter and asks whether it reads as AI-written before submission to a publishing platform; the Skill runs the scripts, scores the six dimensions, and returns a report with revision suggestions. ## Quick Start Ask the assistant to audit the attached chapter for AI-authorship likelihood and produce an evidence-based report with revision suggestions.

Frequently Asked Questions about ai-novel-audit

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I check if a novel chapter was written by AI?

Run the audit workflow on the text: execute the local signal scripts for quantitative metrics, then score six qualitative dimensions with quoted evidence. The output is an AI-authorship percentage range with a confidence level, not a definitive verdict.

What signals indicate AI-generated text in fiction?

Key signals include uniform sentence length with low burstiness CV, high cliche density across multiple categories, named emotions instead of shown ones, generic interchangeable details, stock metaphors, and paragraph-level verbatim repetition. No single signal is conclusive on its own.

Can AI text detection reliably prove a text is machine-written?

No. All AI text detection is probabilistic and can misjudge non-native writers, formulaic genre fiction, and heavily edited AI drafts. High-stakes decisions require provenance evidence such as draft history and version records alongside stylistic analysis.

Does the audit work for short texts under 300 characters?

It runs, but the report must state low confidence because short texts produce noisy signals. The Skill explicitly refuses to give high-confidence scores when the sample is too short or signals contradict each other.

Why does genre fiction score high on AI signals even when human-written?

Romance and fantasy web novels naturally use formulaic phrases, which trigger cliche-density signals. The audit compensates by weighing detail specificity and voice consistency more heavily to distinguish formulaic human writing from AI output.

What are the limitations of local AIGC detection scripts?

Local scripts approximate external detectors using proxies like entropy, TTR, and bigram surprise curves without a real language model perplexity score. Results are risk signals for editorial review, not author-identity verdicts, and external platform spot-checks are recorded separately.