accuracy-evaluator

Score translation accuracy from 0 to 5 with explicit reasoning.

2|Updated Jan 2, 2026
One-click install
npx skills add https://github.com/gonsoomoon-ml/Self-Correcting-Explainable-Translation-Agent --skill accuracy-evaluator
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: accuracy-evaluator
Source: https://github.com/gonsoomoon-ml/Self-Correcting-Explainable-Translation-Agent/tree/main/01_explainable_translate_agent/skills/accuracy-evaluator
Command: npx skills add https://github.com/gonsoomoon-ml/Self-Correcting-Explainable-Translation-Agent --skill accuracy-evaluator

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Evaluates translation accuracy by systematically checking meaning preservation, glossary adherence, and formatting integrity to reduce errors in multilingual content.

Core Features & Use Cases

  • Semantic fidelity evaluation: verifies that the translated text preserves the original meaning.
  • Glossary compliance: ensures domain terms are translated consistently according to a glossary.
  • Format and placeholders: checks that HTML tags, placeholders, and structure are preserved across languages.
  • Use Case: publishers or localization teams can automatically score translations and receive explicit rationale for each score.

Quick Start

Input a source sentence and its translated version, and the evaluator will return a 0-5 score with reasoning.

Frequently Asked Questions about accuracy-evaluator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I evaluate translation accuracy and check for meaning drift?

Evaluate translation accuracy by comparing semantic fidelity, glossary compliance, and formatting preservation. Apply backtranslation checks and glossary validation to detect meaning drift and return a deterministic 0-5 score with explicit reasoning.

How does backtranslation help verify translation consistency?

Backtranslation checks verify translation consistency by translating the target text back to the source language to identify meaning drift. This mechanism detects semantic losses and structural changes across different languages and document types.

How do I ensure HTML tags and placeholders remain intact during translation evaluation?

To ensure HTML tags and placeholders remain intact during translation evaluation, apply format integrity assessment. This process checks that structural elements and placeholders are preserved across languages and document types without unexpected modifications.

What is the best way to validate glossary compliance for domain terms in localized content?

The best way to validate glossary compliance is through automated glossary term validation. This ensures domain terms are translated consistently according to a predefined glossary and returns explicit rationale for any deviations found.

Can I get an automated translation score with explanations for my localization team?

Yes, you can get an automated translation score with explanations. Input a source sentence and its translated version to receive a deterministic 0-5 score with explicit reasoning detailing semantic, glossary, and formatting issues.

Why does my translated text lose formatting and structural elements across languages?

Translated text loses formatting and structural elements across languages when format integrity is not preserved. Applying format integrity assessment detects these structural changes, ensuring placeholders and HTML tags remain intact during the translation process.