Compare Hebrew quote extraction methods and generate a comparison report.
npx skills add https://github.com/unfoldingWord/bp-assistant-skills --skill test-poc
Please help me install this Agent Skill. Skill: test-poc Source: https://github.com/unfoldingWord/bp-assistant-skills/tree/main/.claude/skills/test-poc Command: npx skills add https://github.com/unfoldingWord/bp-assistant-skills --skill test-poc
This skill provides an automated AB test workflow to compare prompt-over-code versus script-based quote extraction methods in translation notes, enabling evidence-based improvement decisions.
Run the test-poc to compare Hebrew quote extraction methods on a PSA chapter.
High-intent search queries and answers about installing and using this skill.
To A/B test Hebrew quote extraction for translation notes, you can run an automated workflow that compares a legacy script against a semantic alignment approach on PSA chapters. It generates per-verse quotes, a comparison report, and optional AT-fit validation outputs.
Comparing prompt-based versus script-based quote extraction is best handled by an automated A/B test workflow that evaluates both methods side-by-side on the same PSA chapter data. This produces a consolidated report highlighting differences for translation notes QA.
Yes, you can validate AT-fit for translation notes alongside quote extraction when prepared notes are present. The A/B test workflow outputs optional AT-fit validation results in addition to the standard per-verse quote comparison report.
Hebrew quote extraction testing requires resolved data paths and validated required inputs for PSA chapters. The workflow automatically resolves test data paths and validates inputs before writing the structured report to the output directory.
Semantic alignment compares to legacy scripts by evaluating both methods against PSA chapters to produce per-verse quotes. The A/B test generates a structured comparison report so you can see exactly how the semantic approach performs against the legacy script.
The A/B test report for Hebrew quote extraction is written as a structured markdown file to the /tmp/claude/poc_ab_report.md path. This consolidated report contains the per-verse quote comparisons and optional AT-fit validation results.
unfoldingWordReference Hebrew idioms, grammar patterns, and vocabulary with usage notes.
JsplixEvaluate worklogs against team lead standards and return approve, revision, or reject decisions.
GrossDesignCoGenerate word-by-word verse data for Hebrew, Aramaic, and Greek scriptures.
unfoldingWordMap Hebrew source words to English ULT words with JSON alignment output.
