training-flw-guide-eval

Grade CommCare field worker training guides against deployed app flows and accessibility constraints.

1|2|Updated Apr 1, 2026
One-click install
npx skills add https://github.com/dimagi-internal/ace --skill training-flw-guide-eval
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: training-flw-guide-eval
Source: https://github.com/dimagi-internal/ace/tree/main/skills/training-flw-guide-eval
Command: npx skills add https://github.com/dimagi-internal/ace --skill training-flw-guide-eval

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Poorly written field worker (FLW) training guides leave first-time workers stranded during real visits, leading to failed task completion, wasted onboarding time, and poor field program outcomes. This Skill eliminates that risk by providing a rigorous, standardized grading framework for FLW guides.

Core Features & Use Cases

  • 5-Dimension Weighted Rubric: Evaluates guides on step concreteness, error recovery coverage, screenshot completeness, language accessibility, and flow ordering fidelity, with hard-gate failure rules for critical gaps.
  • Held-Out Comprehension Testing: Simulates a naive first-time worker with only the guide to score real task completion, not just superficial mentions of UI controls.
  • Use Case: For product and QA teams building CommCare-based field workflows, use this Skill to validate training guides before deployment to ensure new field workers can complete visits without external support.

Quick Start

Use the training-flw-guide-eval skill to grade the Phase 6 FLW guide for your current Connect opportunity and generate a verdict YAML with scored dimensions and surfaced issues.

Frequently Asked Questions about training-flw-guide-eval

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I evaluate field worker training guides for CommCare onboarding usability?

Evaluate field worker training guides by grading them against deployed CommCare app flows using a 5-dimension weighted rubric that scores step concreteness, error recovery, screenshot completeness, language accessibility, and flow ordering to ensure first-time workers can complete visits without external support.

What makes a field worker training guide effective for first-time onboarding?

An effective field worker training guide provides concrete steps, comprehensive error recovery coverage, complete screenshots, accessible language, and correct flow ordering fidelity matching the deployed app, ensuring naive workers can complete end-to-end visits independently without external support.

How do I grade a CommCare training guide to ensure new field workers won't get stranded?

Grade CommCare training guides by simulating a naive first-time worker with only the guide to complete tasks, applying hard-gate failure rules for critical gaps and producing a structured verdict YAML with weighted dimension scores and surfaced severity issues.

Can I use automated grading to validate training guides before deploying CommCare field programs?

Yes, you can validate training guides before deployment by applying a rigorous standardized grading framework that checks accessibility constraints and error recovery requirements, generating scored dimensions and failure flags to catch gaps before field workers encounter them.

What dimensions should I check when reviewing field worker training guide quality?

Check field worker training guide quality across five dimensions: step concreteness, error recovery coverage, screenshot completeness, language accessibility, and flow ordering fidelity, with hard-gate failure rules flagging critical gaps that would block task completion.

Why does my field worker onboarding guide fail to prepare new workers for real visits?

Field worker onboarding guides fail when they lack step concreteness, miss error recovery coverage, have incomplete screenshots, use inaccessible language, or deviate from deployed app flow ordering, leaving first-time workers stranded during real visits without external support.