app-ux-eval

Grade CommCare Connect app UX screenshots against PDD ground truth.

1|2|Updated Apr 1, 2026
One-click install
npx skills add https://github.com/dimagi-internal/ace --skill app-ux-eval
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: app-ux-eval
Source: https://github.com/dimagi-internal/ace/tree/main/skills/app-ux-eval
Command: npx skills add https://github.com/dimagi-internal/ace --skill app-ux-eval

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Manually evaluating the user experience of field worker (FLW) apps is time-consuming, subjective, and often disconnected from original project design requirements. This skill eliminates that gap by providing a structured, rubric-based LLM judgment over captured app screenshots to objectively assess if the built app delivers a good experience for its intended users, with all judgments tied directly to concrete project design document (PDD) ground truth.

Core Features & Use Cases

  • Structured UX Rubric Scoring: Grades 6 core UX dimensions (clarity, flow predictability, error recovery, time budget adherence, journey completion, and capture robustness) with weighted scores and hard deduction rules for critical failures.
  • Pass/Fail Phase Verdicts: Produces per-journey and overall phase pass/fail verdicts to gate app launches, with clear surfacing of failure reasons and calibration tracking across runs.
  • Use Case: For a Connect app build, run this skill after capturing test journey screenshots to get an objective UX quality score that determines if the app is ready for field deployment, with explicit flags for issues like dead-end errors or unvalidated negative-path input handling.

Quick Start

Invoke the app-ux-eval skill as part of the /ace:qa-deep workflow to automatically grade the field worker experience of your built app against project design document requirements using the latest captured test journey screenshots.

Frequently Asked Questions about app-ux-eval

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I evaluate field worker app UX from test screenshots?

You can grade field worker app UX by evaluating captured test journey screenshots against project design document ground truth, scoring six weighted UX dimensions to produce pass or fail verdicts for app launch readiness.

Can I automate QA grading for CommCare Connect app builds?

You can automate QA grading for CommCare Connect builds by running a rubric-based evaluation over captured test journey screenshots to objectively assess if the app delivers a good field worker experience.

What UX dimensions are scored during mobile app screenshot analysis?

Mobile app screenshot analysis scores six core UX dimensions: clarity, flow predictability, error recovery, time budget adherence, journey completion, and capture robustness, applying weighted scores and hard deduction rules for critical failures.

How do I gate app launch readiness based on UX evaluation results?

You gate app launch readiness by reviewing per-journey and overall phase pass or fail verdicts generated from the UX evaluation, which explicitly flag critical failures like dead-end errors, incomplete journeys, or time budget overruns.

What happens if a field worker app has unclear field labels or dead-end errors?

Unclear field labels and dead-end errors trigger hard deduction rules during the UX evaluation, severely penalizing the rubric score and likely causing the test journey to receive a fail verdict for launch readiness.