expo-skill-eval

Evaluates Expo skills for trigger accuracy, code quality, and runtime rendering on simulators.

Updated Sep 6, 2026
One-click install
npx skills add https://github.com/sombek/fitness-guidance-app --skill expo-skill-eval-sombek
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: expo-skill-eval
Source: https://github.com/sombek/fitness-guidance-app/tree/main/mobile/.agents/skills/expo-skill-eval
Command: npx skills add https://github.com/sombek/fitness-guidance-app --skill expo-skill-eval-sombek

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve? Verifying that an Expo skill actually works—triggers on the right prompts, generates compiling code, and renders correctly on real devices—requires a slow, manual testing loop. This Skill automates that end-to-end evaluation pipeline. ## Core Features & Use Cases - Trigger Accuracy Testing: Runs realistic prompts through claude -p subprocesses and measures whether the skill under test is selected, reporting recall. - Code Quality Gates: Generates apps with and without the skill in cached Expo fixtures, then runs tsc --noEmit, diff-aware lint, and expo export as a static gate. - Runtime Screenshots: Boots iOS simulators and Android emulators (or web via Playwright), runs the generated app in Expo Go or a development build, and captures screenshots for visual grading against expectations or a reference image. - Results Viewer: Generates a self-contained HTML report comparing with-skill vs without-skill scores, screenshots, and design-quality rubric dimensions. - Use Case: After editing a skill's description in plugins/expo/skills/, run an eval to confirm the new description improves trigger recall and that generated code still renders correctly on both platforms. ## Quick Start Evaluate the expo-ui skill end-to-end with runtime screenshots on iOS and Android using the latest Expo SDK.

Frequently Asked Questions about expo-skill-eval

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I evaluate an Expo skill end-to-end?

Run the expo-skill-eval pipeline: it creates Expo fixtures, executes prompts with and without the skill via claude -p subprocesses, runs static checks, captures simulator screenshots, and generates an HTML viewer comparing both configurations.

How do I test whether a skill triggers on the right prompts?

The trigger eval runs should-trigger prompts through claude -p with --plugin-dir pointing at the local plugin, then watches the stream for the skill's Skill or Read tool call. It measures recall only and requires the published expo plugin to be disabled first.

Does the eval support both Expo Go and development builds?

Yes. Set EXPO_SKILL_EVAL_RUNNER to expo-go (default, fast, JS-only) or dev-build, which compiles a native dev client via expo run:ios or expo run:android for skills requiring custom native code. Dev builds are slower and disk-heavy.

Can I evaluate a skill against a target UI screenshot?

Yes. Add a reference_image path to an eval case; the executor opens the image and builds an app matching it, and the grader scores visual similarity using the design rubric plus a reference_match score.

Why do snapshot runs fail when pinning an older Expo SDK?

Pinning an SDK older than the device's installed Expo Go makes expo start prompt to install a matching Expo Go, which fails in non-interactive mode. Use the latest SDK or pre-install a matching Expo Go on the simulator.

What are the system requirements for running the eval harness?

You need macOS with Xcode for iOS simulators, the Android SDK with at least one AVD, and bun installed. No other device tooling is assumed; scripts locate adb and the emulator automatically.