running-web-ci-suites

Runs WebMobAI scenario suites as CI gates with sharding, JUnit reports, and exit codes.

Updated Apr 11, 2026
One-click install
npx skills add https://github.com/celikgo/webmobai --skill running-web-ci-suites-celikgo
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: running-web-ci-suites
Source: https://github.com/celikgo/webmobai/tree/main/.claude/skills/running-web-ci-suites
Command: npx skills add https://github.com/celikgo/webmobai --skill running-web-ci-suites-celikgo

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Turning a folder of WebMobAI scenario JSON files into a trustworthy CI build gate is error-prone: wrong binaries exit 0 on failure, tag typos silently skip tests, and traces never make it into uploaded artifacts. This Skill wires suites, parallelism, sharding, reporters, and exit codes correctly. ## Core Features & Use Cases - Suite authoring and execution: Builds suite JSON files with tags, defaults, and inline or path-based scenario entries, then runs them with webmobai-suite using --workers, --shard, --tag, and --reporter flags. - CI pipeline wiring: Produces a complete GitHub Actions workflow with Playwright browser installation, webmobai-doctor preflight, JUnit XML publishing, and artifact upload including per-scenario trace.zip files. - Exit code discipline: Explains the 0/1/2 exit semantics of webmobai-suite, webmobai-scenario, and webmobai-doctor, and why webmobai-test must never gate a build. - Use Case: A team has 12 scenario files and wants a GitHub Actions gate that fails pull requests. This Skill generates the suite file, a 4-shard matrix workflow, JUnit reporting via dorny/test-reporter, and the sessionDir copy step that archives Playwright traces. ## Quick Start Ask the AI to set up your WebMobAI scenario files as a sharded GitHub Actions gate with JUnit reporting and trace artifact uploads.

Frequently Asked Questions about running-web-ci-suites

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run WebMobAI scenarios in GitHub Actions?▼

Write a suite JSON file listing scenario paths with tags, then run webmobai-suite with --workers, --shard, --reporter both, and --out in a workflow step. Pre-install browsers with npx playwright install --with-deps chromium and preflight with webmobai-doctor.

How to shard Playwright test suites across CI machines?▼

Use webmobai-suite --shard k/n with a CI matrix, where k is 1-based and striping assigns indices by modulo. Every shard must receive identical --tag and --exclude-tag flags because filtering runs before sharding, and there is no cross-shard report aggregation.

Why does my CI job exit with code 2 but show no test failures?▼

Exit 2 from webmobai-suite is a usage error, not a test failure. Common causes are =-form flags like --workers=4, unknown options, a second positional argument, or the tag guard triggering when a filter matches zero of a non-empty suite.

Can I use webmobai-test as a CI gate?▼

No, webmobai-test always exits 0 even with failing checks, runs headed, and emits JSON-lines for the desktop app. Gate CI on webmobai-suite or webmobai-scenario, which exit 1 when any scenario step fails.

How do I run authenticated browser tests in CI?▼

Store the storageState JSON as a CI secret, write it to a file at job start, preflight with webmobai-doctor --storage-state, then pass --storage-state to the runner. In suites, a scenario-level storageState field silently overrides the flag due to ??= precedence.

Where are Playwright traces stored after a suite run?▼

Traces are written per-scenario to temporary session directories under the OS tmpdir, not into --out. Read each scenario's sessionDir from the suite-<ts>.json report and copy the trace.zip files into your artifact directory before upload.