What problem does it solve?
End-to-end tests that pass sometimes and fail other times erode trust in CI and waste developer time. This Skill provides a systematic workflow to identify, reproduce, diagnose, and fix flaky Playwright e2e tests in the Streamlit repository.
Core Features & Use Cases
- Flaky Test Discovery: Runs a script that aggregates
playwright_test_stats artifacts from recent CI runs to rank the most flaky tests.
- Structured Diagnosis Workflow: Guides reproduction with up to 25 local runs, inspection of traces, screenshots, and snapshot diffs, and root-cause identification.
- Proven Fix Patterns: Documents fixes for timing issues, snapshot mismatches, browser retry behavior, short timeouts, and Firefox subpixel rendering quirks.
- Use Case: A CI dashboard shows
test_date_input failing intermittently on Firefox. Use this Skill to reproduce the failure locally, identify a snapshot timing issue, add an explicit visibility wait, and verify stability with 10 consecutive passing runs.
Quick Start
Ask the assistant to find the top flaky Playwright e2e tests from recent CI runs and fix the most flaky one.