test-feature

Tests features end-to-end via browser QA, API calls, and LLM eval tests.

12.1k|1.5k|Updated Jul 12, 2023
One-click install
npx skills add https://github.com/elie222/inbox-zero --skill test-feature
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: test-feature
Source: https://github.com/elie222/inbox-zero/tree/main/.claude/skills/test-feature
Command: npx skills add https://github.com/elie222/inbox-zero --skill test-feature

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Verifying that a newly built feature actually works requires juggling browser testing, API verification, test data setup, and AI output evaluation, which is slow and error-prone when done manually.

Core Features & Use Cases

  • Browser QA: Drives the app through the agent-browser CLI with a logged-in Chrome profile, taking screenshots at every step to verify UI behavior, loading states, and error states.
  • API and Google Workspace testing: Sets up test data with the gws CLI (Drive files, Gmail messages, Calendar events) and verifies API endpoints with real API keys.
  • LLM eval tests: Writes or runs eval tests in __tests__/eval/ using describeEvalMatrix and judgeMultiple to assess AI output quality, and can persist tests as reusable QA flows.
  • Use Case: After implementing a new Smart Filing feature, invoke this skill to spin up the dev server, create a test Drive folder, configure the feature in the browser, trigger it with a test email, and receive a pass/fail report with screenshots.

Quick Start

Ask the assistant to test the feature you just built, for example by saying "test the new bulk archive flow end to end and show me screenshots."

Frequently Asked Questions about test-feature

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I test a new feature end to end in a web app?

Describe the feature or point to recent code changes, and the skill plans an approach combining browser QA, API calls, or eval tests. It sets up the dev server, creates test data, executes the test, and reports pass/fail with screenshots.

How to automate browser testing with an OAuth-protected app?

Use headless Chrome launched with a saved user profile directory that already has a logged-in session, then connect agent-browser over CDP on port 9222. Google OAuth blocks the built-in Chromium, so real Chrome with an existing session is required.

Can I test Google Drive, Gmail, and Calendar integrations automatically?

Yes, the gws CLI creates test data such as Drive folders and files, Gmail messages, and Calendar events from the command line. The browser is then used only for app-specific configuration that exists in the product UI.

How do I write eval tests for LLM output quality?

Eval tests live in __tests__/eval/ and use describeEvalMatrix for cross-model comparison plus judgeMultiple with criteria like ACCURACY, TONE, and NO_HALLUCINATION. Run them with pnpm test-ai followed by the eval test name.

Why does my feature flag not take effect during testing?

NEXT_PUBLIC_* environment variables are baked in at build time, so adding one to .env while the dev server runs has no effect. You must restart the dev server before testing for the flag to apply.

When should a manual test be saved as a reusable QA flow?

Persist tests that verify important behavior someone might break later, either as a browser flow spec in qa/browser-flows/ or an eval test in __tests__/eval/. Trivial one-off checks like page loads should not be persisted.