vercel-plugin-eval

Run live Claude Code eval sessions for the vercel-plugin and generate coverage reports.

246|42|Updated Mar 4, 2026
One-click install
npx skills add https://github.com/vercel-labs/vercel-plugin --skill vercel-plugin-eval
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: vercel-plugin-eval
Source: https://github.com/vercel-labs/vercel-plugin/tree/main/.claude/skills/vercel-plugin-eval
Command: npx skills add https://github.com/vercel-labs/vercel-plugin --skill vercel-plugin-eval

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill automates the rigorous testing of the Vercel plugin, ensuring its hooks function correctly, skills are injected properly, and duplicate skill calls are managed.

Core Features & Use Cases

  • Live Eval Sessions: Runs actual Claude Code sessions with the plugin installed to verify behavior.
  • Debug Log Monitoring: Captures and analyzes detailed debug logs in real-time.
  • Coverage Reporting: Produces structured reports on hook coverage, skill injection, and deduplication accuracy.
  • Use Case: Developers can use this Skill to automatically run a suite of tests against new plugin updates, catching regressions and ensuring seamless integration with Vercel's ecosystem before release.

Quick Start

Launch a live eval session for the vercel-plugin by creating a test directory and running the provided command.

Frequently Asked Questions about vercel-plugin-eval

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate testing for Vercel plugin hooks and skill injection?

Automating Vercel plugin hook testing involves launching live Claude Code sessions to verify hook behavior, skill injection, and deduplication logic. This Skill runs real evaluation sessions, monitors debug logs, and generates structured coverage reports for quality assurance.

What is live evaluation for CI/CD plugin behavior?

Live evaluation for CI/CD plugin behavior is the process of executing actual Claude Code sessions with the plugin installed to verify its real-time functionality. It captures detailed debug logs to analyze hook coverage and skill injection accuracy.

Can I use this to verify deduplication logic in my Vercel plugin?

Yes, you can verify deduplication logic by running live evaluation sessions that test how duplicate skill calls are managed. The Skill monitors real-time debug logs to ensure your plugin handles deduplication accurately before release.

How do I generate coverage reports for Vercel plugin updates?

Generating coverage reports for Vercel plugin updates requires running live evaluation sessions that monitor debug logs. The Skill produces structured reports detailing hook coverage, skill injection success, and deduplication accuracy to catch regressions.

Does Vercel plugin evaluation require a specific test directory setup?

Vercel plugin evaluation requires creating a test directory to launch the live eval session. You run the provided command within this directory to start actual Claude Code sessions and monitor the resulting debug logs.