changeset-validation

Validate changesets against git diffs using LLM judgment in openai-agents-js.

Updated May 23, 2026
One-click install
npx skills add https://github.com/kiranimmadi2/promptforge-ai --skill changeset-validation-kiranimmadi2
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: changeset-validation
Source: https://github.com/kiranimmadi2/promptforge-ai/tree/main/openai-agents-js/.agents/skills/changeset-validation
Command: npx skills add https://github.com/kiranimmadi2/promptforge-ai --skill changeset-validation-kiranimmadi2

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve? It ensures changesets in the openai-agents-js monorepo accurately reflect package changes and follow semver bump rules, catching missing, stale, or over-bumped changesets before merge. ## Core Features & Use Cases - Prompt Generation: Builds a validation prompt from git diffs (including uncommitted local changes), changed packages, changeset files, and PR metadata. - Structured Verdicts: Validates LLM-produced JSON verdicts containing ok/errors/warnings/required_bump fields. - Milestone Assignment: Automatically assigns GitHub PR milestones based on the required semver bump and open X.Y.x milestones. - Use Case: Before merging a PR that modifies packages/, run the validation to confirm the changeset covers all changed packages with the correct patch/minor/major bump. ## Quick Start Ask the AI to validate the current branch changeset against the diff and report any required edits or bump changes.

Frequently Asked Questions about changeset-validation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I validate a changeset against my branch diff?

Run pnpm changeset:validate-prompt to generate a prompt containing the git diff, changed packages, and changeset files. Then apply the rules in references/validation-prompt.md to produce a JSON verdict with ok, errors, warnings, and required_bump fields.

How does changeset validation work in GitHub Actions CI?

Run pnpm changeset:validate-prompt with the --ci and --output flags to generate a prompt file from PR context. Feed it to openai/codex-action with a JSON schema, then check the structured verdict using the changeset-validation-result script.

Does the validation include uncommitted local changes?

Yes, in local mode the prompt script includes staged, unstaged, and untracked working tree diffs alongside committed changes. In CI mode it uses only the PR base and head commits from the GitHub event payload.

When is a minor bump required instead of patch?

A minor bump is required only for breaking changes, dropped support, or behaviorally significant features that change existing workflows. Purely additive APIs, types, or explicitly experimental features can remain patch bumps.

Why does milestone assignment get skipped?

Milestone assignment is skipped when GITHUB_TOKEN or GITHUB_EVENT_PATH is missing, no open milestones match the X.Y.x title format, or the required bump is none. It selects patch, minor, or major targets from sorted open milestones.