response-compliance

Run the official OpenResponses compliance test suite against a Response API endpoint.

1|Updated May 9, 2026
One-click install
npx skills add https://github.com/duwenji/generative-ai-oss-tutorials --skill response-compliance-duwenji
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: response-compliance
Source: https://github.com/duwenji/generative-ai-oss-tutorials/tree/main/sandbox/lobe-chat/.agents/skills/response-compliance
Command: npx skills add https://github.com/duwenji/generative-ai-oss-tutorials --skill response-compliance-duwenji

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

It helps you detect schema, validation, and behavioral mismatches between your Response API implementation and the official OpenResponses compliance expectations.

Core Features & Use Cases

  • OpenResponses compliance testing: Runs the official compliance test suite against a local or remote Response API endpoint to verify correctness.
  • Targeted test filtering: Executes only selected scenarios such as basic responses, streaming lifecycle, system-prompt handling, tool calling, image input, and multi-turn history.
  • Debugging for common failures: Provides guidance for typical failure patterns like JSON parsing issues, missing output items, schema field nulls, and Zod validation errors.

Quick Start

Run the OpenResponses compliance suite against your Response API endpoint by starting your dev server with the required mock settings and executing the response-compliance test command for your local APP_URL.

Frequently Asked Questions about response-compliance

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I validate my Response API implementation against OpenResponses compliance rules?

To validate Response API compliance, run the official OpenResponses test suite against your configured endpoint to detect schema, validation, and behavioral mismatches. The test suite verifies that your api/v1/responses routing and authentication flags produce outputs matching expected schema validation rules.

What does SSE streaming compliance testing cover for a Response API endpoint?

SSE streaming compliance testing verifies that your Response API endpoint correctly handles the streaming lifecycle, ensuring server-sent events match the expected OpenResponses schema and validation rules. It also checks for typical failure patterns like JSON parsing issues and missing output items during streaming.

Can I run compliance tests for specific scenarios like tool calling and multimodal image inputs?

Yes, you can execute targeted test filtering to run compliance tests only for selected scenarios such as tool calling, multimodal image inputs, system prompt handling, and multi-turn conversation history. This isolates specific OpenResponses API behaviors for focused validation.

Why does my Response API fail Zod validation and schema field null checks during compliance testing?

Response API compliance failures often stem from schema field nulls or Zod validation errors where your output deviates from OpenResponses expectations. Debugging common failure patterns involves checking JSON parsing issues, missing output items, and ensuring correct schema field population.

Do I need a specific dev server configuration to test OpenResponses compliance locally?

Yes, testing OpenResponses compliance locally requires starting your dev server with the required mock settings and executing the test command against your local APP_URL. This ensures correct routing for api/v1/responses and supported authentication flags so responses match expected validation rules.