skills.rest
a3lem
a3lemCOMMUNITY
Explore all skills by this author →
GitHub

theo-calvin-testing

Compare generated JSON output against expected JSON using the tc framework.

Updated Dec 19, 2025
Search Tags:#testing#specification#json#gherkin#differential testing#tc
One-click install
npx skills add https://github.com/a3lem/my-claude-plugins --skill theo-calvin-testing
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: theo-calvin-testing
Source: https://github.com/a3lem/my-claude-plugins/tree/main/plugins/theo-calvin-testing/skills/theo-calvin-testing
Command: npx skills add https://github.com/a3lem/my-claude-plugins --skill theo-calvin-testing

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill simplifies testing by focusing on the core input-output behavior of code, eliminating the need for complex assertion frameworks and making tests language-agnostic.

Core Features & Use Cases

  • Differential Testing: Compares generated output.json against expected.json using simple diffing.
  • Language-Agnostic Tests: Tests are defined by an executable run script and JSON data, usable with any programming language.
  • Specification as Tests: Treats test suites as immutable specifications, separating "what" from "how".
  • Use Case: Validate that a new API endpoint consistently returns the expected JSON structure for various inputs, even if the internal implementation changes.

Quick Start

Use the theo-calvin-testing skill to run all tests in the current directory.

Frequently Asked Questions about theo-calvin-testing

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run differential testing to compare generated JSON output against expected JSON?▼

Differential testing compares generated output.json against expected.json through simple diffing. You define tests using an executable run script and JSON data files, allowing language-agnostic validation of code behavior against specifications.

Can I use language-agnostic test suites to validate API endpoints without a specific testing framework?▼

Yes, language-agnostic test suites are defined by an executable run script and JSON data files. This eliminates complex assertion frameworks, treating test suites as immutable specifications to validate API behavior across any programming language.

What is differential testing and when do I need to compare JSON outputs?▼

Differential testing is a technique comparing generated JSON against expected JSON to validate code behavior. You need it when separating the specification of what code does from how it is implemented, ensuring consistent API structures.

Do I need bash and jq to run specification tests with JSON data files?▼

Yes, you need bash 4.0+ and jq to execute the differential testing framework. Bash executes the run scripts while jq handles pattern matching within the expected JSON outputs during comparison.

What's the best way to treat test suites as immutable specifications for code validation?▼

The best way is defining tests via executable scripts and JSON data files. This differential testing approach treats suites as immutable specifications, focusing strictly on input-output behavior to validate implementations without complex assertions.

Why does differential testing focus on input-output behavior instead of complex assertions?▼

Differential testing focuses on input-output behavior to simplify testing by directly diffing generated JSON against expected JSON. This eliminates complex assertion frameworks, making tests language-agnostic and treating suites as specifications.

Related Skills

Explore More Software Engineering Skills→
mateonunezmateonunez
2

add-plugin

Scaffold a language-agnostic nucleo CLI plugin with manifest and entrypoint.

Community
Intermediate
JordiNodeJSJordiNodeJS

testing-automation

Automate unit, integration, component, and E2E testing for Next.js 16 projects.

Community
Advanced
surus-latsurus-lat
8

run-benchmark

Execute end-to-end AI benchmarking workflows with spec validation and smoke testing.

Official
Advanced
hpsgdhpsgd

write-feature-spec

Generate Gherkin feature files and pytest-bdd step definitions from natural-language prompts.

Official
Advanced