integration-test

Verify traceway-cli against a live Traceway server with coverage reports.

1.1k|39|Updated Dec 18, 2025
One-click install
npx skills add https://github.com/tracewayapp/traceway --skill integration-test-tracewayapp
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: integration-test
Source: https://github.com/tracewayapp/traceway/tree/main/cli/.claude/skills/integration-test
Command: npx skills add https://github.com/tracewayapp/traceway --skill integration-test-tracewayapp

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires go, jq, bash, and includes scripts (resource) components.

What problem does it solve?

This Skill addresses the need for a comprehensive verification of the traceway-cli against a live Traceway server, ensuring the CLI operates correctly beyond the standard Go smoke suite.

Core Features & Use Cases

  • Live Instance Verification: Checks the functionality of traceway-cli by interacting with a live Traceway server.
  • Real-Data Testing: Tests with real data endpoints, including exceptions, metrics, and logs.
  • Adaptive Metric Discovery: Automatically discovers and tests real metrics.
  • Coverage Report: Generates a human-readable report on the coverage and results of the tests.
  • Safety and Error Handling: Ensures all tests are read-only and validates the absence of forbidden verbs and flags.

Quick Start

Run the integration tests for traceway-cli by executing 'run integration tests' or 'verify the CLI against stormwind'.

Frequently Asked Questions about integration-test

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run end-to-end testing for a CLI against a live server instance?

End-to-end testing for a CLI against a live server instance involves executing verification scripts that interact with real data endpoints. This process validates functionality by checking detail endpoints, discovering metrics adaptively, and generating a human-readable coverage report.

Do I need jq and bash to verify CLI functionality against live instances?

Yes, you need jq and bash to verify CLI functionality against live instances. The verification process utilizes go build for compiling the CLI, alongside bash scripting and jq for executing the tests and parsing the endpoint responses.

What is adaptive metric discovery in live instance testing?

Adaptive metric discovery in live instance testing is a mechanism that automatically identifies and tests real metrics from a live server. It ensures the CLI correctly retrieves and processes actual metric data rather than relying on static test fixtures.

How do I generate a human-readable coverage report for CLI verification?

To generate a human-readable coverage report for CLI verification, execute the integration test scripts against a live server. The script automatically compiles the results into a readable format detailing the test coverage and endpoint validation outcomes.

Are live instance CLI verification tests safe for production environments?

Live instance CLI verification tests are safe for production environments because they enforce read-only operations. The testing mechanism validates the absence of forbidden verbs and flags to ensure no mutating actions occur during endpoint checks.

What prerequisites are needed to test a CLI against a live Traceway server?

To test a CLI against a live Traceway server, you need an authenticated user with a default project configured on the server. Additionally, the local environment must have Go, jq, and bash installed to support the build and script execution.