verifier-agent

Automate correctness testing, fuzz testing, and performance profiling of generated code.

258|48|Updated Jun 22, 2020
One-click install
npx skills add https://github.com/mindspore-ai/akg --skill verifier-agent
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: verifier-agent
Source: https://github.com/mindspore-ai/akg/tree/main/akg_agents/examples/run_skill/skills/verifier-agent
Command: npx skills add https://github.com/mindspore-ai/akg --skill verifier-agent

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill provides automated verification of generated code to ensure functional correctness and performance, reducing debugging time.

Core Features & Use Cases

  • Automated correctness testing across multiple test cases and edge conditions
  • Performance profiling and baseline comparison to detect regressions
  • End-to-end validation workflow with reporting and guardrails

Quick Start

Run the verifier-agent workflow to validate the correctness and performance of newly generated kernels.

Frequently Asked Questions about verifier-agent

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate verification of generated code for functional correctness?

Automated verification of generated code ensures functional correctness by running comprehensive accuracy checks across multiple test cases and edge conditions. This process reduces debugging time by validating accuracy and boundary conditions before deployment.

Can I run performance profiling and fuzz testing on AI generated kernels?

Performance profiling and fuzz testing can run on AI generated kernels to detect performance regressions and boundary condition failures. The workflow profiles performance metrics against baselines and applies fuzz testing to ensure end-to-end validation.

Do I need a structured verifier framework to test code-generation pipelines?

A structured verifier framework is required to test code-generation pipelines. You must configure test suites for accuracy, boundary conditions, and performance metrics, plus reporting capabilities to execute the end-to-end validation workflow with guardrails.

What is the best way to detect performance regressions in newly generated code?

The best way to detect performance regressions in newly generated code is performance profiling with baseline comparison. Automated validation workflows compare current performance metrics against established baselines to identify and report regressions accurately.

Why does my automated validation workflow fail on edge conditions for operator kernels?

Automated validation workflows fail on edge conditions for operator kernels when test suites lack rigorous boundary condition checks. Ensure your structured verifier framework includes comprehensive fuzz testing and accuracy checks to capture these edge cases.