One-click install
npx skills add https://github.com/javiarmesto/CIRCE-Agent-Squad-for-Microsoft-Copilot-Studio --skill run-tests-javiarmesto
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: run-tests
Source: https://github.com/javiarmesto/CIRCE-Agent-Squad-for-Microsoft-Copilot-Studio/tree/main/.github/skills/run-tests
Command: npx skills add https://github.com/javiarmesto/CIRCE-Agent-Squad-for-Microsoft-Copilot-Studio --skill run-tests-javiarmesto

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires copilot-studio-kit, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill automates the process of running and analyzing tests for Copilot Studio agents, simplifying the testing workflow and enabling quick feedback on agent performance.

Core Features & Use Cases

  • Test Execution: Run tests for Copilot Studio agents using the Copilot Studio Kit or analyze results from built-in evaluations.
  • Mode Selection: Choose between using the Copilot Studio Kit or analyzing CSV results from evaluations.
  • Results Analysis: Analyze test results for failures and identify the cause, such as topic mismatches, response issues, or generative answer problems.
  • Fix Proposals: Propose YAML changes to fix identified issues and improve agent performance.

Quick Start

Run the 'run-tests' skill to analyze test results for the 'my-agent' Copilot Studio agent.

Frequently Asked Questions about run-tests

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate testing for Copilot Studio agents?

You can automate testing for Copilot Studio agents by running batch test suites or importing evaluation results to automatically identify failures and propose YAML configuration fixes.

How do I analyze Copilot Studio evaluation results from a CSV file?

To analyze Copilot Studio evaluation results, you can import CSV files from built-in evaluations to automatically identify issues like topic mismatches, response failures, or generative answer problems.

Do I need the Copilot Studio Kit to run agent tests?

Yes, you need the Copilot Studio Kit installed and access to your agent's test configurations to run batch test suites, though you can also analyze CSV results from evaluations without it.

Why are my Copilot Studio agent tests failing?

Copilot Studio agent tests typically fail due to topic mismatches, response issues, or generative answer problems, which can be identified through results analysis and fixed using proposed YAML changes.

Can I get automated fix proposals for failed Copilot Studio agent tests?

Yes, automated fix proposals are generated as YAML configuration changes to directly address identified test failures and improve your Copilot Studio agent's performance.

What is the best way to identify topic mismatches in Copilot Studio test results?

The best way to identify topic mismatches is to analyze evaluation results or run batch test suites, which automatically detects failures and pinpoints the root cause of the agent's behavior.