re-evaluate

Detect new commits and closed issues, then re-run evaluations and update reports.

11|Updated Nov 24, 2025
One-click install
npx skills add https://github.com/brazil-bench/pourpoise --skill re-evaluate
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: re-evaluate
Source: https://github.com/brazil-bench/pourpoise/tree/main/skills/re-evaluate
Command: npx skills add https://github.com/brazil-bench/pourpoise --skill re-evaluate

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Re-evaluate an evaluation of an attempt repository after issues are closed and changes are detected, updating reports and surfacing regressions.

Core Features & Use Cases

  • Automated detection of new commits and closed issues to trigger re-evaluations
  • Re-run relevant evaluations and update the main evaluation report
  • File new issues for regressions or newly discovered problems

Quick Start

Use the re-evaluate skill to re-check a specific attempt, for example: re-evaluate 2025-12-13-python-claude-hive

Frequently Asked Questions about re-evaluate

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I re-evaluate pytest results after closing GitHub issues?

To re-evaluate pytest results after closing GitHub issues, this tool automatically pulls new commits via Git, re-runs relevant evaluations, updates the main report, and files any new regression issues using the GitHub CLI.

What is automated attempt re-evaluation in an evaluation workflow?

Automated attempt re-evaluation is the process of detecting new commits and closed issues in a repository, re-running pytest evaluations, updating the main report, and filing regressions to keep results current after changes.

Does re-evaluating an attempt repository require the GitHub CLI and Git?

Yes, re-evaluating an attempt repository requires the GitHub CLI and Git to pull changes and detect closed issues, alongside pytest to execute the actual test evaluations and update reports.

How do I automatically file regression issues after re-running pytest evaluations?

You can automatically file regression issues after re-running pytest evaluations by using this tool to detect new commits, execute the tests, and create or update issues via the GitHub CLI based on the latest results.

Can I update an existing evaluation report with new pytest test results?

Yes, you can update an existing evaluation report by re-evaluating the attempt, which detects new commits, re-runs the relevant pytest evaluations, and applies the updated results directly to the main report.