Automate SWE-bench benchmark execution and validation in Docker containers.
npx skills add https://github.com/alangeb/tau --skill swe-bench-alangeb
Please help me install this Agent Skill. Skill: swe_bench Source: https://github.com/alangeb/tau/tree/main/src/skills/swe_bench Command: npx skills add https://github.com/alangeb/tau --skill swe-bench-alangeb
This Skill streamlines the complex, multi-step process of running SWE-bench evaluations, managing containerized environments, and analyzing agent-generated patches.
Use the swe_bench skill to start the evaluation pipeline for the next five test cases using the cuda llm group.
High-intent search queries and answers about installing and using this skill.
To automate SWE-bench evaluation, this Skill orchestrates the full lifecycle from container preparation and agent execution to patch extraction and test validation against existing project test harnesses.
Yes, you need a configured Docker environment to run SWE-bench patch testing workflows, as the Skill executes and validates software engineering benchmarks within isolated container environments.
Automated benchmark validation provides structured logging and artifact management for every test run, capturing stdout, context files, and patch diffs to generate a comprehensive audit trail.
You can batch process GitHub issues through an AI agent to automatically verify generated fixes against the project test suite and generate a summary report of pass/fail results.
The tau agent framework manages test lifecycles and artifact generation during software engineering benchmark execution, requiring configured access to automate the end-to-end evaluation pipeline.
DisentinelRuns A/B tests of the Grafema code graph on SWE-bench.
fabioc-alohaReduce Markdown lint errors by enforcing formatting rules during authoring.
bponghnengGenerate structured specification documents from GitHub PR review comments.
addxaiOrchestrate MySQL, Redis, Kafka, MQTT, LocalStack, and WireMock via Docker Compose.
