harness-evolver
Autonomous optimization of LLM agent code via LangSmith
All Skills in This Repository (9)
Pure Emerald Level Indicatorsdev:release
Automate npm package releases with changelog generation and GitHub publishing.
dev:dry-run
Smoke-test the evolve pipeline for tool syntax, argparse behavior, and end-to-end execution.
dev:validate
Validate Claude plugin versions, frontmatter, cross-references, Python syntax, and hooks.
harness:certify
Run repeated evaluations and compute score stability statistics for evolved LLM agents.
harness:deploy
Clean up artifacts, tag releases, and push to version control.
harness:health
Detect and auto-correct quality issues in LangSmith evaluation datasets.
harness:setup
Configure Harness Evolver, LangSmith, and baseline evaluations for Python projects.
harness:status
Display evolution progress and scores from the Harness Evolver workflow.
harness:evolve
Orchestrate propose-evaluate-iterate loops with LangSmith and Git worktrees.
Frequently Asked Questions
FAQPage SchemaHow to install Harness Evolver?โผ
Run `npx skills add raphaelchristi/harness-evolver --all -g -y` in your terminal to install all skills globally.
What does Harness Evolver do?โผ
It autonomously improves your LLM agent's prompts, tools, and architecture by running iterative experiments scored through LangSmith, then merging only the changes that measurably win.
Do I need a LangSmith account to use it?โผ
Yes. You need a LangSmith API key since all datasets, experiments, and LLM-as-judge evaluations run through LangSmith as the backend.
Which frameworks and editors are supported?โผ
It works with any Python agent framework LangSmith can trace, including LangGraph, CrewAI, and OpenAI SDK, and runs in Claude Code, Cursor, Codex, and Windsurf.
Will it break my existing agent code?โผ
No. Every candidate change is tested in an isolated git worktree, and only candidates that pass scoring, constraint, and efficiency gates get merged into your main branch.
Related Repositories in Software Engineering
View All in Software Engineeringโopenclaw
Run a personal AI assistant across your devices and chat apps
superpowers
Gives coding agents a disciplined workflow from idea to merged code
react
AI agent skills for building, testing, and porting React core