ax-python-agent-optimize

Generate evaluator-driven optimization workflows for Python Ax agents with axllm.

2.9k|186|Updated Feb 23, 2023
One-click install
npx skills add https://github.com/ax-llm/ax --skill ax-python-agent-optimize
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ax-python-agent-optimize
Source: https://github.com/ax-llm/ax/tree/main/website/static/python/.well-known/agent-skills/ax-python-agent-optimize
Command: npx skills add https://github.com/ax-llm/ax --skill ax-python-agent-optimize

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill helps you tune and evaluate Python Ax agents without inventing new API shapes, so optimization stays aligned with the generated axllm package.

Core Features & Use Cases

  • Agent Optimization: Run AxGEPA and BootstrapFewShot workflows for Ax agents and reusable components.
  • Evaluators and Judges: Build evaluator callbacks, compare outputs, and persist optimizer artifacts for later reuse.
  • Bounded Experiments: Keep runs constrained with explicit budgets and dataset rows for reproducible testing.

Quick Start

Use this skill to optimize a Python Ax agent with axllm by following the package examples for the exact native API and evaluator pattern.

Frequently Asked Questions about ax-python-agent-optimize

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I optimize Python Ax agents using GEPA and BootstrapFewShot?

To optimize Python Ax agents, you apply evaluator-driven workflows like AxGEPA and BootstrapFewShot. This process tunes agents and reusable components by generating optimization workflows while managing and persisting optimizer artifacts for later reuse.

What is GEPA for agent optimization in axllm?

GEPA is an evaluator-driven optimization technique used in axllm to tune Python Ax agents. It works by applying AxGEPA workflows that leverage evaluator callbacks to compare outputs and iteratively improve agent performance based on bounded dataset experiments.

How do I build evaluator and judge callbacks for Ax agents?

You build evaluator and judge callbacks for Ax agents to compare outputs during optimization runs. These evaluators are integrated into the optimization workflow, allowing the system to assess agent performance and persist optimizer artifacts for reproducible testing.

Do I need explicit budgets to run axllm optimization experiments?

Yes, you need explicit budgets and dataset rows to run axllm optimization experiments. Bounded experiments require these constraints to keep runs controlled, ensuring reproducible testing when tuning Python Ax agents with workflows like AxGEPA and BootstrapFewShot.

Can I persist optimizer artifacts for later reuse in axllm?

Yes, you can persist optimizer artifacts for later reuse in axllm. The optimization process explicitly manages these artifacts, ensuring that evaluator-driven optimization workflows remain reproducible and aligned with the generated axllm package API shapes.

What are the limitations of bounded dataset experiments in axllm?

Bounded dataset experiments in axllm require explicit budgets and package examples to function correctly. Optimization runs are constrained by these dataset rows, meaning experiments must be carefully scoped to ensure reproducible testing within defined limits.