evaluation

You evaluate agent performance by applying a multi-dimensional rubric that measures factual accuracy, completeness, citation accuracy, source quality, and tool efficiency to ensure your agent systems function effectively.

Context engineering quality assurance is the systematic evaluation of agent systems using multi-dimensional rubrics to validate factual accuracy, source quality, and tool efficiency, ensuring continuous monitoring of production environments.

Yes, the agent evaluation framework integrates with production systems for continuous monitoring, allowing you to run ongoing evaluations against test sets to maintain context engineering quality gates.

Yes, you need specific Python libraries including pypdf, pdfplumber, and pdf2image to manage test sets and execute the scripts required for comprehensive agent performance evaluation.

You run an evaluation for the 'agent-systems' test set by executing the 'evaluate' command, which triggers the multi-dimensional rubrics to analyze factual accuracy and tool efficiency.

The multi-dimensional rubric approach for agent testing requires Python dependencies like pdfplumber and pypdf, meaning evaluation is limited to environments where these specific test set management libraries are installed.