consult-sofia

To analyze a sudden drop in agent performance, provide the specific run IDs to the Coval Sofia expert system. It interprets the simulation regressions and monitoring conversations to deliver grounded, FDE-style recommendations for targeted fixes.

FDE analysis is the expert interpretation of organization-specific evaluation metrics, run failures, and agent performance regressions. It bridges raw evaluation data and actionable insights by providing grounded advice on test coverage, persona design, and metric configuration.

Yes, you need an active Coval API connection and a valid organization context. The diagnostic analysis requires this environment to access your evaluation data and provide grounded, FDE-style recommendations.

You can get strategic recommendations for test coverage and persona design by delegating read-only analytical tasks to the Coval Sofia expert system. It evaluates your organization-specific metrics to offer grounded configuration advice.

Yes, you can fix agent performance regressions by delegating the specific run IDs to the expert system. It provides a prioritized plan for agent improvement and targeted test case adjustments based on the diagnostic findings.