What problem does it solve?
This Skill automates the analysis of machine learning experiment results, providing insights into performance trends, hyperparameter impacts, and failure modes to guide future optimization efforts.
Core Features & Use Cases
- Result Ranking & Comparison: Ranks experiments and calculates improvements over a baseline.
- Hyperparameter Impact Analysis: Identifies which hyperparameters have the most significant effect on performance.
- Failure Analysis: Investigates why experiments diverged or failed to inform debugging and strategy adjustments.
- Decision Making: Recommends whether to continue tuning, pivot to a new approach, or stop the optimization process.
- Use Case: After running a batch of hyperparameter tuning experiments for a new model, use this Skill to understand which learning rates and batch sizes yielded the best results, identify any unexpected divergences, and decide on the next steps for further optimization.
Quick Start
Analyze the completed ML experiment results in the project directory.