model-compare

What problem does it solve?

This Skill provides a blind, side-by-side comparison of AI models, enabling users to evaluate their performance and choose the best model for their needs without bias.

Core Features & Use Cases

• Blind Comparison: Users can compare the responses of two to four models simultaneously without knowing which model is which.
• Custom Evaluation: Users can define custom criteria for evaluation and track the history of votes and results.
• Use Case: A researcher wants to compare the performance of different language models on a specific task. They can use this Skill to send the same prompt to multiple models and evaluate their responses.

Quick Start

Use the model-compare skill to compare the performance of the 'gpt-4o' and 'kimi-k2.5' models on the prompt 'What is the latest version of Python and what are the top 2 new features in it?'.