benchmark-model-test

Automate benchmarking of large language models against prompts using Excel and Playwright.

10|55|Updated Mar 31, 2026
One-click install
npx skills add https://github.com/AgenticAIPlan/AgenticAISkills --skill benchmark-model-test
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: benchmark-model-test
Source: https://github.com/AgenticAIPlan/AgenticAISkills/tree/main/skills/benchmark-model-test
Command: npx skills add https://github.com/AgenticAIPlan/AgenticAISkills --skill benchmark-model-test

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires playwright, xlsx, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill automates the end-to-end benchmarking of multiple large language models against the same prompts, enabling objective comparisons and saving manual effort.

Core Features & Use Cases

  • Dynamic model mapping: reads model names from Excel headers to configure per-model tests.
  • End-to-end automation: opens the platform, creates new conversations, selects models, uploads attachments, sends prompts, and writes results back to Excel.
  • Flexible workflow: supports optional login, per-row prompt testing, and per-model result aggregation for batch benchmarking.

Quick Start

Open an Excel file with D column as prompts and G column for attachments, then run the skill to generate results in the same workbook.

Frequently Asked Questions about benchmark-model-test

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate LLM benchmarking across multiple models?

Automate LLM benchmarking by using this Skill to test multiple large language models against identical prompts. It dynamically reads model names from Excel headers and automatically writes the comparison results back to the workbook.

How do I test multiple large language models against the same prompts in Excel?

To test multiple models in Excel, structure prompts in column D and attachments in column G. The Skill maps models from headers, sends prompts via Playwright automation, and writes aggregated results per model.

Does the model benchmarking automation support attachments and login?

The model benchmarking automation supports optional attachments and login. It handles per-row prompt testing and dynamically configures tests based on the models mapped from the Excel headers.

Can I use Playwright for end-to-end LLM performance testing?

You can use Playwright for end-to-end LLM performance testing through this Skill. It automates opening the platform, creating conversations, selecting models, uploading attachments, and collecting benchmark data.

What is the best way to compare LLM performance using Excel sheets?

The best way to compare LLM performance is using Excel-based test sheets. This Skill automates multi-model benchmarking by reading prompts and headers, executing tests, and writing results back for objective comparison.

Do I need to manually select models for batch benchmarking?

You do not need to manually select models for batch benchmarking. The Skill dynamically maps models from the Excel headers to configure per-model tests automatically, enabling end-to-end performance evaluation.