lineup

Compare model responses side by side via command-line interface.

6|1|Updated Jun 23, 2026

Search Tags:#prompt engineering #evaluation #model comparison #model selection #language models

Ready to run

npx skills add https://github.com/JGalego/Bag-of-Tricks --skill lineup

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: lineup
Source: https://github.com/JGalego/Bag-of-Tricks/tree/main/lineup
Command: npx skills add https://github.com/JGalego/Bag-of-Tricks --skill lineup

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires anthropic, openai, google-genai, and includes scripts (resource) components.

What problem does it solve?

The lineup Skill helps you compare responses from multiple models side by side, making it easier to select the best model for your needs or spot inconsistencies.

Core Features & Use Cases

Model Comparison: Compare the answers from different models on the same prompt.
Spot Disagreement: Identify when models disagree, which can be a sign of a potential issue.
Use Case: Use lineup to compare responses from different language models on a complex query to determine which one is most accurate.

Quick Start

Run the lineup skill with the following command: lineup.py --prompt "Explain TCP in one sentence." --models "openai:gpt-4o,anthropic:claude-opus-4-8,gemini:gemini-2.5-flash"

Frequently Asked Questions about lineup

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I compare language model responses side by side for model selection?▼

To compare language model responses, run the lineup script via command line with a specified prompt and a list of model identifiers to display their outputs side by side for model selection and spotting disagreement.

What's the best way to spot disagreement between different language models?▼

The best way to spot disagreement between language models is to provide the exact same prompt to multiple models and compare their responses side by side to identify discrepancies and potential issues.

Can I use lineup to compare models from different providers like OpenAI and Anthropic?▼

Yes, you can compare models from different providers like OpenAI and Anthropic by passing provider-prefixed model identifiers in the command line arguments to evaluate responses on the same prompt.

Do I need API access to multiple providers to compare model responses?▼

Yes, you need API access to multiple providers to compare model responses, as the lineup script requires dependencies on Anthropic, OpenAI, and Google Gemini to fetch responses from different models simultaneously.

How do I run a prompt comparison across multiple models from the command line?▼

To run a prompt comparison across multiple models, execute the lineup.py script with the --prompt flag containing your query and the --models flag listing the desired model identifiers separated by commas.

What limitations exist when comparing language model responses side by side?▼

A limitation of comparing language model responses is that the lineup script operates strictly via a command-line interface and requires pre-configured API access to the specified providers to fetch and display results.