run-source-model-baseline
OfficialGenerate live LLM baselines for migration evaluation
Authorawslabs
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill solves the problem of unreliable AI migration evaluations by generating real source-model responses instead of relying on agent-created baseline answers.
Core Features & Use Cases
- Live Source Model Execution: Re-runs golden prompt datasets against OpenAI, Anthropic, or Gemini models to collect authentic source outputs.
- Model Validation and Recovery: Resolves safe model variants, validates provider availability, handles partial resumes, and records failures without exposing credentials.
- Migration Evaluation Support: Provides side-by-side source and Bedrock outputs for LLM migration quality comparisons and regression analysis.
Quick Start
Use the run-source-model-baseline skill to generate live source model responses from the golden dataset for migration evaluation.
Dependency Matrix
Required Modules
None requiredComponents
Standard package💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: run-source-model-baseline Download link: https://github.com/awslabs/startups/archive/main.zip#run-source-model-baseline Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 545,000+ vetted skills library on demand.