lora-evaluate

Generate a structured test grid and score LoRA image outputs for consistency, fidelity, overfitting, and artefacts.

Updated Aug 27, 2026
One-click install
npx skills add https://github.com/redbananastudios/ai-library --skill lora-evaluate
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: lora-evaluate
Source: https://github.com/redbananastudios/ai-library/tree/main/generated/claude/skills/lora-evaluate
Command: npx skills add https://github.com/redbananastudios/ai-library --skill lora-evaluate

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill helps you catch LoRA quality issues early by generating a controlled test grid and scoring consistency, fidelity, overfitting, and visual artefacts before promotion.

Core Features & Use Cases

  • LoRA test-grid generation: Produces a structured set of evaluation images from a freshly trained LoRA using configurable prompts and weight sweeps.
  • Multi-axis automated scoring: Evaluates subject consistency, prompt fidelity, overfitting risk, and artefacts, then outputs a pass/review/fail verdict with evidence.
  • Negative-control leakage detection: Includes a prompt that should not mention the subject to detect concept leakage.
  • Pipeline-safe, read-only evaluation: Does not train, promote, delete, or publish images—returns an advisory result for human decision-making.

Quick Start

Ask lora-evaluate to evaluate the newly trained LoRA by providing the model_path, run_metadata_path, and output_path so it can write the grid and evaluation report.

Frequently Asked Questions about lora-evaluate

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I evaluate a LoRA for overfitting and prompt fidelity before versioning?

Evaluating a LoRA for overfitting and prompt fidelity requires generating a structured test grid and scoring image outputs across multiple axes. This automated assessment analyzes subject consistency and visual artefacts to return a pass, review, or fail quality verdict before promotion.

What is concept leakage detection in LoRA model evaluation?

Concept leakage detection in LoRA evaluation uses a negative-control prompt that should not mention the trained subject. It checks the generated test grid to ensure the LoRA does not inadvertently bleed the trained concept into unrelated prompts, which helps prevent overfitting.

Can I automatically score LoRA visual artefacts and subject consistency?

Yes, you can automatically score LoRA visual artefacts and subject consistency using multi-axis automated evaluation. The process generates an evaluation report and an image grid, providing evidence-based scores for prompt fidelity and overfitting risk to support a quality verdict.

What inputs are needed to run a LoRA quality check and generate an evaluation grid?

Running a LoRA quality check requires absolute input paths for the LoRA model and training run metadata, plus an output directory. These inputs allow the evaluation process to write the image test grid and the evaluation.json report containing the pass, review, or fail status.

Does the LoRA evaluation process modify, promote, or delete the trained models?

No, the LoRA evaluation process operates as a pipeline-safe, read-only assessment and does not train, promote, delete, or publish images. It strictly returns an advisory result with a pass, review, or fail status to guide human decision-making before model versioning.