polym-eval-score-image-gemini

What problem does it solve?

It removes the manual effort of visually grading AI-generated images by producing structured, dimension-level scores and reasons automatically.

Core Features & Use Cases

• Pointwise grading: Scores a single generated image across multiple quality dimensions on a 0-5 scale, plus an overall rationale.
• Pairwise A/B comparison: Compares two images and returns dimension-wise winners (A, B, or tie) with a short justification.
• Backend flexibility: Uses Vertex AI (default) or ByteDance AIDP through OpenAI-compatible APIs.
• Optional reference images: Adds context for identity, brand, style, and edit consistency evaluation when reference images are provided.

Quick Start

Run the pointwise evaluation with Vertex AI using prompt and generated image file by executing the command: "python scripts/evaluate.py --mode pointwise --prompt "A golden retriever sitting in a garden" --image generated.png".