skills.rest
nimag
nimagCOMMUNITY
Explore all skills by this author →
GitHub

run-benchmark

Compare Gemini File API and Inline document upload performance for underwriting tasks.

Updated Dec 20, 2025
Search Tags:#performance#timing#benchmark#inline#File API
One-click install
npx skills add https://github.com/nimag/fast --skill run-benchmark
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: run-benchmark
Source: https://github.com/nimag/fast/tree/main/.claude/skills/run-benchmark
Command: npx skills add https://github.com/nimag/fast --skill run-benchmark

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill compares Gemini File API vs Inline document approaches for underwriting tasks, helping teams optimize data flow and caching strategies.

Core Features & Use Cases

  • Performance measurements: Upload time, total time, and per-round times.
  • Bias avoidance: Shuffles document order to mitigate caching artifacts.
  • JSON output: Presents timing data for analysis and reporting.

Quick Start

  1. Export GEMINI_API_KEY
  2. Build with make build
  3. Run the benchmark against a loan file with -docs and optional flags (e.g., -rounds, -json)