provider-indexing

Fetch provider data with rate limiting and normalize it into the AIModel schema.

Updated Aug 23, 2026

Search Tags:#API #ETL #rate-limiting #provider-indexing #AIModel #data-normalization

One-click install

npx skills add https://github.com/bradennapier/ai-model-registry --skill provider-indexing

Or copy as Structured Prompt for Agent▼

Please help me install this Agent Skill.
Skill: provider-indexing
Source: https://github.com/bradennapier/ai-model-registry/tree/main/.claude/skills/provider-indexing
Command: npx skills add https://github.com/bradennapier/ai-model-registry --skill provider-indexing

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires @ai-model-registry/spec, @huggingface/transformers, chalk, commander, ora, p-limit, voy-search, xxhash-wasm, openai, and includes scripts (resource) components.

What problem does it solve?

Implements provider data fetching with proper rate limiting, error handling, and normalization to a unified AIModel schema.

Core Features & Use Cases

Rate-limited parallel fetching: Respect provider quotas while maximizing throughput.
BaseProvider abstraction: Common logic for auth, headers, retries, and error handling.
Transform raw data: Normalize provider data into the AIModel schema for consistency.

Quick Start

Run the provider indexing workflow to fetch models from configured providers and generate models.json and index.voy.