model-bank-metadata

Populate knowledgeCutoff, family, and generation fields on model-bank TypeScript model cards.

Updated Jan 27, 2026
One-click install
npx skills add https://github.com/SmallAi-API/smaihub --skill model-bank-metadata-smallai-api
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: model-bank-metadata
Source: https://github.com/SmallAi-API/smaihub/tree/main/.agents/skills/model-bank-metadata
Command: npx skills add https://github.com/SmallAi-API/smaihub --skill model-bank-metadata-smallai-api

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve? Maintaining accurate knowledgeCutoff, family, and generation metadata across roughly 1900 model entries in 80 provider files is error-prone: vendors publish cutoffs inconsistently, aggregator sites copy wrong values, and naming conventions hide family and generation information. This Skill encodes the sourcing rules, derivation regexes, and codemods needed to fill these fields correctly at single-model or repo-wide scale. ## Core Features & Use Cases - Sourcing policy for knowledgeCutoff: Accepts only vendor docs, official Hugging Face cards, and tech reports; rejects aggregator sites and AWS Bedrock cards that conflate launch dates with cutoffs. - Rule-based family/generation derivation: scripts/derive-family.ts maps normalized model ids to family and generation slugs, handling traps like date suffixes, size suffixes, and vendor spelling variants. - Idempotent codemods: scripts/apply-cutoffs.ts and scripts/apply-family.ts insert fields into prettier-formatted model card files, skipping entries that already have values. - Use Case: When a new Claude model PR lands, fill all three metadata fields inline citing the official system card, or run a repo-wide sweep with multi-agent research plus adversarial verification to backfill cutoffs across all providers. ## Quick Start Ask the AI to derive and apply family and generation metadata for all chat models in packages/model-bank/src/aiModels using the skill's extract, derive, and apply scripts.

Frequently Asked Questions about model-bank-metadata

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I backfill knowledgeCutoff across all model-bank entries?

Run scripts/extract-model-ids.ts to get normalized chat model ids, research cutoffs per family chunk with an adversarial verify pass, filter rejected sources, then run scripts/apply-cutoffs.ts with the resulting map. Finish with vitest and tsc checks in packages/model-bank.

What sources are acceptable for a model knowledge cutoff?

Accept only vendor official docs, official Hugging Face org model cards, and official tech reports or launch posts. Reject third-party aggregator sites and AWS Bedrock model cards, which conflate launch dates with cutoffs.

How are family and generation derived from model ids?

scripts/derive-family.ts applies per-vendor regex rules to normalized ids, handling traps like date suffixes, size suffixes, and spelling variants such as qwen2p5 or llama-v3p1. Rolling aliases get family only, with no generation.

Do distilled models inherit the teacher model's knowledge cutoff?

No, distills do not inherit cutoffs from teacher or base models. Use the distill's own published value or leave the field empty. Dated snapshots, quantizations, and context-length variants do inherit their base model's cutoff.

Why did the apply codemod skip some map keys?

The codemods match ids verbatim after normalization, so invisible characters like trailing tabs in aggregator data prevent matches. Check for dirty ids before assuming the model is missing from the data files.

Does adding knowledgeCutoff require a database migration?

No migration is needed. Builtin models are merged from model-bank at read time, so new card fields flow to the client automatically once added to the TypeScript data files.