add-inference-model

Automate end-to-end onboarding of pre-trained models into inference repos.

2.4k|300|Updated Jul 31, 2023
One-click install
npx skills add https://github.com/roboflow/inference --skill add-inference-model
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: add-inference-model
Source: https://github.com/roboflow/inference/tree/main/.claude/skills/add-inference-model
Command: npx skills add https://github.com/roboflow/inference --skill add-inference-model

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Onboarding a new core pre-trained model into the inference repos is slow and error-prone without a standardized playbook.

Core Features & Use Cases

  • End-to-end scaffolding for new core model implementations, including class creation, registry wiring, and tests.
  • Weight packaging and registry wiring covering zip creation and model package submission to the registry.
  • Optional surfaces support for workflows (foundation blocks) and adapters (inference endpoints) when needed.
  • Templates and guidance to ensure consistent model onboarding across architectures and backends.

Quick Start

Begin by defining the architecture name, task type, backend, and weight source, then follow the scaffolding to implement surfaces 1–4 as needed.

Frequently Asked Questions about add-inference-model

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I onboard a new pre-trained model into an inference repository?

Onboarding a new pre-trained model involves automating class implementation, registry wiring, tests, and weight packaging. This ensures consistent model onboarding across multiple architectures and backends with optional workflow blocks and adapters.

What is model registry wiring and why is it needed for inference models?

Model registry wiring connects new core pre-trained models to the inference pipeline via script-based registration. It standardizes weight packaging and submission to the registry, ensuring models are accessible for production workflows and HTTP endpoints.

How do I package model weights and register a new core model for inference?

Packaging model weights requires creating a zip file and submitting the model package to the registry. This process is automated alongside class creation, registry wiring, and unit tests to maintain consistent model onboarding.

Does this model onboarding scaffolding support multiple architectures and backends?

Yes, the scaffolding applies to multiple architectures and backends. It provides templates and guidance for optional surfaces like foundation blocks for workflows and adapters for inference endpoints, ensuring broad compatibility.

What tests are required when adding a new inference model to the registry?

Adding an inference model requires both unit tests and integration tests. The scaffolding also includes documentation templates to ensure the new core pre-trained model meets required testing standards before registry submission.

Can I expose newly added inference models via HTTP endpoints or workflows?

Yes, you can expose models via workflows using foundation blocks or through HTTP endpoints using adapters. These optional surfaces are supported during the end-to-end onboarding of new core pre-trained models.