add-model

Scaffold KServe inference service directories with Docker Compose, Blubber configs, pipelines, and CI wiring.

4|Updated May 12, 2021
One-click install
npx skills add https://github.com/wikimedia/machinelearning-liftwing-inference-services --skill add-model-wikimedia
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: add-model
Source: https://github.com/wikimedia/machinelearning-liftwing-inference-services/tree/main/.claude/skills/add-model
Command: npx skills add https://github.com/wikimedia/machinelearning-liftwing-inference-services --skill add-model-wikimedia

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Adding a new inference model server involves many repetitive, error-prone setup tasks across code, configuration, containerization, pipelines, and CI wiring.

Core Features & Use Cases

  • Model server scaffolding: Creates a model.py that subclasses kserve.Model and includes the standard load(), preprocess(), and predict() structure for consistent inference behavior.
  • Deployment configuration generation: Adds a Blubber pipeline config and Docker Compose service so the model can be built and served with the correct environment variables and mounted model artifacts.
  • Pipeline and CI wiring: Registers test/production and publish pipelines and ensures CI triggers are connected, so new services are exercised and released reliably.

Quick Start

Tell your AI to scaffold a new model server named in kebab-case (for example, article-quality) and generate the model server code, Blubber config, Docker Compose entry, pipeline config, unit test folder, and CI wiring across this repo.

Frequently Asked Questions about add-model

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scaffold a new KServe inference model server?

To scaffold a new KServe inference model server, you generate a model_server directory containing a model.py with standard load, preprocess, and predict methods, alongside Blubber and Docker Compose configurations for deployment.

What files need to be updated when adding a new model to a KServe repository?

Adding a new model requires updating pipeline/config.yaml, adding a blubber.yaml file for pipeline directories, modifying Docker Compose for mounted artifacts, and connecting external CI triggers through integration configuration files.

Does scaffolding a model server include setting up unit tests and CI integration?

Yes, scaffolding a model server includes adding a unit test folder and connecting external CI triggers, ensuring the new KServe inference service is exercised and released reliably through automated pipelines.

How do I configure Docker Compose for a KServe model server deployment?

Configuring Docker Compose for a KServe model server involves adding a service entry that exposes a port, mounts model artifacts, and sets the correct environment variables required to build and serve the inference model locally.

What is the required structure for a KServe model server code file?

The required structure for a KServe model server code file is a model.py that subclasses kserve.Model and implements standard load, preprocess, and predict methods to ensure consistent inference behavior across services.

Can I use this scaffolding process for any named model in a Lift Wing repository?

Yes, you can use this scaffolding process for any named model in a Lift Wing inference-services repository by providing a kebab-case name to generate all required code, pipeline publishing, and deployment configurations.