add-ml-service

Scaffold and register LiftWing inference services in KServe helmfile and values manifests.

4|Updated May 12, 2021
One-click install
npx skills add https://github.com/wikimedia/machinelearning-liftwing-inference-services --skill add-ml-service
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: add-ml-service
Source: https://github.com/wikimedia/machinelearning-liftwing-inference-services/tree/main/.claude/skills/add-ml-service
Command: npx skills add https://github.com/wikimedia/machinelearning-liftwing-inference-services --skill add-ml-service

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

It helps teams add a new LiftWing inference service to Wikimedia’s KServe deployment setup without hand-editing fragile helmfile and values files.

Core Features & Use Cases

  • Adds to an existing namespace: appends a new inference_services entry to the correct values.yaml and staging override file(s).
  • Creates a brand-new namespace scaffold: generates helmfile.yaml, values.yaml, and values-ml-staging-codfw.yaml (and optional eqiad-only env support) from the repo’s templates.
  • Configures operational essentials: collects and wires CPU/memory/GPU requests/limits, replica ranges, optional request batching parameters, model image naming, environment variables, and network egress endpoints for new namespaces.

Quick Start

Tell the skill the new inference service name (kebab-case) when prompted so it can either append the service to an existing namespace or scaffold a new one end-to-end.

Frequently Asked Questions about add-ml-service

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I add a new KServe inference service to a LiftWing namespace?

To add a new KServe inference service to a LiftWing namespace, you append a new inference_services entry to the correct values.yaml and staging override files. This ensures consistent YAML structure without hand-editing fragile helmfile manifests.

What does scaffolding a new namespace for a LiftWing ML service involve?

Scaffolding a new namespace for a LiftWing ML service involves generating helmfile.yaml, values.yaml, and values-ml-staging-codfw.yaml from repo templates. It captures required container environment variables and configures network egress endpoints for the new environment.

Can I configure request batching and replica settings for KServe deployments?

Yes, you can configure request batching and replica settings for KServe deployments. The configuration process supports staging and production replica ranges alongside optional request batching parameters and CPU, memory, or GPU resource limits.

How do I ensure consistent YAML structure when editing helmfile values manifests?

To ensure consistent YAML structure when editing helmfile values manifests, mirror the indentation and field ordering of existing entries. This approach applies when onboarding a new service into an existing namespace or creating a new one.

Does LiftWing namespace onboarding support eqiad-only environments?

Yes, LiftWing namespace onboarding supports eqiad-only environments. When creating a brand-new namespace scaffold, the generation process can optionally include configuration and values support specifically for eqiad-only environments.