building-inferencesh-apps

Build, test, and deploy Python or Node.js applications on the inference.sh platform.

Updated Jul 28, 2026
One-click install
npx skills add https://github.com/Aadi-110i/PEP-PROJECT --skill building-inferencesh-apps-aadi-110i
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: building-inferencesh-apps
Source: https://github.com/Aadi-110i/PEP-PROJECT/tree/main/skills/building-inferencesh-apps
Command: npx skills add https://github.com/Aadi-110i/PEP-PROJECT --skill building-inferencesh-apps-aadi-110i

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve? Developers building apps on inference.sh often misconfigure project scaffolding, resource settings, or output metadata, leading to failed deployments and silently dropped usage tracking. This Skill provides the correct CLI-driven workflow and platform-specific rules to avoid those pitfalls. ## Core Features & Use Cases - CLI-Guided Scaffolding: Enforces belt app init for creating apps with correct inf.yml, inference.py/inference.js, and dependency files. - Full Development Workflow: Covers the mandatory cycle of scaffold, implement, local test, deploy, and cloud verification with output_meta checks. - Resource & Secrets Configuration: Guides GPU/VRAM/RAM settings, secrets, OAuth integrations, and usage tracking metadata for both Python and Node.js. - Use Case: You want to wrap an external image-generation API as a CPU-only inference.sh app. The Skill provides the API-wrapper template, correct BaseAppOutput usage for output_meta, and the deploy-and-verify command sequence. ## Quick Start Ask the assistant to scaffold a new inference.sh app called my-app, implement its run function, test it locally, and deploy it with the belt CLI.

Frequently Asked Questions about building-inferencesh-apps

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create and deploy an app on inference.sh?

Use the belt CLI: run `belt app init my-app` to scaffold, implement inference.py or inference.js, test locally with `belt app test`, then run `belt app deploy` from inside the app directory. Verify the live app with `belt app run user/app --json`.

How do I configure GPU resources for an inference.sh app?

Set resources in inf.yml with gpu count, vram in GB, and type. For GPU apps, use accelerate's Accelerator for device detection instead of torch.cuda.is_available(), and explicitly move models with .to(device, dtype).

Why is output_meta missing from my inference.sh app response?

The output class is likely extending BaseModel instead of BaseAppOutput. Output classes that include output_meta must extend BaseAppOutput, otherwise the metadata is silently dropped from the response.

Does inference.sh support both Python and Node.js apps?

Yes, apps can be written in Python using Pydantic models and BaseApp, or in Node.js using Zod schemas and an exported App class. Both support multi-function apps, secrets, and usage tracking metadata.

How do I add secrets or Google OAuth to an inference.sh app?

Declare secrets or integrations in inf.yml with a key, description, and optional flag. Access secret values via environment variables like os.environ or process.env, and OAuth credentials via GOOGLE_OAUTH_CREDENTIALS or GOOGLE_SA_CREDENTIALS.