foundation-models-on-device

Integrate Apple FoundationModels for on-device text generation and structured output.

16|3|Updated Mar 12, 2026
One-click install
npx skills add https://github.com/sehoon787/my-claude --skill foundation-models-on-device-sehoon787
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: foundation-models-on-device
Source: https://github.com/sehoon787/my-claude/tree/main/skills/ecc/foundation-models-on-device
Command: npx skills add https://github.com/sehoon787/my-claude --skill foundation-models-on-device-sehoon787

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Apple FoundationModels enables on-device language models, delivering privacy-preserving text generation, structured output with @Generable, and streaming capabilities without cloud access.

Core Features & Use Cases

  • On-device text generation using FoundationModels for offline apps.
  • Guided generation with @Generable for structured data, including tools and streaming results.
  • Tool calling to perform domain-specific actions without network calls.
  • Streaming snapshots to update UI in real time.

Quick Start

Integrate FoundationModels on-device into your iOS app and start generating text locally with streaming support.

Frequently Asked Questions about foundation-models-on-device

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I enable on-device LLM text generation in iOS without cloud access?

You can achieve structured output from an on-device LLM by using Apple's @Generable macro with FoundationModels. It guides the local model to generate structured data and stream results within a constrained token budget.

Can I perform tool calling with on-device LLMs in an offline iOS app?

Yes, you can perform tool calling with on-device LLMs using Apple's FoundationModels. This allows your iOS app to invoke domain-specific actions locally without requiring any network calls.

How do I stream real-time UI updates from an on-device LLM in iOS?

You can stream real-time UI updates from an on-device LLM by utilizing streaming snapshots in Apple's FoundationModels. This feature updates the interface dynamically as the local model generates text.

Does Apple FoundationModels support fully private AI workflows on iOS?

Yes, Apple FoundationModels supports fully private AI workflows on iOS by executing language models entirely on-device. This ensures offline generation and user data privacy without cloud dependency.