foundation-models-on-device

Generate text and structured outputs on-device with Apple FoundationModels in iOS apps.

4|7|Updated Apr 9, 2026
One-click install
npx skills add https://github.com/arbisoft/ai-skillforge --skill foundation-models-on-device-arbisoft
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: foundation-models-on-device
Source: https://github.com/arbisoft/ai-skillforge/tree/main/Claude/skills/foundation-models-on-device
Command: npx skills add https://github.com/arbisoft/ai-skillforge --skill foundation-models-on-device-arbisoft

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Enables private, offline language modeling by leveraging Apple's FoundationModels to generate text and structured outputs directly on iOS devices, eliminating cloud dependency for sensitive data.

Core Features & Use Cases

  • Text generation on-device with privacy-preserving execution
  • Guided generation using @Generable for structured outputs
  • Tool calling for domain-specific AI actions
  • Snapshot streaming to update the UI in real-time
  • Offline capability suitable for iOS 26+ apps

Quick Start

Enable on-device FoundationModels, configure a session with Generable types, and implement a simple tool to demonstrate streaming outputs.

Frequently Asked Questions about foundation-models-on-device

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run on-device text generation in iOS apps without sending data to the cloud?

On-device text generation uses Apple FoundationModels to execute language modeling directly on iOS devices, ensuring privacy-preserving execution by eliminating cloud dependency for sensitive data.

How do I get structured outputs from an on-device LLM in iOS?

Structured outputs are generated using the @Generable feature, which provides guided generation to format on-device FoundationModels responses into specific data types within iOS apps.

Can I use on-device FoundationModels for tool calling in iOS applications?

Yes, on-device FoundationModels support tool calling, enabling iOS apps to execute domain-specific AI actions directly on the device while maintaining offline privacy.

What iOS version is required for on-device FoundationModels?

On-device FoundationModels require iOS 26+ to enable offline capability, privacy-preserving text generation, and structured outputs within native iOS applications.

Why use on-device FoundationModels instead of cloud-based generation for iOS?

On-device FoundationModels eliminate cloud dependency to provide offline capability and privacy-preserving execution, ensuring sensitive data never leaves the iOS device during text generation.