skills.rest
agentmatters
agentmattersOFFICIAL
Explore all skills by this author →
WebsiteGitHub

foundation-models-on-device

Integrate Apple FoundationModels for on-device text generation and tool calling in Swift iOS apps.

3|2|Updated Mar 8, 2026
Search Tags:#llm#swift#ios#foundation-models#generable#on-device#tool-calling
One-click install
npx skills add https://github.com/agentmatters/mullai-bot --skill foundation-models-on-device-agentmatters
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: foundation-models-on-device
Source: https://github.com/agentmatters/mullai-bot/tree/main/src/Mullai.Skills/Skills/claude-code-everything/foundation-models-on-device
Command: npx skills add https://github.com/agentmatters/mullai-bot --skill foundation-models-on-device-agentmatters

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Enable private, offline AI capabilities by running language models directly on Apple devices, avoiding cloud data transfer and latency.

Core Features & Use Cases

  • On-device text generation and summarization using FoundationModels.
  • Guided generation with @Generable for structured outputs and type-safe results.
  • Tool calling and snapshot streaming to support responsive UI and domain-specific actions.

Quick Start

Run a minimal on-device session to generate a sample response using FoundationModels.

Frequently Asked Questions about foundation-models-on-device

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run an LLM on-device in iOS for offline text generation?▼

Run an LLM on-device for offline text generation in iOS using Apple's FoundationModels framework, which enables private text generation without transferring data to the cloud.

What is guided generation with @Generable in Swift?▼

Guided generation with @Generable in Swift is a feature of FoundationModels that produces structured, type-safe outputs from on-device language models for reliable iOS app integration.

Does on-device FoundationModels support tool calling and streaming output?▼

Yes, on-device FoundationModels supports tool calling and snapshot streaming to execute domain-specific actions and deliver responsive UI updates in iOS apps.

Do I need an internet connection to use FoundationModels for generable AI tasks?▼

No, FoundationModels performs generable AI tasks fully offline, requiring only on-device model availability to ensure privacy-preserving text generation without internet dependency.

What are the limitations of running on-device LLMs with FoundationModels?▼

Limitations of running on-device LLMs with FoundationModels include requiring on-device model availability, Swift-based integration, and sufficient local hardware resources to process generable tasks.

Related Skills

Explore More Software Engineering Skills→
GGEduGGEdu

foundation-models-on-device

Enable on-device text generation with FoundationModels for iOS 26+ apps.

Community
Advanced
JamkrisJamkris
86

foundation-models-on-device

Generate text and structured output on-device with Apple FoundationModels.

Community
Advanced
TeiNamTeiNam
12

foundation-models-on-device

Generate privacy-preserving text and structured output in iOS 26+ apps using Apple's FoundationModels framework.

Community
Advanced
KanakMalpaniKanakMalpani

foundation-models-on-device

Integrate Apple FoundationModels on-device for private LLM tasks in iOS apps.

Community
Advanced