skills.rest
Oruga420
Oruga420COMMUNITY
Explore all skills by this author →
Website𝕏@Oruga420GitHub

foundation-models-on-device

Run FoundationModels language models locally in iOS apps with Swift.

Updated Mar 24, 2026
Search Tags:#streaming#swift#privacy#generable#on-device#tool-calling#foundationmodels
One-click install
npx skills add https://github.com/Oruga420/claude-code-skills --skill foundation-models-on-device-oruga420
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: foundation-models-on-device
Source: https://github.com/Oruga420/claude-code-skills/tree/main/foundation-models-on-device
Command: npx skills add https://github.com/Oruga420/claude-code-skills --skill foundation-models-on-device-oruga420

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Apple FoundationModels enables on-device language model execution for privacy-preserving apps, allowing offline AI capabilities without data leaving the device.

Core Features & Use Cases

  • On-device text generation with FoundationModels for privacy and offline support.
  • Structured output via @Generable, with Swift types and snapshot streaming for real-time UI updates.
  • Custom tool calling to perform domain-specific actions without cloud round-trips.
  • Availability checks to ensure device eligibility and proper session handling.

Quick Start

Integrate FoundationModels on-device LLM into your iOS app to enable private, offline generation with structured outputs and tool calls.

Frequently Asked Questions about foundation-models-on-device

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run on-device LLMs in my iOS app for offline text generation?▼

To run on-device LLMs in your iOS app, you use FoundationModels to enable privacy-preserving text generation. This allows offline AI capabilities without data leaving the device.

How do I get structured outputs from an on-device language model in Swift?▼

You get structured outputs from an on-device language model in Swift by using the @Generable feature. This provides Swift types and snapshot streaming for real-time UI updates.

Can I execute custom tool calling locally without cloud round-trips on iOS?▼

Yes, you can execute custom tool calling locally without cloud round-trips on iOS. FoundationModels supports domain-specific actions directly on-device to maintain privacy and offline functionality.

How do I check device availability before starting an on-device LLM session?▼

You check device availability before starting an on-device LLM session by implementing device eligibility checks. This ensures proper session handling for robust on-device AI experiences.

Does FoundationModels support streaming responses for real-time UI updates?▼

Yes, FoundationModels supports streaming responses for real-time UI updates. It implements snapshot streaming to deliver robust on-device AI experiences with immediate feedback.

Related Skills

Explore More Software Engineering Skills→
dbrijeshdbrijesh

foundation-models-on-device

Generate text and extract structured data on iOS 26+ with Apple's FoundationModels framework.

Community
Advanced
CharlesWiltgenCharlesWiltgen
1.1k

ios-ai

Route Foundation Models and on-device AI tasks with LanguageModelSession and @Generable.

Community
Advanced
KanakMalpaniKanakMalpani

foundation-models-on-device

Integrate Apple FoundationModels on-device for private LLM tasks in iOS apps.

Community
Advanced
agentmattersagentmatters
3

foundation-models-on-device

Integrate Apple FoundationModels for on-device text generation and tool calling in Swift iOS apps.

Official
Advanced