foundation-models-on-device

To run LLM workflows on-device for offline text generation, you can use this Skill to execute language models locally. It keeps all processing on the device, ensuring privacy-preserving generation without sending data to the cloud.

The token limit for on-device language model execution is 4096 tokens. This Skill satisfies this specific constraint while providing safe, guided generation workflows and offline capabilities for privacy-conscious applications.

You can implement structured output and tool calling with a local LLM using the Generable feature. This Skill enables structured generation for domain actions, allowing privacy-conscious apps to safely guide model outputs offline.

Yes, you can stream partial LLM results locally for a responsive UI using snapshot streaming. This Skill provides real-time streaming of partial generation results, enabling responsive user interfaces while maintaining on-device privacy.

On-device LLM processing keeps user data completely private without cloud connectivity. This Skill performs all AI tasks locally on the device, enhancing privacy and enabling offline usability without sending data to external servers.