What problem does it solve?
React Native developers need a reliable way to choose, install, and wire the correct on-device AI provider so apps can generate text, compute embeddings, or run local inference without confusing setup steps.
Core Features & Use Cases
- Provider selection and integration guidance: Decide between Apple, Llama (GGUF via llama.rn), MLC-LLM, and low-level NCNN based on the target models and platform constraints.
- End-to-end setup recipes: Install the right package(s), validate provider availability where applicable, and wire model usage with Vercel AI SDK generateText/streamText patterns.
- Model lifecycle management: Download, prepare/unload, and manage model storage and execution flows for Llama and MLC-LLM; handle native model paths for NCNN.
Use case example: You want a React Native app to run an offline chat experience using a specific GGUF model—select the Llama path, download the model, prepare it, then call generateText with the provider-backed language model.
Quick Start
Install the correct provider package for your chosen path and follow its checklist to enable the provider, then call generateText with the provider’s model instance.