LLM Proxy Server Integration

What problem does it solve?

This skill solves the challenge of connecting native Android applications to a Spring Boot LLM proxy backend to stream real-time AI responses, eliminating the need to build custom backend endpoints for chat completions, vision inputs, and web search functionality.

Core Features & Use Cases

• Streaming Chat Completions: Send prompts to local or hosted LLMs via the proxy and receive real-time text chunks via Server-Sent Events for a smooth, ChatGPT-like typing effect in Android apps.
• Vision Model Support: Send image inputs alongside text prompts to multimodal models like LLaVA or Moondream for image analysis use cases.
• Optional Web Search Integration: Add a toggle to enable live web search for user queries, with the backend automatically injecting search context and source URLs into the model prompt.
• Use Case: A developer building a native Android AI assistant can use this skill to connect to a local Gemma model, stream responses in real-time, add photo analysis features, and enable web search without writing any backend API code.

Quick Start

Use the LLM Proxy Server Integration skill to add real-time streaming AI chat to your native Android app by implementing the provided OkHttp SSE handler, ViewModel, and Jetpack Compose UI components.