Integrate Gemini or OpenAI text, image, and real-time sessions into XR experiences.
npx skills add https://github.com/google/xrblocks --skill xb-ai
Please help me install this Agent Skill. Skill: xb-ai Source: https://github.com/google/xrblocks/tree/main/skills/xb-ai Command: npx skills add https://github.com/google/xrblocks --skill xb-ai
The xb-ai Skill simplifies integrating AI features like generative text and image queries, live sessions, and content generation into XR applications.
Use the xb-ai skill to enable AI features in your XR Blocks app.
High-intent search queries and answers about installing and using this skill.
To integrate AI for real-time interaction in XR applications, you can use this Skill to facilitate text and image queries, live audio sessions, and real-time content generation with Gemini or OpenAI APIs.
Yes, you can use Gemini or OpenAI for live audio and video sessions in XR. This Skill supports real-time feedback and content generation for interactive AR and VR apps, provided you have valid API access.
Before adding generative text and image queries to XR, you need Gemini or OpenAI API access for AI operations. The Skill also utilizes dependencies like TensorFlow Lite and PyTorch for its internal processing.
XR Blocks works with generative text and image queries for AR apps by providing an API for AI queries and real-time sessions. This enables interactive AR applications to answer user queries with real-time generated responses.
FutureAtomsDevelop real-time audio AI agents with LiveKit, OpenAI Realtime API, and Gemini Live.
erichowensDesign spatial audio and procedural sound for games, VR/AR, and mobile apps.
googleLoad and display GLTF, GLB, and .spz 3D models in XR Blocks applications.
googleIntegrates spatial audio and speech processing into XR Blocks applications.
