xrblocks
OfficialRapidly prototype AI + XR experiences with a cross-platform SDK.
Authorgoogle
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill provides a comprehensive toolkit for quickly building immersive AI and XR applications, streamlining the development process and enabling developers to focus on creating engaging experiences.
Core Features & Use Cases
- Hand Tracking & Gestures: Integrate advanced hand tracking and custom gestures with TensorFlow Lite / PyTorch models.
- Gesture Recognition: Detect various hand gestures like pinch, open-palm, fist, thumbs-up, point, and spread.
- World Understanding: Implement depth sensing, geometry-aware physics, and object recognition with Gemini.
- Agent Context: Utilize semantic trees, visible-object state, and spatial UI for interactive experiences.
- Use Case: Develop an interactive XR game where players can manipulate virtual objects using their hands, with AI-driven interactions and spatial audio.
Quick Start
Create a new XR Blocks application by running xb.init(new xb.Options()) in your script.
Dependency Matrix
Required Modules
three.jstensorflowpytorch
Components
scriptsreferencesassets
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: xrblocks Download link: https://github.com/google/xrblocks/archive/main.zip#xrblocks Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 620,000+ vetted skills library on demand.