googlegoogleOfficialยท20 Agent Skills Included

xrblocks

Build immersive XR web apps with spatial interactions

Builds cross-platform XR web applications with hand tracking, spatial UI, depth sensing, and world understanding. Eliminates complex WebXR boilerplate, manual gesture wiring, and headset-only testing through a desktop simulator. Guides agents through app scaffolding, interactions, AI integration, debugging, and SDK contributions with verified patterns.
npx skills add google/xrblocks --all -g -y
Available:

Instructs your AI agent on the XR Blocks architecture, public API boundaries, build commands, and conventions so it generates working XR apps without hallucinating nonexistent APIs.

All Skills in This Repository (20)

Pure Emerald Level Indicators
๐Ÿ“ฆ In Repo
googlegoogle

xrblocks

Prototype immersive AI and XR experiences with hand tracking and gestures on three.js.

Official
Advanced
๐Ÿ“ฆ In Repo
googlegoogle

xb-physics

Integrate Rapier3D physics with gravity, collisions, and depth-aware colliders in XR applications.

Official
Intermediate
๐Ÿ“ฆ In Repo
googlegoogle

xb-hands

Integrate hand tracking and gesture recognition into XR experiences with TensorFlow Lite/PyTorch.

Official
Advanced
๐Ÿ“ฆ In Repo
googlegoogle

xb-ai

Integrate Gemini or OpenAI text, image, and real-time sessions into XR experiences.

Official
Intermediate
๐Ÿ“ฆ In Repo
googlegoogle

xb-netblocks

Integrate real-time multiplayer with presence avatars and replicated NetObject transforms into XR Blocks.

Official
Intermediate
๐Ÿ“ฆ In Repo
googlegoogle

xb-testing

Simulate XR and AI application tests in headless environments using xrblocks.

Official
Advanced
๐Ÿ“ฆ In Repo
googlegoogle

xb-simulator

Simulate XR Blocks user, hands, depth, and planes in a browser.

Official
Intermediate
๐Ÿ“ฆ In Repo
googlegoogle

xb-sound

Integrates spatial audio and speech processing into XR Blocks applications.

Official
Intermediate
๐Ÿ“ฆ In Repo
googlegoogle

xb-ui

Construct grid-based spatial UI panels in XR Blocks applications.

Official
Intermediate
๐Ÿ“ฆ In Repo
googlegoogle

xb-depth

Add depth sensing and occlusion to XR Blocks applications.

Official
Intermediate
๐Ÿ“ฆ In Repo
googlegoogle

xb-gestures

Recognize hand gestures like pinch and fist in XR environments.

Official
Intermediate
๐Ÿ“ฆ In Repo
googlegoogle

xb-context

Extract semantic trees and visible-object states from XR scenes.

Official
Advanced

Frequently Asked Questions

FAQPage Schema
How to install XR Blocks?โ–ผ

Run `npx skills add google/xrblocks --all -g -y` in your terminal to install all skills in this suite globally.

What is XR Blocks used for?โ–ผ

XR Blocks is a JavaScript SDK for rapidly prototyping XR and AI experiences on the web, built on three.js. It targets WebXR headsets like Galaxy XR and includes a desktop simulator for development.

Can I test XR apps without a headset?โ–ผ

Yes. XR Blocks ships a desktop simulator that runs the same code in a normal Chrome browser, simulating hands, depth, planes, and controllers.

Does XR Blocks support hand and head gestures?โ–ผ

Yes. It provides built-in pinch, fist, thumbs-up, and point detection plus nod and shake head gestures, with support for custom TensorFlow Lite recognizers.

Can I add Gemini AI to my XR app?โ–ผ

Yes. The SDK integrates Gemini for text queries, live voice and video conversations, image generation, and scene-grounded responses via the xb.ai facade.

Related Repositories in Software Engineering

View All in Software Engineeringโ†’