xb-hands

Integrate hand tracking and gesture recognition into XR experiences with TensorFlow Lite/PyTorch.

455|91|Updated Sep 25, 2025
One-click install
npx skills add https://github.com/google/xrblocks --skill xb-hands
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: xb-hands
Source: https://github.com/google/xrblocks/tree/main/skills/xb-hands
Command: npx skills add https://github.com/google/xrblocks --skill xb-hands

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

xb-hands addresses the need for hand tracking integration in XR Blocks apps, allowing for more natural and interactive user engagement.

Core Features & Use Cases

  • Hand Tracking: Integrate advanced hand tracking into your XR application.
  • Gesture Recognition: Supports a variety of gestures like pinch, open-palm, fist, and point.
  • Visualizations: Provides options to visualize joints and meshes for better debugging.
  • Use Case: Add hands to an XR experience for realistic interaction scenarios, like a VR game or an interactive presentation.

Quick Start

Enable hand tracking and visualization in your XR Blocks project using options.enableHands();.

Frequently Asked Questions about xb-hands

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I integrate hand tracking into a WebXR experience?

To add hand tracking, call `options.enableHands();` in your XR Blocks project. This initializes the gesture recognition and visualizations for your interactive AR or VR application.

Can I use TensorFlow Lite for gesture recognition in WebXR?

Yes, TensorFlow Lite enables gesture recognition in WebXR by detecting pinch, open-palm, fist, and point gestures. This allows for natural user interaction within AR and VR applications.

Does WebXR hand tracking work with three.js scene management?

Yes, WebXR hand tracking works with three.js for scene management. The skill requires three.js to handle the 3D environment while processing hand tracking data on Chrome.

What gestures are supported by PyTorch hand tracking in AR applications?

PyTorch hand tracking in AR applications supports pinch, open-palm, fist, and point gestures. These recognized gestures facilitate interactive and realistic user scenarios in XR.

Do I need Chrome to run WebXR hand tracking and visualizations?

Yes, you need Chrome with WebXR support to run hand tracking and visualizations. The browser provides the necessary XR capabilities to process hand joints and meshes effectively.