Extract semantic trees and visible-object states from XR scenes.
npx skills add https://github.com/google/xrblocks --skill xb-context
Please help me install this Agent Skill. Skill: xb-context Source: https://github.com/google/xrblocks/tree/main/skills/xb-context Command: npx skills add https://github.com/google/xrblocks --skill xb-context
This Skill allows for efficient scene context extraction from XR environments, providing agents with semantic trees, visible-object state, and Set-of-Mark labels, simplifying object selection and interaction.
Use the xb-context skill to retrieve the semantic tree from the current XR scene.
High-intent search queries and answers about installing and using this skill.
To extract scene context from an XR environment, retrieve semantic trees and visible-object states to enable object selection. This process provides agents with Set-of-Mark labels, simplifying interaction decisions without delving into complex Three.js objects.
An XR semantic tree is a structured representation of scene context that details object visibility and states. It helps with object selection by providing agents with Set-of-Mark labels, enabling informed interaction decisions without parsing complex Three.js objects.
Scene context retrieval works in both XR environments and desktop simulators. It consistently provides semantic trees, visible-object state, and Set-of-Mark labels to support scene detection and context extraction across different platforms.
You get visible-object states for agent interaction in XR applications by using scene context extraction. This provides detailed semantic trees and Set-of-Mark labels, allowing agents to make informed selection decisions without handling complex Three.js objects.
Use scene context extraction instead of parsing Three.js objects directly because it efficiently provides semantic trees and visible-object states. This simplifies object selection and manipulation by delivering agent-facing context and Set-of-Mark labels without complex object handling.
hkcm91Integrate VR and AR modes into spatial platforms using WebXR, @react-three/xr, and Three.js.
googleIntegrate Rapier3D physics with gravity, collisions, and depth-aware colliders in XR applications.
AutisticAFBuild visionOS spatial computing experiences with SwiftUI and RealityKit.
StonelukasCreate interactive 3D web apps with Three.js for WebGL/WebGPU rendering.
