hz-unity-passthrough-camera-access

You can access the Meta Quest 3 Passthrough Camera in Unity by using this Skill to capture live images, retrieve camera pose and intrinsic parameters, and project pixels into world space for 3D rendering. It enables direct integration with computer vision pipelines.

Yes, you can use Quest 3 camera images for Machine Learning applications by capturing live images from the Passthrough Camera. This Skill provides the necessary image data and camera intrinsics to feed into your computer vision pipelines.

To project Passthrough Camera pixels into world space in Unity, this Skill provides built-in raycasting capabilities. It uses the retrieved camera pose and intrinsic parameters to accurately map 2D image pixels onto 3D real-world coordinates.

Yes, retrieving camera pose and intrinsic parameters is fully supported. This Skill extracts these specific values from the Quest 3 Passthrough Camera to enable accurate 3D projection and real-world environment interaction in Unity.

This Skill is designed specifically for Quest 3 and 3S forward-facing RGB cameras to interact with the real-world environment. It requires Unity and is built for applications like fitness equipment recognition or interactive museum experiences, limiting its scope to these device models.