realitykit

Build AR experiences with RealityKit and ARKit in SwiftUI.

Updated Jun 5, 2026
One-click install
npx skills add https://github.com/harshav167/build-ios-apps --skill realitykit-harshav167
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: realitykit
Source: https://github.com/harshav167/build-ios-apps/tree/main/skills/realitykit
Command: npx skills add https://github.com/harshav167/build-ios-apps --skill realitykit-harshav167

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

Building rich AR experiences on iOS used to require piecing together RealityKit rendering, ARKit world tracking, entity management, and user interaction logic from multiple sources. This Skill provides a cohesive guide and practical patterns for integrating RealityKit into SwiftUI apps, loading content, anchoring objects, and handling gestures.

Core Features & Use Cases

  • RealityView-based AR experiences: render RealityKit content inside SwiftUI.
  • Entity loading, anchoring, and raycasting: place 3D content on planes or in world space and perform hit tests or raycasts.
  • Gesture-driven interactions and accessibility: enable drag/drop, taps, and voice/screen reader support for AR scenes.

Quick Start

Create a RealityView-based AR scene that loads a simple ModelEntity anchored to a detected plane.

Frequently Asked Questions about realitykit

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I build AR experiences with RealityKit in SwiftUI?

You can render RealityKit content inside SwiftUI by using RealityView, then load entities, anchor them to detected planes, and handle user interactions like taps and drags.

How do I anchor 3D objects to real-world planes using ARKit?

Anchor 3D objects to real-world planes by performing raycasts against detected ARKit surfaces, then attaching the loaded RealityKit entities to those anchor points in world space.

Can I use gesture-driven interactions with RealityView on iOS?

Yes, you can enable gesture-driven interactions in RealityView by adding CollisionComponent and InputTargetComponent to entities, allowing users to drag, drop, and tap 3D objects.

Does RealityKit support accessibility for AR scenes?

RealityKit supports accessibility in AR scenes through AccessibilityComponent, enabling voice and screen reader compatibility for entities rendered within your RealityView content.

What is the best way to perform raycasting and hit tests in RealityKit?

The best way to perform raycasting in RealityKit is to use ARKit integration to conduct hit tests against detected planes, returning anchor positions for precise entity placement.

Can I run per-frame updates for RealityView content in SwiftUI?

Yes, you can run per-frame updates for RealityView content by subscribing to the render loop, allowing continuous manipulation of entities and RealityViewCameraContent during AR sessions.