What problem does it solve?
RealityKit AR Companion Development enables developers to rapidly build interactive, persistent AR companions within iOS and visionOS apps, reducing integration friction and time-to-first-interaction.
Core Features & Use Cases
- ECS-based architecture: Entities, components, and systems to model companion behavior, animation, and interactions.
- Tracking and animation: Body and hand tracking, facial morph targets, procedural motions, and skeletal rigs for lifelike character motion.
- AI-driven behavior: State machines, behavior trees, and utility AI patterns for responsive, believable companions.
- Lifecycle & environment: Persistent state management, scene lifecycle integration, spatial audio, and AR anchoring to enable real-world persistence and immersion.
- Use Case: Create an AR companion that follows the user, reacts to gestures, talks, and interacts with their space while preserving state across sessions.
Quick Start
Begin by initializing RealityKit on iOS/visionOS, attach a character to a detected horizontal plane, and experiment with basic tracking, animation, and AI patterns using the provided examples and references.