realitykit-ar-companion

What problem does it solve?

RealityKit AR Companion Development enables developers to rapidly build interactive, persistent AR companions within iOS and visionOS apps, reducing integration friction and time-to-first-interaction.

Core Features & Use Cases

• ECS-based architecture: Entities, components, and systems to model companion behavior, animation, and interactions.
• Tracking and animation: Body and hand tracking, facial morph targets, procedural motions, and skeletal rigs for lifelike character motion.
• AI-driven behavior: State machines, behavior trees, and utility AI patterns for responsive, believable companions.
• Lifecycle & environment: Persistent state management, scene lifecycle integration, spatial audio, and AR anchoring to enable real-world persistence and immersion.
• Use Case: Create an AR companion that follows the user, reacts to gestures, talks, and interacts with their space while preserving state across sessions.

Quick Start

Begin by initializing RealityKit on iOS/visionOS, attach a character to a detected horizontal plane, and experiment with basic tracking, animation, and AI patterns using the provided examples and references.