Human-to-Avatar Face Representation of Extended Reality (XR) Glasses Wearers for Communication

초록

This paper presents a comprehensive framework for standardizing avatar face representation in Extended Reality (XR)-based communication. It defines a consistent representation model for facial features and expressions to ensure high visual fidelity and expressive accuracy across diverse XR devices. The proposed framework supports interoperability across different systems and applications by defining core data structures that adapt to the hardware constraints and capabilities of different setups. A key focus is the real-time synchronization of facial expressions, even when users’ faces are occluded by XR devices, to enhance social presence and interaction quality. To address variability in user devices and network conditions, the framework introduces an adaptive control mechanism for real-time avatar rendering. This mechanism dynamically adjusts the visual complexity and expressiveness of avatars based on device performance and network bandwidth, ensuring consistent and responsive communication experiences in heterogeneous environments. Ultimately, this standardization effort aims to advance immersive communication by enabling lifelike, responsive avatars that reflect users’ expressions, thereby accelerating the adoption of XR technologies in both professional and social domains.