ISMAR '26: Proceedings of the 2026 IEEE International Symposium on Mixed and Augmented Reality

FlowAvatar: Real-Time Full-Body Avatars from Sparse Egocentric Inputs on Consumer XR Devices

Chenfeng Gao*, Taeyoung Yeon*, Sungheon Park, Vasco Xu, Anish Prabhu, Mar Gonzalez-Franco, Karan Ahuja

Abstract

Prior avatar embodiment research has studied tracking completeness (how faithfully the body, hands, and face are sensed and reproduced) and personalized appearance in isolation, each requiring specialized lab equipment. How these factors interact on consumer hardware remains an open question, because no existing system unifies body pose, face, hands, and personalized appearance on a standalone headset. We present FlowAvatar, a system enabling real-time personalized look-alike avatars with full-body pose, hand articulation, facial expression, and eye gaze tracking from sparse egocentric inputs on consumer XR devices (Meta Quest Pro). Our pose model achieves competitive spatial accuracy and state-of-the-art temporal consistency on the AMASS benchmark against prior works with comprehensive spatial and temporal losses validated through architecture and loss ablations, while running in real-time. Two user studies (N=12, N=10) provide converging evidence that tracking completeness and personalized appearance serve complementary roles: tracking completeness broadly improves perceived motion quality, while only their combination achieves positive total embodiment.

Citation

Gao, C., Yeon, T., Park, S., Xu, V., Prabhu, A., Gonzalez-Franco, M., & Ahuja, K. (2026). FlowAvatar: Real-Time Full-Body Avatars from Sparse Egocentric Inputs on Consumer XR Devices. arXiv preprint arXiv:2610.16277.

BibTeX

@article{gao2026flowavatar,
title={FlowAvatar: Real-Time Full-Body Avatars from Sparse Egocentric Inputs on Consumer XR Devices},
author={Gao, Chenfeng and Yeon, Taeyoung and Park, Sungheon and Xu, Vasco and Prabhu, Anish and Gonzalez-Franco, Mar and Ahuja, Karan},
journal={arXiv preprint arXiv:2610.16277},
year={2026}
}