2025 · conference
Round-Trip2 Gesture: Inplace IMU Gesture Recognition with Visual Guidance for Out-of-FOV Interaction
IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) 2025
Abstract
We propose Round-Trip2Gesture, an interaction system that uses smartwatch IMU sensors to enable inplace gesture input free from the sensing FOV of devices. Current smartglasses input is limited by social unsuitability of voice commands and by the restricted sensing field-of-view inherent to hand tracking. Our system introduces a delimiter gesture based on specific wrist motions to achieve reliable interaction in real-world scenarios. Our system enables intuitive gesture interaction free from occulsion and physical constraints. We evaluated a set of 5 gestures with 8 participants. Four gestures showed over 90% accuracy in leave-one-subject-out cross-validation. We introduce the potential of the system through notification dismissal and video playback control applications, demonstrating seamless out-of-FOV interaction in Mixed Reality environments.
Citation
@inproceedings{son2025round,
title = {Round-Trip2 Gesture: Inplace IMU Gesture Recognition with Visual Guidance for Out-of-FOV Interaction},
author = {Taejun Son and Juyoung Lee and Seo Young Oh and Woontack Woo},
booktitle = {2025 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)},
year = {2025},
doi = {10.1109/ISMAR-Adjunct68609.2025.00238}
}