송은화

A WISE (Wearable Interface for Sustainable Enhancement) AR UI/UX platform for smart glasses.

We propose a lifestyle quantification method for personalized augmented reality (AR) intervention in everyday life. Maintaining a healthy lifestyle accompanies extensive workforce and costs, because accurate health evaluation and tailored management is a prerequisite. However, research on assessing multiple dimensions of health and timely administration of personalized information has been lacking. To address these issues, first we deduced participant’s physical activity, nutrition, interpersonal relations, and stress management level through their mobile devices. Each participant’s week-long data were filtered by clinical features evidenced in high-level medical literature. Next, based on their health status, we presented personalized AR interventions in their simulated everyday environment. Statistical analysis and user experiment results verified the clinical capability of our method and its effect on health-promoting decision behaviors of participants. Through this feasibility study, we hope to contribute on tailored lifestyle management in our daily lives, for better health of all.

We propose the Holistic Quantified-Self (HQS), a sensor-driven user model for AR glass users. Existing research on context-aware AR interfaces typically relies on singular context attributes, resulting in an incomplete representation of user states. To address this gap, we propose an integrated user model for AR glass users, encompassing physical condition, cognitive-emotional status, social circumstances, and digital consumption behavior. Our system collects data from various devices, enabling simultaneous prediction of user states and tasks within the AR environment. We envision that this approach paves the way for future adaptive AR interfaces that can dynamically adjust virtual content based on the recognized user states and tasks.

We propose Memo:me, an AR sticky note with priority-based color transition and on-time reminders in smartphones. For the priority-based color transition, the user can choose by himself among three different colors, or the system changes the color automatically 10 minutes before the entered time. For the on-time reminder, Memo:me provides a visual notification and a sound at the designated time. We enabled users to create virtual notes on planes, or carry daily objects with the virtual notes attached. We expect that our system would benefit users to manage their tasks in a time-appropriate manner.

In this poster, we present a digital twin-based mixed reality system for remote collaboration with the size-scaling of the user and the space. The proposed system supports collaboration between an AR host user and a VR remote user by sharing a 3D digital twin of the AR host user. To enhance the coarse authoring of a shared digital twin environment, we provide a size scaling of the digital twin environment with the world-in-miniature view. Also, we enable scaling the size of the VR user’s avatar to enhance both coarse (size-up) and fine-grained (size-down) authoring of the digital twin environment. We describe the system setup, input methods, and interaction methods for scaling space and user.