Junki Kim

Converting national high-precision spatial data into genre-optimized cultural content and letting users author spatial cultural content.

This study introduces RealityBrush, a novel augmented reality (AR) authoring system that allows designers to quickly and easily create realistic virtual objects by capturing and utilizing the kinetic properties of everyday physical objects in the early stages of design. The RealityBrush system consists of a handheld device, a data analysis module and an AR feedback module. The handheld device, which is made in the shape of a rod, is equipped with a depth camera and a force sensor at the tip. When a user holds the device and pokes a physical object, the local force applied to the object and the resulting deformations of the object are measured simultaneously. By analyzing the relationship between measured force and deformations, the RealityBrush system can identify two kinetic properties of the poked object: stiffness and motion resistance. The user can then use the handheld device as a 3D brush to create a virtual object in the air and assign the measured kinetic properties to the created virtual object. Finally, the system’s physics engine allows the user to interact with the created object by using the device to poke or push the object. The technical evaluation showed that the system can successfully extract the stiffness and motion resistance of everyday objects. We also report initial user feedback on AR authoring using the RealityBrush system.

AR technology has been rapidly accepted in the cultural heritage domain, which requires wide context information for complete understanding as providing an enhanced experience to the user with related information of the physical world. However, currently, there are several limitations for seamless AR such as applications in outdoor environments and wearable platforms. To address this issue, we introduce our AR platform in this paper that supports the outdoor AR and wearable platform. Through the standardized metadata schema-based data retrieval, time-space correlated AR content containing the assorted context information can be provided to users. In addition, vision- and sensor-based spatial data composition technology supports stable 3D outdoor tracking. Finally, an immersive visualization provisioning module, which integrates the aforementioned component, provides a 360-degree panorama virtual reality for wearable platforms and the outdoor AR in mobile platforms. Using this platform, we expect a seamless context-aware AR service in the cultural heritage domain.

This study proposed a mobile virtual reality-based application for on-site risk management using Historical Building Information Modeling (HBIM) to alleviate the inefficiency of paper-based risk management of architectural heritage. In this research, we focused on the design of the metadata and the database structure that is based on the point of interest (PoI), anchor, and content metadata for advanced context-aware information retrieval from HBIM system in the mobile environment. To verify our method, we created a mobile VR-based application of the Gwandeokjeong building in Korea. After, we conducted a comparative experiment on performance time, task load and usability and proved the efficiency of our method for on-site risk management. In conclusion, our metadata and database structure in this study contribute to suggest a method to interoperate between HBIM system and mobile VR system and conduct advanced context-aware information retrieval.

사용자 능력을 증강시키는 증강 휴먼 서비스 제공 방법 및 그 시스템이 개시된다. 본 발명의 일 실시예에 따른 증강 휴먼 서비스 제공 방법은 적어도 하나의 사용자 기기에 구비된 센서들을 이용하여 사용자와 관련된 센싱 정보를 획득하는 단계; 상기 획득된 센싱 정보를 이용하여 상기 사용자의 정보를 정량화하고 패턴화함으로써, 상기 사용자의 전인적 정량적 자아(HQS; Holistic Quantified Self)에 대한 사용자 패턴을 생성하는 단계; 및 상기 생성된 사용자 패턴에 기초하여 사용자 맞춤형 서비스를 제공하는 단계를 포함한다.

As the popularization of augmented human, the influence of computing devices on human life is growing. We are facing lots of service in daily life, and it will be more in future. As a result, the border between real and virtual life is vanishing. To manage and maintain yourself in the flood of information, we need to know yourself in detail and quickly. For this reason, there were several research studies about the Quantified Self. However, the studies and applications of QS were held in separately by focusing each limited information, and it arises limitation on understanding in bird-eye view. To address these issues, we propose the unified concept of the Holistic Quantified Self (HQS) with its framework. HQS consists of the quantified indexes of user status which includes physical, emotional, social, and digital behavioral state. By collecting and quantifying the user’s multi-modal sensor data, HQS can be generated. Then, interpreting the pattern of HQS could be utilized to provide customized services to users. HQS framework describe an overall process to ensure the personalized service. Through these study, we expect to fulfill augmented human which enhances user abilities and contribute quality of social life through the development of the personal companion.