Hochul Cho

Generating free-viewpoint 3D 360° VR content from multi-camera video so users can move and interact in a virtual space.

This paper introduces a method for developing Augmented Urban Digital Twin (A-UDT) for virtual and real Internet-of-Things (IoT) visualization and its benefits. It presents a method for generating virtual data using the Virtual IoT (VI) based on real IoT data, which can be used with cloud services. An urban digital twin is developed to find and simulate various problems arising in the city by extracting and visualizing data of the city. Designing urban digital twin has some challenging issues such as the difficulty of processing environmental information in real-time due to the absence of IoT support. This absence of IoT support can make problems like developing urban digital twin without knowing the types and scope of visualization. To overcome this limitation, we propose the augmented city miniature that uses generation system, process, storage, and network system of the component that generates VI with the same data structure as real IoT to generate and send data, and it simulates information on a 3D geographic map by sending the generated virtual data to the visualization part using Augmented Reality (AR). Urban digital twin based on the virtual data can make various simulations of city visualization that can be performed to discover required IoT and reduce development costs. A-UDT system can be applied to monitor and simulate diverse environmental information such as air quality, energy efficiency, object movements, and temperature distribution.

Despite prior efforts to solve urban problems and build smart cities using large-scale urban information, researchers have yet to develop tools for city administrators to easily access a diverse mix of city information. To address this limitation, this article proposes an augmented reality visualization system, GeoACT, which can develop a digital twin to present city information from both macro and micro perspectives. GeoACT employs a 3D virtual city miniature with real and virtual IoT information to provide a macro perspective view, and a 360-degree-video-based visualization technique is used for a micro perspective view. We applied GeoACT to an urban space and demonstrated that it could effectively visualize city information through an augmented reality Head Mounted Display (HMD). Furthermore, GeoACT can be used in urban control centers.

This paper shows a structure and implementation of an Urban Digital Twin (UDT), simulating virtual data productions using Virtual IoT (VI) to design services for citizens. When designing smart city services with UDT systems, developing the system without data support from real IoTs can be created without knowing the scope and limitations of the IoTs. We simulated the services by creating VI system, which can be introduced in the future based on the meaningful data sets of existing Real IoT sensors. This paper focuses on the concept of the proposed system, GeoVCM, the components that make up the system.

We present a novel view synthesis method that allows users to experience a large-scale Six-Degree-of-Freedom (6-DOF) virtual environment. Our main contributions are the construction of a large-scale 6-DOF virtual environment using multiple 360 images as well as synthesis of a scene from novel viewpoints. Novel view synthesis from a single 360 image can give free viewpoint experience with full 6-DOF of head motion to players, but the moveable space is limited within a context of the image. We propose a novel view synthesis process that references multiple 360 images via reconstructing a large-scale real world based virtual data map and perform a weighted blending for interpolating multiple novel view images. Our results show that our approach provides a wider area of virtual environment as well as a smooth transition between each reference 360 images.

The present invention relates to a method and a system for synthesizing a novel view image on the basis of multiple 360 images for 6-degrees of freedom (DoF) virtual reality, wherein multiple 360 images are used to construct a large-scale 6-DoF virtual environment and synthesize a scene at a new viewpoint. The method comprises the steps of: performing a 3D reconfiguration procedure on 360 images to reconstruct 3D geometric information and reconfigure a virtual data map integrating the multiple 360 images into one image; using a reference image closest to a viewpoint extracted from the virtual data map to apply a projection 0026# vertex warping view synthesis algorithm so as to create view im

We propose the system that provides an immersive experience by automatically extending the video content of the TV to the wall. Though it is possible to manually create the appropriate content that works on the existing TV screen, the cost is too expensive to create. The proposed deep neural network uses the center of the video as input and the outside area as output. The trained network automatically generates the extrapolated video according to the input video and a projector projects the resulting content on the living room wall around the TV thereby improving the immersive feeling. The proposed system is expected to pave a new road to the home appliance industry by transforming the living room into the new immersive experience platform.