• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.21 no.3
• /
• pp.59-66
• /
• 2021

Humans mainly recognize surrounding objects using visual and auditory information among the five senses (sight, hearing, smell, touch, taste). Major research related to the latest object recognition mainly focuses on analysis using image sensor information. In this paper, after emitting various chirp audio signals into the observation space, collecting echoes through a 2-channel receiving sensor, converting them into spectral images, an object recognition experiment in 3D space was conducted using an image learning algorithm based on deep learning. Through this experiment, the experiment was conducted in a situation where there is noise and echo generated in a general indoor environment, not in the ideal condition of an anechoic room, and the object recognition through echo was able to estimate the position of the object with 83% accuracy. In addition, it was possible to obtain visual information through sound through learning of 3D sound by mapping the inference result to the observation space and the 3D sound spatial signal and outputting it as sound. This means that the use of various echo information along with image information is required for object recognition research, and it is thought that this technology can be used for augmented reality through 3D sound.

• KSCE Journal of Civil and Environmental Engineering Research
• /
• v.42 no.3
• /
• pp.427-438
• /
• 2022

With the recent growing importance over safety management the need for advanced and technical approaches for on-site safety inspection methods has increased. Railway construction is subject to its own particular set of temporal and spatial challenges due to its unique facilities and equipment. This study aimed to investigate the field characteristics of railway infrastructure and improve the conventional field safety management methods by identifying the most appropriate features of AR technology. Group interviews and surveys were conducted with field safety experts to derive the major problems and inspection needs. Subsequently, various features of AR, such as BIM model projection, and remote conferencing, were investigated to determine their applicability to address safety issues. As a result, four problems in the current safety management process, such as 'lack of time due to the conventional inspection method and inspection of areas that are difficult to access', and three major inspection types, such as 'observance of work procedures, status of installation, adequate dimensional spacing', were identified to be improved when adopting AR based techniques. Furthermore, AR technology utilizing plans to solve safety inspection problems and effectively manage major inspection types were proposed, and a follow up survey was conducted with the same field safety experts to derive the priority of technology development.

• Science of Emotion and Sensibility
• /
• v.15 no.4
• /
• pp.553-564
• /
• 2012

Tangible user interfaces have been developed in the area of Human-Computer Interaction for the last decades, however, the applied domains recently have been extended into the product design and interactive art. Tangible User Interfaces are the combination of digital information and physical objects or environments, thus they provide tangible and intuitive interaction as input and output devices, often combined with Augmented Reality. The research developed a design guideline for tangible user interfaces based on key properties of tangible user interfaces defined previously in five representative research: Tangible Interaction, Intuitiveness and Convenience, Expressive Representation, Context-aware and Spatial Interaction, and Social Interaction. Using the guideline emphasizing user interaction, this research evaluated installation in a science museum in terms of the applied characteristics of tangible user interfaces. The selected 15 installations which were evaluated are to educate visitors for science by emphasizing manipulation and experience of interfaces in those installations. According to the input devices, they are categorized into four Types. TUI properties in Type 3 installation, which uses body motions for interaction, shows the highest score, where items for context-aware and spatial interaction were highly rated. The context-aware and spatial interaction have been recently emphasized as extended properties of tangible user interfaces. The major type of installation in the science museum is equipped with buttons and joysticks for physical manipulation, thus multimodal interfaces utilizing visual, aural, tactile senses etc need to be developed to provide more innovative interaction. Further, more installation need to be reconfigurable for embodied interaction between users and the interactive space. The proposed design guideline can specify the characteristics of tangible user interfaces, thus this research can be a basis for the development and application of installation involving more TUI properties in future.