• Journal of Korea Multimedia Society
• /
• v.21 no.12
• /
• pp.1459-1466
• /
• 2018

Robots which detect human and recognize action are important factors for human interaction, and many researches have been conducted. Recently, deep learning technology has developed and learning based robot's technology is a major research area. These studies require a database to learn and evaluate for intelligent human perception. In this paper, we propose a multi-modal sensor-based image database condition considering the security task by analyzing the image database to detect the person in the outdoor environment and to recognize the behavior during the running of the robot.

• Structural Engineering and Mechanics
• /
• v.43 no.5
• /
• pp.691-709
• /
• 2012

This paper provides a variety of viewpoints to illustrate the mechanism of the deck-stay interaction with the appropriate initial shapes of cable-stayed bridges. Based on the smooth and convergent bridge shapes obtained by the initial shape analysis, the one-element cable system (OECS) and multi-element cable system (MECS) models of the Kao Ping Hsi Bridge in Taiwan are developed to verify the applicability of the analytical model and numerical formulation from the field observations in the authors' previous work. For this purpose, the modal analysis of the two finite element models are conducted to calculate the natural frequency and normalized mode shape of the individual modes of the bridge. The modal coupling assessment is also performed to obtain the generalized mass ratios among the structural components for each mode of the bridge. The findings indicate that the coupled modes are attributed to the frequency loci veering and mode localization when the "pure" deck-tower frequency and the "pure" stay cable frequency approach one another, implying that the mode shapes of such coupled modes are simply different from those of the deck-tower system or stay cables alone. The distribution of the generalized mass ratios between the deck-tower system and stay cables are useful indices for quantitatively assessing the degree of coupling for each mode. These results are demonstrated to fully understand the mechanism of the deck-stay interaction with the appropriate initial shapes of cable-stayed bridges.

• Nuclear Engineering and Technology
• /
• v.22 no.4
• /
• pp.371-379
• /
• 1990

The Xenon spatial oscillation may give rise to operational difficulties in a nuclear power plant. In this study, in order to investigate the Xenon instability for a PWR, the frequency-domain technique is adopted by using Generalized Nyquist Criterion, which is more general and suitable for the multi-input/multi-output system. Also linearized modal fluxes are obtained by a modal expansion. This model has been implemented to test the axial Xenon stability of YGN-1 unit against the changes in plant operating parameters ; power level, control rod position, and core average burnup. The results show that the increase of power level and the deeper insertion of control rod have the destabilizing effect, and that the burnup progress makes the core less stable. Also the results show that the overestimation due to modal interaction was found not to be significant.

• Journal of Multimedia Information System
• /
• v.7 no.2
• /
• pp.107-114
• /
• 2020

This paper proposes a wearable audio book application using two wearable devices, a smartwatch and a hearables. We review requirements of what could be a killer wearable application and design our application based on these elicited requirements. To distinguish our application, we present 7 scenarios and introduce several wearable interaction modalities. To show feasibility of our approach, we design and implement our proof-of-concept prototype on Android emulator as well as on a commercial smartwatch. We thoroughly address how different interaction modalities are designed and implemented in the Android platform. Lastly, we show latency of the multi-modal and alternative interaction modalities that can be gracefully handled in wearable audio application use cases.

• Advances in nano research
• /
• v.6 no.2
• /
• pp.163-182
• /
• 2018

Based on the Reissner mixed variational theorem (RMVT), the authors present a nonlocal Timoshenko beam theory (TBT) for the nonlinear free vibration analysis of multi-walled carbon nanotubes (MWCNT) embedded in an elastic medium. In this formulation, four different edge conditions of the embedded MWCNT are considered, two different models with regard to the van der Waals interaction between each pair of walls constituting the MWCNT are considered, and the interaction between the MWCNT and its surrounding medium is simulated using the Pasternak-type foundation. The motion equations of an individual wall and the associated boundary conditions are derived using Hamilton's principle, in which the von $K{\acute{a}}rm{\acute{a}}n$ geometrical nonlinearity is considered. Eringen's nonlocal elasticity theory is used to account for the effects of the small length scale. Variations of the lowest frequency parameters with the maximum modal deflection of the embedded MWCNT are obtained using the differential quadrature method in conjunction with a direct iterative approach.

• Journal of KIISE:Computing Practices and Letters
• /
• v.9 no.4
• /
• pp.420-430
• /
• 2003

This paper presents an immersive multimodal Gumdo simulation game that allows a user to experience the whole body interaction with an intelligent cyber fencer. The proposed system consists of three modules: (i) a nondistracting multimodal interface with 3D vision and speech (ii) an intelligent cyber fencer and (iii) an immersive feedback by a big screen and sound. First, the multimodal Interface with 3D vision and speech allows a user to move around and to shout without distracting the user. Second, an intelligent cyber fencer provides the user with intelligent interactions by perception and reaction modules that are created by the analysis of real Gumdo game. Finally, an immersive audio-visual feedback by a big screen and sound effects helps a user experience an immersive interaction. The proposed system thus provides the user with an immersive Gumdo experience with the whole body movement. The suggested system can be applied to various applications such as education, exercise, art performance, etc.

• Structural Engineering and Mechanics
• /
• v.43 no.1
• /
• pp.71-87
• /
• 2012

This paper extends a single equation, semi-analytical approach for three-span bridges to multi-span ones for the rapid and precise determination of natural frequencies and natural mode shapes of an orthotropic, multi-span plate. This method can be used to study the dynamic interaction between bridges and vehicles. It is based on the modal superposition method taking into account intermodal coupling to determine natural frequencies and mode shapes of a bridge deck. In this paper, a four- and a five-span orthotropic roadway bridge deck are compared in the first 10 modes with a finite element method analysis using ANSYS software. This simplified implementation matches numerical modeling within 2% in all cases. This paper verifies that applicability of a single formula approach as a simpler alternative to finite element modeling.

• Proceedings of the KSR Conference
• /
• 2010.06a
• /
• pp.1464-1469
• /
• 2010

In this paper, the dynamic stability evaluation of special bridge for high speed railway under ground excitation is performed. The mass, damping, stiffness matrices of bridge are derived from the modal frequencies and mode shape vectors which can be obtained by commercial program. And the high speed train is modeled as multi-single d.o.f models for the sake of vehicle-bridge interaction analysis. In the vehicle-bridge interaction analysis, the vertical directional interaction is only considered. As a numerical example, the 3 span Extradosed bridge which is expected to be installed in Ho-Nam high speed railroad is considered. The analysis results show that the example bridge satisfies the criteria of dynamic stability.

• Earthquakes and Structures
• /
• v.13 no.5
• /
• pp.497-507
• /
• 2017

Flooding induced scour has been long recognized as a major hazard to river-crossing bridges. Many studies in recent years have attempted to evaluate the effects of scour on the seismic performance of bridges, and probabilistic frameworks are usually adopted. However, direct and straightforward insight about how foundation scour affects bridges as a type of soil-foundation-structure system is usually understated. In this paper, we provide a comprehensive review of applied methods centering around seismic assessment of scoured bridges considering soil-foundation-structure interaction. When introducing these applied analysis and modeling methods, a simple bridge model is provided to demonstrate the use of these methods as a case study. Particularly, we propose the use of nonlinear modal pushover analysis as a rapid technique to model scoured bridge systems, and numerical validation and application of this procedure are given using the simple bridge model. All methods reviewed in this paper can serve as baseline components for performing probabilistic vulnerability or risk assessment for any river-crossing bridge system subject to flood-induced scour and earthquakes.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.17 no.10
• /
• pp.2768-2787
• /
• 2023

As an important research direction of the application of computer science in the medical field, the automatic generation technology of radiology report has attracted wide attention in the academic community. Because the proportion of normal regions in radiology images is much larger than that of abnormal regions, words describing diseases are often masked by other words, resulting in significant feature loss during the calculation process, which affects the quality of generated reports. In addition, the huge difference between visual features and semantic features causes traditional multi-modal fusion method to fail to generate long narrative structures consisting of multiple sentences, which are required for medical reports. To address these challenges, we propose a multi-feature optimization Transformer (MFOT) for generating radiology reports. In detail, a multi-dimensional mapping attention (MDMA) module is designed to encode the visual grid features from different dimensions to reduce the loss of primary features in the encoding process; a feature pre-fusion (FP) module is constructed to enhance the interaction ability between multi-modal features, so as to generate a reasonably structured radiology report; a detail enhanced attention (DEA) module is proposed to enhance the extraction and utilization of key features and reduce the loss of key features. In conclusion, we evaluate the performance of our proposed model against prevailing mainstream models by utilizing widely-recognized radiology report datasets, namely IU X-Ray and MIMIC-CXR. The experimental outcomes demonstrate that our model achieves SOTA performance on both datasets, compared with the base model, the average improvement of six key indicators is 19.9% and 18.0% respectively. These findings substantiate the efficacy of our model in the domain of automated radiology report generation.