• MALSORI
• /
• no.60
• /
• pp.125-144
• /
• 2006

W3C announced a standard software architecture for multimodal context-aware middleware that emphasizes modularity and separates structure, contents, and presentation. We implemented a distributed multimodal interface system followed the W3C architecture, based on SCXML. SCXML uses parallel states to invoke both XHTML and VoiceXML contents as well as to gather composite or sequential multimodal inputs through man-machine interactions. We also hire Delivery Context Interface(DCI) module and an external service bundle enabling middleware to support context-awareness services for real world environments. The provision of personalized user interfaces for mobile devices is expected to be used for different devices with a wide variety of capabilities and interaction modalities. We demonstrated the implemented middleware could maintain multimodal scenarios in a clear, concise and consistent manner by some experiments.

• Earthquakes and Structures
• /
• v.12 no.3
• /
• pp.271-284
• /
• 2017

This paper presents a multimodal adaptive nonlinear static method of analysis that, differently from the nonlinear static methods suggested in seismic codes, does not require the definition of the equivalent Single-Degree-Of-Freedom (SDOF) system to evaluate the seismic response of structures. First, the proposed method is formulated for the assessment of r.c. plane frames and then it is extended to 3D framed structures. Furthermore, the proposed nonlinear static approach is re-elaborated as a displacement-based design method that does not require the use of the behaviour factor and takes into account explicitly the plastic deformation capacity of the structure. Numerical applications to r.c. plane frames and to a 3D framed structure with inplan irregularity are carried out to illustrate the attractive features as well as the limitations of the proposed method. Furthermore, the numerical applications evidence the uncertainty about the suitability of the displacement demand prediction obtained by the nonlinear static methods commonly adopted.

• Journal of Multimedia Information System
• /
• v.4 no.3
• /
• pp.123-144
• /
• 2017

Personalized media includes user-targeted and user-generated content (UGC) exchanged through social media and interactive applications. The increased consumption of UGC presents challenges and opportunities to multimedia information systems. We work towards modeling a deep structure for content networks. To gain insights, a hybrid practice with Media Framework (MF) is presented for network creation of personalized media, which leverages the authoring methodology with user-generated semantics. The system's vertical integration allows users to audition their personalized media networks in the context of a global system network. A navigation scheme with dynamic GUI shifts the interaction paradigm for content query and sharing. MF adopts a multimodal architecture anticipating emerging use cases and genres. To model diversification of platforms, information processing is robust across multiple technology configurations. Physical and virtual networks are integrated with distributed services and transactions, IoT, and semantic networks representing media content. MF applies spatiotemporal and semantic signal processing to differentiate action responsiveness and information responsiveness. The extension of multimedia information processing into authoring enables generating interactive and impermanent media on computationally enabled devices. The outcome of this integrated approach with presented methodologies demonstrates a paradigmatic shift of the concept of UGC as personalized media network, which is dynamical and evolvable.

• ETRI Journal
• /
• v.46 no.1
• /
• pp.22-34
• /
• 2024

Exposure to varied noisy environments impairs the recognition performance of artificial intelligence-based speech recognition technologies. Degraded-performance services can be utilized as limited systems that assure good performance in certain environments, but impair the general quality of speech recognition services. This study introduces an audiovisual speech recognition (AVSR) model robust to various noise settings, mimicking human dialogue recognition elements. The model converts word embeddings and log-Mel spectrograms into feature vectors for audio recognition. A dense spatial-temporal convolutional neural network model extracts features from log-Mel spectrograms, transformed for visual-based recognition. This approach exhibits improved aural and visual recognition capabilities. We assess the signal-to-noise ratio in nine synthesized noise environments, with the proposed model exhibiting lower average error rates. The error rate for the AVSR model using a three-feature multi-fusion method is 1.711%, compared to the general 3.939% rate. This model is applicable in noise-affected environments owing to its enhanced stability and recognition rate.

• Journal of the Institute of Electronics Engineers of Korea TC
• /
• v.46 no.1
• /
• pp.10-23
• /
• 2009

In this paper we propose a novel mobile terminal software architecture supporting energy efficient handover operation in heterogeneous networks. Since the legacy proposals for L3 handover are mostly dependent on IETF Mobile IP which has some problems in movement detection mechanism and no considerations on nested heterogeneous network environment as a result they make serious overload on networks and terminals by performing unnecessary handover in such network environments. The proposed architecture has terminal-oriented network selection and switching architecture where a mobile terminal periodically monitors network status and selects the optimum network, and reduces energy consumption by making L3 handover of Mobile IP to the finally selected network. The network selection method first picks up some candidate networks by considering a terminal speed and power consumption estimation, and determines the final target handover network among the candidates after evaluating multiple factors including QoS required by a terminal, network status, user preference and terminal battery status. Finally we verify the functionality and performance of the energy efficient vertical handover architecture by means of adopting it into a real mobile terminal.

• Journal of Ship and Ocean Technology
• /
• v.10 no.3
• /
• pp.36-48
• /
• 2006

The train ferry, accommodating trains roll on and off, is often called as 'Railway on the Sea' or 'Blue High-way' since she can connect the railways or roads segregated by the sea and improve the accessibility and continuity of land transport systems. The ferry is especially appropriate to the intermodal transport routes mostly passing through the land but have relatively short sea segment. As the train ferry can considerably reduce the cost and time for cargo handling and modal shift and unnecessitates excessive initial investment on infrastructures such as large harbor cranes or vast container yards, introduction of train Ro-Ro ferries lessen the total transport cost for door-to-door transportation with full exploitation of the existing railway system. All the ports placed in Shandong, Liaoning and Jiangsu provinces of China are connected to the hinterlands via well developed railway and road systems. Therefore, realization of the Incheon-Yantai train ferry system will link Korea railways to TCR and the 4,131-kilometer-long Longhai-Lanxin Railway, along the famous Eurasian Continental Bridge. In the present paper, the Incheon-Yantai train ferry will be introduced as a good example of an efficient multimodal short sea shipping system for Northeast Asia.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.14 no.3
• /
• pp.962-975
• /
• 2020

The accurate segmentation of infant brain MR image into white matter (WM), gray matter (GM), and cerebrospinal fluid (CSF) is very important for early studying of brain growing patterns and morphological changes in neurodevelopmental disorders. Because of inherent myelination and maturation process, the WM and GM of babies (between 6 and 9 months of age) exhibit similar intensity levels in both T1-weighted (T1w) and T2-weighted (T2w) MR images in the isointense phase, which makes brain tissue segmentation very difficult. We propose a deep network architecture based on U-Net, called Triple Residual Multiscale Fully Convolutional Network (TRMFCN), whose structure exists three gates of input and inserts two blocks: residual multiscale block and concatenate block. We solved some difficulties and completed the segmentation task with the model. Our model outperforms the U-Net and some cutting-edge deep networks based on U-Net in evaluation of WM, GM and CSF. The data set we used for training and testing comes from iSeg-2017 challenge (http://iseg2017.web.unc.edu).

• BMB Reports
• /
• v.55 no.3
• /
• pp.113-124
• /
• 2022

Single-cell RNA sequencing (scRNA-seq) has greatly advanced our understanding of cellular heterogeneity by profiling individual cell transcriptomes. However, cell dissociation from the tissue structure causes a loss of spatial information, which hinders the identification of intercellular communication networks and global transcriptional patterns present in the tissue architecture. To overcome this limitation, novel transcriptomic platforms that preserve spatial information have been actively developed. Significant achievements in imaging technologies have enabled in situ targeted transcriptomic profiling in single cells at single-molecule resolution. In addition, technologies based on mRNA capture followed by sequencing have made possible profiling of the genome-wide transcriptome at the 55-100 ㎛ resolution. Unfortunately, neither imaging-based technology nor capture-based method elucidates a complete picture of the spatial transcriptome in a tissue. Therefore, addressing specific biological questions requires balancing experimental throughput and spatial resolution, mandating the efforts to develop computational algorithms that are pivotal to circumvent technology-specific limitations. In this review, we focus on the current state-of-the-art spatially resolved transcriptomic technologies, describe their applications in a variety of biological domains, and explore recent discoveries demonstrating their enormous potential in biomedical research. We further highlight novel integrative computational methodologies with other data modalities that provide a framework to derive biological insight into heterogeneous and complex tissue organization.

• Journal of Navigation and Port Research
• /
• v.36 no.10
• /
• pp.883-888
• /
• 2012

Recently, the logistics industry in Asia is growing rapidly mostly with Chinese economic development. A variety of studies have been carried out to reduce the logistic cost under the situation that the global freight traffic continues to increasing. The Short Sea Shipping(SSS) system, a multi modal transport system centered around coastal shipping to realize high value-added logistics, achieved considerable success in EU. To implement the SSS system in Korea, it is necessary to develop the various essential technologies related to development of efficient ships and port facilities, including equipment for loading and unloading containers, operating and managing systems for freight terminals and technologies for tracking and securing containers. The present paper focuses on the survey of the current essential technologies available for implementation of the SSS system and suggests the direction of future development in the technologies.

• The Journal of the Korea Contents Association
• /
• v.21 no.7
• /
• pp.248-258
• /
• 2021

24-hour monitoring is required to maintain the city's lifeline function in the underground facility for public utilities. And it is necessary to develop technology to exchange the shortage of human resources. It is difficult to reflect the specificity of underground space management in general management methods. This study proposes underground facility for public utilities digital twin system requirements. The concept of space is divided into physical space and virtual space, and the physical space constitutes the type and layout of the sensor that is the basis for the construction of the multimodal image sensor system, and the virtual space constitutes the system architecture. It also suggested system functions according to the task. It will be effective in preventing disasters and maintaining the lifeline function of the city through the digital twins.