• 대한음성학회지:말소리
• /
• 제60호
• /
• pp.125-144
• /
• 2006

W3C announced a standard software architecture for multimodal context-aware middleware that emphasizes modularity and separates structure, contents, and presentation. We implemented a distributed multimodal interface system followed the W3C architecture, based on SCXML. SCXML uses parallel states to invoke both XHTML and VoiceXML contents as well as to gather composite or sequential multimodal inputs through man-machine interactions. We also hire Delivery Context Interface(DCI) module and an external service bundle enabling middleware to support context-awareness services for real world environments. The provision of personalized user interfaces for mobile devices is expected to be used for different devices with a wide variety of capabilities and interaction modalities. We demonstrated the implemented middleware could maintain multimodal scenarios in a clear, concise and consistent manner by some experiments.

• Earthquakes and Structures
• /
• 제12권3호
• /
• pp.271-284
• /
• 2017

This paper presents a multimodal adaptive nonlinear static method of analysis that, differently from the nonlinear static methods suggested in seismic codes, does not require the definition of the equivalent Single-Degree-Of-Freedom (SDOF) system to evaluate the seismic response of structures. First, the proposed method is formulated for the assessment of r.c. plane frames and then it is extended to 3D framed structures. Furthermore, the proposed nonlinear static approach is re-elaborated as a displacement-based design method that does not require the use of the behaviour factor and takes into account explicitly the plastic deformation capacity of the structure. Numerical applications to r.c. plane frames and to a 3D framed structure with inplan irregularity are carried out to illustrate the attractive features as well as the limitations of the proposed method. Furthermore, the numerical applications evidence the uncertainty about the suitability of the displacement demand prediction obtained by the nonlinear static methods commonly adopted.

• Journal of Multimedia Information System
• /
• 제4권3호
• /
• pp.123-144
• /
• 2017

Personalized media includes user-targeted and user-generated content (UGC) exchanged through social media and interactive applications. The increased consumption of UGC presents challenges and opportunities to multimedia information systems. We work towards modeling a deep structure for content networks. To gain insights, a hybrid practice with Media Framework (MF) is presented for network creation of personalized media, which leverages the authoring methodology with user-generated semantics. The system's vertical integration allows users to audition their personalized media networks in the context of a global system network. A navigation scheme with dynamic GUI shifts the interaction paradigm for content query and sharing. MF adopts a multimodal architecture anticipating emerging use cases and genres. To model diversification of platforms, information processing is robust across multiple technology configurations. Physical and virtual networks are integrated with distributed services and transactions, IoT, and semantic networks representing media content. MF applies spatiotemporal and semantic signal processing to differentiate action responsiveness and information responsiveness. The extension of multimedia information processing into authoring enables generating interactive and impermanent media on computationally enabled devices. The outcome of this integrated approach with presented methodologies demonstrates a paradigmatic shift of the concept of UGC as personalized media network, which is dynamical and evolvable.

• ETRI Journal
• /
• 제46권1호
• /
• pp.22-34
• /
• 2024

Exposure to varied noisy environments impairs the recognition performance of artificial intelligence-based speech recognition technologies. Degraded-performance services can be utilized as limited systems that assure good performance in certain environments, but impair the general quality of speech recognition services. This study introduces an audiovisual speech recognition (AVSR) model robust to various noise settings, mimicking human dialogue recognition elements. The model converts word embeddings and log-Mel spectrograms into feature vectors for audio recognition. A dense spatial-temporal convolutional neural network model extracts features from log-Mel spectrograms, transformed for visual-based recognition. This approach exhibits improved aural and visual recognition capabilities. We assess the signal-to-noise ratio in nine synthesized noise environments, with the proposed model exhibiting lower average error rates. The error rate for the AVSR model using a three-feature multi-fusion method is 1.711%, compared to the general 3.939% rate. This model is applicable in noise-affected environments owing to its enhanced stability and recognition rate.

• 대한전자공학회논문지TC
• /
• 제46권1호
• /
• pp.10-23
• /
• 2009

본 논문에서 에너지 효율적 이종망간 핸드오버를 지원하는 새로운 모바일 단말 소프트웨어 아키텍쳐를 제안한다. 기존 방식은 L3 핸드오버를 IETF Mobile IP에 의존하고 있어 Mobile IP가 가지는 이동성 검출 방식의 문제점을 그대로 가지며 동시에 이종의 네트워크 환경에 대한 어떠한 지원도 없으므로 중첩된 다중망 상황에서 불필요한 핸드오버를 자주 수행하게 되어 네트워크와 단말에 심각한 오버로드를 유발시킨다. 이에 반해 제안하는 방식은 단말기반의 망선택 및 전환을 수행하는 구조로서 단말에서 망상태를 주기적으로 모니터링하고 최적의 망을 선택하여 결정된 망으로의 L3 핸드오버 명령을 Mobile IP에 지시하는 형태로 불필요한 에너지 소모를 최소화한다. 망선택 방식은 단말의 속도 기반 망선택 및 전력소모 예측 등을 통해 핸드오버 대상이 될 망들을 선별한 후 단말이 요구하는 QoS, 네트워크 상태, 사용자의 선호도 및 단말의 배터리 상태 등을 종합적으로 고려하여 최종적으로 최적의 네트워크를 선택하는 방식을 취한다. 마지막으로 본 논문에서 제시하는 에너지 효율적 이종망간 핸드오버 아키텍쳐를 실제 단말에 적용하여 그 기능 및 성능을 검증한다.

• Journal of Ship and Ocean Technology
• /
• 제10권3호
• /
• pp.36-48
• /
• 2006

The train ferry, accommodating trains roll on and off, is often called as 'Railway on the Sea' or 'Blue High-way' since she can connect the railways or roads segregated by the sea and improve the accessibility and continuity of land transport systems. The ferry is especially appropriate to the intermodal transport routes mostly passing through the land but have relatively short sea segment. As the train ferry can considerably reduce the cost and time for cargo handling and modal shift and unnecessitates excessive initial investment on infrastructures such as large harbor cranes or vast container yards, introduction of train Ro-Ro ferries lessen the total transport cost for door-to-door transportation with full exploitation of the existing railway system. All the ports placed in Shandong, Liaoning and Jiangsu provinces of China are connected to the hinterlands via well developed railway and road systems. Therefore, realization of the Incheon-Yantai train ferry system will link Korea railways to TCR and the 4,131-kilometer-long Longhai-Lanxin Railway, along the famous Eurasian Continental Bridge. In the present paper, the Incheon-Yantai train ferry will be introduced as a good example of an efficient multimodal short sea shipping system for Northeast Asia.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제14권3호
• /
• pp.962-975
• /
• 2020

The accurate segmentation of infant brain MR image into white matter (WM), gray matter (GM), and cerebrospinal fluid (CSF) is very important for early studying of brain growing patterns and morphological changes in neurodevelopmental disorders. Because of inherent myelination and maturation process, the WM and GM of babies (between 6 and 9 months of age) exhibit similar intensity levels in both T1-weighted (T1w) and T2-weighted (T2w) MR images in the isointense phase, which makes brain tissue segmentation very difficult. We propose a deep network architecture based on U-Net, called Triple Residual Multiscale Fully Convolutional Network (TRMFCN), whose structure exists three gates of input and inserts two blocks: residual multiscale block and concatenate block. We solved some difficulties and completed the segmentation task with the model. Our model outperforms the U-Net and some cutting-edge deep networks based on U-Net in evaluation of WM, GM and CSF. The data set we used for training and testing comes from iSeg-2017 challenge (http://iseg2017.web.unc.edu).

• BMB Reports
• /
• 제55권3호
• /
• pp.113-124
• /
• 2022

Single-cell RNA sequencing (scRNA-seq) has greatly advanced our understanding of cellular heterogeneity by profiling individual cell transcriptomes. However, cell dissociation from the tissue structure causes a loss of spatial information, which hinders the identification of intercellular communication networks and global transcriptional patterns present in the tissue architecture. To overcome this limitation, novel transcriptomic platforms that preserve spatial information have been actively developed. Significant achievements in imaging technologies have enabled in situ targeted transcriptomic profiling in single cells at single-molecule resolution. In addition, technologies based on mRNA capture followed by sequencing have made possible profiling of the genome-wide transcriptome at the 55-100 ㎛ resolution. Unfortunately, neither imaging-based technology nor capture-based method elucidates a complete picture of the spatial transcriptome in a tissue. Therefore, addressing specific biological questions requires balancing experimental throughput and spatial resolution, mandating the efforts to develop computational algorithms that are pivotal to circumvent technology-specific limitations. In this review, we focus on the current state-of-the-art spatially resolved transcriptomic technologies, describe their applications in a variety of biological domains, and explore recent discoveries demonstrating their enormous potential in biomedical research. We further highlight novel integrative computational methodologies with other data modalities that provide a framework to derive biological insight into heterogeneous and complex tissue organization.

• 한국항해항만학회지
• /
• 제36권10호
• /
• pp.883-888
• /
• 2012

최근 아시아의 물류산업은 중국경제의 급부상과 함께 빠른 속도로 성장하고 있으며, 전 세계적으로 물동량이 계속적으로 증가하고 있는 상황에서 물류비용 절감을 위하여 다양한 연구가 활발히 수행중이다. 근해운송시스템은 연안해운을 중심으로 두 가지 이상의 수송연계 수단을 효율적으로 이용하여, 국제간 고부가 가치 물류 시스템을 창출하는 시스템으로써 유럽에서 상당한 성과를 올리고 있다. 따라서 우리나라에 알맞은 근해운송시스템을 도입하기 위해서는 효율적인 선박, 항만, 컨테이너 하역 및 운송 장비, 터미널 운영 및 관리시스템 기술, 화물정보 추적 및 통신 분야의 요소 기술 개발이 요구된다. 본 논문에서는 현 단계의 요소기술 현황을 살펴보고, 앞으로 나아가야 할 공학적 기술에 대한 시사점을 제시하고자 한다.

• 한국콘텐츠학회논문지
• /
• 제21권7호
• /
• pp.248-258
• /
• 2021

지하공동구의 도시 생명선 기능유지를 위해서는 24시간 모니터링을 수행해야 하며 부족한 인력을 대체하기 위한 기술개발이 필요하다. 일반적인 관리방법으로는 지하 공간 특성을 반영하기 어려워 본 연구에서는 지하공동구를 대상으로 공간정보 기반의 디지털 트윈 시스템 요구사항을 도출하였다. 물리적 공간과 가상공간으로 구분하였으며, 물리적 공간은 멀티모달 영상센서 체계 구축의 기반이 되는 센서의 종류와 배치도를, 가상공간은 지하공동구에 대한 시스템 아키텍처를 구성하였다. 그리고 업무에 따른 시스템 기능을 제시하였다. 지하공동구 디지털 트윈을 통해 재난을 예방하고, 조기에 대응하여 도시 생명선의 기능유지에 효과적일 것으로 예상한다.