• ETRI Journal
• /
• v.24 no.1
• /
• pp.1-11
• /
• 2002

A video summary abstracts the gist from an entire video and also enables efficient access to the desired content. In this paper, we propose a novel method for summarizing news video based on multimodal analysis of the content. The proposed method exploits the closed caption data to locate semantically meaningful highlights in a news video and speech signals in an audio stream to align the closed caption data with the video in a time-line. Then, the detected highlights are described using MPEG-7 Summarization Description Scheme, which allows efficient browsing of the content through such functionalities as multi-level abstracts and navigation guidance. Multimodal search and retrieval are also within the proposed framework. By indexing synchronized closed caption data, the video clips are searchable by inputting a text query. Intensive experiments with prototypical systems are presented to demonstrate the validity and reliability of the proposed method in real applications.

• 한국HCI학회:학술대회논문집
• /
• 2006.02a
• /
• pp.579-586
• /
• 2006

모바일 환경에서 휴대폰을 사용하다 보면 무의식적으로 전화를 받지 못하는(Missing call) 상황이 빈번하게 일어난다. 휴대폰에서는 기본적으로 시각 청각 촉각의 다중양식 피드백(Multimodal feedback)을 제공하고 있음에도 불구하고, 이렇게 Missing call 이 발생하는 현상에는 여러 가지 다양한 원인이 존재할 것이다. 본 연구에서는 이러한 원인을 찾기 위해 모바일 환경 내 휴대폰 사용자 행동연구를 실시하여 일반적인 휴대패턴을 분석하고, Missing call과 관련하여 주로 설정하는 수신모드와 휴대패턴의 상호영향을 연구하고자 하였다. 본 연구결과, 모바일 환경에서 휴대폰 수신 탐지능력에는 인지심리학적(감각과 주의관련), 환경적, 행동학적 요인이 영향을 미칠 수 있는 것으로 나타났다. 또한 모바일 환경에서 주로 사용하는 수신모드인 진동모드 설정시, 휴대폰 사용자가 속한 환경에 다른 요인들이 복합적으로 존재할 경우 휴대폰 수신에 대한 탐지만족도가 감소함을 확인할 수 있었다.

• Earthquakes and Structures
• /
• v.12 no.3
• /
• pp.271-284
• /
• 2017

This paper presents a multimodal adaptive nonlinear static method of analysis that, differently from the nonlinear static methods suggested in seismic codes, does not require the definition of the equivalent Single-Degree-Of-Freedom (SDOF) system to evaluate the seismic response of structures. First, the proposed method is formulated for the assessment of r.c. plane frames and then it is extended to 3D framed structures. Furthermore, the proposed nonlinear static approach is re-elaborated as a displacement-based design method that does not require the use of the behaviour factor and takes into account explicitly the plastic deformation capacity of the structure. Numerical applications to r.c. plane frames and to a 3D framed structure with inplan irregularity are carried out to illustrate the attractive features as well as the limitations of the proposed method. Furthermore, the numerical applications evidence the uncertainty about the suitability of the displacement demand prediction obtained by the nonlinear static methods commonly adopted.

• Journal of Gastric Cancer
• /
• v.15 no.3
• /
• pp.218-221
• /
• 2015

Gastric metastasis from ovarian carcinoma is extremely rare and the prognosis for patients is poor. We report a case of multimodal treatment improving the survival time of a patient with gastric metastasis from ovarian cancer. A 73-year-old woman with known serous ovarian cancer was admitted to the hospital due to epigastric pain and dyspepsia. On esophagogastroduodenoscopy, a protruding mass was noted at the gastric antrum. She underwent distal gastrectomy with Billroth I anastomosis and lymph node dissection, including the para-aortic lymph nodes. The final pathology revealed gastric metastasis from ovarian serous adenocarcinoma. In this case, after cytoreductive surgery, chemotherapy was performed each time a recurrence was diagnosed, and remission was accomplished. She survived for 108 months after the first diagnosis of the metastatic tumor in the stomach. Multimodal treatment of metastatic lesions since the first diagnosis allowed the patient to survive longer than those in previous reports.

• The Journal of Information Technology
• /
• v.1 no.2
• /
• pp.15-24
• /
• 1998

C.I.F. and F.O.B. contracts are the chief terms used in international trade contracts. But, in recently, the multimodal transport which is based on the containerization and the improvement of air transport has been grown gradually, Regardless of theese change in international trade environment, most of the contract of sale is made by C.I.F. and F.O.B. contracts which are based on the traditional port to port transport. In other words, there are some limitation in terms of legal base in which traditional C.I.F. and F.O.B. contract is applied to the changed environment. Especially, problems arised in marine insurance which export by F.O.B. trade terms. Therefore, when the parties of the contracts of sale make an sale contracts by using the container ship and Multimodal Transport, they should use the F.C.A. and C.I.P. contracts Instead of F.O.B. and C.I.F. contracts for the transport of goods. And parties of the contracts of sale need to gain a better understanding of the characteristic of F.C.A. and C.I.P. terms and the problem of the F.C.A. and C.I.P. contracts used in the performance on international multimodal transport.

• Journal of KIISE:Software and Applications
• /
• v.30 no.7_8
• /
• pp.719-726
• /
• 2003

This paper proposes a multimodal registration method for segmentation of the Visible Human color images, in which color characteristics of bones are very similar to those of its surrounding fat areas. Bones are initially segmented in CT images, and then registered into color images to lineate their boundaries in the color images. For the segmentation of bones in CT images, a thresholding method is developed. The registration method registers boundaries of bodies in CT and color images using a cross-correlation approach, in which the boundaries of bodies are extracted by thresholding segmentation methods. The proposed method has been applied to segmentation of bones in a head and legs whose boundary is ambiguous due to surrounding fat areas with similar color characteristics, and produced promising results.

• ETRI Journal
• /
• v.39 no.2
• /
• pp.173-180
• /
• 2017

Multimodal medical image fusion is the process of retrieving valuable information from medical images. The primary goal of medical image fusion is to combine several images obtained from various sources into a distinct image suitable for improved diagnosis. Complexity in medical images is higher, and many soft computing methods are applied by researchers to process them. Intuitionistic fuzzy sets are more appropriate for medical images because the images have many uncertainties. In this paper, a new method, based on Sugeno's intuitionistic fuzzy set (SIFS), is proposed. First, medical images are converted into Sugeno's intuitionistic fuzzy image (SIFI). An exponential intuitionistic fuzzy entropy calculates the optimum values of membership, non-membership, and hesitation degree functions. Then, the two SIFIs are disintegrated into image blocks for calculating the count of blackness and whiteness of the blocks. Finally, the fused image is rebuilt from the recombination of SIFI image blocks. The efficiency of the use of SIFS in multimodal medical image fusion is demonstrated on several pairs of images and the results are compared with existing studies in recent literature.

• Proceedings of the KSR Conference
• /
• 2010.06a
• /
• pp.1615-1622
• /
• 2010

Recently, there has been an increase in interest from the aspects of transshipment and connection between the means of transportation. Not only for passengers but also for freight transportation as the need for transportation efficiency is growing while the importance of logistic railway transportation is emerging. The domestic freight transportation is carried out by roads, railroads, ships, and port. However, as other means of transportation, except road, is impossible for Door to Door Service, multimodal transportation accompanied by road transportation is carried out. Here, even though 'transshipment' occurs, because of the lack of basic data regarding this, it is difficult to reflect it in the demand forecasting. With respect to the Korean freight O-D, it was very difficult to have equivalent comparison on the competitiveness and availability of transportation services between the point of departure and the final destination. Taking into account the study of implementation of logit model considering the time and cost of transshipment of multimodal transportation and the transshipment resistance value upon selecting means of freight transportation on multimodal transportation was comparatively insufficient. This study consisted of questionnaire targeting shippers, and based on this, transshipment resistance value was calculated by deriving utility function. By doing so, I intend to examine the effect 'transshipment' has on selecting the means of transportation occurring from freight transportation.

• Journal of Chest Surgery
• /
• v.23 no.4
• /
• pp.707-714
• /
• 1990

Despite of mortality and morbidity rates that are higher than other forms of therapy, surgical resection has been mainstay for the treatment of esophageal cancer because of a prompt completeness as well as a high possibility of cure. But a substantial numbers of patients are unsuitable for surgical treatment and those undergoing resection have still poor long term survival rate. With hopes of improving long term survival, we have attempted multimodal approach, composed of preoperative induction chemotherapy utilizing Cisplatin and 5 \ulcornerFU, surgery and postoperative loco-regional radiotherapy for the treatment of esophageal cancer since 1985. During the period of 1967 \ulcorner1985, 27 patients[group A] were treated by surgery only and during recent 5 years 28 patients[group B] by multimodal treatment, Clinical review and comparison between the two groups were as follows: l. Applied surgical procedures were hand-sewn esophagogastrostomy, esophagocologastrostomy and esophagojejunostomy in group A. In group B, only esophagogastrostomy was underwent using stapler mainly. 2. Incidence of peri and postoperative complication showed no remarkable differences between the two groups, but the occurrences of leakage from the anastomotic site were 5[19% ] out of group A and 1[4%] out of group B. 3. The response rate to induction chemotherapy was 36% in group B, 4. The number of local cancer recurrence at the site of anastomosis was 6[22%] out of group A, whereas 2[7%] out of group B. 5. Postoperative I year and 2 year survival were 61%, 15% in group A and 75%, 42% in group B.

• Journal of Institute of Control, Robotics and Systems
• /
• v.13 no.8
• /
• pp.743-748
• /
• 2007

Recently, various types of camera mouse are developed using the image processing. The camera mouse showed limited performance compared to the traditional optical mouse in terms of the response time and the usability. These problems are caused by the mismatch between the size of the monitor and that of the active pixel area of the CMOS Image Sensor. To overcome these limitations, we designed a new input device that uses the face recognition as well as the speech recognition simultaneously. In the proposed system, the area of the monitor is partitioned into 'n' zones. The face recognition is performed using the web-camera, so that the mouse pointer follows the movement of the face of the user in a particular zone. The user can switch the zone by speaking the name of the zone. The multimodal mouse is analyzed using the Keystroke Level Model and the initial experiments was performed to evaluate the feasibility and the performance of the proposed system.