• 대한음성학회지:말소리
• /
• 제58호
• /
• pp.101-117
• /
• 2006

The development of efficient multimodal interfaces and fusion algorithms requires knowledge of usage patterns that show how people use multiple modalities. We analyzed multimodal usage patterns for TV-guide application scenarios (or tasks). In order to collect usage patterns, we implemented a multimodal usage pattern collection system having two input modalities: speech and touch-gesture. Fifty-four subjects participated in our study. Analysis of the collected usage patterns shows a positive correlation between the task type and multimodal usage patterns. In addition, we analyzed the timing between speech-utterances and their corresponding touch-gestures that shows the touch-gesture occurring time interval relative to the duration of speech utterance. We believe that, for developing efficient multimodal fusion algorithms on an application, the multimodal usage pattern analysis for the given application, similar to our work for TV guide application, have to be done in advance.

• 대한화학회지
• /
• 제61권4호
• /
• pp.211-217
• /
• 2017

The purpose of this study was to examine UK students' use of multimodal representations in science. Students were asked to explain their understandings of the scientific concept and presentation of the multimodal representations in a science Assessing Pupils' Progress (APP) task. Participants of this study were fifty-four Year 7 students taught by the same teacher. Students from one class (27 students) were assigned to the experimental group, and then they received instruction encouraging the using of multimodal representations as evidences to support students' claims. One class (27 students) was assigned to the control group and they received instruction with traditional teaching methods. Both groups performed an APP task for assessment. The samples of APP assessments produced by students both from the experimental and control groups were analyzed using an analysis framework of multimodal representations, embeddedness in evidence and understanding of scientific concepts. Data analysis indicated that the students in the experimental group performed better than that of the control group on embeddedness of multimodal representations in the APP task. In addition, there was a significant difference between the two groups in the evaluation of understand of the scientific concepts.

• 한국산업융합학회 논문집
• /
• 제9권4호
• /
• pp.263-268
• /
• 2006

This paper presents a real-time verification system by extracting a features of multimodal biometrics using hybrid method, which is combined the moment balance and the independent component analysis(ICA). The moment balance is applied to reduce the computation loads by extracting the validity signal due to exclude the needless backgrounds of multimodal biometrics. ICA is also applied to increase the verification performance by removing the overlapping signals due to extract the statistically independent basis of signals. Multimodal biometrics are used both the faces and the fingerprints which are acquired by Web camera and acquisition device, respectively. The proposed system has been applied to the fusion problems of 48 faces and 48 fingerprints(24 persons * 2 scenes) of 320*240 pixels, respectively. The experimental results show that the proposed system has a superior verification performances(speed, rate).

• 아동학회지
• /
• 제34권4호
• /
• pp.163-177
• /
• 2013

Digital technology has advanced rapidly and it is anticipated that multimodal ways of meaning-making will become increasingly important. Consequently, teaching multimodal literacies is becoming a major issue in education. This study focuses on the use of picture diaries as a means of teaching multimodal literacies. Picture diaries are one of the basic and unique multimodal texts used in lower elementary level classes in Korea. A further advantage is that it is a promising text model which can be taught in unplugged ways. In order to explore the educational implications of using such picture diaries, this study sought to analyze the ways in which twenty four $1_{st}$ graders in an elementary school constructed meaning with written language and pictures in composing picture diaries. 251 picture diaries composed during several months of their $1_{st}$ grade period were analyzed based on the constant comparative method. The results indicated that the students utilized both written language and pictures in diverse and creative ways to provide their audience with more comprehensive meaning. These results indicate that teachers need to consider their students as active multimodal meaning-makers and provide their students with more opportunities to practice multimodal meaning-making and share their experiences.

• 한국항해학회지
• /
• 제19권4호
• /
• pp.41-61
• /
• 1995

The international trade is basically founded on the contract of international sale of goods and backed up by the contract of international carriage of goods and the contract of insurance in the goods carried. For the efficient development of international trade, it is essential to incorporate the above three fields closely together. Economic growth has developed international trade which has accelerated the development of international carriage of goods. As a result of rapid expansion of international carriage of goods, rationalization of transport was required, which has brought about the International Multimodal Transport System(herein after referred to as 'IMT') through containerization. International multimodal transport system has affected international trade a lot, especially the field of insurance a great deal. The aim of this paper is to analyze contents of Multimodal Transport Operator's(MTO's) liability system in the UN Convention on International Multimodal Transport of Goods, 1980 and FIATA Bill of Lading(FBL) as one of current Multimodal Transport Documents. The analysis of MTO's liability system will be a good introductory concept for the further study of insurance problems for the development of IMT.

• 한국정보시스템학회지:정보시스템연구
• /
• 제32권3호
• /
• pp.1-17
• /
• 2023

Purpose The proliferation of data on the internet has created a need for innovative methods to analyze user satisfaction data. Traditional survey methods are becoming inadequate in dealing with the increasing volume and diversity of data, and new methods using unstructured internet data are being explored. While numerous comment-based user satisfaction studies have been conducted, only a few have explored user satisfaction through video and audio data. Multimodal sentiment analysis, which integrates multiple modalities, has gained attention due to its high accuracy and broad applicability. Design/methodology/approach This study uses multimodal sentiment analysis to analyze user satisfaction of iPhone and Samsung products through online videos. The research reveals that the combination model integrating multiple data sources showed the most superior performance. Findings The findings also indicate that price is a crucial factor influencing user satisfaction, and users tend to exhibit more positive emotions when content with a product's price. The study highlights the importance of considering multiple factors when evaluating user satisfaction and provides valuable insights into the effectiveness of different data sources for sentiment analysis of product reviews.

• Journal of Animal Science and Technology
• /
• 제63권6호
• /
• pp.1443-1452
• /
• 2021

This study aimed to investigate the effects of the multimodal group intervention that combined animal-assisted therapy (AAT) and integrated play therapy (IPT) on depression and self-esteem in undergraduate university students. The subjects were 40 students attending animal-related and social welfare departments of universities located in a metropolitan city. The multimodal intervention program was conducted for eight sessions (twice a week, 60 min each) in the experimental group. Data analysis was conducted using the independent sample t-test, ANCOVA, and paired sample t-test for pre- and post-test. Therefore, the multimodal intervention program applying AAT and IPT showed positive effects on depression and self-esteem in university students. Based on these results, this study proposed the operation of multidisciplinary education and practical and policy utilization methods to reduce depression among university students and help improve their self-esteem.

• 한국도로학회논문집
• /
• 제17권2호
• /
• pp.123-134
• /
• 2015

PURPOSES : The key point of a multimodal LOS (level-of-service) evaluation system is that all of the modes are mutually associated to determine each mode's LOS. For example, the LOS of the bicycle mode is measured based on not only bicycle volumes, but also automobile volumes. However, the Korea Highway Capacity Manual (KHCM) still focuses on the automobile mode in evaluating the LOS of the roads. Additionally, the KHCM's LOS of the other modes, except for the automobile, is not consistent with actual road conditions. The KHCM, therefore, needs to develop and introduce a multimodal LOS system in order to evaluate the service conditions more accurately. METHODS: As a preliminary step to the introduction of multimodal LOS research, in this study the current problem of the KHCM's LOS system through a close review and comparison with other HCMs (highway capacity manuals) was identified. Secondly, a field survey and investigation of the urban streets to apply the HCM's multimodal LOS system was conducted. Finally, a comparison analysis of the results of the HCM and KHCM LOS was performed. RESULTS: In the study, it was found that the results of the LOS for the automobile mode did not show a significant difference between the HCM and KHCM. However, the LOS of the bicycle and pedestrian mode tended to be worse in the multimodal LOS system, which results from considering the effects of the automobile mode. Moreover, it was found that many cases have the potential to improve the overall LOS conditions, while reducing the automobile capacity. CONCLUSIONS: With the introduction of the multimodal LOS system, road diet and complete streets can be easily applied to ans actual road improvement project. Ultimately, the multimodal LOS system should be introduced into the KHCM, which can then be applied to traffic impact studies and other road improvement projects for more accurate evaluations.

• 대한화학회지
• /
• 제56권4호
• /
• pp.500-508
• /
• 2012

이 연구의 목적은 다중 표상 수업이 고등학생들의 글쓰기에서 나타난 다중 표상의 내재성에 미치는 영향을 알아보기 위한 것이다. 이 연구는 광역시에 위치한 고등학교 자연계열 2학년 2개 학급 학생 74명을 대상으로 수행하였으며, 2개 학급 중 1개 학급 41명을 실험집단으로, 다른 1개 학급 33명을 비교집단으로 선정하였다. 실험집단에는 2차시의 다중 표상 수업과 7가지 주제에 대한 전통적인 방식의 수업을 처치하였고, 비교집단에는 다중 표상 수업을 제외하고 실험집단과 동일하게 수업을 진행하였다. 학생들이 작성한 Summary Writing의 분석 결과, 다중 표상의 내재성에 대한 실험집단의 평균이 비교집단에 비해 통계적으로 유의미하게 높은 것으로 나타났다.

• 한국항해항만학회:학술대회논문집
• /
• 한국항해항만학회 2004년도 춘계학술대회 논문집
• /
• pp.421-426
• /
• 2004

다국적기업의 증가는 물류환경을 국제복합운송체계로 이끌고 있다. 기반시설이 잘 갖추어진 유럽의 경우에는 제2의 실크로드를 개발하기위한 노력이 끊임없이 행해지고 있다. 본 논문에서는 국제복합운송의 중요성에 대해 설명하고, 유럽 복합운송 체계에 대한 분석을 통해 국내 및 동북아 복합운송체계를 제안한다. 이를 위해 유럽 복합운송 사례를 분석하고 TAR의 북부 노선을 통해 한반도 남단을 기점으로 하는 노선의 경제적 효과와 이를 철도와 항만 및 공항으로 연결하는 복합운송 모델을 개발한다. 실질적으로 본 연구의 실효성을 증명할 수치적 근거가 부족하나, 본 논문에서는 기존에 제시되지 않았던 구체적인 복합운송 모델을 개발 및 제안함으로써, ESCAP에서 수행하게 될 시범 컨테이너 전용열차 운행 프로젝트를 통해 노선별 거리, 시간, 비용, 세금, 통관절차, 환적시설 등의 정보를 차후 경제성평가 연구에 활용할 수 있을 것으로 기대한다.