• 제목/요약/키워드: Multimodal studies

검색결과 82건 처리시간 0.026초

The influence of learning style in understanding analogies and 2D animations in embryology course

  • Narayanan, Suresh;Ananthy, Vimala
    • Anatomy and Cell Biology
    • /
    • 제51권4호
    • /
    • pp.260-265
    • /
    • 2018
  • Undergraduate students struggle to comprehend embryology because of its dynamic nature. Studies have recommended using a combination of teaching methods to match the student's learning style. But there has been no study to describe the effect of such teaching strategy over the different types of learners. In the present study, an attempt has been made to teach embryology using the combination of analogies and simple 2D animations made with Microsoft powerpoint software. The objective of the study is to estimate the difference in academic improvement and perception scale between the different types of learners after introducing analogies and 2D animation in a lecture environment. Based on Visual, Aural, Read/Write, and Kinesthetic (VARK) scoring system the learners were grouped into unimodal and multimodal learners. There was significant improvement in post-test score among the unimodal (P<0.001) and multimodal learners (P<0.001). When the post-test score was compared between the two groups, the multimodal learners performed better the unimodal learners (P=0.018). But there was no difference in the perception of animations and analogies and long-term assessment between the groups. The multimodal learners performed better than unimodal learners in short term recollection, but in long term retention of knowledge the varied learning style didn't influence its outcome.

Multimodal Sentiment Analysis for Investigating User Satisfaction

  • 황교엽;송쯔한;박병권
    • 한국정보시스템학회지:정보시스템연구
    • /
    • 제32권3호
    • /
    • pp.1-17
    • /
    • 2023
  • Purpose The proliferation of data on the internet has created a need for innovative methods to analyze user satisfaction data. Traditional survey methods are becoming inadequate in dealing with the increasing volume and diversity of data, and new methods using unstructured internet data are being explored. While numerous comment-based user satisfaction studies have been conducted, only a few have explored user satisfaction through video and audio data. Multimodal sentiment analysis, which integrates multiple modalities, has gained attention due to its high accuracy and broad applicability. Design/methodology/approach This study uses multimodal sentiment analysis to analyze user satisfaction of iPhone and Samsung products through online videos. The research reveals that the combination model integrating multiple data sources showed the most superior performance. Findings The findings also indicate that price is a crucial factor influencing user satisfaction, and users tend to exhibit more positive emotions when content with a product's price. The study highlights the importance of considering multiple factors when evaluating user satisfaction and provides valuable insights into the effectiveness of different data sources for sentiment analysis of product reviews.

Multimodal Interaction Framework for Collaborative Augmented Reality in Education

  • Asiri, Dalia Mohammed Eissa;Allehaibi, Khalid Hamed;Basori, Ahmad Hoirul
    • International Journal of Computer Science & Network Security
    • /
    • 제22권7호
    • /
    • pp.268-282
    • /
    • 2022
  • One of the most important technologies today is augmented reality technology, it allows users to experience the real world using virtual objects that are combined with the real world. This technology is interesting and has become applied in many sectors such as the shopping and medicine, also it has been included in the sector of education. In the field of education, AR technology has become widely used due to its effectiveness. It has many benefits, such as arousing students' interest in learning imaginative concepts that are difficult to understand. On the other hand, studies have proven that collaborative between students increases learning opportunities by exchanging information, and this is known as Collaborative Learning. The use of multimodal creates a distinctive and interesting experience, especially for students, as it increases the interaction of users with the technologies. The research aims at developing collaborative framework for developing achievement of 6th graders through designing a framework that integrated a collaborative framework with a multimodal input "hand-gesture and touch", considering the development of an effective, fun and easy to use framework with a multimodal interaction in AR technology that was applied to reformulate the genetics and traits lesson from the science textbook for the 6th grade, the first semester, the second lesson, in an interactive manner by creating a video based on the science teachers' consultations and a puzzle game in which the game images were inserted. As well, the framework adopted the cooperative between students to solve the questions. The finding showed a significant difference between post-test and pre-test of the experimental group on the mean scores of the science course at the level of remembering, understanding, and applying. Which indicates the success of the framework, in addition to the fact that 43 students preferred to use the framework over traditional education.

Preparation of Micro-/Macroporous Carbons and Their Gas Sorption Properties

  • Hwang, Yong-Kyung;Shin, Hye-Seon;Hong, Jin-Yeon;Huh, Seong
    • Bulletin of the Korean Chemical Society
    • /
    • 제35권2호
    • /
    • pp.377-382
    • /
    • 2014
  • Micro-/macroporous carbons (MMCs) were prepared using a hollow mesoporous silica capsule (HMSC) as a sacrificial hard template. The carbonization process after the infiltration of furfuryl alcohol into the template-free HMSC material afforded MMC materials in high yield. The hard template HMSC could be removed by HF etching without deteriorating the structure of MMC. The MMC materials were fully characterized by SEM, TEM, PXRD, XPS, and Raman spectroscopy. The replication processes were so successful that MMCs exhibited a hollow capsular structure with multimodal microporosity. Detailed textural properties of MMC materials were investigated by volumetric $N_2$ adsorption-desorption analysis at 77 K. To explore the gas sorption abilities of MMCs for other gases, $H_2$ and $CO_2$ sorption analyses were also performed at various temperatures. The multimodal MMC materials were found to be good sorbents for both $H_2$ and $CO_2$ at low pressure.

Multimodal Medical Image Fusion Based on Sugeno's Intuitionistic Fuzzy Sets

  • Tirupal, Talari;Mohan, Bhuma Chandra;Kumar, Samayamantula Srinivas
    • ETRI Journal
    • /
    • 제39권2호
    • /
    • pp.173-180
    • /
    • 2017
  • Multimodal medical image fusion is the process of retrieving valuable information from medical images. The primary goal of medical image fusion is to combine several images obtained from various sources into a distinct image suitable for improved diagnosis. Complexity in medical images is higher, and many soft computing methods are applied by researchers to process them. Intuitionistic fuzzy sets are more appropriate for medical images because the images have many uncertainties. In this paper, a new method, based on Sugeno's intuitionistic fuzzy set (SIFS), is proposed. First, medical images are converted into Sugeno's intuitionistic fuzzy image (SIFI). An exponential intuitionistic fuzzy entropy calculates the optimum values of membership, non-membership, and hesitation degree functions. Then, the two SIFIs are disintegrated into image blocks for calculating the count of blackness and whiteness of the blocks. Finally, the fused image is rebuilt from the recombination of SIFI image blocks. The efficiency of the use of SIFS in multimodal medical image fusion is demonstrated on several pairs of images and the results are compared with existing studies in recent literature.

그래픽노블을 통한 다중문식성의 발달 (The Use of Graphic Novels for Developing Multiliteracies)

  • 윤은자
    • 영어영문학
    • /
    • 제56권4호
    • /
    • pp.575-596
    • /
    • 2010
  • The modes of narratives and communication have expanded due to social and cultural changes and technological development. Thus texts have become multimodal and media hybridities and media crossover have been increasing as well. Multimodality requires new literacy to understand and interpret those multimodal texts other than existing traditional literacy approaches. The New London Group (2000) argues that multiliteracies are needed to serve today's changing multimodal texts. Kress (2003) also argues, visual texts have been prevailing, being mingled with other modes of texts such as linguistic, audio, gestural, and spatial modes. Literary texts are not exception in this trend of multimodality. The recent renaissance of comics, in particular, the new light on graphic novels can be interpreted in this historical vein. In comparison to comics, no consensus has been made in defining graphic novels, however, many studies have been recently conducted in order to look into the potential of graphic novels in building multiliteracies. In this paper, the graphic novel as a literary genre are explored from a histocial perspective and the definition of graphic novels was attempted to be made. In the light of multiliteracies, this paper presented cases that show how graphic novels can be utilized to build multiliteracies. Lastly, the use of graphic novels for English as a foreign language was introduced as well. The author hopes that at the age of multimodality, the potential graphic novels have in language and literacy education can be taken into account by language teachers and students in expanding their territory of literacy.

Outcomes of the Multimodal Treatment of Malignant Pleural Mesiothelioma: The Role of Surgery

  • Na, Bub-Se;Kim, Ji Seong;Hyun, Kwanyong;Park, In Kyu;Kang, Chang Hyun;Kim, Young Tae
    • Journal of Chest Surgery
    • /
    • 제51권1호
    • /
    • pp.35-40
    • /
    • 2018
  • Background: The treatment of malignant pleural mesothelioma (MPM) is challenging, and multimodal treatment including surgery is recommended; however, the role of surgery is debated. The treatment outcomes of MPM in Korea have not been reported. We analyzed the outcomes of MPM in the context of multimodal treatment, including surgery. Methods: The records of 29 patients with pathologically proven MPM from April 1998 to July 2015 were retrospectively reviewed. The treatment outcomes of the surgery and non-surgery groups were compared. Results: The overall median survival time was 10.6 months, and the overall 3-year survival rate was 25%. No postoperative 30-day or in-hospital mortality occurred in the surgery group. Postoperative complications included tachyarrhythmia (n=4), pulmonary thromboembolism (n=1), pneumonia (n=1), chylothorax (n=1), and wound complications (n=3). The treatment outcomes between the surgery and non-surgery groups were not significantly different (3-year survival rate: 31.3% vs. 16.7%, respectively; p=0.47). In a subgroup analysis, there was no significant difference in the treatment outcomes between the extrapleural pneumonectomy group and the non-surgery group (3-year survival rate: 45.5% vs. 16.7%, respectively; p=0.23). Conclusion: Multimodal treatment incorporating surgery did not show better outcomes than non-surgical treatment. A nationwide multicenter data registry and prospective randomized controlled studies are necessary to optimize the treatment of MPM.

가상 인간의 감정 표현 인식을 위한 비언어적 다중모달 영향 분석 (Impact Analysis of nonverbal multimodals for recognition of emotion expressed virtual humans)

  • 김진옥
    • 인터넷정보학회논문지
    • /
    • 제13권5호
    • /
    • pp.9-19
    • /
    • 2012
  • 디지털 콘텐츠에서 HCI로 활용되는 가상 인간은 얼굴 표정과 신체자세와 같은 모달을 이용하여 다양한 감정을 표현하지만 비언어적 다중모달의 조합에 대한 연구는 많지 않다. 감정을 표현하는 가상 인간을 제작하려면 계산 엔진 모델은 얼굴 표정과 신체자세와 같은 비언어적 모달의 조합이 사용자에 의해 어떻게 인식되는지를 고려해야 하기 때문에 본 연구는 가상 인간의 감정 표현 디자인에 필요한 비언어적 다중모달의 영향을 분석하여 제시한다. 먼저 가상 인간에 대한 다중모달 별 감정 인식을 평가하여 다른 모달간의 상대적 영향성을 분석하였다. 그리고 일치하는 얼굴과 자세 모달을 통해 기본 감정 및 정서가와 활성화 인식에 대한 영향을 평가하며 감정이 불일치하는 다중모달을 통해 일상생활에서 빈번하게 드러나는 중첩된 감정의 인식 정도를 관측하였다. 실험 결과, 가상 인간의 얼굴과 신체자세의 표정이 일치하면 감정 인식이 용이하며, 얼굴 표정으로 감정 카테고리를 판별하지만 감정의 활성화 차원 판단에는 자세 모달리티가 선호됨을 확인하였다. 본 연구 결과는 감정을 드러내는 가상 인간의 행동 동기화 및 애니메이션 엔진 시스템 구현에 활용할 수 있다.

Comparative Study of Multimodal Therapy in Facial Palsy Patients

  • Neville, Catriona;Gwynn, Tamsin;Young, Karen;Jordan, Elizabeth;Malhotra, Raman;Nduka, Charles;Kannan, Ruben Yap
    • Archives of Plastic Surgery
    • /
    • 제49권5호
    • /
    • pp.633-641
    • /
    • 2022
  • Introduction In chronic facial palsy, synkinetic muscle overactivity and shortening causes muscle stiffness resulting in reduced movement and functional activity. This article studies the role of multimodal therapy in improving outcomes. Methods Seventy-five facial palsy patients completed facial rehabilitation before being successfully discharged by the facial therapy team. The cohort was divided into four subgroups depending on the time of initial attendance post-onset. The requirement for facial therapy, chemodenervation, or surgery was assessed with East Grinstead Grade of Stiffness (EGGS). Outcomes were measured using the Facial Grading Scale (FGS), Facial Disability Index, House-Brackmann scores, and the Facial Clinimetric Evaluation scale. Results FGS composite scores significantly improved posttherapy (mean-standard deviation, 60.13 ± 23.24 vs. 79.9 ± 13.01; confidence interval, -24.51 to -14.66, p < 0.0001). Analysis of FGS subsets showed that synkinesis also reduced significantly (p < 0.0001). Increasingly, late clinical presentations were associated with patients requiring longer durations of chemodenervation treatment (p < 0.01), more chemodenervation episodes (p < 0.01), increased doses of botulinum toxin (p < 0.001), and having higher EGGS score (p < 0.001). Conclusions This study shows that multimodal facial rehabilitation in the management of facial palsy is effective, even in patients with chronically neglected synkinesis. In terms of the latency periods between facial palsy onset and treatment initiation, patients presenting later than 2 years were still responsive to multimodal treatment albeit to a lesser extent, which we postulate is due to increasing muscle contracture within their facial muscles.

"Say Hello to Vietnam!": A Multimodal Analysis of British Travel Blogs

  • Thuy T.H. Tran
    • 수완나부미
    • /
    • 제15권2호
    • /
    • pp.91-129
    • /
    • 2023
  • This paper reports the findings of a multimodal study conducted on 10 travel blog posts about Vietnam by seven British professional travel bloggers. The study takes a sociolinguistic view to tourism by seeing travel blogs as a source for linguistic and other semiotic materials while considering language as situated practice for the social construction of fundamental categories such as "human," "society," and "nation." It borrows concepts from Halliday's Systemic Functional Linguistics for interpersonal metafunction to develop an analytical framework to study how the co-occurrence of text and still images in these travel blog posts formulated the portrayal of Vietnam as a tourism destination and indicated the main sociolinguistic features of the blogs. The analysis of appreciation values and interactive qualities encoded in evaluative adjectives and still images show that Vietnam is generally portrayed as a country of identity and diversity. It provides tourists with positive experiences in terms of places of interest, food and local lifestyles and is cost-competitive. Strangerhood and authenticity are two outstanding sociolinguistic features exhibited in these travel blog posts. The findings of this study also underline the co-contribution of the linguistic sign, in this case evaluative adjectives, and the visual sign, in this case still images, as interpersonal meaning-making resources. To portray Vietnam, still images served as integral elements to evidence the credibility of verbal narrations. To unveil sociolinguistic characteristics of travel blogs, still images supported the linguistic realizations of authenticity and strangerhood on the posts, and in some case delivered an even stronger message than words. Not only does the study present a source of feedback from international travelers to tourism practice in Vietnam, but it also provides insights into multimodal analysis of tourism discourse which remains an under-researched area in Vietnam.