• Phonetics and Speech Sciences
• /
• v.4 no.3
• /
• pp.25-30
• /
• 2012

This study investigated whether native Korean listeners could use visual cues for the identification of the English consonants /b/ and /v/. Both auditory and audiovisual tokens of word minimal pairs in which the target phonemes were located in word-initial or word-medial position were used. Participants were instructed to decide which consonant they heard in $2{\times}2$ conditions: cue (audio-only, audiovisual) and location (word-initial, word-medial). Mean identification scores were significantly higher for audiovisual than audio-only condition and for word-initial than word-medial condition. Also, according to signal detection theory, sensitivity, d', and response bias, c were calculated based on both hit rates and false alarm rates. The measures showed that the higher identification rate in the audiovisual condition was related with an increase in sensitivity. There were no significant differences in response bias measures across conditions. This result suggests that native Korean speakers can use visual cues while identifying confusing non-native phonemic contrasts. Visual cues can enhance non-native speech perception.

• Journal of Korea Multimedia Society
• /
• v.23 no.4
• /
• pp.615-624
• /
• 2020

By enabling musicians to freely control the elements involved in sound production and tone generation with a variety of timbre, synthesizers have revolutionized and permanently changed music since the 1960s. Paik-Abe Video Synthesizer, a masterpiece of video art maestro Nam June Paik, is a prominent example of re-interpretation of this new musical instrument in the realm of video and audio. This article examines Paik-Abe Video Synthesizer as an innovative instrument to play videos from the perspective of audiovisual art, and establishes its aesthetic value and significance through both artistic and technical analysis. The instrument, which embodied the concept of image sampling and real-time interactive video as an image-based multi-channel music production tool, contributed to establishing a new relationship between sound and image within the realm of audiovisual art. The fact that his video synthesizer not only adds image to sound, but also presents a complete fusion of image and sound as an image instrument with musical characteristics, becomes highly meaningful in this age of synesthesia.

• International Journal of Internet, Broadcasting and Communication
• /
• v.16 no.3
• /
• pp.98-112
• /
• 2024

As digital education progresses, MOOC (Massive Open Online Courses) are increasingly utilized by learners, making research on MOOC learning outcomes a necessary endeavor. In this study, we systematically investigated the impact of audiovisual elements on learning outcomes in MOOC, highlighting the nuanced role these components play in enhancing educational effectiveness. Through a comprehensive survey and rigorous analysis involving descriptive statistics, reliability metrics, and regression techniques, we quantified the influence of text, graphics, color, teacher images, sound effects, background music, and teacher's voice on learner attention, cognitive load, and satisfaction. We discovered that background music and text layout significantly improve engagement and reduce cognitive burden, underscoring their pivotal role in the instructional design of MOOC. We findings contribute new insights to the field of digital education, emphasizing the critical importance of integrating audiovisual elements thoughtfully to foster better learning environments and outcomes. Not only advances academic understanding of multimedia learning impacts but also offers practical guidance for educators and course designers seeking to enhance the efficacy of MOOC.

• Korean journal of communication and information
• /
• v.22
• /
• pp.77-106
• /
• 2003

As globalization of communication is going on and as the media have become increasingly central to the world economy, media policy matters have become the province of world economic organizations like the IMF and the WTO. The WTO service negotiation is focused primarily on the discriminatory and quantitative barriers associated with the trade of audiovisual services. Domestic measures such as subsidization, content regulation including quotas, and licensing requirements and restrictions on foreign ownership and control are at issues here. These measures have been successfully implemented by countries wishing to withstand competition from the American audiovisual industry. The debate about trade in audiovisual services is permeated by the unstated assumption that these programs are pure commodities whose production, distribution, exhibition and in turn, values are solely determined by the market forces. It is therefore presumed that liberalization of trade in audiovisual services will benefit all, serving cultural pluralism and diversity as well as economic efficiency. However, this assumption is not shared by developing countries, the recipients of U.S. television material. They argue audiovisual sector requires a social and cultural approach, since it plays a key role in the preservation of people's identity and social bonds. They claim that it is the each state's right to define its media policy and to implement it through the means it considers fit. These clashing views over the nature of the audiovisual material and the ways in which protect cultural pluralism and diversity do not confine to be the realm of theoretical debate. Each state's interest and motivation to protect its local industry and to have a competitive advantage in the international market is working in this battle. Consolidation with the countries like Australia, Canada, and EU nations, in favour of cultural exemption, seems to be the best policy for us. However, we are not entirely free from the WTO pressures, considering relation to the U. S. This study analyzes Korean Broadcasting Law compared with those of other OECD countries and tries to propose some strategical guidelines facing WTO service negotiation in the area of broadcasting.

• The Journal of the Convergence on Culture Technology
• /
• v.9 no.3
• /
• pp.213-219
• /
• 2023

The purpose of this study is to prove the students' understanding of audiovisual translation and the class effect by using the lesson plan that can efficiently teach the audiovisual translation class, which is one of the major elective courses at S University. After taking the course, a questionnaire was surveyed and the results were analyzed. The response and satisfaction with the content of the class was positive and very high, and it was confirmed that the background knowledge of the movie was especially helpful for translation practice. The effect of the class was focused on translating subtitles, and only the abbreviated part of the response to the questionnaire was expressed in a table, and the rest was expressed descriptively. Specifically, the response rate for abbreviations, pronouns, titles suitable for personal relationships, putting subjects and predicates close together were the most positive, followed by natural expressions, sign writing, handling of honorifics and informal words, attaching subject and predicates closer, translating them in reverse, and converting units.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.13 no.2
• /
• pp.810-831
• /
• 2019

Recently, continuous dimensional emotion recognition from audiovisual clues has attracted increasing attention in both theory and in practice. The large amount of data involved in the recognition processing decreases the efficiency of most bimodal information fusion algorithms. A novel algorithm, namely the incomplete Cholesky decomposition based kernel cross factor analysis (ICDKCFA), is presented and employed for continuous dimensional audiovisual emotion recognition, in this paper. After the ICDKCFA feature transformation, two basic fusion strategies, namely feature-level fusion and decision-level fusion, are explored to combine the transformed visual and audio features for emotion recognition. Finally, extensive experiments are conducted to evaluate the ICDKCFA approach on the AVEC 2016 Multimodal Affect Recognition Sub-Challenge dataset. The experimental results show that the ICDKCFA method has a higher speed than the original kernel cross factor analysis with the comparable performance. Moreover, the ICDKCFA method achieves a better performance than other common information fusion methods, such as the Canonical correlation analysis, kernel canonical correlation analysis and cross-modal factor analysis based fusion methods.

• ETRI Journal
• /
• v.46 no.1
• /
• pp.22-34
• /
• 2024

Exposure to varied noisy environments impairs the recognition performance of artificial intelligence-based speech recognition technologies. Degraded-performance services can be utilized as limited systems that assure good performance in certain environments, but impair the general quality of speech recognition services. This study introduces an audiovisual speech recognition (AVSR) model robust to various noise settings, mimicking human dialogue recognition elements. The model converts word embeddings and log-Mel spectrograms into feature vectors for audio recognition. A dense spatial-temporal convolutional neural network model extracts features from log-Mel spectrograms, transformed for visual-based recognition. This approach exhibits improved aural and visual recognition capabilities. We assess the signal-to-noise ratio in nine synthesized noise environments, with the proposed model exhibiting lower average error rates. The error rate for the AVSR model using a three-feature multi-fusion method is 1.711%, compared to the general 3.939% rate. This model is applicable in noise-affected environments owing to its enhanced stability and recognition rate.

• Therapeutic Science for Rehabilitation
• /
• v.9 no.3
• /
• pp.77-89
• /
• 2020

Objective : The purpose of this study is to investigate the effects of audiovisual biofeedback training using RAPAEL Smart Pegboard on the cognitive function of stroke patients. Methods : A total of 20 participants were divided into an intervention group and a control group, with 10 patients per group K-MoCA and NCSE were used for pre and post intervention evaluation. The intervention method of the intervention group provided traditional occupational therapy and audiovisual biofeedback training, and the control group provided traditional occupational therapy and participated in self-activity programs. Results : K-MoCA revealed a significant difference in visuo-spatial and executive functions, attention, memory, and overall score in the internvention group compared to the control group (p<.05). In addition, the results of NCSE showed that there was a significant difference in attention, memory, and overall score in the intervention group compared to the control group (p<.05). Conclusion : We confirmed that the audiovisual biofeedback training had a positive effect on the cognitive function of stroke patients. Therefore, it could be useful tool for the rehabilitation of stroke patients in future occupational therapy clinical environments.

• Journal of information and communication convergence engineering
• /
• v.18 no.2
• /
• pp.115-122
• /
• 2020

Audiovisual (AV) facilities such as TVs and signage are installed in various public places. However, audio cannot be used to prevent noise and interference from individuals, which results in a loss of concentration and understanding of AV content. To address this problem, a total technique for remotely listening to audio from audiovisual facilities with clean sound quality while maintaining video and lip-syncing through personal smart mobile devices is proposed in this paper. Through the experimental results, the proposed scheme has been verified to reduce system power consumption by 8% to 16% and provide real-time processing with a low latency of 120 ms. The system described in this paper will contribute to the activation of audio telehearing services as it is possible to provide audio remote services in various places, such as express buses, trains, wide-area and intercity buses, public waiting rooms, and various application services.

• The Journal of Korean Society for School & Community Health Education
• /
• v.8 no.1
• /
• pp.1-11
• /
• 2007

Objectives: School must provide the proper sex education to students, thereby, the students for have right standards of sexuality and preventing from sexual crimes. This study conducted to identify the effectiveness and students' satisfaction level on Sex education program for middle school students prepared by the Ministry of Education and Human Resources. Methods: The sample size of the study was 644 students(458 female students and 186 male students) in middle school. A self reporting type of questionnaire survey was conducted from May 2 through May 27, 2005. Collected data were processed using SPSSwin 12.0; The data were analysed through t-test, stepwise multiple regression analysis. Results: Lectures and audiovisual materials were mostly used for sex education for students. Many students were satisfied with the program of physical and sexual organ development, pregnancy, contraceptive methods and sexual abuse. Many students wanted to study more on courtship, love, and marriage. The programs which the students did not understand well were sexually transmitted diseases, pregnancy and mass media and sex. Forty six percentage of the students reported that they were satisfied with the education program. Thirty three percentage of the students said that they were not satisfied with the program. The students who had earlier menstruation experience and the students whose academic achievement were higher were more satisfied with sex education program (P<.05). The students who were satisfied with the sex education CD prepared by the ministry of education were more satisfied with sex education program. (P<.001). When the CDs were appropriately used, the students were more satisfied with the education program (P<.05). The sound and pictures in the CD did not much affect the students. Audiovisual programs were more effective than lectures.