• Journal of Information Processing Systems
• /
• v.13 no.3
• /
• pp.448-463
• /
• 2017

Multimedia is a ubiquitous and indispensable part of our daily life and learning such as audio, image, and video. Objective and subjective quality evaluations play an important role in various multimedia applications. Blind image quality assessment (BIQA) is used to indicate the perceptual quality of a distorted image, while its reference image is not considered and used. Blur is one of the common image distortions. In this paper, we propose a novel BIQA index for Gaussian blur distortion based on the fact that images with different blur degree will have different changes through the same blur. We describe this discrimination from three aspects: color, edge, and structure. For color, we adopt color histogram; for edge, we use edge intensity map, and saliency map is used as the weighting function to be consistent with human visual system (HVS); for structure, we use structure tensor and structural similarity (SSIM) index. Numerous experiments based on four benchmark databases show that our proposed index is highly consistent with the subjective quality assessment.

• Journal of The Institute of Information and Telecommunication Facilities Engineering
• /
• v.10 no.4
• /
• pp.143-147
• /
• 2011

The system using augmented reality can save the time and cost. It is verified in various fields under the possibility of a technology by solving unrealistic feeling in the virtual space. Therefore, augmented reality has a variety of the potential to be used. Generally, multimodal senses such as visual/auditory/tactile feed back are well known as a method for enhancing the immersion in case of interaction with virtual object. By adapting tangible object we can provide touch sensation to users. a 3D model of the same scale overlays the whole area of the tangible object; thus, the marker area is invisible. This contributes to enhancing immersive and natural images to users. Finally, multimodal feedback also creates better immersion. In this paper, sound feedback is considered. By further improving immersion learning augmented reality for children with the initial step learning content is presented. Augmented reality is in the intermediate stages between future world and real world as well as its adaptability is estimated more than virtual reality.

• Child Health Nursing Research
• /
• v.23 no.4
• /
• pp.494-504
• /
• 2017

Purpose: The aim of this study was to analyze Neonatal Intensive Care Unit nurses' behaviors while soothing newborns with bronchopulmonary dysplasia. Methods: An observational study was used to assess nurses' soothing behaviors. Data were collected from September, 2012 to March, 2013 using an audio-video recording system. Participants were eight babies and 12 nurses caring for those babies. After obtaining parental permission, the overall process of each episode from nurses' engagement in soothing to the end of soothing was recorded. Then a researcher interviewed each participating nurse. Data from 18 episodes were transcribed as verbal and nonverbal nursing behaviors and then categorized by two researchers. Results: There were 177 observed soothing behaviors which were classified with the five sensory-based categories (tactile, oral, visual, auditory, vestibular). Most frequently observed soothing behavior was 'Gently talking' followed by 'Removing irritant', and 'Providing non-nutritive sucking'. Nurses' perceived soothing behaviors were similar to the observed soothing behaviors except for 'Gently talking'. Conclusion: Nurses used diverse and mixed soothing behaviors as well as recognizing those behaviors as essential nursing skills. Nurses' soothing behaviors identified in this study can be used to comfort babies and to enhance their developmental potential in accordance with individual characterstics or cues.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2003.11a
• /
• pp.223-226
• /
• 2003

최근, 컴퓨터 환경의 발달로 각 분야에서 AV(Audio-Visual) 콘텐츠의 사용량이 기하급수적으로 증가되었다 또한 컴퓨터, 방송 및 네트워크의 융합으로 이 전 보다 다양한 종류의 어플리케이션에서 다양한 형태로 AV 콘텐츠가 사용되고 있다 이에 따라, 이런 다양한 형태의 AV콘텐츠를 표현하는 방법 및 검색하여 사용하는 방법에 대한 많은 연구들이 이루어지고 있다 이런 연구들의 한 형태로 본 논문에서는 AV 콘텐츠를 표현하는 방법으로 MPEG-4 콘텐츠를 XML에 기반 하여 표현한 XMT(eXtensible MPEG-4 Textual fomat)와 AV 콘텐츠를 검색하는 방법으로 MPEG-7 표준을 사용하여 객체기반 MPEG-4의 콘텐츠 검객 시스템을 제안하였다 다양한 포맷의 미디어 데이터 및 그래픽 객체들을 각각의 하나의 객체로 간주하여 AV콘텐츠를 구성하는 MPEG-4 시스템을 XML을 기반으로 표현한 XMT 포맷으로는 MPEG-4 콘텐츠를 구성하는 미디어 데이터를 바탕으로 검색하는데 한계가 있다. 따라서 미디어 데이터 검색을 위한 메타데이 터의 표준으로 사용되고 있는 MPEG-7 을 사용하여 객체 기반 MPEG-4 콘텐츠 검색이 효과적으로 이루어질 수 있도록 확장된 XMT 포맷을 제안하고, 이를 사용하는 시험 시스템을 구성하였다. 이렇게 함으로써 MPEG-4로 표현된 객체 기반 AV 콘텐츠 검색 시 MPEG-7메타데이터를 사용하여 보다 사용자가 원하는 콘텐츠를 효율적으로 검색하여 제공할 수 있을 것으로 사려된다

• Proceedings of the Korea Information Processing Society Conference
• /
• 2012.11a
• /
• pp.1162-1165
• /
• 2012

어미로부터 생후 21일령(또는 28일령)에 젖을 때는 어린 자돈들은 면역력이 약하여 통상 폐사율이 30~40%까지 치솟는 등 자돈 관리가 국내 양돈 농가의 가장 큰 문제 중 하나로 인식되고 있다. 본 논문에서는 이러한 양돈 농가의 문제를 해결하기 위하여 자돈사(새끼돼지 축사)에 카메라와 마이크를 설치하고 획득된 영상과 소리 정보를 이용하여 자돈들을 모니터링하는 시스템을 제안한다. 제안된 시스템은 실시간으로 유입되는 영상과 소리 스트림 데이터로부터 각각 움직임 벡터와 평균 피치 값을 추출하여 이미 설정된 정상 상황의 임계치 값을 넘는 순간부터를 불특정 이상 상황이라 판단한다. 실제, 경상남도 함양군의 한 돼지 농장에 A/V 센서 기반의 실험 환경을 구축하고 2012년 6월 한 달간의 이유자돈 돈사의 모니터링 데이터 셋을 취득하였고 전반기 15일간의 데이터 셋을 이용하여 자돈사 모니터링 시스템의 프로토타입을 설계 구현하였으며 후반기 15일간의 A/V 스트림 데이터로는 검증 실험을 수행하였다.

• Annual Conference on Human and Language Technology
• /
• 2023.10a
• /
• pp.253-257
• /
• 2023

최근 다양한 대화 시스템이 스마트폰 어시스턴트, 자동 차 내비게이션, 음성 제어 스피커, 인간 중심 로봇 등의 실세계 인간-기계 인터페이스에 적용되고 있다. 하지만 대부분의 대화 시스템은 텍스트 기반으로 작동해 다중 모달리티 입력을 처리할 수 없다. 이 문제를 해결하기 위해서는 비디오와 같은 다중 모달리티 장면 인식을 통합한 대화 시스템이 필요하다. 기존의 비디오 기반 대화 시스템은 주로 시각, 이미지, 오디오 등의 다양한 자질을 합성하거나 사전 학습을 통해 이미지와 텍스트를 잘 정렬하는 데에만 집중하여 중요한 행동 단서와 소리 단서를 놓치고 있다는 한계가 존재한다. 본 논문은 이미지-텍스트 정렬의 사전학습 임베딩과 행동 단서, 소리 단서를 활용해 비디오 기반 대화 시스템을 개선한다. 제안한 모델은 텍스트와 이미지, 그리고 오디오 임베딩을 인코딩하고, 이를 바탕으로 관련 프레임과 행동 단서를 추출하여 발화를 생성하는 과정을 거친다. AVSD 데이터셋에서의 실험 결과, 제안한 모델이 기존의 모델보다 높은 성능을 보였으며, 대표적인 이미지-텍스트 자질들을 비디오 기반 대화시스템에서 비교 분석하였다.

• Proceedings of the Korean Institute of Navigation and Port Research Conference
• /
• 2004.04a
• /
• pp.61-67
• /
• 2004

This paper describes Three-Dimensional Listening Simulation System (3D-LSS) which is to analyze whistle sound related marine casualties, and is to evaluate the accident situations using 3D sound by Head Related Transfer Function. At first, the three-dimensional listening model from the analysis of accident situations is proposed, and then the reproduction and evaluation methods of 3D sounds are also discussed. The system is designed to explain the accident situations and to simulate the possible situations with GUI based graphics and 3D sound reproduction. The evaluation experiments using 3D-LSS are carried out with six cases that did not known whether it is true or not the blast and listening of the whistle sound between two vessels. As results of psychological assessments by five subjects, the six cases can be analyzed clearly by visual images and audio sounds, thus the usability of 3D-LSS as one of the judgment assistant system of marine casualty is verified.

• Journal of Navigation and Port Research
• /
• v.28 no.8
• /
• pp.659-666
• /
• 2004

This paper describes Three-Dimensional Listening Simulation System (3D-LSS) which is to analyze whistle sound related marine casualties, and is to evaluate the accident situations using 3D sound by Head Related Transfer Function At first, the hree-dimensional listening model from the analysis of accident situations is proposed, and then the reproduction and evaluation methods of 3D sounds are also discussed. The system is designed to explain the accident situations and to simulate the possible situations with GUI based graphics and 3D sound reproduction. The evaluation experiments using 3D-LSS are carried out with six cases that did not known whether it is true or not the blast and listening of the whistle sound between two vessels. As results of psychological assessments by five subjects, the six cases can be analyzed clearly by visual images and audio sounds, thus the usability of 3D-LSS as one of the judgment assistant system of marine casualty is verified.

• Journal of KIISE:Computing Practices and Letters
• /
• v.9 no.4
• /
• pp.420-430
• /
• 2003

This paper presents an immersive multimodal Gumdo simulation game that allows a user to experience the whole body interaction with an intelligent cyber fencer. The proposed system consists of three modules: (i) a nondistracting multimodal interface with 3D vision and speech (ii) an intelligent cyber fencer and (iii) an immersive feedback by a big screen and sound. First, the multimodal Interface with 3D vision and speech allows a user to move around and to shout without distracting the user. Second, an intelligent cyber fencer provides the user with intelligent interactions by perception and reaction modules that are created by the analysis of real Gumdo game. Finally, an immersive audio-visual feedback by a big screen and sound effects helps a user experience an immersive interaction. The proposed system thus provides the user with an immersive Gumdo experience with the whole body movement. The suggested system can be applied to various applications such as education, exercise, art performance, etc.

• Journal of The Korean Association For Science Education
• /
• v.15 no.2
• /
• pp.213-222
• /
• 1995

Analyzing textbook is the first step for enhancing the level of biology education especially in Korea. Prior studies of textbook analysis have mostly dealt with such topics as terminology analysis, content analysis, relationship analysis of chapters, and comparative studies. However, not much attention was paid to concept system to be learned and to relevance of concepts chosen. Therefore, the purpose of this study is to clarify the concept system and to elucidate the relationship among concepts for effective learning. Novak's concept map was utilized as a theoretical framework for the analysis of chapter I of high school biology textbook. Concept map has several distinctive merits in many aspects such as teaching, learning, and evaluation. It not only makes the understanding of key concepts and proposition a lot easier, but also helps to link prior knowledge and new concepts more effectively. This study will be a basic material for improving textbook for effective biology learning. The conclusions of the study are as follows: 1. Concepts in subchapters were arranged unsystematically or they were overlapping. For more effective understanding, those items should be rearranged. 2. Key concepts are not arrayed properly according to their hierarchy. Therefore, it was hard for students to set up concept structure. 3. The concepts emphasized by bold letters were not selected properly in accordance with their importance. Appropriate concepts should be chosen. 4. Key concepts should be explained by using examples in everyday life for easy understanding. 5. Many concepts in molecular biology is too abstract to grasp their meaning. Therefore, many audio-visual materials should be used to aid concept building.