• Title/Summary/Keyword: visual-audio

Search Result 424, Processing Time 0.035 seconds

Effect of the Observation of an Audio-Visual Modeling on the Rehabilitation of Upper Limb Function in Stroke Patients (시청각적 모델링의 관찰이 뇌졸중 환자의 상지기능 재활에 미치는 영향)

  • Park, Sang-Bum;Kim, Mi-Hyun
    • Physical Therapy Korea
    • /
    • v.14 no.2
    • /
    • pp.1-10
    • /
    • 2007
  • The purpose of this experiment was to investigate the applicability of audio-visual modeling for improving the efficiency of rehabilitative programs by analyzing the effects of observing these various models on the capacity of stroke patients to perform upper limb activities. Twenty-one stroke patients participated in the experiment and were randomly assigned to either task modeling, sport modeling, or control group. During 2 weeks of intervention, subjects in all groups participated in the physical practice of experimental tasks. These tasks comprised of a Nine Hole Peg Test, the Jebsen-Taylor Hand Function tests, and locomotion. These tasks were performed 5 days a week, 30 min per day. In addition to the physical practice, the task modeling group observed a model performing experimental tasks and locomotive activities for 20 min, while the sport modeling group observed a model performing various sport activities for 20 min. Subjects' ability to perform the experimental tasks was measured 3 times, before, immediately after, and 1 week after the intervention. Analyses of the capacity to perform upper extremity activities displayed significant improvement from the pre-test to immediate and delayed post-tests in all groups. However, the amount of improvement was the highest in the task modeling group. The task modeling group was superior to the control group in the post-test of all experimental tasks, whereas the sport modeling group did not display significant differences from the control group. These results suggest that audio-visual modeling can be used as an effective cognitive intervention for facilitating the rehabilitation of stroke patients, and its rehabilitative effect can be maximized when the program is comprised of performance scenes directly related to the target task.

  • PDF

Development of Processing System for Audio-vision System Based on Auditory Input (청각을 이용한 시각 재현 시스템의 개발)

  • Kim, Jung-Hun;Kim, Deok-Kyu;Won, Chul-Ho;Lee, Jong-Min;Lee, Hee-Jung;Lee, Na-Hee;Yoon, Su-Young
    • Journal of Biomedical Engineering Research
    • /
    • v.33 no.1
    • /
    • pp.25-31
    • /
    • 2012
  • The audio vision system was developed for visually impaired people and usability was verified. In this study ten normal volunteers were included in the subject group and their mean age was 28.8 years old. Male and female ratio was 7:3. The usability of audio vision system was verified by as follows. First, volunteers learned distance of obstacles and up-down discrimination. After learning of audio vision system, indoor and outdoor walking examination was performed. The test was scored by ability of up-down and lateral discrimination, distance recognition and walking without collision. Each parameter was scored by 1 to 5. The results were 93.5 +- SD(ranges, 86 to 100) of 100. In this study, we could convert visual information to auditory information by audio-vision system and verified possibility of applying to daily life for visually impaired people.

Design and Implemention of Multimedia Integrated Processing Unit for Computer-Nased Video Conference (컴퓨터 영상회의를 위한 멀티미디어 통합처리장치의 설계 및 구현)

  • 김현기;홍재근
    • Journal of the Korean Institute of Telematics and Electronics C
    • /
    • v.35C no.3
    • /
    • pp.59-68
    • /
    • 1998
  • This paper propose a hardware architecure of multimediasysgem for integrated processing of the multimedia data such as audio and video, and describes on the design and implementation of multimedia integrated processing Unit. The unit comprises most commonly needed multimedia processing function for computer-based video conference: audio-visual datacapture, playback, compression, decompression as well as interleaving/disinterleaving of compressed audio-visual data. The proposed architecture minimizes the CPU overhead that might be caused by multimedia data processing and assures the fluent data flow among system components. Also, this unit is tested and analyzed under the computer-based video conference to confirm the multimedia unit of proposed architecture using communication protocol and application software through Ethernet and FDDI (Fiber Distributed Data Interface) networks.

  • PDF

A Novel Covariance Matrix Estimation Method for MVDR Beamforming In Audio-Visual Communication Systems (오디오-비디오 통신 시스템에서 MVDR 빔 형성 기법을 위한 새로운 공분산 행렬 예측 방법)

  • You, Gyeong-Kuk;Yang, Jae-Mo;Lee, Jinkyu;Kang, Hong-Goo
    • The Journal of the Acoustical Society of Korea
    • /
    • v.33 no.5
    • /
    • pp.326-334
    • /
    • 2014
  • This paper proposes a novel covariance matrix estimation scheme for minimum variance distortionless response (MVDR) beamforming. By accurately tracking direction-of-sound source arrival (DoA) information using audio-visual sensors, the covariance matrix is efficiently estimated by adopting a variable forgetting factor. The variable forgetting factor is determined by considering signal-to-interference ratio (SIR). Experimental results verify that the performance of the proposed method is superior to that of the conventional one in terms of interference/noise reduction and speech distortion.

Based PKI System for Secure Authentication on IPTV (IPTV에서 PKI기반의 안전한 인증시스템)

  • Shuai, Wang;Jo, In-June
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.13 no.5
    • /
    • pp.899-905
    • /
    • 2009
  • IPTV service is one of the representatives for the integration of broadcasting industry and communication industry, which also can meet users' various demands and provide efficient service. As the increasing number of IPTV users and contents servers, it is necessary to provide the safety authority system to prevent the illegal audio-visual, incorrect audio-visual authority, and illegal authority control. This thesis puts forward PKI(public Key Infrastructure) as the foundation key production mechanism. Through this mechanism, the key can be transferred safely to users and authenticate the ID of users and contents servers. In a word, our system can provide safe and efficient service for mutual authentication.

An Analysis on Appropriateness of Environmental Education Materials (환경교육 교재의 적합성 분석)

  • Yang, Jae-Sik;Nam, Sang-Joon
    • Hwankyungkyoyuk
    • /
    • v.16 no.2
    • /
    • pp.65-73
    • /
    • 2003
  • This study has an aim to construct a reference frame to analyze the appropriateness of environmental education(EE) materials of elementary schools, and to search the basic direction of the scheme for analysis. In addition, this study has an aim to induce what the results of this analysis suggests for the development and reconstruction of EE materials. It was analyzed how truly EE materials reflected contents selected as an analysis scheme, after grasping practical use and features of textbooks, audio-visual materials, and a web-site that are typical materials in EE of elementary schools. The results in textbook analysis were that there were a human-centered environmentalism in the EE unit ("Environmentally Sound National Development", 5th Grade) of Social Studies. The result in analysis of audio-visual materials "Environmental Warrior, Zentaforce" of EBS, were that there are unhealthy environmentalism in that material. In other words, technology itself is considered as a almighty means to solve environmental problems. Finally, the result in web-site analysis were that the "Environmental Class" of Ministry of Environment did not have sound environmentalism. The above result of study shows us that the most important thing in developing and using the environmental education materials is to have sound environmental values and EE perspective, to evaluate EE material with various point of view, to judge its result, and to use it.

  • PDF

A study on the Development of a Driving Simulator for Reappearance of Vehicle Motion (I) (차량 주행 감각 재현을 위한 운전 시뮬레이터 개발에 관한 연구 (I))

  • Park, Min-Kyu;Lee, Min-Cheol;Son, Kwon;Yoo, Wan-Suk;Han, Myung-Chul;Lee, Jang-Myung
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.16 no.6
    • /
    • pp.90-99
    • /
    • 1999
  • A vehicle driving simulator is a virtual reality device which a human being feels as if the one drives a vehicle actually. The driving simulator is used effectively for studying interaction of a driver-vehicle and developing vehicle system of a new concept. The driving simulator consists of a vehicle motion bed system, motion controller, visual and audio system, vehicle dynamic analysis system, cockpit system, and etc. In it is paper, the main procedures to develop the driving simulator are classified by five parts. First, a motion bed system and a motion controller, which can track a reference trajectory, are developed. Secondly, a performance evaluation of the motion bed system for the driving simulator is carried out using LVDTs and accelerometers. Thirdly, a washout algorithm to realize a motion of an actual vehicle in the driving simulator is developed. The algorithm changes the motion space of a vehicle into the workspace of the driving simulator. Fourthly, a visual and audio system for feeling higher realization is developed. Finally, an integration system to communicate and monitor between sub systems is developed.

  • PDF

An Audio-Visual Teaching Aid (AVTA) with Scrolling Display and Speech to Text over the Internet

  • Davood Khalili;Chung, Wan-Young
    • Proceedings of the IEEK Conference
    • /
    • 2003.07c
    • /
    • pp.2649-2652
    • /
    • 2003
  • In this Paper, an Audio-Visual Teaching aid (AVTA) for use in a classroom and with Internet is presented. A system, which was designed and tested, consists of a wireless Microphone system, Text to Speech conversion Software, Noise filtering circuit and a Computer. An IBM compatible PC with sound card and Network Interface card and a Web browser and a voice and text messenger service were used to provide slightly delayed text and also voice over the internet for remote teaming, while providing scrolling text from a real time lecture in a classroom. The motivation for design of this system, was to aid Korean students who may have difficulty in listening comprehension while have, fairly good reading ability of text. This application of this system is twofold. On one hand it will help the students in a class to view and listen to a lecture, and on the other hand, it will serve as a vehicle for remote access (audio and text) for a classroom lecture. The project provides a simple and low cost solution to remote learning and also allows a student to have access to classroom in emergency situations when the student, can not attend a class. In addition, such system allows the student in capturing a teacher's lecture in audio and text form, without the need to be present in class or having to take many notes. This system will therefore help students in many ways.

  • PDF

Visual Object Tracking Fusing CNN and Color Histogram based Tracker and Depth Estimation for Automatic Immersive Audio Mixing

  • Park, Sung-Jun;Islam, Md. Mahbubul;Baek, Joong-Hwan
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.14 no.3
    • /
    • pp.1121-1141
    • /
    • 2020
  • We propose a robust visual object tracking algorithm fusing a convolutional neural network tracker trained offline from a large number of video repositories and a color histogram based tracker to track objects for mixing immersive audio. Our algorithm addresses the problem of occlusion and large movements of the CNN based GOTURN generic object tracker. The key idea is the offline training of a binary classifier with the color histogram similarity values estimated via both trackers used in this method to opt appropriate tracker for target tracking and update both trackers with the predicted bounding box position of the target to continue tracking. Furthermore, a histogram similarity constraint is applied before updating the trackers to maximize the tracking accuracy. Finally, we compute the depth(z) of the target object by one of the prominent unsupervised monocular depth estimation algorithms to ensure the necessary 3D position of the tracked object to mix the immersive audio into that object. Our proposed algorithm demonstrates about 2% improved accuracy over the outperforming GOTURN algorithm in the existing VOT2014 tracking benchmark. Additionally, our tracker also works well to track multiple objects utilizing the concept of single object tracker but no demonstrations on any MOT benchmark.