• Title/Summary/Keyword: visual-audio

Search Result 424, Processing Time 0.027 seconds

Audio Stress Effect on Visual ERP Stimulated by 3-dimensional Environment (청각 스트레스가 3차원 시자극 유발전위에 미치는 영향 분석)

  • 박찬희;홍철운;김남균
    • Journal of Biomedical Engineering Research
    • /
    • v.23 no.4
    • /
    • pp.301-308
    • /
    • 2002
  • This research was performed to analyze quantitatively how spiritual stress affects some ERPs on human through sight stimulus after the settlement of visual and auditory integration environment in three dimension space. We measured ERPs in the normal state and spiritual stress sessions separately. The subjects were 10 normal men and women and vital signs was recorded from Fpl, Fz, Cz, Pz, O1, O2's scalps. The experiment was done in isolated room where electro-magnetic effect do not affect. The result showed that P300's amplitude was a little higher under stress session and latent period in this resulted in longer time. We recorded through voltage variation the activity of brain which is in charge of human's perception. cognition, process of action and evaluated the effect of spiritual stress. We expected that the result of this research can be used to evaluate the malfunction of brain.

A Study on the Facilities Layout of Lower Floor and Space Characteristics Through Analysis of Newly Established Schools in Chungbuk since 2010 (충북의 2010년 이후 신설된 학교 분석을 통한 저층부 배치 시설 및 공간 특성 연구)

  • Kang, Hye-Jin;Jung, Jin-Ju
    • Journal of the Korean Institute of Educational Facilities
    • /
    • v.22 no.2
    • /
    • pp.3-13
    • /
    • 2015
  • The policy of the Ministry of education through the social awareness and issues are being changed. Accordingly, in response to the school building which also has to be changed. This study is Low-floor(1~2 floor) for high accessibility, important management and a lot of locomotion. This study is analysis by floor of newly established schools in Chungbuk. Facility and space on the possible low-floor situated are classified administrative zone, health zone, student support + local exchange zone, STEAM(creativity, personality) supporting zone. The administrative area includes administration office, principal's office and board rooms. The administrative zone is located against schoolyard. Because it is possible visual control of schoolyard. also it controls visitor access so it is placed near main entrance. Health zone is located near a special class, counseling center and wee class for emergency situation. and is located near schoolyard for visual control. Student support + local exchange area includes library and computer lab, audio-visual room, auditorium or gymnasium. It put more emphasis resident welfare, culture and education. So it opens for local residents. It is located center of few stories or near entrance. STEAM(creativity, personality) supports science lab, art room, family room. It is possible such a theory class, experience class and indoor and outdoor class. It is located few floors. This study is used as a reference for school building projects planing.

A Speech Recognition System based on a New Endpoint Estimation Method jointly using Audio/Video Informations (음성/영상 정보를 이용한 새로운 끝점추정 방식에 기반을 둔 음성인식 시스템)

  • 이동근;김성준;계영철
    • Journal of Broadcast Engineering
    • /
    • v.8 no.2
    • /
    • pp.198-203
    • /
    • 2003
  • We develop the method of estimating the endpoints of speech by jointly using the lip motion (visual speech) and speech being included in multimedia data and then propose a new speech recognition system (SRS) based on that method. The endpoints of noisy speech are estimated as follows : For each test word, two kinds of endpoints are detected from visual speech and clean speech, respectively Their difference is made and then added to the endpoints of visual speech to estimate those for noisy speech. This estimation method for endpoints (i.e. speech interval) is applied to form a new SRS. The SRS differs from the convention alone in that each word model in the recognizer is provided an interval of speech not Identical but estimated respectively for the corresponding word. Simulation results show that the proposed method enables the endpoints to be accurately estimated regardless of the amount of noise and consequently achieves 8 o/o improvement in recognition rate.

Telemedicine robot system for visual inspection and auscultation using WebRTC (WebRTC를 이용한 육안 검사 및 청진용 원격진료 로봇 시스템)

  • Jae-Sam Park
    • Journal of Advanced Navigation Technology
    • /
    • v.27 no.1
    • /
    • pp.139-145
    • /
    • 2023
  • When a doctor examines a patient in a hospital, the doctor directly checks the patient's condition and conducts a face-to-face diagnosis through dialogue with the patient. However, it is often difficult for doctors to directly treat patients. Recently, several types of telemedicine systems have been developed. However, the systems have lack of capabilities to observe heart disease, neck condition, skin condition, inside ear condition, etc. To solve this problem, in this paper, an interactive telemedicine robot system with autonomous driving in a room capable of visual examination and auscultation of patients is developed. The developed robot can be controlled remotely through the WebRTC platform to move toward the patient and check a patient's condition under the doctor's observation using the multi-joint robot arm. The video information, audio information, patient's heart sound, and other data obtained remotely from patients can be transmitted to a doctor through the web RTC platform. The developed system can be applied to the various places where doctors are not possible to attend.

Implementation of Text-to-Audio Visual Speech Synthesis Using Key Frames of Face Images (키프레임 얼굴영상을 이용한 시청각음성합성 시스템 구현)

  • Kim MyoungGon;Kim JinYoung;Baek SeongJoon
    • MALSORI
    • /
    • no.43
    • /
    • pp.73-88
    • /
    • 2002
  • In this paper, for natural facial synthesis, lip-synch algorithm based on key-frame method using RBF(radial bases function) is presented. For lips synthesizing, we make viseme range parameters from phoneme and its duration information that come out from the text-to-speech(TTS) system. And we extract viseme information from Av DB that coincides in each phoneme. We apply dominance function to reflect coarticulation phenomenon, and apply bilinear interpolation to reduce calculation time. At the next time lip-synch is performed by playing the synthesized images obtained by interpolation between each phonemes and the speech sound of TTS.

  • PDF

Prevention for the elderly safety issues to prepare for an aged society (고령화사회대비 노인안전사고 예방방안)

  • Moon, Gee-Sik;Choi, Jung-Kweon;Park, Hee-Jin
    • The Korean Journal of Emergency Medical Services
    • /
    • v.12 no.2
    • /
    • pp.71-84
    • /
    • 2008
  • The usual reasons for elderly safety accidents include lack of care for disaster, physical disability, and an error of judgment and so on. But it is true that accidents will occur continuously with the afore-mentioned causes. Against the elderly safety accidents, safety is the main prerequisite for leading the successful and easy life in the elderly. Therefore, this study is purposed to provide the way of thinking about elderly safety issues by suggesting the methods and contents of education program. This study is specifically focused on developing audio-visual materials involved in all the safety accidents and researching the effect of safety education ability through materials with a view to identify the substantial problems. Education program should make a continuous and long term study so that the curricula of the safety accidents prevention education can be done systematically.

  • PDF

Chinese Instrument with Sound Visualization function (사운드 시각화 기능을 가진 중국 악기)

  • Xue, Xiangrong;Yuan, Menghe;Yang, Weitiang;Na, Min-Ju;Lee, Kang-Hee
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2013.01a
    • /
    • pp.271-272
    • /
    • 2013
  • The music with the times, evolved from analogous tape music to digital music. New authoring tools, interfaces, and applications make us to produce high quality music using cheap equipments. Inspired by this concept, we design an classical chinese style-instrument with the audio-visual interactive function. It enables a user to compose music and to see a vivid picture at the same time.

  • PDF

Music summarization using visual information of music and clustering method

  • Kim, Sang-Ho;Ji, Mi-Kyong;Kim, Hoi-Rin
    • 한국HCI학회:학술대회논문집
    • /
    • 2006.02a
    • /
    • pp.400-405
    • /
    • 2006
  • In this paper, we present effective methods for music summarization which summarize music automatically. It could be used for sample music of on-line digital music provider or some music retrieval technology. When summarizing music, we use different two methods according to music length. First method is for finding sabi or chorus part of music which can be regarded as the most important part of music and the second method is for extracting several parts which are in different structure or have different mood in the music. Our proposed music summarization system is better than conventional system when structure of target music is explicit. The proposed method could generate just one important segment of music or several segments which have different mood in the music. Thus, this scheme will be effective for summarizing music in several applications such as online music streaming service and sample music for Tcommerce.

  • PDF

Models for evaluating and predicting the user satisfaction of product designs (제품다자인의 감성만족도 평가 및 예측모델 개발)

  • Han, Seong-Ho
    • Journal of the Ergonomics Society of Korea
    • /
    • v.20 no.1
    • /
    • pp.87-113
    • /
    • 2001
  • This study introduces the concept of image/impression of a product design, human interface elements, and the relationships between them. It is assumed that the human interface can be decomposed into detailed design elements, called human interface elements. This study attempts to build functional relationships between the image/impression of a product and human interface elements. Two different human factors experiments were conducted to demonstrate the effectiveness of the approach suggested in this study. A total of 35 audio/visual consumer electronics products (e.g., CD players, VCRs) were shown on a display screen and the subjects were instructed to evaluate them in terms of eight image/impression dimensions. One experiment was conducted using Korean subjects while the other using American subjects. The functional relationships were modeled by using the multiple linear regression technique. Similarity and difference between the Korean and the American subjects were analyzed. The approach suggested in this study is expected to help designers and developers identify important design variables to enhance the subjective satisfaction of a product design.

  • PDF

Analysis of Roles of Lighting and Background Musik for Storytelling - a Case Study of Disney's Short Animated Film (스토리텔링에서의 조명과 배경음악의 역할 분석 -디즈니 단편 애니메이션 <페이퍼맨>을 중심으로)

  • Park, Eun-Hea
    • Journal of Korea Multimedia Society
    • /
    • v.18 no.8
    • /
    • pp.988-995
    • /
    • 2015
  • In 2013, Academy Award for Best Animated Short Film was granted to Walt Disney's short animation, (2012). With various aspects of its excellence, I focus on the very effective use of digital lightings and underscores for storytelling as its success factors. In this respect, this paper aims at analyzing the roles of the visual factors, especially tone, contrast, etc. created by lightings, and audio factors, especially underscores, in the film's story development. I find that can be characterized by the well-built story structure with distinct three acts. The main stream of the story is expressed with the overall mood that is created by the fine adjustments of brightness of the main light, and contrast. And the direction and the intensity of the lighting successfully describe the emotions of the characters in each scene. In addition, I find that properly chosen and positioned underscores make the development of the story more dynamic and more harmonized.