• Title/Summary/Keyword: Visual and Audio System

Search Result 148, Processing Time 0.025 seconds

Telemedicine robot system for visual inspection and auscultation using WebRTC (WebRTC를 이용한 육안 검사 및 청진용 원격진료 로봇 시스템)

  • Jae-Sam Park
    • Journal of Advanced Navigation Technology
    • /
    • v.27 no.1
    • /
    • pp.139-145
    • /
    • 2023
  • When a doctor examines a patient in a hospital, the doctor directly checks the patient's condition and conducts a face-to-face diagnosis through dialogue with the patient. However, it is often difficult for doctors to directly treat patients. Recently, several types of telemedicine systems have been developed. However, the systems have lack of capabilities to observe heart disease, neck condition, skin condition, inside ear condition, etc. To solve this problem, in this paper, an interactive telemedicine robot system with autonomous driving in a room capable of visual examination and auscultation of patients is developed. The developed robot can be controlled remotely through the WebRTC platform to move toward the patient and check a patient's condition under the doctor's observation using the multi-joint robot arm. The video information, audio information, patient's heart sound, and other data obtained remotely from patients can be transmitted to a doctor through the web RTC platform. The developed system can be applied to the various places where doctors are not possible to attend.

Design of a Three Dimensional Audio System for Multicast Conferencing (멀티캐스트 화상회의를 위한 3-D 음향시스템 설계)

  • 김영오;고대식
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.25 no.1B
    • /
    • pp.71-76
    • /
    • 2000
  • On multimedia teleconferencing system existing a number of participants, face of the participants can beperceived by visual image. However, differentiation of each participant's voice and spaciousness sense are very hard since voice of all participants is processed with one dimensional data. In this paper, we implemented three dimensional audio rendering system using the HRTF(Head Related Transfer Function) and distance sense reproduction method and determined the optimal location of the participants for teleconferencing system. In the results of the listening test using elevation and azimuth angle, we showed that directional perception of the azimuth angles were better than that of the elevation angles. Specially, we showed that participant location using the HRTFS of the azimuth angle 10" , 90" , 270" and350" was efficient in teleconferencing system existing four participants. We also proposed that distance cue was used for enhancement of the reality and location of many participants more than five.ipants more than five.

  • PDF

A Study of 3D Sound Modeling based on Geometric Acoustics Techniques for Virtual Reality (가상현실 환경에서 기하학적 음향 기술 기반의 3차원 사운드 모델링 기술에 관한 연구)

  • Kim, Cheong Ghil
    • Journal of Satellite, Information and Communications
    • /
    • v.11 no.4
    • /
    • pp.102-106
    • /
    • 2016
  • With the popularity of smart phones and the help of high-speed wireless communication technology, high-quality multimedia contents have become common in mobile devices. Especially, the release of Oculus Rift opens a new era of virtual reality technology in consumer market. At the same time, 3D audio technology which is currently used to make computer games more realistic will soon be applied to the next generation of mobile phone and expected to offer a more expansive experience than its visual counterpart. This paper surveys concepts, algorithms, and systems for modeling 3D sound virtual environment applications. To do this, we first introduce an important design principle for audio rendering based on physics-based geometric algorithms and multichannel technologies, and introduce an audio rendering pipeline to a scene graph-based virtual reality system and a hardware architecture to model sound propagation.

Music summarization using visual information of music and clustering method

  • Kim, Sang-Ho;Ji, Mi-Kyong;Kim, Hoi-Rin
    • 한국HCI학회:학술대회논문집
    • /
    • 2006.02a
    • /
    • pp.400-405
    • /
    • 2006
  • In this paper, we present effective methods for music summarization which summarize music automatically. It could be used for sample music of on-line digital music provider or some music retrieval technology. When summarizing music, we use different two methods according to music length. First method is for finding sabi or chorus part of music which can be regarded as the most important part of music and the second method is for extracting several parts which are in different structure or have different mood in the music. Our proposed music summarization system is better than conventional system when structure of target music is explicit. The proposed method could generate just one important segment of music or several segments which have different mood in the music. Thus, this scheme will be effective for summarizing music in several applications such as online music streaming service and sample music for Tcommerce.

  • PDF

Design of Emergency Evacuation Guiding System with Serially Connected Multi-channel Speakers (직렬 스피커 연결을 이용한 비상 대피 유도 시스템의 설계)

  • Chung, Han-Vit;Kim, Tea-Wan;Chung, Yun-Mo
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.48 no.4
    • /
    • pp.142-152
    • /
    • 2011
  • In general, existing emergency evacuation guiding systems depend on visual techniques like emergency lights or LEDs. Actually people in the case of fire emergency condition may not obtain a range of view because of smoke from the fire. This paper introduces a technique to design an emergency guiding system using directivity sound to cope with this problem. In this case all speakers are serially connected for audio signal transmission in a serial fashion to achieve convenient speaker installation. Floyd algorithm is used to find shortest evacuation paths. Because serially connected multi-channel speakers are weak in case of disconnection, this paper uses a technique to solve the diagnostic problem. In the proposed system, a PC based on the USB protocol is used for control and observation. The system has achievements, such as increasing evacuation rate under emergency conditions, and serial transmission of audio signal for easy maintenance and low installation cost.

A Study on Implementation of Objective Quality Assurance System for Mobile Multimedia Video (이동 멀티미디어 영상의 객관적인 품질측정 시스템 구현에 관한 연구)

  • Paek, Seung-Eun;Ohn, Jin-Ho;Joo, Hae-Jong;Hong, Bong-Wha;Kim, Eun-Won;Park, Young-Bae
    • Proceedings of the IEEK Conference
    • /
    • 2007.07a
    • /
    • pp.487-488
    • /
    • 2007
  • This Paper provides perceptual metrics for video quality based on properties of human visual system, and audio quality based on human audition. All metrics work without reference signals, allowing non-intrusive, in-service measurements. A simple and easy-to-learn user interface displays the metrics and saves them in popular file formats like CSV.

  • PDF

A Study on the Development of a Selection System for Preservation Formats of Image-Type Electronic Records (이미지 유형 전자기록물의 보존포맷 선정체계 구축방안 연구)

  • Song, ChaeEun;Yang, Dongmin
    • The Korean Journal of Archival Studies
    • /
    • no.79
    • /
    • pp.343-387
    • /
    • 2024
  • Electronic records, characterized by their inherent volatility and instability, necessitate sustainable preservation measures to ensure their long-term accessibility. The National Archives of Korea has instituted a selection system for preservation formats tailored predominantly for document-type electronic records. However, this system falls short in accommodating other record types such as audiovisual records. This study endeavors to broaden the applicability of the existing system, with a concentrated focus on image-type electronic records, and to formulate foundational guidelines for their long-term preservation. In South Korea, image-type electronic records rank as the second most prevalent category following document-type. The image-type electronic records are the most basic form of audio-visual records, and research on this lays the foundation for future discussions on other audio-visual records. Consequently, this research has led to the development of a selection system for preservation formats specifically for image-type electronic records. This system is designed to facilitate the prompt and efficient evaluation of preservation format suitability, even in the context of emerging image formats. The efficacy of this system was validated through its application to extant image formats, resulting in the selection of TIFF, JFIF, and PNG as the optimal preservation formats. The outcomes of this study offer valuable insights and practical reference points for future preservation format evaluations within the field of electronic record management.

Automatic measurement of voluntary reaction time after audio-visual stimulation and generation of synchronization signals for the analysis of evoked EEG (시청각자극 후의 피험자의 자의적 반응시간의 자동계측과 유발뇌파분석을 위한 동기신호의 생성)

  • 김철승;엄광문;손진훈
    • Science of Emotion and Sensibility
    • /
    • v.6 no.4
    • /
    • pp.15-23
    • /
    • 2003
  • Recently, there have been many attempts to develop BCI (brain computer interface) based on EEG (electroencephalogram). Measurement and analysis of EEG evoked by particular stimulation is important for the design of brain wave pattern and interface of BCI. The purpose of this study is to develop a general-purpose system that measures subject's reaction time after audio-visual stimulation which can work together with any other biosignal measurement systems. The entire system is divided into four modules, which are stimulation signal generation, reaction time measurement, evoked potential measurement and synchronization. Stimulation signal generation module was implemented by means of Flash. Measurement of the reaction time (the period between the answer request and the subject reaction) was achieved by self-made microcontroller system. EEG measurement was performed using the ready-made hardware and software without any modification. Synchronization of all modules was achieved by, first, the black-and-white signals on the stimulation screen synchronized with the problem presentation and the answer request, second, the photodetectors sensing the signals. The proposed method offers easy design of purpose-specific system only by adding simple modules (reaction time measurement, synchronization) to the ready-made stimulation and EEG system, and therefore, it is expected to accelerate the researches requiring the measurement of evoked response and reaction time.

  • PDF

A Speech Recognition System based on a New Endpoint Estimation Method jointly using Audio/Video Informations (음성/영상 정보를 이용한 새로운 끝점추정 방식에 기반을 둔 음성인식 시스템)

  • 이동근;김성준;계영철
    • Journal of Broadcast Engineering
    • /
    • v.8 no.2
    • /
    • pp.198-203
    • /
    • 2003
  • We develop the method of estimating the endpoints of speech by jointly using the lip motion (visual speech) and speech being included in multimedia data and then propose a new speech recognition system (SRS) based on that method. The endpoints of noisy speech are estimated as follows : For each test word, two kinds of endpoints are detected from visual speech and clean speech, respectively Their difference is made and then added to the endpoints of visual speech to estimate those for noisy speech. This estimation method for endpoints (i.e. speech interval) is applied to form a new SRS. The SRS differs from the convention alone in that each word model in the recognizer is provided an interval of speech not Identical but estimated respectively for the corresponding word. Simulation results show that the proposed method enables the endpoints to be accurately estimated regardless of the amount of noise and consequently achieves 8 o/o improvement in recognition rate.

Study on Health Education Providing System in Korea - Health Education Policy- (한국의 보건교육 제공체계 연구 - 보건교육 정책을 중심으로 -)

  • 김대희;임재은
    • Korean Journal of Health Education and Promotion
    • /
    • v.8 no.2
    • /
    • pp.6-23
    • /
    • 1991
  • The method of this study is as follows : First, the interview with the civil servants concerned. Second, the review of the pertinent public ledgers. Third, the review of the existing reference. The results of this study are as follows. 1) The health education system in Korea has only the head. But it does not have the trunk and the limbs that it can move with. 2) Health educator should have the essential work that is the planning and coordinating work of intersectoral health education programs. They should also have the trust works from other sectors. 3) The proposition in the health education policy is as follows: First, the department or section of health education should be made newly in the public health organization. Second, at the level of province(Do) and county(Gun), the health educator should be stationed. Third, most training courses of health care members should involve health education subjects. Fourth, the health center at the level of county(Gun) should have a minimum material and audio-visual equipment of health education. Fifth, regular health education should be put into practice through local broadcast or CATV etc.. Sixth, school health education should be consolidated. Seventh, village health worker(nurse) should be stationed at the level of health center, so that he(she) can work as health educator. 4) The ultimate model of health education system is that of Fig. 5. But it is impossible to change the system synoptically. At first health educator should be stationed at health center. And then the system should be gradually organized.

  • PDF