• Title/Summary/Keyword: Audio-Visual Information

Search Result 207, Processing Time 0.031 seconds

Telemedicine robot system for visual inspection and auscultation using WebRTC (WebRTC를 이용한 육안 검사 및 청진용 원격진료 로봇 시스템)

  • Jae-Sam Park
    • Journal of Advanced Navigation Technology
    • /
    • v.27 no.1
    • /
    • pp.139-145
    • /
    • 2023
  • When a doctor examines a patient in a hospital, the doctor directly checks the patient's condition and conducts a face-to-face diagnosis through dialogue with the patient. However, it is often difficult for doctors to directly treat patients. Recently, several types of telemedicine systems have been developed. However, the systems have lack of capabilities to observe heart disease, neck condition, skin condition, inside ear condition, etc. To solve this problem, in this paper, an interactive telemedicine robot system with autonomous driving in a room capable of visual examination and auscultation of patients is developed. The developed robot can be controlled remotely through the WebRTC platform to move toward the patient and check a patient's condition under the doctor's observation using the multi-joint robot arm. The video information, audio information, patient's heart sound, and other data obtained remotely from patients can be transmitted to a doctor through the web RTC platform. The developed system can be applied to the various places where doctors are not possible to attend.

A Real-time Pigsty Monitoring System Based on Audio/Visual Sensors (A/V 센서 기반의 실시간 돈사 모니터링 시스템)

  • Oh, Seunggeun;In, Kyeongjun;Chung, Yongwha;Chang, Hong-Hee;Park, Daihee
    • Annual Conference of KIPS
    • /
    • 2012.11a
    • /
    • pp.1162-1165
    • /
    • 2012
  • 어미로부터 생후 21일령(또는 28일령)에 젖을 때는 어린 자돈들은 면역력이 약하여 통상 폐사율이 30~40%까지 치솟는 등 자돈 관리가 국내 양돈 농가의 가장 큰 문제 중 하나로 인식되고 있다. 본 논문에서는 이러한 양돈 농가의 문제를 해결하기 위하여 자돈사(새끼돼지 축사)에 카메라와 마이크를 설치하고 획득된 영상과 소리 정보를 이용하여 자돈들을 모니터링하는 시스템을 제안한다. 제안된 시스템은 실시간으로 유입되는 영상과 소리 스트림 데이터로부터 각각 움직임 벡터와 평균 피치 값을 추출하여 이미 설정된 정상 상황의 임계치 값을 넘는 순간부터를 불특정 이상 상황이라 판단한다. 실제, 경상남도 함양군의 한 돼지 농장에 A/V 센서 기반의 실험 환경을 구축하고 2012년 6월 한 달간의 이유자돈 돈사의 모니터링 데이터 셋을 취득하였고 전반기 15일간의 데이터 셋을 이용하여 자돈사 모니터링 시스템의 프로토타입을 설계 구현하였으며 후반기 15일간의 A/V 스트림 데이터로는 검증 실험을 수행하였다.

Blind Image Quality Assessment on Gaussian Blur Images

  • Wang, Liping;Wang, Chengyou;Zhou, Xiao
    • Journal of Information Processing Systems
    • /
    • v.13 no.3
    • /
    • pp.448-463
    • /
    • 2017
  • Multimedia is a ubiquitous and indispensable part of our daily life and learning such as audio, image, and video. Objective and subjective quality evaluations play an important role in various multimedia applications. Blind image quality assessment (BIQA) is used to indicate the perceptual quality of a distorted image, while its reference image is not considered and used. Blur is one of the common image distortions. In this paper, we propose a novel BIQA index for Gaussian blur distortion based on the fact that images with different blur degree will have different changes through the same blur. We describe this discrimination from three aspects: color, edge, and structure. For color, we adopt color histogram; for edge, we use edge intensity map, and saliency map is used as the weighting function to be consistent with human visual system (HVS); for structure, we use structure tensor and structural similarity (SSIM) index. Numerous experiments based on four benchmark databases show that our proposed index is highly consistent with the subjective quality assessment.

Design and Implementation of Smart Pen based User Interface System for U-learning (U-Learning 을 위한 스마트펜 인터페이스 시스템 디자인 및 개발)

  • Shim, Jae-Youen;Kim, Seong-Whan
    • Annual Conference of KIPS
    • /
    • 2010.11a
    • /
    • pp.1388-1391
    • /
    • 2010
  • In this paper, we present a design and implementation of U-learning system using pen based augmented reality approach. Student has been given a smart pen and a smart study book, which is similar to the printed material already serviced. However, we print the study book using CMY inks, and embed perceptually invisible dot patterns using K ink. Smart pen includes (1) IR LED for illumination, IR pass filter for extracting the dot patterns, and (3) camera for image captures. From the image sequences, we perform topology analysis which determines the topological distance between dot pixels, and perform error correction decoding using four position symbols and five CRC symbols. When a student touches a smart study books with our smart pen, we show him/her multimedia (visual/audio) information which is exactly related with the selected region. Our scheme can embed 16 bit information, which is more than 200% larger than previous scheme, which supports 7 bits or 8 bits information.

Design of a Three Dimensional Audio System for Multicast Conferencing (멀티캐스트 화상회의를 위한 3-D 음향시스템 설계)

  • 김영오;고대식
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.25 no.1B
    • /
    • pp.71-76
    • /
    • 2000
  • On multimedia teleconferencing system existing a number of participants, face of the participants can beperceived by visual image. However, differentiation of each participant's voice and spaciousness sense are very hard since voice of all participants is processed with one dimensional data. In this paper, we implemented three dimensional audio rendering system using the HRTF(Head Related Transfer Function) and distance sense reproduction method and determined the optimal location of the participants for teleconferencing system. In the results of the listening test using elevation and azimuth angle, we showed that directional perception of the azimuth angles were better than that of the elevation angles. Specially, we showed that participant location using the HRTFS of the azimuth angle 10" , 90" , 270" and350" was efficient in teleconferencing system existing four participants. We also proposed that distance cue was used for enhancement of the reality and location of many participants more than five.ipants more than five.

  • PDF

Implementation of SMIL Editor for Multimedia Broadcasting (멀티미디어 방송을 위한 SMIL 편집 시스템 구현)

  • 장대영;김창수;정회경
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.8 no.3
    • /
    • pp.622-629
    • /
    • 2004
  • Recently, as digital broadcasting and internet are spreaded out of the world, we can easily use informations with less restrictions of time and space. According to the current trends, concerns for the ways of representing multimedia data has been rapidly increased, and users demand the services with integrated document that takes not only simple text and image but also time varying audio-visual data. Therefore, in 1998, W3C presented an international standard, SMIL in order to solve multimedia object representation and synchronization problems. By using SMIL, various multimedia elements can be integrated as a multimedia document with proper view in a space and time. Using this SMIL document, we can create new internet radio broadcasting service that delivers not only audio data but also various text, image and video. In this paper, we describe on a SMIL document editor for the common users to be able to represent time varying multimedia data with special layout and synchronization of time and space.

Multimedia Technologies for Teaching Musical Art under Present-day Conditions

  • Svitlana Huralna;Nataliia Demianko;Nataliia Sulaieva;Viktoriia Irkliienko;Tetiana Horokhivska
    • International Journal of Computer Science & Network Security
    • /
    • v.24 no.5
    • /
    • pp.165-171
    • /
    • 2024
  • The processes of society's informatization and digitalization necessitate the widespread use of new pedagogical technologies. Through these technologies, comprehensive disclosure of didactic functions of new methods of educational activity and the realization of the potential and creative potential. The use of information and computer multimedia technologies in teaching music art is especially relevant in the intensification of the development of interactive technologies, the transition to mixed forms of learning, and a period of socio-economic and sociopolitical upheavals. The study aims to substantiate the theoretical and applied principles of the analysis of multimedia technology learning musical art in modern conditions and assess the status and trends in their use in conducting educational activities. The study uses general scientific and unique methods of economic analysis, in particular, analysis and synthesis, analogy and comparison, generalization and systematization, and graphic ways. Regarding the results of the study of multimedia technologies for teaching musical art in current conditions, it was found that they contribute to the development of the seeker's creative, creative, and cognitive activity, have a positive impact on learning material, and diversify the educational process. Multimedia technologies such as presentations, programs for watching a video, listening to audio, music and singing karaoke, electronic encyclopedias, and Internet resources are proven to be the most used in music education. They have several qualitative and quantitative advantages, manifested in the possibilities of audio-visual presentation of educational material and significantly higher information density. It is suggested to strengthen the use of such computer programs as Microsoft Word, Ahead Nero, Finale, Adobe Audition, Sound Forge, and Microsoft PowerPoint for musical art classes.

Status and Needs for Nutrition Services for Infants and Preschoolers among Public Health Center Workers and Infants Mothers (보건소 영유아 영양사업 실태와 보건소 종사자와 영유아모의 영양사업 요구도)

  • 구재옥;최경숙
    • Korean Journal of Community Nutrition
    • /
    • v.6 no.3
    • /
    • pp.354-360
    • /
    • 2001
  • This study was carried out to investigate the present status of nutrition services for infants in public health centers and the need for nutrition services of health workers and infants mothers. The study subjects were 146 health workers and 197 infants mothers. The results were as follows : At present, the only major nutrition services for infants were vaccination and dental care. Proper nutrition management services were available to infants. Nutrition knowledge scores were 16.8 for health workers and 15.3 for mothers out of 20 possible points. Health workers strongly demanded a well-organized nutrition education program, government support, audio-visual materials and the employment of a community nutritionist. The public health workers, in particular, demanded the development of education programs for breastfeeding and weaning. The infants mothers demanded services of nutrition information and teaching of cooking and menu planning. Based on this, the results suggest that the employment of a community nutritionist and the development of practical nutrition service programs for infants are needed very urgently for public health centers.

  • PDF

Modelling of the Information Process with Visual and Audio in Human Brain (두뇌의 시$\cdot$청각 정보처리 과정의 모델링)

  • 김성주;서재용;조현찬;김성현;전홍태
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 2002.05a
    • /
    • pp.187-190
    • /
    • 2002
  • 인간의 두뇌에서는 갖가지 다양한 형태의 입력들을 이용하여 동시에 여러 가지의 판단, 추론 및 기억 등의 기능을 수행한다 이러한 이유로 인간 두뇌는 거대한 지능형 정보처리기라고 할 수 있다 현재 정보처리 메커니즘은 다양한 형태로 발달되고 있지만 그 중에서도 지능형 정보처리 메커니즘으로는 소프트 컴퓨팅 기법을 응용한 것이 대부분이다. 본 논문에서는 소프트 컴퓨팅 기법을 이용하여 두뇌에서의 시각, 청각의 정보처리 과정을 하나의 구조로 모델링하고자 한다. 시각에서의 정보와 청각에서의 정보는 각기 다른 모듈에서 처리되는 방식을 취하고 있으며, 최종적으로 두 감각 정보를 이용한 처리가 가능하도록 모듈형태의 전체적인 구조를 지니고 있다. 상이한 두 가지의 정보를 동시에 처리하는 과정을 모델링함으로써 복잡한 문제의 해결 및 다양한 경우에 대한 고려를 수행하여 인간 두뇌 모델링의 기초를 마련하고자 한다.

  • PDF

A Blind Video Watermarking Technique Using Luminance Masking and DC Modulus Algorithm (휘도 마스킹과 DC Modulus 알고리즘을 이용한 비디오 워터마킹)

  • Jang Yong-Won;Kim, In-Taek;Han, Seung-Soo
    • The Transactions of the Korean Institute of Electrical Engineers D
    • /
    • v.51 no.7
    • /
    • pp.302-307
    • /
    • 2002
  • Digital watermarking is the technique, which embeds an invisible signal including signal including owner identification and copy control information into multimedia data such as audio, video, and images for copyright protection. A new MPEG watermark embedding algorithm using complex block effect based on the Human Visual System(HVS) is introduced in this paper. In this algorithm, $8{\times}8$ dark blocks are selected, and the watermark is embedded in the DC component of the discrete cosine transform(DCT) by using quantization and modulus calculation. This algorithm uses a blind watermark retrieval technique, which detects the embedded watermark without using the original image. The experimental results show that the proposed watermark technique is robust against MPEG coding, bitrate changes, and various GOP(Group of Picture) changes.