• Title/Summary/Keyword: Audio and Video

Search Result 805, Processing Time 0.03 seconds

A Study on the Interactive Effect of Spoken Words and Imagery not Synchronized in Multimedia Surrogates for Video Gisting (비디오 의미 파악을 위한 멀티미디어 요약의 비동시적 오디오와 이미지 정보간의 상호 작용 효과 연구)

  • Kim, Hyun-Hee
    • Journal of the Korean Society for Library and Information Science
    • /
    • v.45 no.2
    • /
    • pp.97-118
    • /
    • 2011
  • The study examines the interactive effect of spoken words and imagery not synchronized in audio/image surrogates for video gisting. To do that, we conducted an experiment with 64 participants, under the assumption that participants would better understand the content of videos when viewing audio/image surrogates rather than audio or image surrogates. The results of the experiment showed that overall audio/image surrogates were better than audio or image surrogates for video gisting, although the unsynchronized multimedia surrogates made it difficult for some participants to pay attention to both audio and image when the content they present is very different.

constructing management system for video & audio material in the digital library (디지털도서관의 비디오 및 오디오자료 관리 시스템 구축)

  • 노영희
    • Journal of the Korean Society for information Management
    • /
    • v.15 no.1
    • /
    • pp.149-164
    • /
    • 1998
  • The study aims to construct a system which can provide multimedia materials, specifically, digitalized video and audio materials on the internet. To accomplish this objective, it investigates technology on constructing a VOD/AOD system, current situations on video and audio data management in domestic and internatinal broadcasting institution and information centers. The study proposes a VOD/AOD system which can effectively manage and disseminate these materials on the internet.

  • PDF

DTV Lip-Sync Test Using Embedded Audio-Video Time Indexed Signals (숨겨진 오디오 비디오 시간 인덱스 신호를 사용한 DTV 립싱크 테스트)

  • 한찬호;송규익
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.41 no.3
    • /
    • pp.155-162
    • /
    • 2004
  • This paper concentrated on lip synchronization (lip sync) test for DTV with respect to audio and video signals using a finite digital bitstream In this paper, we propose a new lip sync test method which does not effect on the current program by use of the transient effect area test signals (TATS) and audio-video time index lip sync test signals (TILS).the experimental result shows that the time difference between audio and video signal can be easily measured by captured oscilloscope waveform at any time.

Classification of TV Program Scenes Based on Audio Information

  • Lee, Kang-Kyu;Yoon, Won-Jung;Park, Kyu-Sik
    • The Journal of the Acoustical Society of Korea
    • /
    • v.23 no.3E
    • /
    • pp.91-97
    • /
    • 2004
  • In this paper, we propose a classification system of TV program scenes based on audio information. The system classifies the video scene into six categories of commercials, basketball games, football games, news reports, weather forecasts and music videos. Two type of audio feature set are extracted from each audio frame-timbral features and coefficient domain features which result in 58-dimensional feature vector. In order to reduce the computational complexity of the system, 58-dimensional feature set is further optimized to yield l0-dimensional features through Sequential Forward Selection (SFS) method. This down-sized feature set is finally used to train and classify the given TV program scenes using κ -NN, Gaussian pattern matching algorithm. The classification result of 91.6% reported here shows the promising performance of the video scene classification based on the audio information. Finally, the system stability problem corresponding to different query length is investigated.

A study on the design and implementation of the transport protocol for Audio/Video data transmission (음성 및 화상 데이타 전송을 위한 트랜스포트 프로토콜의 설계 및 구현에 관한 연구)

  • Kim, June;Lee, Kwang-Hui;An, Sun-Shin
    • Proceedings of the KIEE Conference
    • /
    • 1987.07b
    • /
    • pp.1053-1057
    • /
    • 1987
  • In this paper, we have studied a communication protocol which may provide Audio/Video data transmission in real time. Auido/Video data have its own characteristics. A new transport protocol with realtime constraint has been designed and implemented which performs dynamic error control and flow control depending on the characteristics of transmitted Audio/Video data. Since the receiving data can be predicted from the previously received data using the prediction function in Auido/Video data transmission, these functions are introduced in our transport protocol that may possibly improve the speed of data transmission and give a real time response. We have tested our transport protocol and measured the performance by the simulation. We assume that our transport protocol would be used in LAN environment. Our prime purpose is to provide a reliable and real time Auido/Video data transmission service.

  • PDF

A Synchronization of Audio/Video Stream on Software MPEG-1 Playback System (Software MPEG-1 재생 시스템을 위한 Audio/Video 스트림의 동기화)

  • 박태강;이호석
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 1998.10c
    • /
    • pp.303-305
    • /
    • 1998
  • MPGE(Moving Picture Expert Group)은 디지털 동영상 압축 부호화의 표준으로 자리잡고 있으며 MPEG-1에 이어 현재는 MPEG-2가 상용화되어 있는 실정이다. 복잡한 압축 기법의 적용으로 이를 재생하기 위해서는 전용의 하드웨어가 필요했지만 CPU의 성능이 향상됨에 따라 소프트웨어적으로 구현이 가능하게 되었다. 본 논문에서는 Software MPEG-1 Playback System에서 가장 큰 문제가 되는 Audio와 Video간의 동기화에 관한 기법을 제시한다.

  • PDF

Study on the Localization Concordance of Video and Audio (시선에 따른 영상 음향 정위 일치에 관한 연구)

  • Lee, Kyou-Won;Choi, Hae-Geun;Park, So-Youn;Park, Goo-Man;Kim, Seong-Kweon
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.13 no.6
    • /
    • pp.1293-1300
    • /
    • 2018
  • The $360^{\circ}$ video has a lot of image information and usefulness; however, the position of the audio source judged by hearing is different from the position on the screen. Therefore, human feels tired, the immersion decrease and user cant watch the video for Moreer time. In this paper, the concordance rate of the video and the audio localization is defined. The rate is expressed in a percentage. It means how much the system makes the sound localization real according to the position of the source on the screen. With this rate, the audio localization performance of immersive audio producing and playing system can be evaluated. It will be helpful for developers to make the higher performance system and expected to contribute to make makinguality system with reality.

Additional data packetizing method for providing multichannel audio service on T-DMB environment (지상파 DMB 환경에서 멀티채널 오디오 서비스를 제공하기 위한 부가정보 패킷화 방법 연구)

  • Lee, Yong-Ju;Seo, Jeong-Il;Beack, Seung-Kwon;Kang, Kyeong-Ok;Lim, Jong-Soo
    • Journal of Broadcast Engineering
    • /
    • v.14 no.3
    • /
    • pp.332-341
    • /
    • 2009
  • Terrestrial digital multimedia broadcasting(T-DMB) is one of mobile broadcasting services, and the commercial service was started in December 2005 in Korea. The performance targets of T-DMB are providing VCD(video CD) quality video and FM radio quality audio. In recent years, the researches for providing high quality video or audio service on T-DMB environments have been being carried out. To provide high-quality video or audio service, some additional data should be transmitted to the receiver as well as T-DMB video and audio data. Since the data rate for one T-DMB program is low, it is important to transmit the additional data at a low bit rate. In this paper, we propose a packetizing method for efficient transmission of the additional data to provide multichannel audio service on T-DMB environment.

Development of a Haptic Based Video and Audio Streaming Method (촉각기반 비디오 및 오디오 스트리밍 기술 개발)

  • You, Yong-Hee;Cho, Dong-Hyun;Lee, Hwan-Mun;Kim, Ki-Kwon;Jun, Kyung-Koo;Sung, Mee-Young
    • 한국HCI학회:학술대회논문집
    • /
    • 2009.02a
    • /
    • pp.538-541
    • /
    • 2009
  • In this paper, we explain a haptic based video and audio streaming method. The proposed method is to stream tactile and vibration information along with video and audio information. The video screen is divided into a grid, and each cell has tactile information which is corresponding to the content. At the same time, the sound stream is also analyzed and vibration information is applied. These data are streamed to clients and displayed through a haptic device and a vibration interface. So, a client will be more immersed into the video and audio by touching and getting vibrations.

  • PDF

Feasibility Study on Audio-Tactile Display via Spectral Modulation (스펙트럼 변조를 이용한 청각정보의 촉감재현 가능성 연구)

  • Kwak, Hyun-Koo;Kim, Whee-Kuk;Chung, Ju-No;Kang, Dae-Im;Park, Yon-Kyu;Koo, Min-Mo
    • Journal of the Korean Society for Precision Engineering
    • /
    • v.28 no.5
    • /
    • pp.638-647
    • /
    • 2011
  • Various approaches directly using vibrations of speakers have been suggested to effectively display the aural information such as the music to the hearing-impaired or the deaf. However, in these approaches, the human can't sense the frequency information over the maximum perceivable vibro-tactile frequency (around 1kHz). Therefore, in this study, an approach via spectral modulation of compressing the high frequency audio information into perceivable vibro-tactile frequency domain and outputting the modulated signals through the designated speakers is proposed. Then it is shown, through simulations of using Short-Time Fourier Transform (STFT) with Hanning windows and through preliminary experiments of using the vibro-tactile display testbed which is built and interfaced with a notebook PC, that the modulated signal of a natural sound composing sounds of a frog, a bird, and a water stream could produce the noise-free signal suitable enough for vibro-tactile speakers without causing Significant interfering disturbances, Lastly, for three different combinations of information provided to the subject, that is, i) with only video image, ii) with video image along with the modulated vibro-tactile stimuli as proposed in this study to the forearm of the subject, and iii) with video image along with full audio information, the effects to the human sense of reality and his emotion to given audio-video clips including various sounds and images are investigated and compared. It is shown from results of those experiments that the proposed method of providing modulated vibro-tactile stimuli along with the video images to the human has very high feasibility to transmit pseudo-aural sense to the human.