• Journal of the Korean Society for Library and Information Science
• /
• v.45 no.2
• /
• pp.97-118
• /
• 2011

The study examines the interactive effect of spoken words and imagery not synchronized in audio/image surrogates for video gisting. To do that, we conducted an experiment with 64 participants, under the assumption that participants would better understand the content of videos when viewing audio/image surrogates rather than audio or image surrogates. The results of the experiment showed that overall audio/image surrogates were better than audio or image surrogates for video gisting, although the unsynchronized multimedia surrogates made it difficult for some participants to pay attention to both audio and image when the content they present is very different.

• Journal of the Korean Society for information Management
• /
• v.15 no.1
• /
• pp.149-164
• /
• 1998

The study aims to construct a system which can provide multimedia materials, specifically, digitalized video and audio materials on the internet. To accomplish this objective, it investigates technology on constructing a VOD/AOD system, current situations on video and audio data management in domestic and internatinal broadcasting institution and information centers. The study proposes a VOD/AOD system which can effectively manage and disseminate these materials on the internet.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.41 no.3
• /
• pp.155-162
• /
• 2004

This paper concentrated on lip synchronization (lip sync) test for DTV with respect to audio and video signals using a finite digital bitstream In this paper, we propose a new lip sync test method which does not effect on the current program by use of the transient effect area test signals (TATS) and audio-video time index lip sync test signals (TILS).the experimental result shows that the time difference between audio and video signal can be easily measured by captured oscilloscope waveform at any time.

• The Journal of the Acoustical Society of Korea
• /
• v.23 no.3E
• /
• pp.91-97
• /
• 2004

In this paper, we propose a classification system of TV program scenes based on audio information. The system classifies the video scene into six categories of commercials, basketball games, football games, news reports, weather forecasts and music videos. Two type of audio feature set are extracted from each audio frame-timbral features and coefficient domain features which result in 58-dimensional feature vector. In order to reduce the computational complexity of the system, 58-dimensional feature set is further optimized to yield l0-dimensional features through Sequential Forward Selection (SFS) method. This down-sized feature set is finally used to train and classify the given TV program scenes using κ -NN, Gaussian pattern matching algorithm. The classification result of 91.6% reported here shows the promising performance of the video scene classification based on the audio information. Finally, the system stability problem corresponding to different query length is investigated.

• Proceedings of the KIEE Conference
• /
• 1987.07b
• /
• pp.1053-1057
• /
• 1987

In this paper, we have studied a communication protocol which may provide Audio/Video data transmission in real time. Auido/Video data have its own characteristics. A new transport protocol with realtime constraint has been designed and implemented which performs dynamic error control and flow control depending on the characteristics of transmitted Audio/Video data. Since the receiving data can be predicted from the previously received data using the prediction function in Auido/Video data transmission, these functions are introduced in our transport protocol that may possibly improve the speed of data transmission and give a real time response. We have tested our transport protocol and measured the performance by the simulation. We assume that our transport protocol would be used in LAN environment. Our prime purpose is to provide a reliable and real time Auido/Video data transmission service.

• Proceedings of the Korean Information Science Society Conference
• /
• 1998.10c
• /
• pp.303-305
• /
• 1998

MPGE(Moving Picture Expert Group)은 디지털 동영상 압축 부호화의 표준으로 자리잡고 있으며 MPEG-1에 이어 현재는 MPEG-2가 상용화되어 있는 실정이다. 복잡한 압축 기법의 적용으로 이를 재생하기 위해서는 전용의 하드웨어가 필요했지만 CPU의 성능이 향상됨에 따라 소프트웨어적으로 구현이 가능하게 되었다. 본 논문에서는 Software MPEG-1 Playback System에서 가장 큰 문제가 되는 Audio와 Video간의 동기화에 관한 기법을 제시한다.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.13 no.6
• /
• pp.1293-1300
• /
• 2018

The $360^{\circ}$ video has a lot of image information and usefulness; however, the position of the audio source judged by hearing is different from the position on the screen. Therefore, human feels tired, the immersion decrease and user cant watch the video for Moreer time. In this paper, the concordance rate of the video and the audio localization is defined. The rate is expressed in a percentage. It means how much the system makes the sound localization real according to the position of the source on the screen. With this rate, the audio localization performance of immersive audio producing and playing system can be evaluated. It will be helpful for developers to make the higher performance system and expected to contribute to make makinguality system with reality.

• Journal of Broadcast Engineering
• /
• v.14 no.3
• /
• pp.332-341
• /
• 2009

Terrestrial digital multimedia broadcasting(T-DMB) is one of mobile broadcasting services, and the commercial service was started in December 2005 in Korea. The performance targets of T-DMB are providing VCD(video CD) quality video and FM radio quality audio. In recent years, the researches for providing high quality video or audio service on T-DMB environments have been being carried out. To provide high-quality video or audio service, some additional data should be transmitted to the receiver as well as T-DMB video and audio data. Since the data rate for one T-DMB program is low, it is important to transmit the additional data at a low bit rate. In this paper, we propose a packetizing method for efficient transmission of the additional data to provide multichannel audio service on T-DMB environment.

• 한국HCI학회:학술대회논문집
• /
• 2009.02a
• /
• pp.538-541
• /
• 2009

In this paper, we explain a haptic based video and audio streaming method. The proposed method is to stream tactile and vibration information along with video and audio information. The video screen is divided into a grid, and each cell has tactile information which is corresponding to the content. At the same time, the sound stream is also analyzed and vibration information is applied. These data are streamed to clients and displayed through a haptic device and a vibration interface. So, a client will be more immersed into the video and audio by touching and getting vibrations.

• Journal of the Korean Society for Precision Engineering
• /
• v.28 no.5
• /
• pp.638-647
• /
• 2011

Various approaches directly using vibrations of speakers have been suggested to effectively display the aural information such as the music to the hearing-impaired or the deaf. However, in these approaches, the human can't sense the frequency information over the maximum perceivable vibro-tactile frequency (around 1kHz). Therefore, in this study, an approach via spectral modulation of compressing the high frequency audio information into perceivable vibro-tactile frequency domain and outputting the modulated signals through the designated speakers is proposed. Then it is shown, through simulations of using Short-Time Fourier Transform (STFT) with Hanning windows and through preliminary experiments of using the vibro-tactile display testbed which is built and interfaced with a notebook PC, that the modulated signal of a natural sound composing sounds of a frog, a bird, and a water stream could produce the noise-free signal suitable enough for vibro-tactile speakers without causing Significant interfering disturbances, Lastly, for three different combinations of information provided to the subject, that is, i) with only video image, ii) with video image along with the modulated vibro-tactile stimuli as proposed in this study to the forearm of the subject, and iii) with video image along with full audio information, the effects to the human sense of reality and his emotion to given audio-video clips including various sounds and images are investigated and compared. It is shown from results of those experiments that the proposed method of providing modulated vibro-tactile stimuli along with the video images to the human has very high feasibility to transmit pseudo-aural sense to the human.