• Journal of Korea Game Society
• /
• v.19 no.1
• /
• pp.73-84
• /
• 2019

This study is intended to suggest ways to improve the quality of the service of subtitles provided for the convenience of viewing for deaf people on e-sports broadcast content and game streamer content. Generally, subtitling files of broadcast content are manually written on air by stenographers, so a delay of 3 to 5 seconds is inevitable compared to the original content. Therefore, the present study proposed the formation of an automatic synchronization calibration system using speech recognition technology. In addition, a content application experiment using this system was conducted, and the final result confirmed that the time of synchronization error of subtitling data could be reduced to less than 1 second.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 1998.06a
• /
• pp.67-70
• /
• 1998

본 논문에서는 뉴스 비디오 자막의 구조적 문자 특성을 이용한 자동 자막추출방법을 기술하였다. 기존의 방법들은 경계 추출이나 이진화 과정 후에 화소값의 변화 profile에 나타나는 문자의 굵기, 간격 등의 문자 특징을 이용하는데 반해 본 논문에서 제안한 방식은 뉴스 비디오 자막에서 문자와 배경을 구분하는 테두리선을 배경과 문자를 구분하는 경계로 하여, 적절한 이진화 과정과 영역확장 기법을 이용하여 문자를 추출하였다. 제안한 방법은 문자에 대하 사전지식이 없어도 되며, 사용한 영역확장 기법은 기존의 방법에서의 경계 추출기법보다 간단하면서도 효과적인 문자추출 결과를 나타낸다.

• Proceedings of the KAIS Fall Conference
• /
• 2007.11a
• /
• pp.417-419
• /
• 2007

본 논문은 방송 프로그램 제작에 있어서 영상자막 제작 기법에 따른 다양한 현상들을 살펴보고자 한다. 기존의 방송 프로그램 제작에 있어서 자막의 기능(sub-title)은 간략한 정보를 전달하는 기능으로 사용되었다. 그러나 최근 다양한 방송 프로그램에서 활용되고 있는 영상 자막의 기능과 효과는 단순한 정보를 제공하는 기능에서 새로운 패러다임을 통한 유행적 패턴으로 발전되고 있는 형식을 살펴볼 수 있다.

• Journal of Broadcast Engineering
• /
• v.13 no.4
• /
• pp.544-553
• /
• 2008

With the development of video editing technology, there are growing uses of overlay text inserted into video contents to provide viewers with better visual understanding. Since the content of the scene or the editor's intention can be well represented by using inserted text, it is useful for video information retrieval and indexing. Most of the previous approaches are based on low-level features, such as edge, color, and texture information. However, existing methods experience difficulties in handling texts with various contrasts or inserted in a complex background. In this paper, we propose a novel framework to localize the overlay text in a video scene. Based on our observation that there exist transient colors between inserted text and its adjacent background a transition map is generated. Then candidate regions are extracted by using the transition map and overlay text is finally determined based on the density of state in each candidate. The proposed method is robust to color, size, position, style, and contrast of overlay text. It is also language free. Text region update between frames is also exploited to reduce the processing time. Experiments are performed on diverse videos to confirm the efficiency of the proposed method.

• Journal of Broadcast Engineering
• /
• v.5 no.1
• /
• pp.113-122
• /
• 2000

It is sometimes necessary to remove the captions and recover original images from video images already broadcast, When the number of images requiring such recovery is small, manual processing is possible, but as the number grows it would be very difficult to do it manually. Therefore, a method for recovering original image for the caption areas in needed. Traditional research on image restoration has focused on restoring blurred images to sharp images using frequency filtering or video coding for transferring video images. This paper proposes a method for automatically recovering original image using BMA(Block Matching Algorithm). We extract information on caption regions and scene change that is used as a prior-knowledge for recovering original image. From the result of caption information detection, we know the start and end frames of captions in video and the character areas in the caption regions. The direction for the recovery is decided using information on the scene change and caption region(the start and end frame for captions). According to the direction, we recover the original image by performing block matching for character components in extracted caption region. Experimental results show that the case of stationary images with little camera or object motion is well recovered. We see that the case of images with motion in complex background is also recovered.

• Science of Emotion and Sensibility
• /
• v.22 no.4
• /
• pp.31-44
• /
• 2019

This study intended to investigate the effects of the subtitle location on the decreased working memory abilities caused by aging. A junior group (average age: 26, SD: 3.06, N=27) and a senior group (average age: 61.69, SD=4.18, N=26) participated in this study and they all performed N-back tasks which measured the working memory ability of the participants and video subtitle recognition tasks that assessed the most effectively recognized subtitle locations in the video. The results of the N-back task revealed slower response times and low accuracy rates in the senior group in comparison to the junior group, suggesting lower working memory abilities in the senior group vis-à-vis the junior group. The deterioration of working memory due to aging also negatively influenced the 'left-bottom' subtitle location in the video subtitle recognition task and positively influenced the 'left-center' location of the screen. The deterioration of working memory ability did not affect other subtitle locations. By examining the positive or negative effects of the deterioration of working memory ability as a function of age on subtitle locations, the present study suggests that the selection of suitable subtitle locations taking into account the ages of video viewers would cause information to be more effectively displayed on screen.

• Applied Chemistry for Engineering
• /
• v.22 no.5
• /
• pp.545-550
• /
• 2011

We have synthesized a high electrically conductive 4-(2-(4-(acetylthio)phenyl)ethynyl)benzoic acid (APBA) with a conjugated aromatic structure as a bio fix linker, and then fabricated APBA self-assembled monolayer (SAM) with a self-assembly technique. The structure of the prepared APBA SAM was studied and electrochemical properties of APBA SAM immobilized with a ferrocene molecule were investigated. Also, we have examined the molecular orientation and oxidation-reduction redox characteristics of the mixed SAM consisting of APBA and butanethiol (BT) with a X-ray photo electron spectroscopy (XPS) and cyclicvoltammetry, respectively. Electrochemical activity of the mixed SAM was increased with increasing the mixed time. Especially, the maximum redox current was obtained at a mixed time of 36 hrs.

• Journal of Korea Multimedia Society
• /
• v.17 no.3
• /
• pp.385-392
• /
• 2014

In this paper, we developed an Android application named VIVID where users can edit the moving captions easily on smartphone videos. This makes it convenient to set the time range, text, location and motion of caption text on the video. The editing result is uploaded to web server in html and can be shared with other users.

• Annual Conference on Human and Language Technology
• /
• 2018.10a
• /
• pp.559-560
• /
• 2018

순환 신경망(RNN) 기반의 Long Short-Term Memory(LSTM)는 자연어처리 분야에서 우수한 성능을 보이는 모델이다. 음성을 문자로 변환해주는 Speech to Text (STT)를 이용해 자막을 생성하고, 생성된 자막을 다른 언어로 동시에 번역을 해주는 서비스가 활발히 진행되고 있다. STT를 사용하여 자막을 추출하는 경우에는 마침표가 없이 전부 연결된 문장이 생성되기 때문에 정확한 번역이 불가능하다. 본 논문에서는 영어자막의 자동 번역 시, 정확도를 높이기 위해 텍스트를 문장으로 분할하여 마침표를 생성해주는 방법을 제안한다. 이 때, LSTM을 이용하여 데이터를 학습시킨 후 테스트한 결과 62.3%의 정확도로 마침표의 위치를 예측했다.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2002.11a
• /
• pp.619-623
• /
• 2002

We can speak caption as information that can not except caption on sports video. The sports highlight were composed that we recognize captioning. This paper is the necessary work to the middle-step to analysis the caption through the retrieval and discrimination from the position of caption. This paper improve at first and simplify the image through the excellent threshold value algorithm in the preprocessing and then use method that can analysis caption through the multiplex frame merging algorithm. Its speed performing shows up higher and simplier than the region growing process.