Browse > Article

A Method for Recovering Text Regions in Video using Extended Block Matching and Region Compensation  

전병태 (한국전자통신연구원 컴퓨터·소프트웨어연구소)
배영래 (충북대학교 전자상거래학과)
Publication Information
Journal of KIISE:Software and Applications / v.29, no.11, 2002 , pp. 767-774 More about this Journal
Abstract
Conventional research on image restoration has focused on restoring degraded images resulting from image formation, storage and communication, mainly in the signal processing field. Related research on recovering original image information of caption regions includes a method using BMA(block matching algorithm). The method has problem with frequent incorrect matching and propagating the errors by incorrect matching. Moreover, it is impossible to recover the frames between two scene changes when scene changes occur more than twice. In this paper, we propose a method for recovering original images using EBMA(Extended Block Matching Algorithm) and a region compensation method. To use it in original image recovery, the method extracts a priori knowledge such as information about scene changes, camera motion and caption regions. The method decides the direction of recovery using the extracted caption information(the start and end frames of a caption) and scene change information. According to the direction of recovery, the recovery is performed in units of character components using EBMA and the region compensation method. Experimental results show that EBMA results in good recovery regardless of the speed of moving object and complexity of background in video. The region compensation method recovered original images successfully, when there is no information about the original image to refer to.
Keywords
text extraction; recovering text region; video images;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 전병태, 이재연, 배영래, '블록 정합을 이용한 비디오 자막 영역의 원 영상 복원 방법', 방송공학회논문지, Vol.5, No.1, pp.l13-122, 2000   과학기술학회마을
2 정기철, 남수진, 한정현, 'Automatic Text Detection and Removal in Digital Videos', 컴퓨터비젼 및 패턴인식 추계워크샵(CVPR'2001), pp.l67~168, Nov., 2001
3 Chun, Byung Tae, Younglae Bae, Tai-Yun Kim, 'Recovering original images forr video caption areas using camera motion and video information', Machine Graphics & Vision Journal, Vol.9, Nos.1/2, pp. 187~200, 2000
4 정기철, 남수진, 한정현,'Automatic Text detection and removal in digital videos,' 2001년 컴퓨터 비젼 및 패턴인식 연구회 추계 워크샵, pp.167-168, 연세대, 2001
5 이미숙, 설상훈, 양윤모, 이성환, '셧 경계 검출 및 카메라 동작 분석을 통한 비디오 자동 파싱 방법', 정보과학회논문지(B), Vol.25, No.8, pp.1249-1257, 1998
6 J. S. Boreczky and L. A. Rowe, 'Comparison of Video Shot Boundary Detection Techniques', IS&T/SPIE, Vol. 2670, pp.170-179, Feb. 1996   DOI
7 이재현, 장옥배, '움직임 벡터를 사용한 점진적 장면 전환 검출', 정보과학회논문지(C), 제3권, 제2호, pp.207-215, 1997
8 한규서,이재연, 정세윤, 배영래, '평균값을 이용한 통합형 카메라 동작 추출 시스템 개발', 한국정보처리학회 추계학술대회논문집(상), Vo1.8, No.2, .pp 777-780, 2001   과학기술학회마을
9 J.L.Barron, et.all, 'Systems and Experiment : Performance of Optical Flow Techniques', Int'l J. of Computer Vision, Vol. 12, 1994 pp.43-77   DOI
10 P.Jolly, H.K.Kim, 'Efficient automatic analysis of camera work and microsegmentation of video using spatiotemporal images', Image Commu. Vol. 8, 1996, pp.295-307   DOI   ScienceOn
11 장석우, '카메라의 동작을 보정한 장면전환 검출', 숭실대학교 박사학위청구논문, 2000
12 Kim, Hae-Kwang, 'Efficient automatic text location method and content-based indexing and structuring of video database', Journal of Visual Communication and Image Representation, Vol.7, No.4, pp.336-344, Dec. 1996   DOI   ScienceOn
13 오원근, 유병문, 이인동 외2인, '영상처리 처리 기술을 이용한 조사당 벽화의 복원', 한국과학기술연구원/시스템공학연구소 연구보고서(E21131), 1992
14 Furht, Borko, Joshua Greenberg and Raymond Westwater, Motion Estimation Algorithm for Video Compression, Kluwer Academic Press, 1997
15 Jang, Seok-Woo, Kyu-Jung Kim and Hyung-Il Choi, 'Accurate Estimation of Motion Vectors using Active Block Matching', Inter. Conference on RSCTC'2000, Spriger-Verlag in Lecture Notes, pp. 489 - 493 , 2000
16 전병태,배영래,김태윤, '일반화된 문자 및 비디오 자막 영역 추출 방법', 정보과학회논문지 : 소프트웨어 및 응용, Vo1.27, No.6, 2000
17 Lienhart, Rainer and Frank Stuber, 'Automatic text recognition in digital videos', Proc. of the SPIE, Image and Video Processing IV, Vol. SPIE2666, pp.180-188, San Jose, 1996   DOI