• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.44 no.6
• /
• pp.36-42
• /
• 2007

According to the increased demand of high quality multimedia content, it needs to recover an old movies. But the film of old movie is damaged with line scratches and dust. In this paper, the detection and restoration algorithm of B/W line scratch is proposed. Our scheme estimates and interpolates the damaged partial information of line scratch using the linear recursive curve trace which consider the intensity values of left and right region of line scratch and then median filtering processed. As a result, the film image PSNR 44.68 with B/W line scratch is increased up to 48.60 and the intensity of the interpolate pixel is approached about 14 against the pixel of original image.

• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.45 no.6
• /
• pp.162-169
• /
• 2008

Film restoration is to detect the location and extent of defected regions from a given movie film, and if present, to reconstruct the lost information of each regions. It has gained increasing attention by many researchers, to support multimedia service of high quality. Among artifacts, scratch is the most frequent degradation. In this paper, an automatic film line scratch removal system is developed that can detect and restore all kind of scratches. For this we use the spatial information of scratches: The scratch in old films has lower or higher brightness than neighboring pixels in its vicinity and usually appears as a vertically long thin line. Our systems consists of scratch detection and scratch restoration. The scratches of various types are detected by neural network based texture classifier and morphology-based shape filter and then the degraded regions are restored using bilinear interpolation. To assess the validity of the Proposed method, it has been tested with all kinds of scratches, and then experimental results show that the proposed approach is robust to various scratches and efficient to apply a real film removal system.

• The KIPS Transactions:PartD
• /
• v.15D no.4
• /
• pp.581-588
• /
• 2008

Old films or photographs usually have damages from physical or chemical effects, and the damage and digitalization make stain, scratch, scribbling, noise, and digital drop out in frames. Damages include global damage and local damage, and it is well known that local damage restoration is a main factor for improving image quality. Previous researches have focused on impairment localization (esp. for line scratch impairments) and restoration techniques for line scratch, dirt, blob, and intentional scratch. Inpainting is a key technique using partial derivatives to restore damages in images. It does not show good quality for the complex images because it is based on finite order for partial derivatives, and it takes much time complexity. In this paper, we present a modified inpainting scheme, where we use Sobel edge operator's and angle to compute isophotes, and compare our scheme with Bertalmio's scheme. We experiment our scheme with two old Korean films, and Simulation results show that our scheme requires smaller time complexity than Bertalmio's scheme with comparable reconstructed image quality.

• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.43 no.6 s.312
• /
• pp.26-33
• /
• 2006

Film restoration is to detect the location and extent of defected regions from a given movie film, and if present, to reconstruct the lost information of each region. It has gained increasing attention by many researchers, to support multimedia service of high quality. In general, an old film is degraded by dust, scratch, flick, and so on. Among these, the most frequent degradation is the scratch. So far techniques for the scratch restoration have been developed, but they have limited applicability when dealing with all kinds of scratches. To fully support the automatic scratch restoration, the system should be developed that can detect all kinds of scratches from a given frame of old films. This paper presents a neurual network (NN)-based texture classifier that automatically detect all kinds of scratches from frames in old films. To facilitate the detection of various scratch sizes, we use a pyramid of images generated from original frames by having the resolution at three levels. The image at each level is scanned by the NN-based classifier, which divides the input image into scratch regions and non-scratch regions. Then, to reduce the computational cost, the NN-based classifier is only applied to the edge pixels. To assess the validity of the proposed method, the experiments have been performed on old films and animations with all kinds of scratches, then the results show the effectiveness of the proposed method.

• The KIPS Transactions:PartB
• /
• v.17B no.1
• /
• pp.47-54
• /
• 2010

Old archived film shows two major defects: line scratch and blobs. In this paper, we present a design and implementation of an automatic video restoration system for line scratches observed in archived film. We use autoregressive (AR) image model because we can make stochastic and specifically autoregressive image generation process with our PAST-PRESENT model and Sampling Pattern. We designed locality maximizing scanning pattern, which can generate nearly stationary time-like series of pixels, which is a strong requirement for a stochastic series to be autoregressive. The sampled pixel series undergoes filtering and model fitting using Durbin-Levinson algorithm before interpolation process. We designed three-stage film restoration system, which includes (1) film acquisition from VHS tapes, (2) simple line scratch detection and restoration, and (3) manual blob identification and sophisticated inpainting scheme. We implemented film acquisition and simple inpainting scheme on Texas Instruments DSP board TMS320DM642 EVM, and implemented our AR inpainting scheme on PC for sophisticated restoration. We experimented our scheme with two old Korean films: "Viva Freedom" and "Robot Tae-Kwon-V", and the experimental results show that our scheme improves Bertalmio's scheme for subjective quality (MOS), objective quality (PSNR), and especially restoration ratio (RR), which reflects how much similar to the manual inpainting results.

• Proceedings of the Korean Information Science Society Conference
• /
• 2007.06c
• /
• pp.454-459
• /
• 2007

최근 다양한 형태의 멀티미디어의 확산과 영상에 대한 관심이 높아짐에 따라 필름 복원은 많은 사람들로부터 관심을 받고 있는 연구 분야다. 본 논문에서는 스크래치 텍스처 및 형태 특성을 이용하여 모든 종류의 스크래치를 자동으로 검출하고 복원 할 수 있는 방법을 제안한다. 제안된 방법은 손상된 필름에서 자주 발생되는 스크래치의 공간적인 정보를 이용하여 텍스처 분류기와 형태 필터링을 통해 스크래치를 검출 하고, 양선형 보간법을 사용하여 손상된 필름 영역을 주변 픽셀 값을 이용하여 스크래치를 제거 함으로써 영상을 복원한다. 본 논문에서 제안된 방법은 Kokaram의 논문에 제안된 방법보다 다양한 종류의 스크래치를 정확하게 인식하며, 적은 계산 비용임에도 불구하고 양선형 보간법은 스크래치 영역을 제거한다.

• Proceedings of the Korean Information Science Society Conference
• /
• 2005.11b
• /
• pp.868-870
• /
• 2005

스크래치는 오래된 필름에서 가장 많이 나타나는 손상 요인이다. 고화질의 멀티미디어 서비스를 제공하기 위해서는 이러한 스크래치들은 반드시 검출 및 복원되어야 한다. 이러한 중요성 때문에 지금까지 많은 복원 알고리즘이 개발되어 왔으나, 스크래치 영역의 자동검출에 대한 연구는 거의 이루어지지 않은 실정이다. 따라서 본 논문에서는 자동으로 스크래치영역을 추출할 수 있는 신경망 기반의 검출 방법을 제안한다. 다층 퍼셉트론 (Multi-layer perceptron: MLP)을 이용하여 스크래치영역과 비 스크래치영역을 구분하는데, 이 MLP는 다양한 크기의 스크래치를 검출하기 위해 다양한 크기의 입력 영상에 대해 적용된다. 제안된 방법의 평가를 위해 principal/ secondary 스크래치, alone/not-alone 스크래치, moving/static 스크래치등의 다양한 종류의 스크래치를 가진 영상에 대해 실험이 이루어졌고, 그 결과 제안된 방법의 강건함과 효율성을 입증되었다.

• Proceedings of the Korean Information Science Society Conference
• /
• 2006.06b
• /
• pp.277-279
• /
• 2006

본 논문에서는 스크래치 텍스처 및 형태특성을 이용하여 모든 종류의 스크래치를 자동으로 검출 할 수 있는 방법을 제안한다. 제안한 방법은 텍스처 분류 단계와 형태 필터링 단계를 구성된다. 텍스처 분류단계에서는 스크래치의 텍스처 정보를 이용하여 입력영상의 각 화소를 스크래치와 비스크래래치 영역으로 분류한다. 이때 분류기로 신경망을 사용한다. 형태필터링단계에서는 스크래치의 형태정보에 기반하여 설계된 원소구조를 사용하는 모폴로지 필터를 사용하여 잘못 분류된 스크래치 영역을 제거한다. 제안된 방법의 평가를 위해 다양한 종류의 스크래치를 가진 영화 및 애니메이션 데이터에 대해 실험이 이루어 졌고, 그 결과 제안된 방법의 강건함과 효율성이 입증되었다.