Browse > Article
http://dx.doi.org/10.3745/KIPSTB.2010.17B.1.047

Design and Implementation of AR Model based Automatic Identification and Restoration Scheme for Line Scratches in Old Films  

Han, Ngoc-Soc (한국전자통신연구소)
Kim, Seong-Whan (서울시립대학교 컴퓨터과학부)
Publication Information
The KIPS Transactions:PartB / v.17B, no.1, 2010 , pp. 47-54 More about this Journal
Abstract
Old archived film shows two major defects: line scratch and blobs. In this paper, we present a design and implementation of an automatic video restoration system for line scratches observed in archived film. We use autoregressive (AR) image model because we can make stochastic and specifically autoregressive image generation process with our PAST-PRESENT model and Sampling Pattern. We designed locality maximizing scanning pattern, which can generate nearly stationary time-like series of pixels, which is a strong requirement for a stochastic series to be autoregressive. The sampled pixel series undergoes filtering and model fitting using Durbin-Levinson algorithm before interpolation process. We designed three-stage film restoration system, which includes (1) film acquisition from VHS tapes, (2) simple line scratch detection and restoration, and (3) manual blob identification and sophisticated inpainting scheme. We implemented film acquisition and simple inpainting scheme on Texas Instruments DSP board TMS320DM642 EVM, and implemented our AR inpainting scheme on PC for sophisticated restoration. We experimented our scheme with two old Korean films: "Viva Freedom" and "Robot Tae-Kwon-V", and the experimental results show that our scheme improves Bertalmio's scheme for subjective quality (MOS), objective quality (PSNR), and especially restoration ratio (RR), which reflects how much similar to the manual inpainting results.
Keywords
Inpainting; Restoration; Autoregressive; Line Scratch;
Citations & Related Records
연도 인용수 순위
  • Reference
1 M. Bertalmio, G. Sapiro, V. Caselles, and C. Ballester. “Image Inpainting,” In Proc. SIGGRAPH 2000, 2000, pp.417-424.
2 PrestoSpace project, http://prestospace.org.
3 A. C. Kokaram, “Detection and removal of line scratches in degraded motion picture sequences,” Signal Processing VIII, Vol.1, pp.5-8, Sep., 1996.
4 A. C. Kokaram, “Motion Picture Restoration: Digital Algorithms for Artefact Suppression in Degraded Motion Picture Film and Video,” Springer-Verlag, Berlin, Germany, 1998.
5 M. Oliveira, B. Bowen, R. McKenna, and Y.-S. Chang. “Fast Digital Image Inpainting,” In Proc. VCIP 2001, 2001, pp. 261-266.
6 A. Telea. “An Image Inpainting Technique Based on the Fast Marching Method,” Journal of Graphics Tools, Vol.9, No.1, pp.25-36, 2004.
7 A. C. Kokaram, “A statistical framework for picture reconstruction using AR models,” In European Conference on Computer Vision workshop on Statistical methods in video processing (ISBN 0-9581044-0-9),Copenhagen, Denmark, pp.73-78, June 2002.
8 D. Marr and E. Hildreth, “Theory of edge detection,” In Proc. Roy. Soc., London B207, 1980, pp.187-217.   DOI
9 D. Mumford and J. Shah, “Optimal approximations bypiecewise smooth functions and associated variational problems,”In Comm. Pure Appl, Math, 42, 1989, pp.577-685.   DOI
10 Texas Instruments Incorporated, http://www.ti.com.
11 Peter J. Brockwell (Author), Richard A. Davis (Author), “Introduction to Time Series and Forecasting,” Springer, New York, 1996.
12 K. H. Ko and S. W. Kim. “Efficient Inpainting of Old Film Scratch using Sobel Edge Operator based Isophote Computation,” in CIT 2006, 2006, pp.125.   DOI
13 D. Vitulano, V. Bruni, and P. Ciarlini, “Line scratch detection on digital images: an energy based model,” (Special Issue in) Journal of WSCG, Vol.10, No.2, 2002, pp.477-484.