• Journal of KIISE:Software and Applications
• /
• v.29 no.11
• /
• pp.767-774
• /
• 2002

Conventional research on image restoration has focused on restoring degraded images resulting from image formation, storage and communication, mainly in the signal processing field. Related research on recovering original image information of caption regions includes a method using BMA(block matching algorithm). The method has problem with frequent incorrect matching and propagating the errors by incorrect matching. Moreover, it is impossible to recover the frames between two scene changes when scene changes occur more than twice. In this paper, we propose a method for recovering original images using EBMA(Extended Block Matching Algorithm) and a region compensation method. To use it in original image recovery, the method extracts a priori knowledge such as information about scene changes, camera motion and caption regions. The method decides the direction of recovery using the extracted caption information(the start and end frames of a caption) and scene change information. According to the direction of recovery, the recovery is performed in units of character components using EBMA and the region compensation method. Experimental results show that EBMA results in good recovery regardless of the speed of moving object and complexity of background in video. The region compensation method recovered original images successfully, when there is no information about the original image to refer to.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.28 no.4C
• /
• pp.424-432
• /
• 2003

In this paper, an effective method of stereo image reconstruction through the regularized adaptive disparity estimation is proposed. Althougth the conventional adaptive disparity estimation method can sharply improve the PSNR of a reconstructed stereo image, but some problems of overlapping between the matching windows and disallocation of the matching windows can be occurred, because the matching window size changes adaptively in accordance with the magnitude of feature values. Accordingly, in thia paper, a new regularized adaptive disparity estimation technique is proposed. That is, by regularizing the estimated disparity vector with the neughboring disparity vectors, problems of the conventional adaptive disparity estimated scheme might be solved, and also the predicted stereo image can be more effectively reconstructed. From some experiments using the CCETT'S stereo image pairs of 'Man' and 'Claude', it is analyzed that the proposed disparity estimation scheme can improve PSNRs of the reconstructed images to 10.89dB, 6.13dB for 'Man' and 1.41dB, 0.81dB for 'Claude' by comparing with those of the conventional pixel-based and adaptive estimation method, respectively.

• The Transactions of the Korea Information Processing Society
• /
• v.6 no.7
• /
• pp.1980-1987
• /
• 1999

Restored image is always lower quality than original one due to distortion and noise. The purpose of image restoration is to improve the image quality by fixing the noise or distortion information. One category of spatial filters for image restoration is linear filter. This filter algorithm is easily implemented and can be suppressed the Gaussian noise effectively, but not so good performance for spot or impulse noise. In this paper, we propose the nonlinear spatial filter algorithm for image restoration called the optimal adaptive multistage filter(OAMF). The OAMF is used to reduce the filtering time, increases the noise suppression ratio and preserves the edge information. The OAMF optimizes the adaptive multistage filter(AMF) by using weight learning algorithm of back-propagation learning algorithm. Simulation results of this filter algorithm are presented and discussed.

• Journal of the Korea Computer Graphics Society
• /
• v.25 no.3
• /
• pp.1-9
• /
• 2019

The image obtained from systems such as autonomous driving cars or fire-fighting robots often suffer from several degradation such as noise, motion blur, and compression artifact due to multiple factor. It is difficult to apply image recognition to these degraded images, then the image restoration is essential. However, these systems cannot recognize what kind of degradation and thus there are difficulty restoring the images. In this paper, we propose the deep neural network, which restore natural images from images degraded in several ways such as noise, blur and JPEG compression in situations where the distortion applied to images is not recognized. We adopt the channel attention modules and skip connections in the proposed method, which makes the network focus on valuable information to image restoration. The proposed method is simpler to train than other methods, and experimental results show that the proposed method outperforms existing state-of-the-art methods.

• Journal of Broadcast Engineering
• /
• v.23 no.4
• /
• pp.503-510
• /
• 2018

Restoring of damaged images is a fundamental problem that was attempted before digital image processing technology appeared. Various algorithms for reconstructing damaged images have been introduced. However, the results show inferior restoration results compared with manual restoration. Recent developments of DNN (Deep Neural Network) have introduced various studies that apply it to image restoration. However, if the wide area is damaged, it can not be solved by a general interpolation method. In this case, it is necessary to reconstruct the damaged area through contextual information of surrounding images. In this paper, we propose an image restoration network using a generative adversarial network (GAN). The proposed system consists of image generation network and discriminator network. The proposed network is verified through experiments that it is possible to recover not only the natural image but also the texture of the original image through the inference of the damaged area in restoring various types of images.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.48 no.5
• /
• pp.72-83
• /
• 2011

In this paper, we propose a method to detect and recover the occluded parts of face images using the correlation between pairs of pixels. In a training stage, correlation coefficients between every pairs of pixels are calculated using the occlusion-free face images. Once a new occluded face image is shown, the occluded area is detected and recovered using the correlation coefficients obtained in the training stage. We compare the performance of the proposed method with the conventional method based on PCA. The results show that the proposed method detects and recovers occluded area with much smaller noises than the conventional PCA based method. Moreover, recovered images by the proposed method were more smooth with reduced blurring effect.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.21 no.10
• /
• pp.2541-2551
• /
• 1996

Human visual systems are sensitive to noise on the flat intensity area. But it becomes less sensitive on the edge area. Recently, many types of spatially adaptive image restoration methods have been proposed, which employ the above mentioned huan visual characteristics. The present paper presents an adaptive image restoration method, which increases sharpness of the edge region, and smooths noise on the flat intensity area. For edge detection, the proposed method uses the visibility function based on the local variance on each pixel. And it adaptively changes the regularization parameter. More specifically, the image to be restored is divided into a number of steps from the flat area to the edge regio, and then restored by using the finite impulse response constrained least squares filter.

• Journal of the Institute of Electronics and Information Engineers
• /
• v.50 no.12
• /
• pp.150-158
• /
• 2013

In this paper we present approximated constrained least squares filter for real-time directionally adaptive image restoration. The proposed method makes a hardware implementation easier for real-time image restoration because of reducing the filter size. Furthermore, for directional adaptive image restoration, this paper estimates the local orientation by analyzing the covariance matrix and applies to approximated constrained least squares filter. Experimental results show that the proposed method is sharper and less artifacts than existing methods.

• Journal of Broadcast Engineering
• /
• v.24 no.3
• /
• pp.430-439
• /
• 2019

The CNN (convolutional neural network) based single degradation restoration method shows outstanding performance yet is tailored on solving a specific degradation type. In this paper, we present an algorithm of multi-degradation classification and restoration. We utilize the CNN based algorithm for solving image degradation classification problem using pre-trained Inception-v3 network. In addition, we use the existing CNN based algorithms for solving particular image degradation problems. We identity the restoration order of multi-degraded images empirically and compare with the non-reference image quality assessment score based on CNN. We use the restoration order to implement the algorithm. The experimental results show that the proposed algorithm can solve multi-degradation problem.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.10 no.4
• /
• pp.177-182
• /
• 2010

Research on recovering original images from captions has been widely done in a reusability point of view. In usual, dynamic images imported from foreign countries often have captions of foreign languages, so it is necessary to translate them into one's language. For the natural exchange of captions without loss of original images, recovering the images corresponding to captions is necessary. However, though recovering original images is very important, systematic analysis on the characteristics of captions has not been done yet. Therefore, in this paper, we first survey the classification methods of TV programs at academic worlds, broadcasting stations, and broadcasting organizations, and then analyses the frequency of captions, importance of caption contents, and necessity of recovering according to their types. Also, we analyze the characteristics of captions which are significantly recognized to be necessary to recover, and use them as recovering information.