• Proceedings of the Korea Institute of Convergence Signal Processing
• /
• 2005.11a
• /
• pp.221-224
• /
• 2005

대부분의 영상은 다양한 이유(노이즈, 전송과정 중 발생하는 문제 등)로 인해 항상 좋은 품질을 보여주진 못한다. 이렇게 훼손된 영상의 복원은 다양한 정보를 제공한다. 이런 훼손된 영상을 복원하기 위해 Median filtering과 같은 기존의 처리 방법들은 주변 화소(Pixel)를 평활화(Smoothing) 처리를 하기 때문에 noise 처리에는 좋으나 원 영상의 중요한 에지 성분까지도 평활화 처리를 함으로써 에지 부분의 공간적 이동을 초래할 수 있다. 이러한 문제점을 해결하기 위하여 image inpainting 방법이 제안되고 있으며, inpainting 기법에는 편미분 방정식(PDE)을 이용한 방법, 텍스쳐 병합 기반의 방법들이 있다. 그러나 이러한 inpainting 기법들은 연산 수행시간이 많이 소요되는 단점이 있다. 따라서 본 연구에서는 image inpainting을 수행시 소요되는 연산시간을 줄이는 fast image inpainting 알고리즘을 제안한다.

• Journal of Information Processing Systems
• /
• v.16 no.5
• /
• pp.1129-1144
• /
• 2020

The thangka image inpainting method based on wavelet transform is not ideal for contour curves when the high frequency information is repaired. In order to solve the problem, a new image inpainting algorithm is proposed based on edge structural constraints and wavelet transform coefficients. Firstly, a damaged thangka image is decomposed into low frequency subgraphs and high frequency subgraphs with different resolutions using wavelet transform. Then, the improved fast marching method is used to repair the low frequency subgraphs which represent structural information of the image. At the same time, for the high frequency subgraphs which represent textural information of the image, the extracted and repaired edge contour information is used to constrain structure inpainting in the proposed algorithm. Finally, the texture part is repaired using texture synthesis based on the wavelet coefficient characteristic of each subgraph. In this paper, the improved method is compared with the existing three methods. It is found that the improved method is superior to them in inpainting accuracy, especially in the case of contour curve. The experimental results show that the hierarchical method combined with structural constraints has a good effect on the edge damage of thangka images.

• Journal of Broadcast Engineering
• /
• v.24 no.1
• /
• pp.186-189
• /
• 2019

Image inpainting is an image processing technique that restores an image by naturally filling the empty or damaged regions in an image. In this paper, we present a new image inpainting technique that can suppress the generation of texture garbage which is one of the artifacts of existing exemplar-based image inpainting. Unlike the existing technique, only the stationary source patch is sampled as the exemplar patch based on the assumption of spatial stationarity of the texture. This prevents the texture garbage, which is an inconsistent piece of texture from being copied to the target region. Experimental results show that the texture synthesis using the proposed method produces more natural inpainting results than the existing method.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2009.11a
• /
• pp.349-350
• /
• 2009

In this paper, we describe an error concealment techniques based on image inpainting for the image impairments due to the packet loss. Image inpainting is to remove or restore the damaged sections from the images, which is usually old images, paintings, or video films. Inpainting has a long history which goes back to the era when the paintings come out. Manual inpainting is no more used, and we can use digital inpainting for the digitally impaired images and video sequences. In this paper, we review the error concealment techniques for the packet loss recovery and propose our inpainting based image impairment recovery scheme for video communication over packet networks.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.16 no.3
• /
• pp.877-893
• /
• 2022

With the development of deep learning, face inpainting has been significantly enhanced in the past few years. Although image inpainting framework integrated with generative adversarial network or attention mechanism enhanced the semantic understanding among facial components, the issues of reconstruction on corrupted regions are still worthy to explore, such as blurred edge structure, excessive smoothness, unreasonable semantic understanding and visual artifacts, etc. To address these issues, we propose a Learnable Structure Knowledge of Fusion Network (LSK-FNet), which learns a prior knowledge by edge generation network for image inpainting. The architecture involves two steps: Firstly, structure information obtained by edge generation network is used as the prior knowledge for face inpainting network. Secondly, both the generated prior knowledge and the incomplete image are fed into the face inpainting network together to get the fusion information. To improve the accuracy of inpainting, both of gated convolution and region normalization are applied in our proposed model. We evaluate our LSK-FNet qualitatively and quantitatively on the CelebA-HQ dataset. The experimental results demonstrate that the edge structure and details of facial images can be improved by using LSK-FNet. Our model surpasses the compared models on L1, PSNR and SSIM metrics. When the masked region is less than 20%, L1 loss reduce by more than 4.3%.

• Journal of the Optical Society of Korea
• /
• v.19 no.4
• /
• pp.390-396
• /
• 2015

We propose a partial occlusion removal method for computational integral imaging reconstruction (CIIR) based on the usage of the exemplar based inpainting technique. The proposed method is an improved version of the original linear inpainting based CIIR (LI-CIIR), which uses the inpainting technique to fill in the data missing region. The LI-CIIR shows good results for images which contain objects with smooth surfaces. However, if the object has a textured surface, the result of the LI-CIIR deteriorates, since the linear inpainting cannot recover the textured data in the data missing region well. In this work, we utilize the exemplar based inpainting to fill in the textured data in the data missing region. We call the proposed method the neighboring elemental image exemplar based inpainting (NEI-exemplar inpainting) method, since it uses sources from neighboring elemental images to fill in the data missing region. Furthermore, we also propose an automatic occluding region extraction method based on the use of the mutual constraint using depth estimation (MC-DE) and the level set based bimodal segmentation. Experimental results show the validity of the proposed system.

• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.48 no.1
• /
• pp.8-16
• /
• 2011

Image inpainting is a technique for removing damaged regions and reconstructing them with visually plausible backgrounds. However, if size of the damaged regions for reconstructing is large, the unexpected results can be obtained due to disconnected structures within reconstructed regions. In this paper, by considering spatial distance information between candidate patches and a damaged patch as well as pixel value difference, an exemplar-based image inpainting using multiple patches is proposed. In conventional exemplar-based image inpainting method, implausible results such as blocking effects or repetition of reconstructed patch may occur by using inappropriately selected single patch. To improve the exemplar-based method, the weighted sum of multiple patches considering both the spatial distance and the pixel value difference between the target patch and the candidate patches is utilized. Experimental results have shown that the proposed method produces better performance of image inpainting than the existing method.

• Journal of the Korean Society of Radiology
• /
• v.11 no.7
• /
• pp.655-661
• /
• 2017

Sparse view CT has been widely used to reduce radiation dose to patient in radiation therapy. In this work, we performed sinogram restoration from sparse sampling data by using inpainting method for simulation and experiment. Sinogram restoration was performed in accordance with sampling angle and restoration method, and their results were validated with root mean square error (RMSE) and image profiles. Simulation and experiment are designed to fan beam scan for various projection angles. Sparse data in sinogram were restored by using linear interpolation and inpainting method. Then, the restored sinogram was reconstructed with filtered backprojection (FBP) algorithm. The results showed that RMSE and image profiles were depended on the projection angles and restoration method. Based on the simulation and experiment, we found that inpainting method could be improved for sinogram restoration in comparison to linear interpolation method for estimating RMSE and image profiles.

• Journal of Information Processing Systems
• /
• v.13 no.5
• /
• pp.1183-1202
• /
• 2017

Image restoration has been carried out by texture synthesis mostly for large regions and inpainting algorithms for small cracks in images. In this paper, we propose a new approach that allows for the simultaneous fill-in of different structures and textures by processing in a wavelet domain. A combination of structure inpainting and patch-based texture synthesis is carried out, which is known as patch-based inpainting, for filling and updating the target region. The wavelet transform is used for its very good multiresolution capabilities. The proposed algorithm uses the wavelet domain subbands to resolve the structure and texture components in smooth approximation and high frequency structural details. The subbands are processed separately by the prioritized patch-based inpainting with isophote energy driven texture synthesis at the core. The algorithm automatically estimates the wavelet coefficients of the target regions of various subbands using optimized patches from the surrounding DWT coefficients. The suggested performance improvement drastically improves execution speed over the existing algorithm. The proposed patch optimization strategy improves the quality of the fill. The fill-in is done with higher priority to structures and isophotes arriving at target boundaries. The effectiveness of the algorithm is demonstrated with natural and textured images with varying textural complexions.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.9 no.12
• /
• pp.5170-5188
• /
• 2015

This paper proposes a novel progressive secret image-hiding scheme based on the inpainting technique, the vector quantization technique (VQ) and the exploiting modification direction (EMD) technique. The proposed scheme first divides the secret image into non-overlapping blocks and categorizes the blocks into two groups: complex and smooth. The blocks in the complex group are compressed by VQ with PCA sorted codebook to obtain the VQ index table. Instead of embedding the original secret image, the proposed method progressively embeds the VQ index table into the cover images by using the EMD technique. After the receiver recovers the complex parts of the secret image by decoding the VQ index table from the shadow images, the smooth parts can be reconstructed by using the inpainting technique based on the content of the complex parts. The experimental results demonstrate that the proposed scheme not only has the advantage of progressive data hiding, which involves more shadow images joining to recover the secret image so as to produce a higher quality steganography image, but also can achieve high hiding capacity with acceptable recovered image quality.