• Journal of the Optical Society of Korea
• /
• v.19 no.4
• /
• pp.390-396
• /
• 2015

We propose a partial occlusion removal method for computational integral imaging reconstruction (CIIR) based on the usage of the exemplar based inpainting technique. The proposed method is an improved version of the original linear inpainting based CIIR (LI-CIIR), which uses the inpainting technique to fill in the data missing region. The LI-CIIR shows good results for images which contain objects with smooth surfaces. However, if the object has a textured surface, the result of the LI-CIIR deteriorates, since the linear inpainting cannot recover the textured data in the data missing region well. In this work, we utilize the exemplar based inpainting to fill in the textured data in the data missing region. We call the proposed method the neighboring elemental image exemplar based inpainting (NEI-exemplar inpainting) method, since it uses sources from neighboring elemental images to fill in the data missing region. Furthermore, we also propose an automatic occluding region extraction method based on the use of the mutual constraint using depth estimation (MC-DE) and the level set based bimodal segmentation. Experimental results show the validity of the proposed system.

• Journal of KIISE
• /
• v.43 no.4
• /
• pp.437-449
• /
• 2016

Previous image processing techniques based on plane-to-plane transformations cannot be utilized for spherical panoramic images. In this paper, we propose a new method to inpaint a spherical panoramic image using exemplar, which is deformed by the location of the patch. Our proposed method makes the deformed exemplar patch by latitude and uses it as the reference patch to restore the damaged area. The exemplar-based inpainting method is based on the planar image coordinate system and thus the classical method cannot be applied to the spherical panoramic image. The merit of our proposed method is the fact that it is not dependent on the location of the damaged area. From the experimental results, we proved that our proposed method satisfies the original purpose of the exemplar-based inpainting technique for the spherical panoramic image.

• The Journal of the Korea Contents Association
• /
• v.14 no.2
• /
• pp.1-9
• /
• 2014

Image inpainting is the widely used technique to restore a damaged region or to fill a hole in an image. The exemplar-based technique effectively generates new texture by copying colour values of the most correlated patch in the source into the empty region of the current patch. In traditional exemplar-based synthesis, the patch correlation is computed using only the already filled pixels of the current patch. Thus, by ignoring the correlation between the hole regions of the two patches, an undesirable patch which is highly correlated with the current patch in the already filled area but considerably dissimilar in the area to be filled can be selected, which results in bad texture propagation. To avoid such problems, a new exemplar-based inpainting method using patch extrapolation is proposed. The empty part of the current patch is extrapolated beforehand, and then the complete patch is used for finding its exemplar. Experimental results show that the proposed method provides more natural synthesis results than the conventional ones.

• Journal of Broadcast Engineering
• /
• v.24 no.1
• /
• pp.186-189
• /
• 2019

Image inpainting is an image processing technique that restores an image by naturally filling the empty or damaged regions in an image. In this paper, we present a new image inpainting technique that can suppress the generation of texture garbage which is one of the artifacts of existing exemplar-based image inpainting. Unlike the existing technique, only the stationary source patch is sampled as the exemplar patch based on the assumption of spatial stationarity of the texture. This prevents the texture garbage, which is an inconsistent piece of texture from being copied to the target region. Experimental results show that the texture synthesis using the proposed method produces more natural inpainting results than the existing method.

• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.48 no.1
• /
• pp.8-16
• /
• 2011

Image inpainting is a technique for removing damaged regions and reconstructing them with visually plausible backgrounds. However, if size of the damaged regions for reconstructing is large, the unexpected results can be obtained due to disconnected structures within reconstructed regions. In this paper, by considering spatial distance information between candidate patches and a damaged patch as well as pixel value difference, an exemplar-based image inpainting using multiple patches is proposed. In conventional exemplar-based image inpainting method, implausible results such as blocking effects or repetition of reconstructed patch may occur by using inappropriately selected single patch. To improve the exemplar-based method, the weighted sum of multiple patches considering both the spatial distance and the pixel value difference between the target patch and the candidate patches is utilized. Experimental results have shown that the proposed method produces better performance of image inpainting than the existing method.

• Journal of the Korea Computer Graphics Society
• /
• v.15 no.1
• /
• pp.17-23
• /
• 2009

We present a simple new idea to improve the quality of exemplar based texture synthesis using multiple rotated input exemplars. Our algorithm successfully obtain rotational synthesis feature variations and manages to reduce the artifacts in the results, especially patch seams due to the structure of the exemplars provided which have been inappropriate for previous neighborhood matching synthesis algorithms. Our algorithm is parallel in nature, thus it is possible to implement our algorithm using GPU or multi-core CPU to accelerate synthesis process.

• Journal of information and communication convergence engineering
• /
• v.14 no.1
• /
• pp.57-63
• /
• 2016

In generally, the resolution of reconstructed three-dimensional images can be seriously degraded by undesired occlusions in the integral imaging system, because the undesired information of the occlusion overlap the three-dimensional images to be reconstructed. To solve the problem of the undesired occlusion, we present an exemplar-based image restoration method in integral imaging system. In the proposed method, a minimum spanning tree-based stereo matching method is used to remove the region of undesired occlusions in each elemental image. After that, the removed occlusion region of each elemental images are re-established by using the exemplar-based image restoration method. For further improve the performance of the image restoration, the structure tensor is used to solve the filling error cause by discontinuous structures. Finally, the resolution enhanced three-dimensional images are reconstructed by using the restored elemental images. The preliminary experiments are presented to demonstrate the feasibility of the proposed method.

• Journal of KIISE:Software and Applications
• /
• v.37 no.8
• /
• pp.629-640
• /
• 2010

The exemplar-based inpainting model is widely used to remove objects from natural images and to restore a damaged region. This paper presents a method which improves the performance of the conventional exemplar-based inpainting model by modifying three major parts in the model: data term, confidence term and patch selection. While the conventional data term is calculated using the local gradient, the proposed method uses 16 compass masks to get the global gradient to make the method robust to noise. To overcome the problem that the confidence term gets negligible in the inside of the eliminated region, a method is proposed which makes the confidence term decrease slowly in the eliminated region. The patch selection procedure is modified so that the closer patch has higher weight. Experiments showed that the proposed method produced more natural images and lower reconstruction error than the conventional exemplar-based inpainting.

• Journal of Korea Game Society
• /
• v.15 no.6
• /
• pp.121-130
• /
• 2015

In this paper, we propose a method to automatically create the contents for spot-the-difference games. A spot-the-difference game is the game that finds the differences such as removal of some objects in the image or changes of shapes and colors from the original image. The original purpose of the exemplar-based image inpainting technique is to remove unnecessary objects. We use the exemplar-based inpainting technique to make the spot-the-difference game contents. From our implementation and experiments, we showed the effectiveness of our automatic generation technique of spot-the-difference contents.

• Journal of Electrical Engineering and Technology
• /
• v.11 no.4
• /
• pp.1003-1011
• /
• 2016

In this paper, a new algorithm by using 3D warping technique to effectively fill holes that are produced when creating a virtual-viewpoint image is proposed. A hole is defined as the region that cannot be seen in the reference view when a virtual view is created. In the proposed algorithm, to reduce the blurring effect that occurs on the hole region filled by conventional algorithms and to enhance the texture quality of the generated virtual view, Exemplar Based In-painting algorithm is used. The boundary noise which occurs in the initial virtual view obtained by 3D warping is also removed. After 3D warping, we estimate the relative location of the background to the holes and then pixels adjacent to the background are filled in priority to get better result by not using only adjacent object's information. Also, the temporal inconsistency between frames can be reduced by expanding the search region up to the previous frame when searching for most similar patch. The superiority of the proposed algorithm compared to the existing algorithms can be shown through the experimental results.