• Journal of Korea Multimedia Society
• /
• v.11 no.2
• /
• pp.153-162
• /
• 2008

We propose a novel image inpainting method composed of two parts: band matching and seamless cloning. In band matching, a band enclosing the boundary of a missing region is compared to those from the other parts of the image. The inner area of the minimum difference band is then copied to the missing region. Even though this band matching results in successful inpainting in many practical applications, brightness discontinuity (a seam) may appear between the filled missing region and its neighborhood. We apply seamless cloning to remove such discontinuity between the two regions. However, since this basic method using one patch may not deal with cases where there are abrupt changes of color or brightness along the boundary, we furthermore devise one more step: target sub-division. The target area is subdivided into small sub-areas, and the band matching and seamless cloning are applied to each of them. The multiple results from the sub-division are then ordered according to inpainting quality, which is measured based on the edge map or discontinuity map along the boundary band.

• Journal of KIISE
• /
• v.43 no.4
• /
• pp.437-449
• /
• 2016

Previous image processing techniques based on plane-to-plane transformations cannot be utilized for spherical panoramic images. In this paper, we propose a new method to inpaint a spherical panoramic image using exemplar, which is deformed by the location of the patch. Our proposed method makes the deformed exemplar patch by latitude and uses it as the reference patch to restore the damaged area. The exemplar-based inpainting method is based on the planar image coordinate system and thus the classical method cannot be applied to the spherical panoramic image. The merit of our proposed method is the fact that it is not dependent on the location of the damaged area. From the experimental results, we proved that our proposed method satisfies the original purpose of the exemplar-based inpainting technique for the spherical panoramic image.

• Journal of Broadcast Engineering
• /
• v.15 no.1
• /
• pp.3-13
• /
• 2010

In this paper, we propose a method for filling out the occlusions in generating multi-view images from one source image and its ground-truth depth image. The method is based on image inpainting and layered interpolation. The source image is first divided into several layers using depth information. The occlusions are interpolated separately in every layered image using the image inpainting algorithm. Finally, the interpolated layered images are combined to obtain different viewpoint images. Interpolating occlusions with depth-correlated texture information that is contained to each layer makes it possible to obtain more detailed and accurate results than previous methods. The effectiveness of the proposed method is shown through experimental results.

• Journal of the Society of Naval Architects of Korea
• /
• v.59 no.2
• /
• pp.118-124
• /
• 2022

Marine environment analysis and ship motion prediction during ship navigation are important technologies for safe and economical operation of autonomous ships. As a marine environment analysis technology, there is a method of analyzing waves by measuring the sea states through images acquired based on radar(radio detection and ranging) signal. However, in the process of deriving marine environment information from radar images, noises generated by external factors are included, limiting the interpretation of the marine environment. Therefore, image processing for noise removal is required. In this study, image inpainting by partial convolutional neural network model is proposed as a method to remove noises and reconstruct radar images.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2022.05a
• /
• pp.104-107
• /
• 2022

autoencoder deep learning model has excellent ability to restore abnormal data to normal data, so it is not appropriate for anomaly detection. In addition, the Inpainting method, which is a method of restoring hidden data after masking (masking) a part of the data, has a problem in that the restoring ability is poor for noisy images. In this paper, we use a method of modifying and improving the MLP-Mixer model to mask the image at a certain ratio and to reconstruct the image by delivering compressed information of the masked image to the model. After constructing a model learned with normal data from the MVTec AD dataset, a reconstruction error was obtained by inputting normal and abnormal images, respectively, and anomaly detection was performed through this. As a result of the performance evaluation, it was found that the proposed method has superior anomaly detection performance compared to the existing method.

• Journal of the Korean Society for Industrial and Applied Mathematics
• /
• v.22 no.2
• /
• pp.91-100
• /
• 2018

In this paper, we propose a new method for template matching, patch ratio, to inpaint unknown pixels. Before this paper, many inpainting methods used sum of squared differences(SSD) or sum of absolute differences(SAD) to calculate distance between patches and it was very useful for closest patches for the template that we want to fill in. However, those methods don't consider about geometric similarity and that causes unnatural inpainting results for human visuality. Patch ratio can cover the geometric problem and moreover computational cost is less than using SSD or SAD. It is guaranteed about finding the most similar patches by Cauchy-Schwarz inequality. For ignoring unnecessary process, we compare only selected candidates by priority calculations. Exeperimental results show that the proposed algorithm is more efficent than Criminisi's one.

• The KIPS Transactions:PartD
• /
• v.15D no.4
• /
• pp.581-588
• /
• 2008

Old films or photographs usually have damages from physical or chemical effects, and the damage and digitalization make stain, scratch, scribbling, noise, and digital drop out in frames. Damages include global damage and local damage, and it is well known that local damage restoration is a main factor for improving image quality. Previous researches have focused on impairment localization (esp. for line scratch impairments) and restoration techniques for line scratch, dirt, blob, and intentional scratch. Inpainting is a key technique using partial derivatives to restore damages in images. It does not show good quality for the complex images because it is based on finite order for partial derivatives, and it takes much time complexity. In this paper, we present a modified inpainting scheme, where we use Sobel edge operator's and angle to compute isophotes, and compare our scheme with Bertalmio's scheme. We experiment our scheme with two old Korean films, and Simulation results show that our scheme requires smaller time complexity than Bertalmio's scheme with comparable reconstructed image quality.

• The Journal of the Korea Contents Association
• /
• v.5 no.6
• /
• pp.138-145
• /
• 2005

This paper describes a technique for detecting the boundary of the optic disk in digital image of the retina using inward and outward curve evolution. This paper offers medical information about glaucoma progresses. For accurate boundary detection, image inpainting based on texture synthesis removes blood vessels crossing the optic disk. For removing noises and preserving boundary of optic disk in image inpainting process, the anisotropic diffusion filtering is necessary. After pre-processing, the optic disk boundary is determined using inward and outward curve evolution. The experimental results show that the algorithm is effective for detection of optic disk boundary.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.15 no.10
• /
• pp.3642-3667
• /
• 2021

Texture synthesis technology has the advantages of repairing texture and structure at the same time. However, during the filling process, the size of the patch is fixed, and the content of the filling is not fully considered. In order to be able to adaptively change the patch size, we used the exemplar-based inpainting technique as the test algorithm, considering the image structure and texture, calculated the image structure patch size and texture patch size, and comprehensively determined the image patch size. This can adaptively change the patch size according to the filling content. In addition, we use multi-layer images to calculate the priority, so that the order of image repair was more stable. The proposed repair algorithm is compared with other image repair algorithms. The experimental results showed that the proposed adaptive image repair algorithm can better repair the texture and structure of the image, which proved the effectiveness of the proposed algorithm.

• Journal of the Korean Society for Industrial and Applied Mathematics
• /
• v.18 no.2
• /
• pp.157-166
• /
• 2014

If there are metals located in the X-ray scanned object, a point outside the metals has its range of projection angle at which projections passing through the point are disturbed by the metals. Roughly speaking, this implies that attenuation information at the point is missing in the blocked projection range. So conventional projection completion MAR algorithms to use the undisturbed projection data on the boundary of the metaltrace is less efficient in reconstructing the attenuation coefficient in detailed parts, in particular, near the metal region. In order to overcome this problem, we propose the algebraic correction technique (ACT) to utilize a pre-reconstructed interim image of the attenuation coefficient outside the metal region which is obtained by solving a linear system designed to reduce computational costs. The reconstructed interim image of the attenuation coefficient is used as prior information for MAR. Numerical simulations support that the proposed correction technique shows better performance than conventional inpainting techniques such as the total variation and the harmonic inpainting.