• International journal of advanced smart convergence
• /
• v.11 no.2
• /
• pp.13-21
• /
• 2022

In this paper, we propose a learning based joint demosaicing and super-resolution framework which uses only the mosaiced color filter array(CFA) image as the input. As the proposed method works only on the mosaicied CFA image itself, there is no need for a large dataset. Based on our framework, we proposed two different structures, where the first structure uses one deep image prior network, while the second uses two. Experimental results show that even though we use only the CFA image as the training image, the proposed method can result in better visual quality than other bilinear interpolation combined demosaicing methods, and therefore, opens up a new research area for joint demosaicing and super-resolution on raw images.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.8 no.3
• /
• pp.1011-1025
• /
• 2014

A demosaicing method for a Bayer-like W-RGB color filter array (CFA) is proposed. When reproducing images from a W-RGB CFA, conventional color separation methods for W-RGB CFA are likely to cause blurring near the edges due to rough averaging using a color ratio of neighboring pixels. Moreover, these methods cannot be applied to real-life digital cameras with W-RGB CFA because the methods were proposed under an ideal situation, W=R+G+B, not a real-life situation, $W{\neq}R+G+B$. To improve edge performance, we propose a method of constant color difference assumption with inversed weight, which uses information from all edge directions for interpolating all missing color channels. The proposed method calculates the correlation between W, R, G, and B to enable its application to real-life digital cameras with W-RGB CFA. Simulations were performed to evaluate the proposed method using images captured from a real-life digital camera with W-RGB CFA. Simulation results shows that we can demosaic by using the proposed algorithm compared with the conventional one in about +34.79% SNR, +11.43% PSNR, +1.54% SSIM and 14.02% S-CIELAB error. Thus, the proposed method demosaics better than the conventional methods.

• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.43 no.6 s.312
• /
• pp.92-100
• /
• 2006

In imaging devices such as digital cameras using a single image sensor, captured images are the sub-sampled images comprised of the pixels that have only one of the three primary colors per a pixel. This images should be restored to the color images through an image processing referred as color interpolation. In this paper, we derive relation between the average of the data from CFA image sensor and the average of each color channel data. By using this relation, a new efficient method for color interpolation is proposed. Also, in order to reduce the zipper effect in a restored image, missing luminance values are interpolated along any edges in the captured image. On the other hand, for the chrominance channel interpolation, we average difference between a chrominance value and a luminance value in a local area, and this average value is added to the pixel value of the interpolated location. The proposed method has been compared with several previous methods, and our experimental results show the better results than the other methods.

• Journal of the Institute of Electronics and Information Engineers
• /
• v.51 no.9
• /
• pp.129-138
• /
• 2014

Various interpolations for digital imaging devices with a single image sensor have proposed. However, conventional methods did not consider the resolution modus of image sensor using periodic sampling. Therefore, the resulting images have problems such as quality degradation and color artifacts(color moire, zipper). In this paper, we propose a color interpolation algorithm for pixel resolution modus of image sensor. The proposed algorithm consisted of an initial step to compensate edge prediction effectively and refinement step using minimum directions for pixel resolution modus. To analyze a result of the proposed algorithm with conventional methods, we evaluated subjectively using images quality comparison and objectively using PSNR(Peak Signal to Noise Ratio). Experimental results showed that the proposed algorithm was more successful in eliminating the color artifacts than conventional methods judged by both objective and subjective criteria.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.36 no.5C
• /
• pp.286-294
• /
• 2011

In most digital cameras, images are obtained by a sensor overlaid by the color filter array (CFA) such as Bayer, demanding a demosaicking procedure to rebuild the full resolution color images. However, due to the nature of sensor, it is necessary to consider denoising step to remove the noise. In this paper, we analyze demosaicking and denoising jointly and show that the proposed method can solve the denoising issue by simple manner, well suppress different level of noises. The proposed algorithm yields comparable performances measured by several image quality assessment (CPSNR, SCIELAB, and FSIM), while the computational cost is low.

• Journal of the Institute of Electronics and Information Engineers
• /
• v.50 no.7
• /
• pp.205-215
• /
• 2013

In digital imaging system, Bayer pattern is widely used and the observed image is degraded by optical blur during image acquisition process. Generally, demosaicing and deblurring process are separately performed in order to convert a blurred Bayer image to a high resolution color image. However, the demosaicing process often generates visible artifacts such as zipper effect and Moire artifacts when performing interpolation across edge direction in Bayer pattern image. These artifacts are emphasized by the deblurring process. In order to solve this problem, this paper proposes a deblurring algorithm combined with edge directional color demosaicing method. The proposed method is consisted of interpolation step and region classification step. Interpolation and deblurring are simultaneously performed according to horizontal and vertical directions, respectively during the interpolation step. In the region classification step, characteristics of local regions are determined at each pixel position and the directionally obtained values are region adaptively fused. Also, the proposed method uses blur model based on wave optics and deblurring filter is calculated by using estimated characteristics of local regions. The simulation results show that the proposed deblurring algorithm prevents the boosting of artifacts and outperforms conventional approaches in both objective and subjective terms.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.34 no.12C
• /
• pp.1138-1146
• /
• 2009

Digital cameras adopting a single CCD detector collect image color by subsampling in three color planes and successively interpolating the information to reconstruct full-resolution color images. Therefore, to recovery of a full-resolution color image from a color filter array (CFA) like the Bayer pattern is generally considered as an interpolation issue for the unknown color components. In this paper, we first calculate luminance component value by combining R, G, B channel component information which is quite different from the conventional demosaicing algorithm. Because conventional system calculates G channel component followed by computing R and B channel components. Integrating the obtained gradient edge information and the improved weighting function in luminance component, a new edge sensitive demosaicing technique is presented. Based on 24 well known testing images, simulation results proved that our presented high-quality demosaicing technique shows the best image quality performance when compared with several recently presented techniques.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.45 no.3
• /
• pp.46-54
• /
• 2008

Most commercial CCD/CMOS image sensors have CFA(Color Filter Array) where each pixel gathers light of a selective color to reduce the sensor size and cost. There are many algorithms proposed to reconstruct the original clolr image by adopting pettern recognition of regularization methods to name a few. However the resulting image still suffer from errors such as flase color, zipper effect. In this paper we propose an adaptive edge weight demosaicking algorithm that is based on POCS(Projection Onto Convex Sets) not only to improve the entire image's PSNR but also to reduce the edge region's errors that affect subjective image quality. As a result, the proposed algorithm reconstruct better quality images especially at the edge region.

• Journal of the Institute of Electronics Engineers of Korea SD
• /
• v.43 no.11 s.353
• /
• pp.26-36
• /
• 2006

In this paper, we propose a cost-effective color filter may (CFA) demosaicing method for digital still cameras in which a single CCD or CMOS image sensor is used. Since a CFA is adopted, we must interpolate missing color values in the red, green and blue channels at each pixel location. While most state-of-the-art algorithms invest a great deal of computational effort in the enhancement of the reconstructed image to overcome the color artifacts, we focus on eliminating the color artifacts with low computational complexity. Using spatial correlation of the adjacent pixels, the edge-directional information of the neighbor pixels is used for determining the edge direction of the current pixel. We apply our method to the state-of-the-art algorithms which use edge-directed methods to interpolate the missing color channels. The experiment results show that the proposed method enhances the demosaiced image qualify from $0.09{\sim}0.47dB$ in PSNR depending on the basis algorithm by removing most of the color artifacts. The proposed method was implemented and verified successfully using verilog HDL and FPGA. It was synthesized to gate-level circuits using 0.25um CMOS standard cell library. The total logic gate count is 12K, and five line memories are used.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.9 no.12
• /
• pp.5087-5102
• /
• 2015

Rapid popularization of smart cell phone equipped with camera has led to a number of new legal and criminal problems related to multimedia such as digital image, which makes cell phone source identification an important branch of digital image forensics. This paper proposes a classifier combination based source identification strategy for cell phone images. To identify the outlier cell phone models of the training sets in multi-class classifier, a one-class classifier is orderly used in the framework. Feature vectors including color filter array (CFA) interpolation coefficients estimation and multi-feature fusion is employed to verify the effectiveness of the classifier combination strategy. Experimental results demonstrate that for different feature sets, our method presents high accuracy of source identification both for the cell phone in the training sets and the outliers.