• Journal of the Institute of Electronics Engineers of Korea SD
• /
• v.43 no.11 s.353
• /
• pp.26-36
• /
• 2006

In this paper, we propose a cost-effective color filter may (CFA) demosaicing method for digital still cameras in which a single CCD or CMOS image sensor is used. Since a CFA is adopted, we must interpolate missing color values in the red, green and blue channels at each pixel location. While most state-of-the-art algorithms invest a great deal of computational effort in the enhancement of the reconstructed image to overcome the color artifacts, we focus on eliminating the color artifacts with low computational complexity. Using spatial correlation of the adjacent pixels, the edge-directional information of the neighbor pixels is used for determining the edge direction of the current pixel. We apply our method to the state-of-the-art algorithms which use edge-directed methods to interpolate the missing color channels. The experiment results show that the proposed method enhances the demosaiced image qualify from $0.09{\sim}0.47dB$ in PSNR depending on the basis algorithm by removing most of the color artifacts. The proposed method was implemented and verified successfully using verilog HDL and FPGA. It was synthesized to gate-level circuits using 0.25um CMOS standard cell library. The total logic gate count is 12K, and five line memories are used.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.47 no.3
• /
• pp.1-10
• /
• 2010

In this paper, we propose a novel way of combining color demosaicing and the auto white balance (AWB) method, which are important parts of image processing. Performance of the AWB is generally affected by demosaicing results because most AWB algorithms are performed posterior to color demosaicing. In order to increase the performance and efficiency of the AWB algorithm, the color constancy problem is considered during the color demosaicing step. Initial estimates of the directional luminance and chrominance values are defined for estimating edge direction and calculating the AWB gain. We propose a modified edge-based AWB method that used a pre-defined achromatic region. The estimation of edge direction is performed region adaptively by using the local statistics of the initial estimates of the luminance and chrominance information. The proposed method shows significant improvements in terms of visual and numerical criteria when compared to conventional methods.

• Proceedings of the KIEE Conference
• /
• 2005.07d
• /
• pp.2864-2866
• /
• 2005

색역폭 사상은 디스플레이 장치간의 색재현성 차이를 보정하기 위한 기법이다. 본 논문에서는 사면체 보간에 의한 실시간 색역폭 사상을 제안하고자 한다. 기존의 제안된 육면체 보간 방식에 비해 이 논문에서 제안된 사면체 보간(tetrahedral interpolation) 방법은 색공간의 분할을 통해 분할된 각각의 사면체 색 공간에서 색역폭 사상이 수행됨으로서 왜곡이 감소되고 육면체 보간이 8개의 룩업테이블을 사용하는데 비해 4개의 룩업 테이블을 사용함으로서 실시간 처리속도의 향상과 하드웨어의 구현 시 비용절감을 기대할 수가 있다.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.44 no.5
• /
• pp.103-111
• /
• 2007

In this paper, we propose a VLSI architecture of hardware optimized high quality image signal processor for a Single-chip CMOS Image Sensor(CIS). The Single-chip CIS is usually used for mobile applications, so it has to be implemented as small as possible while maintaining the image quality. Several image processing algorithms are used in ISP to improve captured image quality. Among the several image processing blocks, demosaicing and image filter are the core blocks in ISP. These blocks need line memories, but the number of line memories is limited in a low cost Single-chip CIS. In our design, high quality edge-adaptive and cross channel correlation considered demosaicing algorithm is adopted. To minimize the number of required line memories for image filter, we share the line memories using the characteristics of demosaicing algorithm which consider the cross correlation. Based on the proposed method, we can achieve both high quality and low hardware complexity with a small number of line memories. The proposed method was implemented and verified successfully using verilog HDL and FPGA. It was synthesized to gate-level circuits using 0.25um CMOS standard cell library. The total logic gate count is 37K, and seven and half line memories are used.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2018.11a
• /
• pp.69-72
• /
• 2018

본 논문은 Multiscale Gradients (MSG)를 기반으로 한 Color Filter Array Interpolation을 토대로 개선된 필터와 보간 과정의 알고리듬을 제안한다. MSG는 초록색 채널 보간, 초록색 채널 갱신, 빨간색 및 파란색 채널 보간 과정으로 이루어진다. 이때, 더욱 정교한 보간을 위해 필터의 크기를 증가시키고, 보간 과정에 이용되는 주변 픽셀의 개수를 늘렸다. 이러한 실험을 통해 높은 스펙트럼 상관관계, 낮은 채도, 낮은 색 경사도를 가진 Kodak dataset과 자연 영상과 유사한 특성을 갖는 McMaster dataset 모두의 경우에서 Color Peak Signal to Noise Ratio (CPSNR)이 향상되는 것을 확인하였다.

• Journal of the Korea Society of Computer and Information
• /
• v.15 no.10
• /
• pp.59-70
• /
• 2010

Each pixels become got pixel value for color of only one from among colors because of bayer pattern that light receiving device of image sensor which is used in HHP and digital camera writes only one color. Information of the missing pixels could infer perfect color image from using information of neighbor pixels by using CFA(Color Filter Array). In this paper, we derive relation between the average of the data from the light receiving device of image sensor and each color channel data. And by using this relation, a new efficient edge color fuzzy method for color interpolation is proposed. Also, missing luminance signal channel interpolation was fuzzy interpolation along any edges direction for reducing color noise and interpolating efficiently it. And in this paper, the proposed method has been proved improving average 2.4dB than the conventional method by using PSNR. Also, resolution of the image of the proposed method was similar to the original image by visual images, we has been verified to be decreased a chromatic aberration than image of conventional algorithms with simulation result.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2015.11a
• /
• pp.121-124
• /
• 2015

본 논문은 Multiscale Gradients (MSG)를 기반으로 한 Color Filter Array Interpolation을 배경으로 Kodak Dataset보다 실제 디지털 카메라로 촬영한 이미지에 가까운 McMaster Dataset에서 개선된 성능을 내는 알고리듬을 제안한다. MSG는 녹색 채널 보간, 녹색 채널 갱신, 빨간색, 파란색 채널 보간의 과정을 거친다. 이때 높은 스펙트럼 상관관계, 낮은 색채도, 낮은 색 경사도를 가진 Kodak Dataset과 달리 자연 이미지에서는 녹색 채널 갱신 과정의 추정방법을 사용하면 화질 및 Color Peak Signal to Noise Ratio (CPSNR)이 저하되는 것을 확인하였다. 이러한 실험결과를 바탕으로 개선된 필터와 색상 보간 과정을 통해 기존의 알고리듬에 비해 향상된 성능을 보여주는 알고리듬을 제안한다.

• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.43 no.6 s.312
• /
• pp.92-100
• /
• 2006

In imaging devices such as digital cameras using a single image sensor, captured images are the sub-sampled images comprised of the pixels that have only one of the three primary colors per a pixel. This images should be restored to the color images through an image processing referred as color interpolation. In this paper, we derive relation between the average of the data from CFA image sensor and the average of each color channel data. By using this relation, a new efficient method for color interpolation is proposed. Also, in order to reduce the zipper effect in a restored image, missing luminance values are interpolated along any edges in the captured image. On the other hand, for the chrominance channel interpolation, we average difference between a chrominance value and a luminance value in a local area, and this average value is added to the pixel value of the interpolated location. The proposed method has been compared with several previous methods, and our experimental results show the better results than the other methods.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.47 no.2
• /
• pp.86-94
• /
• 2010

In this paper, we propose spatially adaptive color demosaicing of noisy Bayer data. When sensor noises are not considered in demosaicing, they may degrade result image. In order to obtain high resolution image, sensor noises are considered in the color demosaicing step. We identify flat, edge and pattern regions at each pixel location to improve the performance of the algorithm and to reduce complexity. Based on the pre-classified regions, the demosaicing of the G channel is performed using the local statistics to reduce the interpolation error. The sensor noise is simultaneously removed by a modified version of non-local mean filter in the green and in the color difference domain. The R and B channels are interpolated easily using fully interpolated and denoised G and color difference values. Experimental results show that the proposed method achieves a significant improvement in terms of visual and numerical criteria, when compared to conventional methods.

• Journal of Broadcast Engineering
• /
• v.15 no.2
• /
• pp.265-279
• /
• 2010

A color image requires at least three color channels to obtain the full color image. However the image sensor obtains only the intensity of the brightness, that is, three image sensors are required for every pixel to capture the full color image. Since the image sensor is quiet expensive, most of digital still cameras adopt single image sensor array with color filter array (CFA) to reduce the size and the cost. Since the image obtained using single sensor array has only one color component per pixel, we need to reconstruct the missing two color components to obtain the full color image. We call this process as color filter interpolation or demosaicking. In this paper, demosaicking algorithm composed of two large step is proposed. Proposed algorithm is combined with several different algorithms such as Edge-directed demosaicking, Second-order gradients as correction terms, Smooth hue transition Interpolation, etc. The simulation results show that the proposed algorithm performs much better than the state-of-the-art demosaicking algorithms in terms of both subjective and objective qualities.