Browse > Article

An Image Signal Processor for Ultra Small HDGrade Video Sensor with 3A in Camera Phones  

Jang, Won-Woo (Dept. of Electronics Engineering, Dong-A University)
Kim, Joo-Hyun (SAMSUNG Electro-Mechanics Co. Ltd.)
Han, Hag-Yong (Dept. of Electronics Engineering, Dong-A University)
Yang, Hoon-Gee (Dept. of Radio science Engineering, Kwangwoon University)
Kang, Bong-Soon (Dept. of Electronics Engineering, Dong-A University)
Abstract
In this paper, we propose an image signal processor (ISP) for an ultra small HD-grade video sensor with 3A (AWB, AE, and AF) in camera phones that can process 720P/30fps videos. In order to enhance the video quality of the systems, it is necessary to achieve the high performance of the 3A. The proposed AWB algorithm multiplies the adjusted coefficients of color gains to the captured data of white objects. The proposed AE method adopts the index step moving based on the difference between an averaged Y luminance and a target luminance, together with IIR filters with variable time responses. The proposed AF technique controls the focus curve to find the lens position that maximizes the integrated high frequency components in luminance values by using highpass filters. Finally, we compare the image quality captured from our system to the quality of a commercial HD camcorder in order to evaluate the performance of the proposed ISP. The proposed ISP system is also fabricated with 0.18um CMOS flash memory process.
Keywords
Image signal processor; 3A; AWB; AE; AF; Adaptive Color Samples; Index Step Moving;
Citations & Related Records
연도 인용수 순위
  • Reference
1 J. He, R. Zhou, and Z. Hong, "Modified Fast Climbing Search Auto-focus Algorithm with Adaptive Step Size Searching Technique for Digital Camera," IEEE Trans. on Consumer Electronics, Vol. 49, No. 2, pp. 257 – 262, May 2003   DOI   ScienceOn
2 A. Morimura et al., "A Digital Video Camera System," IEEE Trans. On Consumer Electronics, Vol. 36, No. 4, pp. 866 – 876, Nov. 1990   DOI   ScienceOn
3 V. Cardei, B. Funt, and K. Barnard, "Adaptive illuminant estimation using neural network," Proc.Of the 8th Int. Conf. on Artificial Neural Network, pp.749 – 754, Skvde, Sweden, 1998
4 R. C. Gonzalez, Digital Image Processing, 3rd ed., Addison Wesley Longman, 2007
5 D. Doswald, J. Hafliger, P. Blessing, N. Felber, P. Niederer, and W. Fichtner, "A 30-frames/smegapixel real-time CMOS image processor," IEEE Trans. on Solid-State Circuits, Vol. 35, No. 11, pp. 1732 – 1743, Nov. 2000   DOI   ScienceOn
6 J. Huo, Y. Chang, J. Wang, and X. Wei, "Robust Automatic White Balance Algorithm using Gray Color Points in Images," IEEE Trans. on Consumer Electronics, Vol. 52, No. 2, pp. 541–546, May 2006   DOI   ScienceOn
7 G. Buchsbaum, "A spatial processor model for object colour perception," Journal of Franklin Institute, Vol.310, No. 1, pp. 1-26, 1980   DOI   ScienceOn
8 B. Cassin and S. Solomon, Dictionary of Eye Terminology. Gainsville, Florida: Triad Publishing Company, 1990
9 E. B. Goldstein, Sensation & Perception. 7th Edition. Canada: Thompson Wadsworth, 2007
10 W. Kao, S. Chen, T. Sun, T. Chiang, and S. Lin, "An Integrated Software Architecture for Real- Time Video and Audio Recording Systems," IEEE Trans. on Consumer Electronics, Vol. 51, No. 3, pp. 879 – 884, Aug. 2005   DOI   ScienceOn
11 S. W. Lee, Y. Kumar, J. M. Cho, S. W. Lee, and S. W. Kim, "Enhanced autofocus algorithm using robust focus measure and fuzzy reasoning," IEEE Trans. On Consumer Electronics, Vol. 18, No. 9, pp. 1237-1246, Sep. 2008   DOI   ScienceOn
12 J. Ha, S. Lee, T. Kim, W. Choi, and B. Kang, "A New Approach to Color Adjustment for Mobile Application Display with a Skin Protection Algorithm on a CIE1931 Diagram," IEEE Trans. on Consumer Electronics, Vol. 53, No. 1, pp. 191–196, Feb. 2007   DOI
13 R. Pete, Digital Color Correction, Thomson Learning, 2005
14 W. Jang, B. Kwak, J. Kim, and B. Kang, "An Image Signal Processor For Ultra Small HD Video Sensor With 3A In Camera Phones," ICCE, 3.3-3, Jan. 2009   DOI
15 E.H. Land, "The retinex theory of color vision," Scientific American, pp. 108-129, 1997
16 H. Yoshida, S. Okada, H. Murata, M. Kurokawa, and H. Okada, "Ultra small HD video camera using MPEG4 codec with SD memory card as storage,' ICCE, 8.3-3, Jan. 2007   DOI
17 T. Kuno, H. Sugiura, and N. Matoba, "A new automatic exposure system for digital still cameras,' IEEE Trans. on Consumer Electronics, Vol. 44, No. 1, pp, 192 – 199, Feb. 1998   DOI   ScienceOn
18 W. Jang, K. Son, J. Kim, and B. Kang, "Auto White Balance System Using Adaptive Color Samples for Mobile Devices," pp. 1462 – 1465, IEEE APCCAS2008, Dec. 2008   DOI
19 J. Lee, Y. Jung, B. Kim, and S. Ko, "An Advanced Video Camera System with Robust AF, AE, and AWB Control," IEEE Trans. on Consumer Electronics, Vol. 47, No. 3, pp. 694 –699, Aug. 2001   DOI   ScienceOn
20 S. Sohn, S. Yang, S. Kim, K. Baek, and W. Paik, "SoC Design of An Auto-Focus Driving Image Signal Processor for Mobile Camera Applications," IEEE Trans. on Consumer Electronics, Vol. 52, No. 1, pp. 10 – 16, Feb. 2006   DOI   ScienceOn