Journal of information and communication convergence engineering

The Korea Institute of Information and Commucation Engineering (한국정보통신학회)
권호 표지

An Image Signal Processor for Ultra Small HDGrade Video Sensor with 3A in Camera Phones

  • Published : 2009.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we propose an image signal processor (ISP) for an ultra small HD-grade video sensor with 3A (AWB, AE, and AF) in camera phones that can process 720P/30fps videos. In order to enhance the video quality of the systems, it is necessary to achieve the high performance of the 3A. The proposed AWB algorithm multiplies the adjusted coefficients of color gains to the captured data of white objects. The proposed AE method adopts the index step moving based on the difference between an averaged Y luminance and a target luminance, together with IIR filters with variable time responses. The proposed AF technique controls the focus curve to find the lens position that maximizes the integrated high frequency components in luminance values by using highpass filters. Finally, we compare the image quality captured from our system to the quality of a commercial HD camcorder in order to evaluate the performance of the proposed ISP. The proposed ISP system is also fabricated with 0.18um CMOS flash memory process.

Keywords

References

  1. W. Kao, S. Chen, T. Sun, T. Chiang, and S. Lin, "An Integrated Software Architecture for Real- Time Video and Audio Recording Systems," IEEE Trans. on Consumer Electronics, Vol. 51, No. 3, pp. 879 – 884, Aug. 2005 https://doi.org/10.1109/TCE.2005.1510498
  2. J. Lee, Y. Jung, B. Kim, and S. Ko, "An Advanced Video Camera System with Robust AF, AE, and AWB Control," IEEE Trans. on Consumer Electronics, Vol. 47, No. 3, pp. 694 –699, Aug. 2001 https://doi.org/10.1109/30.964165
  3. S. Sohn, S. Yang, S. Kim, K. Baek, and W. Paik, "SoC Design of An Auto-Focus Driving Image Signal Processor for Mobile Camera Applications," IEEE Trans. on Consumer Electronics, Vol. 52, No. 1, pp. 10 – 16, Feb. 2006 https://doi.org/10.1109/TCE.2006.1605018
  4. T. Kuno, H. Sugiura, and N. Matoba, "A new automatic exposure system for digital still cameras,' IEEE Trans. on Consumer Electronics, Vol. 44, No. 1, pp, 192 – 199, Feb. 1998 https://doi.org/10.1109/30.663747
  5. J. He, R. Zhou, and Z. Hong, "Modified Fast Climbing Search Auto-focus Algorithm with Adaptive Step Size Searching Technique for Digital Camera," IEEE Trans. on Consumer Electronics, Vol. 49, No. 2, pp. 257 – 262, May 2003 https://doi.org/10.1109/TCE.2003.1209511
  6. A. Morimura et al., "A Digital Video Camera System," IEEE Trans. On Consumer Electronics, Vol. 36, No. 4, pp. 866 – 876, Nov. 1990 https://doi.org/10.1109/30.61549
  7. D. Doswald, J. Hafliger, P. Blessing, N. Felber, P. Niederer, and W. Fichtner, "A 30-frames/smegapixel real-time CMOS image processor," IEEE Trans. on Solid-State Circuits, Vol. 35, No. 11, pp. 1732 – 1743, Nov. 2000 https://doi.org/10.1109/4.881221
  8. J. Ha, S. Lee, T. Kim, W. Choi, and B. Kang, "A New Approach to Color Adjustment for Mobile Application Display with a Skin Protection Algorithm on a CIE1931 Diagram," IEEE Trans. on Consumer Electronics, Vol. 53, No. 1, pp. 191–196, Feb. 2007 https://doi.org/10.1109/TCE.2007.339524
  9. W. Jang, K. Son, J. Kim, and B. Kang, "Auto White Balance System Using Adaptive Color Samples for Mobile Devices," pp. 1462 – 1465, IEEE APCCAS2008, Dec. 2008 https://doi.org/10.1109/APCCAS.2008.4746307
  10. J. Huo, Y. Chang, J. Wang, and X. Wei, "Robust Automatic White Balance Algorithm using Gray Color Points in Images," IEEE Trans. on Consumer Electronics, Vol. 52, No. 2, pp. 541–546, May 2006 https://doi.org/10.1109/TCE.2006.1649677
  11. G. Buchsbaum, "A spatial processor model for object colour perception," Journal of Franklin Institute, Vol.310, No. 1, pp. 1-26, 1980 https://doi.org/10.1016/0016-0032(80)90058-7
  12. V. Cardei, B. Funt, and K. Barnard, "Adaptive illuminant estimation using neural network," Proc.Of the 8th Int. Conf. on Artificial Neural Network, pp.749 – 754, Skvde, Sweden, 1998
  13. E.H. Land, "The retinex theory of color vision," Scientific American, pp. 108-129, 1997
  14. B. Cassin and S. Solomon, Dictionary of Eye Terminology. Gainsville, Florida: Triad Publishing Company, 1990
  15. E. B. Goldstein, Sensation & Perception. 7th Edition. Canada: Thompson Wadsworth, 2007
  16. H. Yoshida, S. Okada, H. Murata, M. Kurokawa, and H. Okada, "Ultra small HD video camera using MPEG4 codec with SD memory card as storage,' ICCE, 8.3-3, Jan. 2007 https://doi.org/10.1109/ICCE.2007.341490
  17. S. W. Lee, Y. Kumar, J. M. Cho, S. W. Lee, and S. W. Kim, "Enhanced autofocus algorithm using robust focus measure and fuzzy reasoning," IEEE Trans. On Consumer Electronics, Vol. 18, No. 9, pp. 1237-1246, Sep. 2008 https://doi.org/10.1109/TCSVT.2008.924105
  18. R. C. Gonzalez, Digital Image Processing, 3rd ed., Addison Wesley Longman, 2007
  19. W. Jang, B. Kwak, J. Kim, and B. Kang, "An Image Signal Processor For Ultra Small HD Video Sensor With 3A In Camera Phones," ICCE, 3.3-3, Jan. 2009 https://doi.org/10.1109/ICCE.2009.5012325
  20. R. Pete, Digital Color Correction, Thomson Learning, 2005