Browse > Article

Real-Time Fixed Pattern Noise Suppression using Hardware Neural Networks in Infrared Images Based on DSP & FPGA  

Park, Chang-Han (SIAT, SAMSUNG THALES Co., Ltd.)
Han, Jung-Soo (SIAT, SAMSUNG THALES Co., Ltd.)
Chun, Seung-Woo (SIAT, SAMSUNG THALES Co., Ltd.)
Publication Information
Journal of the Institute of Electronics Engineers of Korea CI / v.46, no.4, 2009 , pp. 94-101 More about this Journal
Abstract
In this paper, we propose design of hardware based on a high speed digital signal processor (DSP) and a field programmable gate array (FPGA) for real-time suppression of fixed pattern noise (FPN) using hardware neural networks (HNN) in cooled infrared focal plane array (IRFPA) imaging system FPN appears a limited operation by temperature in observable images which applies to non-uniformity correction for infrared detector. These have very important problems because it happen serious problem for other applications as well as degradation for image quality in our system Signal processing architecture for our system operates reference gain and offset values using three tables for low, normal, and high temperatures. Proposed method creates virtual tables to separate for overlapping region in three offset tables. We also choose an optimum tenn of temperature which controls weighted values of HNN using mean values of pixels in three regions. This operates gain and offset tables for low, normal, and high temperatures from mean values of pixels and it recursively don't have to do an offset compensation in operation of our system Based on experimental results, proposed method showed improved quality of image which suppressed FPN by change of temperature distribution from an observational image in real-time system.
Keywords
InfraRed Focal Plane Array; Hardware Neural Networks; Digital Signal Processor; Non-uniformity Correction; Fixed Pattern Noise;
Citations & Related Records
연도 인용수 순위
  • Reference
1 C. Park, J. Han, and K. Bae, 'Suppression of fixed pattern noise for infrared image system,' Proc. The International Society for Optical Engineering (SPIE), Int. Conf. Defense and Security Symposium (DSS 2008), Vol. 6968, no. 69681Q, pp. 1-9, April 2008   DOI
2 H. Zhou, R. Lai, S. Liu, B. Wang, Q. Li, 'A new real-time processing system for the IRFPA imaging signal based on DSP&FPGA,' Infrared Physics, Technology, Vol. 46, no. 4, pp. 277-281, 2005   DOI   ScienceOn
3 G. Acciani, G. Brunetti, and G. Fornarelli, 'Application of neural networks in optical inspection and classification of solder joints in surface mount technology,' IEEE Trans., Industrial Informatics, Vol. 2, no. 3, pp. 200-209, August. 2006   DOI   ScienceOn
4 F. Chen and S. Liu, 'A neural-network approach to recognize defect spatial pattern in semiconductor fabrication,' IEEE Trans. Semiconductor Manufacturing, Vol. 13, no. 3, pp. 366-373, August 2000   DOI   ScienceOn
5 H. Lee, S. Kim, D. Park, J. Kim, and C. Park, 'Robust method for detecting an infrared small moving target based on the facet-based model,' Proc. The International Society for Optical Engineering (SPIE), Int. Conf. Defense and Security Symposium (DSS 2008), Vol. 6969, no. 69690E, pp. 1-9, April 2008   DOI
6 I. Lim, 'Implementation for temporal noise identification using adaptive threshold of infrared imaging system,' Proc. The International Society for Optical Engineering (SPIE), Europe Security and Defence (ESD 2007), Vol. 6737, no. 673718, pp. 1-10, October 2007   DOI
7 C. Park, K. Bae, and J. Jung, 'Object recognition in infrared image sequences using scale invariant feature transform,' Proc. The International Society for Optical Engineering (SPIE), Int. Conf. Defense and Security Symposium (DSS 2008), Vol. 6968, no. 69681P, pp. 1-9, April 2008   DOI
8 S. Chun, Y. Hayakawa, and K. Nakajima 'Hardware neural network for a visual inspection system,' IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences 2008, Vol. E91-A, no. 4, pp. 935-942, April 2008   DOI   ScienceOn
9 T. Zhang and Y. Shi, 'Edge-directed adaptive nonuniformity correction for staring infrared focal plane arrays,' Image, Vision Computing, Vol. 25, no. 6, pp. 833-851, June 2007   DOI   ScienceOn
10 A. Averbuch, G. Liron, and B. Bobrovsky, 'Scene based non-uniformity correction in thermal images using Kalman filter,' Image, Vision Computing, Vol. 25, no. 6, pp. 833-851, June 2007   DOI   ScienceOn
11 H. Hikawa, 'A digital hardware pulse-mode neuron with piecewise linear activation function,' IEEE Trans. Neural Networks, Vol. 4, no. 5, pp. 1028-1037, September 2003
12 S. Sato, K. Nemoto, S. Akimoto, M. Kinjo, and K. Nakajima, 'Implementation of a new neurochip using stochastic logic,' IEEE Trans. Neural Networks, Vol. 14, no. 5, pp. 1122-1127, September 2003   DOI   ScienceOn