Browse > Article
http://dx.doi.org/10.9708/jksci.2019.24.06.011

Scene-based Nonuniformity Correction by Deep Neural Network with Image Roughness-like and Spatial Noise Cost Functions  

Hong, Yong-hee (LIG Nex1)
Song, Nam-Hun (LIG Nex1)
Kim, Dae-Hyeon (LIG Nex1)
Jun, Chan-Won (Defense Industry Technology Center)
Jhee, Ho-Jin (LIG Nex1)
Abstract
In this paper, a new Scene-based Nonuniformity Correction (SBNUC) method is proposed by applying Image Roughness-like and Spatial Noise cost functions on deep neural network structure. The classic approaches for nonuniformity correction require generally plenty of sequential image data sets to acquire accurate image correction offset coefficients. The proposed method, however, is able to estimate offset from only a couple of images powered by the characteristic of deep neural network scheme. The real world SWIR image set is applied to verify the performance of proposed method and the result shows that image quality improvement of PSNR 70.3dB (maximum) is achieved. This is about 8.0dB more than the improved IRLMS algorithm which preliminarily requires precise image registration process on consecutive image frames.
Keywords
Deep Neural Network; Image Roughness-like; SN; SBNUC; Improved IRLMS;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 D. A. Scribner, M. Kruer, and J. Killiany, "Infrared focal plane array technology," Proc. IEEE, vol. 79, no. 1, pp. 66-85, Jan 1991.   DOI
2 A. Friedenberg and I. Goldbatt, "Nonuniformity two-point linear correction errors in infrared focal plane arrays," Opt. Eng. 37(4), pp. 1251-1253, April, 1998.   DOI
3 O. Riou, S. Berrebi, and P. Bremond, "Nonuniformity correction and thermal drift compensation of thermal infrared camera," Proc. SPIE 5405, pp 294-302, April, 2004.
4 R. Hardie, F. Baxley, B. Brys, and P. Hytla, "Scene-based nonuniformity correction with reduced ghosting using a gated LMS algorithm," Opt. Express 17, pp. 14918-14933, 2009.   DOI
5 J. Harris and Y. Chiang, "Minimizing the 'ghosting' artifact in scene-based nonuniformity correction," Proc. SPIE 3377, pp. 106-113, 1998.
6 Russell C. Hardie, Majeed M. Hayat, Earnest Armstrong, and Brian Yasuda, "Scene-based nonuniformity correction with video sequences and registration," Applied Optics Vol. 39, Issue 8, pp. 1241-1250, 2000.   DOI
7 Chao Zuo, Qian Chen, Guohua Gu and Xiubao Sui, "Scene-Based Nonuniformity Correction Algorithm Based on Interframe Registration," J Opt Soc Am A Opt Image Sci Vis 28 (6), pp. 1164-1176, Jun, 2011.   DOI
8 Chao Zuo, Qian Chen, Guohua Gu, Xiubao Sui, and Jianle Ren, "Improved interframe registration based nonuniformity correction for focal plane arrays," ELSEVIER Infrared Physics & Technology Vol 55, Issue 4, pp. 263-269, July 2012.   DOI
9 Chao Zuo, Yuzhen Zhang, Qian Chen, Guohua Gu, Weixian Qian, Xiubao Sui and Jianle Ren, "A two-frame approach for scene-based nonuniformity correction in array sensors," ELSEVIER Infrared Physics & Technology Vol 60, pp. 190-196, Sep 2013.   DOI
10 D. Scribner, K. Sarkady, M. Kruer, J. Caldfield, J. Hunt, M. Colbert, and M. Descour, "Adaptive nonuniformity correction for IR focal plane arrays using neural networks," Proc. SPIE 1541, pp. 100-109, 1991.
11 Yohann Tendero, Stephane Landeau and Jerome Gilles, "Non-uniformity Correction of Infrared Images by Midway Equalization," Image Processing On Line, pp. 134-146, Jan 2012.   DOI
12 Yong-hee Hong, Keun-Jae Lee, Hong-Rak Kim, Ho-Jin Jhee, "Scene-based Nonuniformity Correction Complemented by Block Reweighting and Global Offset Initialization," Journal of The Korea Society of Computer and Information, Vol. 22 No. 8, pp. 15-23, August 2017.   DOI
13 Lee Jonhho, Ra Jongbeom, "Improvement on a optimization algorithm for non-uniformity correction of infrared videos," Master Thesis, KAIST, Department of Electrical Engineering, 2013.
14 Kim Seongmin, Bae Yoonsung, Jang Jaeho, and Ra Jongbeom, "Fixed Pattern Noise Reduction in Infrared Videos Based on Joint Correction of Gain and Offset," The Institute of Electronics and Information Engineers, Vol. 49, SP. 2, pp. 35-44, 2012.   DOI
15 Gun-hyo No, Yong-hee Hong, Jin-ho Park, Ho-jin Jhee, "Scene-based Nonuniformity Correction for Neural Network Complemented by Reducing Lense Vignetting Effect and Adaptive Learning rate," Journal of The Korea Society of Computer and Information, Vol. 23 No. 7, pp. 81-90, July 2018.   DOI
16 D. L. Perry and E. L. Dereniak, "Linear theory of nonuniformity correction in infrared staring sensors," Opt. Eng. 32, pp. 1854-1859, 1993.   DOI