Browse > Article
http://dx.doi.org/10.7840/KICS.2011.36C.6.349

Image Registration and Fusion between Passive Millimeter Wave Images and Visual Images  

Lee, Hyoung (대구대학교 정보통신공학부)
Lee, Dong-Su (대구대학교 정보통신공학부)
Yeom, Seok-Won (대구대학교 정보통신공학부)
Son, Jung-Young (대구대학교 정보통신공학부)
Guschin, Vladmir P. (대구대학교 정보통신공학부)
Kim, Shin-Hwan (대구대학교 정보통신공학부)
Abstract
Passive millimeter wave imaging has the capability of detecting concealed objects under clothing. Also, passive millimeter imaging can obtain interpretable images under low visibility conditions like rain, fog, smoke, and dust. However, the image quality is often degraded due to low spatial resolution, low signal level, and low temperature resolution. This paper addresses image registration and fusion between passive millimeter images and visual images. The goal of this study is to combine and visualize two different types of information together: human subject's identity and concealed objects. The image registration process is composed of body boundary detection and an affine transform maximizing cross-correlation coefficients of two edge images. The image fusion process comprises three stages: discrete wavelet transform for image decomposition, a fusion rule for merging the coefficients, and the inverse transform for image synthesis. In the experiments, various types of metallic and non-metallic objects such as a knife, gel or liquid type beauty aids and a phone are detected by passive millimeter wave imaging. The registration and fusion process can visualize the meaningful information from two different types of sensors.
Keywords
Millimeter wave imaging; Image fusion; Image registration; Concealed object detection; Feature extraction; Discrete wave transforms;
Citations & Related Records
연도 인용수 순위
  • Reference
1 http://www.tsa.gov/311/311-carry-ons.shtm
2 H. Lee, S. Yeom, J. Son, and V. P. Gushin, "Image Registration and fusion of MMW and visual images for concealed object detection," Proc. SPIE defense, security, and sensing, Orlando, Vol.7670, 76700H, April 2010.
3 R. C. Gonzalez, Digital Image Processing 2/E (Prentice-Hall Inc., 2003).
4 T. W. D. Bosq, J. M. Lopez-Alonso, and G. D. Boreman, "Millimeter wave imaging system for landmine detection," Applied optics, Vol.45, No.22, pp.5686-5692, 2006.   DOI
5 G. Pajares and J. M. de la Cruz, "A wavelet-based image fusion tutorial," Pattern Recognition, Vol.37, No.9, pp.185-1872, 2004.
6 P. Hill, N. Canagarajah, and D. Bull, "Image fusion using complex wavelets," Proc. the 13th British Machine Vision Conference, Isaac Councill, San Francisco, pp. 287-296, 2002.
7 L. Yujiri, M. Shoucri, and P. Moffa, "Passive millimeter-wave imaging," IEEE microwave magazine, Vol.4, pp.39-50, September, 2003.   DOI   ScienceOn
8 Z. Xue, R. S. Blum, and Y. Li, "Fusion of visual and IR images for concealed weapon detection," Proc. IEEE information fusion, Vol.2, pp.1198-1205, 2002.   DOI
9 X. Qing, X. Shuai, T. Bing, L. Jiansheng, and G. Zexun, "Complex wavelet and application to image fusion," ISPRS, Commission III, WG III/6.
10 E. G. Swee and S. Elangovan, "Applications of Symlets for denoising and load forecasting," Proc. IEEE signal processing workshop, Madison, Wisconsin, pp.165-169, 1999.
11 J. Son, V. P. Guschin, S. Yeom, S. Kim, and H. Lee, "Stereo images in millimeter-wave regime," Proc. SPIE 7329, 73290L, April, 2009.
12 M. R. Fetterman, J. Grata, G. Jubic, W. L. Kiser, Jr., and A. Visnansky, "Simulation, acquisition and analysis of passive millimeterwave images in remote sensing applications," Optics Express, Vol.16, No.25, pp.20503-20515, 2008.   DOI
13 K. B. Cooper, R. J. Dengler, N. Llombart, T. Bryllert, G. Chattopadhyay, I. Mehdi, and P. H. Siegel, "An approach for sub-second imaging of concealed objects using terahertz (THZ) radar," Int. J. Infrared Millim. Waves, Vol.30, pp.1297-1307, 2009.