Browse > Article
http://dx.doi.org/10.9717/kmms.2016.19.12.1951

Two Scale Fusion Method of Infrared and Visible Images Using Saliency and Variance  

Kim, Young Choon (Dept. of Information Communication & Security, U1 University)
Ahn, Sang Ho (Dept. of Electronic, Telecommunications, Mechanical & Automotive Engineering, Inje University)
Publication Information
Journal of Korea Multimedia Society / v.19, no.12, 2016 , pp. 1951-1959 More about this Journal
Abstract
In this paper, we propose a two-scale fusion method for infrared and visible images using saliency and variance. The images are separated into two scales respectively: a base layer of low frequency component and a detailed layer of high frequency component. Then, these are synthesized using weight. The saliencies and the variances of the images are used as the fusion weights for the two-scale images. The proposed method is tested on several image pairs, and its performance is evaluated quantitatively by using objective fusion metrics.
Keywords
Infrared And Visible Image Fusion; Two-scale Synthesis; Based Layer; Detail Layer; Saliency; Variance; Fusion Weight;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 R.S. Blum and Z. Liu, Multi-sensor Image Fusion & Its Applications, CRC press, Taylor & Francis Group, Boca Raton, 2006.
2 H.B. Kekre, D. Mishra, and R. Saboo, "Review of Image Fusion Techniques and Performance Evaluation Parameters," International Journal of Engineering Science and Technology, Vol. 5, No. 4. pp. 880-889, 2013.
3 Y. Zheng, Image fusion and its applications, InTech, India, 2011.
4 E. Gu, E. Lee, S. Kim, W. Cho, H. Kim, and K. Park, "FLIR and CCD image fusion algorithm based on adaptive weight for target extraction," Journal of Korea Multimedia Society, Vol. 15, No. 3, pp. 291-298, 2012.   DOI
5 F.A. Al-Wassai, N.V. Kalyankar, and A.A. Al-Zaky, "Multisensor Image Fusion Based on Feature-level," International Journal of Latest Technology in Engineering, Management & Applied Science, Vol. 1, Issue 5, pp. 124-138, 2012.
6 L. Xu, J. Du, Q. Hu, and Q. Li, "Feature-based Image Fusion with a Uniform Discrete Curvelet Transform," International Journal of Advanced Robotic Systems, Vol. 10, pp. 1-10, 2013.   DOI
7 E. Lallier and M. Farooq, "A Real Time Pixel-level Based Image Fusion via Adaptive Weight Averaging," Information Fusion, Vol. 2, pp. 3-12, 2000.
8 Z. Xue, R.S. Blum, and Y. Li, "Fusion of Visual and IR Images for Concealed Weapon Detection," Proceeding of International Conference on Information Fusion, pp. 1198-1205, 2002.
9 V.P.S. Naidu and J.R. Raol, "Pixel-level Image Fusion Using Wavelets and Principal Component Analysis," Defense Science Journal, Vol. 58, No. 3, pp. 338-352, 2008.   DOI
10 S.K. Sadhasivam, M.B. Keerthivasan, and Muttan S, "Implementation of Max Principle with PCA in Image Fusion for Surveillance and Navigation Application," Electronic Letter on Computer Vision and Image Analysis, Vol. 10, No. 1, pp. 1-10, 2011.   DOI
11 J. Han, E.J. Pauwels, and P. Zeeuw, "Fast Saliency-aware Multi-modality Image Fusion," Neurocomputing, Vol. 111, pp. 70-80, 2013.   DOI
12 J. Zhao, Q. Zhou, Y. Chen, H. Feng, Z. Xu, and Q. Li, "Fusion of Visible and Infrared Images Using Saliency Analysis and Detail Preserving Based Image Decomposition," Infrared Physics & Technology, Vol. 56, pp. 93-99, 2013.   DOI
13 G. Cui, H. Feng, Z. Xu, Q. Li, and Y. Chen, "Detail Preserved Fusion of Visible and Infrared Images Using Regional Saliency Extraction and Multi-scale Image Decomposition," Optics Communications, Vol. 341, pp. 199-209, 2015.   DOI
14 D.P. Bavirisetti and R. Dhuli, "Two-scale Image Fusion of Visible and Infrared Images Using Saliency Detection," Infrared Physics & Technology, Vol. 76, pp. 52-64, 2016.   DOI
15 H. Li, B. Manjunath, and S. Mitra, "Multisensor Image Fusion Using the Wavelet Transform," Graphical Models and Image Processing, Vo1. 57, Issue 3. pp.235-245, 1995.   DOI
16 X. Bai, F. Zhou, and B. Xue, "Fusion of Infrared and Visual Images through Region Extraction by Using Multiscale Center-surround Top-hat Transform," Optics Express, Vol. 19, No. 9, pp. 8444-8457, 2011.   DOI
17 R. Achanta, S. Hemami, M, Estrada, and S. Susstrunk, "Frequency-tuned Salient Region Detection," Proceeding of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1597-1604, 2009.
18 V. Aslantas and E. Bendes, "A New Image Quality Metric for Image Fusion: The Sum of the Correlations of Differences," International Journal of Electronics and Communications. Vol. 69, pp. 1890-1896, 2015.   DOI
19 Z. Wang and A.C. Bovik, "A Universal Image Quality Index," IEEE Signal Processing Letters, Vol. 9, No. 3, pp. 81-84, 2002.   DOI
20 G. Piella and H. Heijmans, "A New Quality Metric for Image Fusion," Proceedings of International Conference on Image Processing, pp. 173-176, 2003.