Browse > Article
http://dx.doi.org/10.9708/jksci.2017.22.12.069

An Improved Multi-resolution image fusion framework using image enhancement technique  

Jhee, Hojin (LIG Nex1 Co.,Ltd.)
Jang, Chulhee (LIG Nex1 Co.,Ltd.)
Jin, Sanghun (LIG Nex1 Co.,Ltd.)
Hong, Yonghee (LIG Nex1 Co.,Ltd.)
Abstract
This paper represents a novel framework for multi-scale image fusion. Multi-scale Kalman Smoothing (MKS) algorithm with quad-tree structure can provide a powerful multi-resolution image fusion scheme by employing Markov property. In general, such approach provides outstanding image fusion performance in terms of accuracy and efficiency, however, quad-tree based method is often limited to be applied in certain applications due to its stair-like covariance structure, resulting in unrealistic blocky artifacts at the fusion result where finest scale data are void or missed. To mitigate this structural artifact, in this paper, a new scheme of multi-scale fusion framework is proposed. By employing Super Resolution (SR) technique on MKS algorithm, fine resolved measurement is generated and blended through the tree structure such that missed detail information at data missing region in fine scale image is properly inferred and the blocky artifact can be successfully suppressed at fusion result. Simulation results show that the proposed method provides significantly improved fusion results in the senses of both Root Mean Square Error (RMSE) performance and visual improvement over conventional MKS algorithm.
Keywords
Multi-resolution Image fusion; Quad-tree structure; Multi-scale Kalman Smoothing;
Citations & Related Records
연도 인용수 순위
  • Reference
1 S.M Kay, "Fundamentals of Statistical Signal Processing: Estimation Theory," Prentice Hall, Upper Saddle River, NJ, 1993.
2 L. Yue, et al., "A locally adaptive L1-L2 norm for multi-frame super-resolution of images with mixed noise and outliers," Signal Processing, Vol. 105, Nu. pp. 156-174, 2014.   DOI
3 Q. Zhou, and A.-X. Zhu, "The recent advancement in digital terrain analysis and modeling," International Journal of Geographical Information Science, Vol. 27, No.7, pp. 1269-1271, 2013.   DOI
4 M.R. Luettgen, W.C. Karl, and A. Willsky, "Multiscale Representations of Markov Random Fields," IEEE Trans. Signal Processing, Vol. 41, pp. 3377-3395, Dec. 1993.   DOI
5 A.S. Willsky, "Multiresolution Markov models for signal and image processing," Proceedings of the IEEE , Vol. 90, No. 8, p.p 1396-1458, Aug. 2002.   DOI
6 W. Fieguth, W. C. Karl, and A. S. Willsky, "Multiscale Stochastic Processing of Topex/Poseidon Oceanogrphic Altimetry," IEEE Trans. Image Proc., Vol. 9, pp. 456-468, Mar. 2000.   DOI
7 K. Chou, A. Willsky, and R. Nikoukhah, "Multiscale systems, Kalman filters, and Riccati equations," IEEE Transactions on Automatic Control, Vol. 39, No. 3, pp.479-492, Mar. 1994.   DOI
8 K.C. Slatton, M.M. Crawford, and B.L. Evans, "Fusing interferometric radar and laser altimeter data to estimate surface topography and vegetation heights," IEEE Transactions on Geoscience and Remote Sensing, Vol. 39, pp. 2470-2482, 2001.   DOI
9 H. Zebker, S. Madsen, and J. Martin, "The TOPSAR interferometric radar topographic mapping instrument," IEEE Transactions on Geoscience and Remote Sensing, Vol. 30, pp. 933-940, 1992.   DOI
10 H. Jhee, S. Cheung, and K.C Slatton, "Efficient observational updating for fusion of incomplete image data," In Proceedings of the IEEE International Geoscience and Remote Sensing Symposium, Vol. 4, pp. 2807-2810, Jul. 2005.
11 S. Todorovic, and M.C. Nechyba, "Interpretation of complex scenes using dynamic tree-structure Bayesian networks," Computer Vision and Image Understanding, Vol. 106 No.1, p.71-84, Apr. 2007.   DOI
12 G. Pajares, and J.M de la Cruz, "A wavelet-based image fusion tutorial," Pattern Recognition, Vol. 37, Issue 9, pp. 1855-1872, Sep. 2004.   DOI
13 M. M. Daniel and A. S. Willsky, "A multiresolution methodology for signal-level fusion and data assimilation with applications to remote sensing," Proc. IEEE, Vol. 85, pp. 164-180, Jan. 1997.   DOI
14 W. Irving, W. Karl, and A. Willsky, "A Theory for Multiscale Stochastic Realization," 33rd Conference on Decision and Control, Vol. 1, pp. 655-662, Jan. 1994.
15 H. E. Rauch, C. T. Striebel, and F. Tung, "Maximum likelihood estimates of linear dynamic systems," AIAA Journal, Vol. 3, No. 8, pp. 1445-1450, Aug. 1965.   DOI
16 K. Chou, A, Willsky, and R. Nikoukhah, "Multiscale systems, Kalman filters, and Riccati equations," IEEE Transactions on Automatic Control, Vol. 39, pp. 479-492, Mar. 1994.   DOI