Browse > Article
http://dx.doi.org/10.3745/KTCCS.2022.11.6.185

Multimodal Medical Image Fusion Based on Double-Layer Decomposer and Fine Structure Preservation Model  

Zhang, Yingmei (전북대학교 컴퓨터공학부)
Lee, Hyo Jong (전북대학교 컴퓨터공학부)
Publication Information
KIPS Transactions on Computer and Communication Systems / v.11, no.6, 2022 , pp. 185-192 More about this Journal
Abstract
Multimodal medical image fusion (MMIF) fuses two images containing different structural details generated in two different modes into a comprehensive image with saturated information, which can help doctors improve the accuracy of observation and treatment of patients' diseases. Therefore, a method based on double-layer decomposer and fine structure preservation model is proposed. Firstly, a double-layer decomposer is applied to decompose the source images into the energy layers and structure layers, which can preserve details well. Secondly, The structure layer is processed by combining the structure tensor operator (STO) and max-abs. As for the energy layers, a fine structure preservation model is proposed to guide the fusion, further improving the image quality. Finally, the fused image can be achieved by performing an addition operation between the two sub-fused images formed through the fusion rules. Experiments manifest that our method has excellent performance compared with several typical fusion methods.
Keywords
Multimodal Medical Image; Image Fusion; Double-layer Decomposer; Fine Structure Preservation Model;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Y. Han, Y. Cai, Y. Cao, and X. Xu, "A new image fusion performance metric based on visual information fidelity," Information Fusion, Vol.14, No.2, pp.127-135, Apr. 2013.   DOI
2 Z. Zhu, M. Zheng, G. Qi, D. Wang, and Y. Xiang, "A phase congruency and local laplacian energy based multimodality medical image fusion method in NSCT domain," IEEE Access, Vol.7, pp.20811-20824, 2019.   DOI
3 S. Li, X. Kang, L. Fang, J. Hu, and H. Yin, "Pixel-level image fusion: A survey of the state of the art," Information Fusion, Vol.33, pp.100-112, 2017.   DOI
4 B. Yang and S. Li, "Multifocus image fusion and restoration with sparse representation," IEEE Transactions on Instrumentation and Measurement, Vol.59, No.4, pp.884-892, 2010.   DOI
5 Y. Zhai and M. Shah, "Visual attention detection in video sequences using spatiotemporal cues," in Proceeding of the 14th ACM International Conference on Multimedia, pp. 815-824, 2006.
6 G. Cui, H. Feng, Z. Xu, Q. Li, and Y. Chen, "Detail preserved fusion of visible and infrared images using regional saliency extraction and multiscale image decomposition," Optics Communications, Vol.341, pp.199-209, Apr. 2015.   DOI
7 V. Aslantas and E. Bendes, "A new image quality metric for image fusion: the sum of the correlations of differences," Aeu-international Journal of Electronics and Communications, Vol.69, No.12, pp.1890-1896, 2015.   DOI
8 S. Li and B. Yang, "Multifocus image fusion by combining curvelet and wavelet transform," Pattern Recognition Letter, Vol.29, No.9, pp.1295-1301, Jul. 2008.   DOI
9 M. Yin, X. Liu, Y. Liu, and X. Chen, "Medical image fusion with parameter-adaptive pulse coupled neural network in nonsubsampled shearlet transform domain," IEEE Transactions on Instrumentation and Measurement, Vol.68, No.1, pp.49-64, 2019.   DOI
10 L. Nie, L. Zhang, L. Meng, X. Song, X. Chang, and X. Li, "Modeling disease progression via multisource multitask learners: A case study with alzheimer's disease," IEEE Transactions on Neural Networks and Learning Systems, Vol.28, No.7, pp.1508-1519, Jul. 2017.   DOI
11 H. Hermessi, O. Mourali, and E. Zagrouba, "Multimodal medical image fusion review: Theoretical background and recent advances," Signal Processing, Vol.183, pp.108036, 2021.   DOI
12 R. Singh and A. Khare, "Fusion of multimodal medical images using Daubechies complex wavelet transform-a multiresolution approach," Information Fusion, Vol.19, pp.49-60, 2014.   DOI
13 Y. Liu, S. Liu, and Z. Wang, "A general framework for image fusion based on multi-scale transform and sparse representation," Information Fusion, Vol.24, No.1, pp.147-164, 2015.   DOI
14 Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity," IEEE Transactions on Image Processing, Vol.13, No.4, pp.600-612, 2004.   DOI
15 V. Prasath, R. Pelapur, G. Seetharaman, and K. Palaniappan, "Multiscale structure tensor for improved feature extraction and image regularization," IEEE Transactions on Image Processing, Vol.28, No.12, pp.6198-6210, 2019.   DOI
16 C. S. Xydeas and V. Petrovic, "Objective image fusion performance measure," Electronics Letters, Vol.36, No.4, pp.308-309, 2000.   DOI
17 E. D. Vidoni, "The whole brain atlas: www.med.harvard.edu/aanlib," Journal of Neurologic Physical Therapy, Vol.36, No.2, pp.108, Jun. 2012, doi: 10.1097/NPT.0b013e3182563795.   DOI