Journal of applied mathematics & informatics

The Korean Society for Computational and Applied Mathematics (한국전산응용수학회)
권호 표지
DOI QR코드

DOI QR Code

FUSESHARP: A MULTI-IMAGE FOCUS FUSION METHOD USING DISCRETE WAVELET TRANSFORM AND UNSHARP MASKING

  • GARGI TRIVEDI (Department of Applied Science & Humanities, G. H. Patel College of Engineering & Technology, Charutar Vidya Mandal University) ;
  • RAJESH SANGHAVI (Department of Applied Science & Humanities, G. H. Patel College of Engineering & Technology, Charutar Vidya Mandal University)
  • Received : 2023.02.08
  • Accepted : 2023.05.10
  • Published : 2023.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, a novel hybrid method for multi-focus image fusion is proposed. The method combines the advantages of wavelet transform-based methods and focus-measure-based methods to achieve an improved fusion result. The input images are first decomposed into different frequency sub-bands using the discrete wavelet transform (DWT). The focus measure of each sub-band is then calculated using the Laplacian of Gaussian (LoG) operator, and the sub-band with the highest focus measure is selected as the focused sub-band. The focused sub-band is sharpened using an unsharp masking filter to preserve the details in the focused part of the image.Finally, the sharpened focused sub-bands from all input images are fused using the maximum intensity fusion method to preserve the important information from all focus images. The proposed method has been evaluated using standard multi focus image fusion datasets and has shown promising results compared to existing methods.

Keywords

References

  1. S. Lefkovits, L. Lefkovits and L. Szil'agyi, Applications of Different CNN Architectures for Palm Vein Identification, Modeling Decisions for Artificial Intelligence (2019), 295-306. 10.1007/978-3-030-26773-5 26
  2. G.J. Trivedi and R. Sanghvi, Novel Approach to Multi-Modal Image usion Fusing Modified Convolutional Layers, Journal of Innovative Image Processing 5(3) (2023), 229-253. 10.36548/jiip.2023.3.002
  3. G. Xiao, D.P. Bavirisetti, G. Liu and X. Zhang, Image Fusion, Springer, Singapore, 2020. 10.1007/978-981-15-4867-3
  4. H. Kaur, D. Koundal and V. Kadyan, Image Fusion Techniques: A Survey, Archives of Computational Methods in Engineering 28(7) (2021), 4425-4447. 10.1007/s11831-021-09540-7
  5. Y. Niu, L. Shen, X. Huo and G. Liang, Multi-Objective Wavelet-Based Pixel-Level Image Fusion Using Multi-Objective Constriction Particle Swarm Optimization, Studies in Computational Intelligence (2010), 151-178. 10.1007/978-3-642-05165-4 7
  6. G.J. Trivedi and R. Sanghvi, Medical Image Fusion Using CNN with Automated Pooling, Indian Journal Of Science And Technology 15(42) (2023), 2267-2274. 10.17485/ijst/v15i42.1812.
  7. C.R. Mohan, S. Kiran and A.A. Kumar, An Enhancement Process for Multi-focus Images Resulted from Image Fusion using shift DTCWT and MPCA in Multiresolution Domain, Procedia Computer Science 218 (2023), 2713-22. 10.1016/j.procs.2023.01.243
  8. V. Rajinikanth, S.C. Satapathy, N. Dey and R. Vijayarajan, DWT-PCA Image Fusion Technique to Improve Segmentation Accuracy in Brain Tumor Analysis, Lecture Notes in Electrical Engineering (2018), 453-62. 10.1007/978-981-10-7329-8 46
  9. L. Zhou, A Gradient-based Multi-focus Image Fusion Method Using Multiwavelets Transform, 2012 International Conference on Industrial Control and Electronics Engineering (2012). 10.1109/icicee.2012.110
  10. L. Li, C. Li, X. Lu, H. Wang and D. Zhou Multi-focus image fusion with convolutional neural network based on Dempster-Shafer theory, Optik 272 (2023), 170223. 10.1016/j.ijleo.2022.170223
  11. G. Zhang, R. Nie, J. Cao, L. Chen and Y. Zhu, FDGNet: A pair feature difference guided network for multimodal medical image fusion, Biomedical Signal Processing and Control 81 (2023), 104545. 10.1016/j.bspc.2022.104545
  12. G.T. Vasu, and P. Palanisamy, Gradient-based multi-focus image fusion using foreground and background pattern recognition with weighted anisotropic diffusion filter, Signal, Image and Video Processing (2023). 10.1007/s11760-022-02470-2
  13. L. Guo and L. Liu, A Perceptual-Based Robust Measure of Image Focus, IEEE Signal Processing Letters 29 (2022), 2717-2721. 10.1109/lsp.2023.3235647.
  14. U. Ali, I.H. Lee and M.T. Mahmood, Incorporating structural prior for depth regularization in shape from focus, Computer Vision and Image Understanding 27 (2023), 103619. 10.1016/j.cviu.2022.103619
  15. N. Madali, A. Gilles, P. Gioia and L. Morin, Automatic depth map retrieval from digital holograms using a depth-from-focus approach, Applied Optics 62(10) (2023), D77. 10.1364/ao.478634
  16. S. Liu, L. Qu, M. Wang and Z. Song, Fusionmlp: A Mlp-Based Unified Image Fusion Framework, SSRN Electronic Journal (2023). 10.2139/ssrn.4334055
  17. N. You, L. Han, D. Zhu and W. Song, Research on Image Denoising in Edge Detection Based on Wavelet Transform, Applied Sciences 13(3) (2023), 1837. 10.3390/app13031837
  18. M.M. Iqbal Ch, M.M. Riaz, N. Iltaf, A. Ghafoor and S.S. Ali, A multi-focus image fusion using high-level DWT components and guided filter, Multimedia Tools and Applications 79 (2020), 12817-12828. 10.1016/j.cviu.2022.103619
  19. G.B. Gebremeskel, A critical analysis of the multi-focus image fusion using discrete wavelet transform and computer vision - Soft Computing, Computer Vision and Image Understanding 26 (2022), 5209-5225. 10.1016/j.cviu.2022.103619
  20. S. Pertuz, D. Puig and M.A. Garcia, Analysis of focus measure operators for shape-from-focus, Pattern Recognition 46(5) (2013), 1415-1432. 10.1016/j.patcog.2012.11.011
  21. S.C.F. Lin, C.Y. Wong, G. Jiang, M.A. Rahman, T.R. Ren, N. Kwok, H. Shi, Y.-H. Yu and T. Wu, Intensity and edge based adaptive unsharp masking filter for color image enhancement, Optik 127(1) (2016), 407-414. 10.1016/j.ijleo.2015.08.046
  22. E. Gul and A.N. Toprak, Contourlet and discrete cosine transform based quality guaranteed robust image watermarking method using artificial bee colony algorithm, Expert Systems with Applications 212 (2023), 118730. 10.1016/j.eswa.2022.118730
  23. B. Xiao, G. Ou, H. Tang, X. Bi and W. Li, Multi-Focus Image Fusion by Hessian Matrix Based Decomposition, IEEE Transactions on Multimedia 22(2) (2022), 285-297. 10.1109/tmm.2019.2928516
  24. Y. Yang, M. Ding, S. Huang, Y. Que, W. Wan, M. Yang and J. Sun, Multi-Focus Image Fusion via Clustering PCA Based Joint Dictionary Learning, IEEE Access 5 (2017), 16985-16997. 10.1109/access.2017.2741500
  25. G.J. Trivedi and R. Sanghvi, Optimizing Image Fusion Using Modified Principal Component Analysis Algorithm and Adaptive Weighting Scheme, International Journal of Advanced Networking and Applications 15(1) (2023), 5769-5774. 10.35444/IJANA.2023.15103
  26. J. Qi, H. Yang and Z. Kong, Fusion of remote sensing images based on multi-resolution analysis, Journal of Physics: Conference Series 2419(1) (2023), 012051. 10.1088/1742-6596/2419/1/012051
  27. S. Liu, L. Qu, Q. Qiao, M. Wang and Z. Song, Wavelet-based self-supervised learning for multi-scene image fusion, Neural Computing and Applications 34(18) (2022), 15689-15704. 10.1007/s00521-022-07242-0
  28. H. Li, W. Qian, R. Nie, J. Cao, D. Xu, Siamese conditional generative adversarial network for multi-focus image fusion, Applied Intelligence (2023). 10.1007/s10489-022-04406-2
  29. J.K. Rohrbach Dataset taken from website raw samples, Finkelerweg 37, CH-4144 Arlesheim, cited on (2023). http://rawsamples.ch/index.php/en/
  30. R.C. Gonzalez, R.E. Woods, and S.L. Eddins Digital image processing using MATLAB, Knoxville, Gatesmark Publishing, 2020.