Journal of Applied and Pure Mathematics

The Korean Society for Computational and Applied Mathematics (한국전산응용수학회)
권호 표지
DOI QR코드

DOI QR Code

MOSAICFUSION: MERGING MODALITIES WITH PARTIAL DIFFERENTIAL EQUATION AND DISCRETE COSINE TRANSFORMATION

  • GARGI TRIVEDI (Department of Applied Science & Humanities, G. H. Patel College of Engineering & Technology, Charutar Vidya Mandal University) ;
  • RAJESH SANGHAVI (Department of Applied Science & Humanities, G. H. Patel College of Engineering & Technology, Charutar Vidya Mandal University)
  • Received : 2023.08.23
  • Accepted : 2023.09.15
  • Published : 2023.11.30
Download PDF
⟨ Previous Next ⟩

Abstract

In the pursuit of enhancing image fusion techniques, this research presents a novel approach for fusing multimodal images, specifically infrared (IR) and visible (VIS) images, utilizing a combination of partial differential equations (PDE) and discrete cosine transformation (DCT). The proposed method seeks to leverage the thermal and structural information provided by IR imaging and the fine-grained details offered by VIS imaging create composite images that are superior in quality and informativeness. Through a meticulous fusion process, which involves PDE-guided fusion, DCT component selection, and weighted combination, the methodology aims to strike a balance that optimally preserves essential features and minimizes artifacts. Rigorous evaluations, both objective and subjective, are conducted to validate the effectiveness of the approach. This research contributes to the ongoing advancement of multimodal image fusion, addressing applications in fields like medical imaging, surveillance, and remote sensing, where the marriage of IR and VIS data is of paramount importance.

Keywords

References

  1. Y. Chen, L. Cheng, H. Wu, F. Mo, and Z. Chen, Infrared and visible image fusion based on iterative differential thermal information filter, Optics and Lasers in Engineering 148 (2022), 106776. 
  2. G. Xiao, D.P. Bavirisetti, G. Liu and X. Zhang, Image Fusion, Springer, Singapore, 2020. Doi: 10.1007/978-981-15-4867-3 
  3. G.J. Trivedi and R. Sanghvi, Novel Approach to Multi-Modal Image using Fusing Modified Convolutional Layers, Journal of Innovative Image Processing 5(3) (2023), 229-253. Doi: 10.36548/jiip.2023.3.002 
  4. G. Zhang, R. Nie, J. Cao, L. Chen and Y. Zhu, FDGNet: A pair feature difference guided network for multimodal medical image fusion, Biomedical Signal Processing and Control 81 (2023), 104545. Doi: 10.1016/j.bspc.2022.104545 
  5. H. Kaur, D. Koundal and V. Kadyan, Image Fusion Techniques: A Survey, Archives of Computational Methods in Engineering 28(7) (2021), 4425-4447. Doi: 10.1007/s11831-021-09540-7 
  6. B. Meher, S. Agrawal, R. Panda, L. Dora, and A. Abraham, Visible and infrared image fusion using an efficient adaptive transition region extraction technique, Engineering Science and Technology, an International Journal 29 (2022), 101037. Doi: 10.1016/j.jestch.2021.06.017. 
  7. S. Hao, T. He, B. An, X. Ma, H. Wen, and F. WangS. Hao, T. He, B. An, X. Ma, H. Wen, and F. Wang, VDFEFuse: A novel fusion approach to infrared and visible images, Infrared Physics & Technology 121 (2022), 2713-22. Doi: 10.1016/j.infrared.2022.104048 
  8. V. Kamarthi, D. Satyanarayana, and G.P.M. Ninjappa, Multimodal Medical Image Fusion Based on Intuitionistic Fuzzy Sets and Weighted Activity Measure in NSST Domain, Current Signal Transduction Therapy 17(2) (2022). Doi: 10.2174/1574362417666220405151738 
  9. W. Tang, F. He, Y. Liu, and Y. Duan, MATR: Multimodal Medical Image Fusion via Multiscale Adaptive Transformer, IEEE Transactions on Image Processing (2022), 5134-5149. Doi: 10.1109/tip.2022.319328 
  10. Y. Li and S. Jiang, Multi-Focus Image Fusion Using Geometric Algebra Based Discrete Fourier Transform, IEEE Access 8 (2020), 60019-60028. Doi: 10.1109/ACCESS.2020.2981814 
  11. H. Jiang, P. Maharjan, Z. Li, and G. York, DCT-Based Residual Network for NIR Image Colorization, IEEE International Conference on Image Processing (ICIP) 2022. Doi: 10.1109/icip46576.2022.9897373 
  12. V.P.S. Naidu, and B. Elias, A novel image fusion technique using DCT-based Laplacian pyramid, International Journal of Inventive Engineering and Sciences (IJIES) (2013), 2319-9598. 
  13. G.J. Trivedi and R. Sanghvi, Medical Image Fusion Using CNN with Automated Pooling, Indian Journal Of Science And Technology 15(42) (2023), 2267-2274. Doi: 10.17485/ijst/v15i42.1812 
  14. S. Liu, L. Qu, Q. Qiao, M. Wang and Z. Song, Wavelet-based self-supervised learning for multi-scene image fusion, Neural Computing and Applications 34(18) (2022), 15689-15704. Doi: 10.1007/s00521-022-07242-0 
  15. W. Kong and Y. Lei, A Technique for image fusion between gray-scale visual light and infrared images based on NSST and improved RF, Optik 124(23) (2013), 6423-6431. Doi: 10.1016/j.ijleo.2013.05.038 
  16. S. Budhiraja, S. Agrawal, and B. S. Sohi Performance Analysis of Multi-scale Transforms for Saliency-Based Infrared and Visible Image Fusion, Proceedings of the International Conference on Data Science and Applications, 2021. Doi: 10.1007/978-981-16-5120-5 60. 
  17. G.J. Trivedi and R. Sanghvi, Optimizing Image Fusion Using Modified Principal Component Analysis Algorithm and Adaptive Weighting Scheme, International Journal of Advanced Networking and Applications 15(1) (2023), 5769-5774. Doi: 10.35444/IJANA.2023.15103 
  18. N. You, L. Han, D. Zhu and W. Song, Research on Image Denoising in Edge Detection Based on Wavelet Transform, Applied Sciences 13(3) (2023), 1837. Doi: 10.3390/app13031837 
  19. M.M. Iqbal Ch, M.M. Riaz, N. Iltaf, A. Ghafoor and S.S. Ali M.M. Iqbal Ch, M.M. Riaz, N. Iltaf, A. Ghafoor and S.S. Ali, A multi-focus image fusion using high-level DWT components and guided filter, Multimedia Tools and Applications 79 (2020), 12817-12828. Doi: 10.1016/j.cviu.2022.103619 
  20. V. Rajinikanth, S.C. Satapathy, N. Dey and R. Vijayarajan, DWT-PCA Image Fusion Technique to Improve Segmentation Accuracy in Brain Tumor Analysis, Lecture Notes in Electrical Engineering (2018), 453-62. Doi: 10.1007/978-981-10-7329-8 46 
  21. S. Singh, H. Singh, A. Gehlot, J. kaur, and Gagandeep, IR and visible image fusion using DWT and bilateral filter, Microsystem Technologies (2022). Doi: 10.1007/s00542-022-05315-7 
  22. G.J. Trivedi and R. Sanghvi, FUSESHARP: A Multi-Image Focus Fusion method using Discrete Wavelet Transform and Unsharp Masking, Appl. Math. & Informatics 41(5) (2023), 1115-1128. https://doi.org/10.14317/jami.2023.1115 
  23. G.J. Trivedi and R. Sanghvi, A New Approach For Multimodal Medical Image Fusion Using PDE-Based Technique, Suranaree J. Sci. Technol. 30(4) (2023), 030132(1-7). https://doi.org/10.55766/sujst-2023-04-e0843 
  24. G.T. Vasu, and P. Palanisamy, Gradient-based multi-focus image fusion using foreground and background pattern recognition with weighted anisotropic diffusion filter, Signal, Image, and Video Processing (2023). Doi: 10.1007/s11760-022-02470-2 
  25. D.P. Bavirisetti and R. Dhuli, Fusion of Infrared and Visible Sensor Images Based on Anisotropic Diffusion and Karhunen-Loeve Transform, IEEE Sensors Journal 16(01) (2016). Doi: 10.1109/jsen.2015.2478655 
  26. G.J. Trivedi, R. Sanghvi, V. Shah and J. Sharma, On solution of non-instantaneous impulsive Hilfer fractional integro-differential evolution system, Mathematica Applicanda 51(1) (2023), 3-20. Doi: 10.14708/ma.v50i2.7168. 
  27. T. Sharma, S. Pathak, G.J. Trivedi and R. Sanghvi, AFlow Modelling in Porous Medium Applying Numerical Techniques: A Comparative Analysis, Recent Research Reviews Journal 2(2) (2023), 288-304. https://doi.org/10.36548/rrrj.2023.2.004 
  28. M. Wang and X. Shang, IA Fast Image Fusion With Discrete Cosine Transform, IEEE Signal Processing Letters 27 (2023), 990-994. Doi: 10.1109/LSP.2020.2999788 
  29. D. Jiang and J. Kim, Image Retrieval Method Based on Image Feature Fusion and Discrete Cosine Transform, Applied Sciences 11(12) (2021), 5701. Doi: 10.3390/app11125701 
  30. E. Gul and A.N. Toprak, Contourlet and discrete cosine transform based quality guaranteed robust image watermarking method using artificial bee colony algorithm, Expert Systems with Applications 212 (2023), 118730. Doi: 10.1016/j.eswa.2022.118730 
  31. A. Toet, The TNO Multiband Image Data Collection, Data in Brief 15 (2017), 249-251. Doi: 10.1016/j.dib.2017.09.038 
  32. X. Zhang, P. Ye, and G. Xiao VIFB: A Visible and Infrared Image Fusion Benchmark, Dataset taken from website GitHub Cited on 2023. https://github.com/xingchenzhang/VIFB 
  33. D.P. Bavirisetti, G. Xiao, and G. Liu Multi-sensor image fusion based on fourth-order partial differential equations, 2017 20th International Conference on Information Fusion (Fusion) 2017. Doi: 10.23919/icif.2017.8009719 
  34. R.C. Gonzalez, R.E. Woods, and S.L. Eddins Digital image processing using MATLAB, Knoxville, Gatesmark Publishing, 2020.