DOI QR코드

DOI QR Code

TSDnet: Three-scale Dense Network for Infrared and Visible Image Fusion

TSDnet: 적외선과 가시광선 이미지 융합을 위한 규모-3 밀도망

  • Zhang, Yingmei (Dept. of Computer Science and Engineering, Jeonbuk National University) ;
  • Lee, Hyo Jong (Dept. of Computer Science and Engineering, Jeonbuk National University)
  • 장영매 (전북대학교 컴퓨터공학부) ;
  • 이효종 (전북대학교 컴퓨터공학부)
  • Published : 2022.11.21

Abstract

The purpose of infrared and visible image fusion is to integrate images of different modes with different details into a result image with rich information, which is convenient for high-level computer vision task. Considering many deep networks only work in a single scale, this paper proposes a novel image fusion based on three-scale dense network to preserve the content and key target features from the input images in the fused image. It comprises an encoder, a three-scale block, a fused strategy and a decoder, which can capture incredibly rich background details and prominent target details. The encoder is used to extract three-scale dense features from the source images for the initial image fusion. Then, a fusion strategy called l1-norm to fuse features of different scales. Finally, the fused image is reconstructed by decoding network. Compared with the existing methods, the proposed method can achieve state-of-the-art fusion performance in subjective observation.

Keywords

Acknowledgement

This work was supported in part by the Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education under Grant 2019R1D1A3A03103736 and in part by project for Joint Demand Technology R&D of Regional SMEs funded by Korea Ministry of SMEs and Startups in 2021 (No. S3035805).