Browse > Article
http://dx.doi.org/10.3837/tiis.2022.01.004

Skin Lesion Segmentation with Codec Structure Based Upper and Lower Layer Feature Fusion Mechanism  

Yang, Cheng (College of Telecommunications and information Engineering, Nanjing University of Posts and Telecommunications)
Lu, GuanMing (College of Telecommunications and information Engineering, Nanjing University of Posts and Telecommunications)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.16, no.1, 2022 , pp. 60-79 More about this Journal
Abstract
The U-Net architecture-based segmentation models attained remarkable performance in numerous medical image segmentation missions like skin lesion segmentation. Nevertheless, the resolution gradually decreases and the loss of spatial information increases with deeper network. The fusion of adjacent layers is not enough to make up for the lost spatial information, thus resulting in errors of segmentation boundary so as to decline the accuracy of segmentation. To tackle the issue, we propose a new deep learning-based segmentation model. In the decoding stage, the feature channels of each decoding unit are concatenated with all the feature channels of the upper coding unit. Which is done in order to ensure the segmentation effect by integrating spatial and semantic information, and promotes the robustness and generalization of our model by combining the atrous spatial pyramid pooling (ASPP) module and channel attention module (CAM). Extensive experiments on ISIC2016 and ISIC2017 common datasets proved that our model implements well and outperforms compared segmentation models for skin lesion segmentation.
Keywords
semantic segmentation; skin lesion segmentation; deep learning; convolutional neural network (CNN); atrous spatial pyramid pooling;
Citations & Related Records
연도 인용수 순위
  • Reference
1 X. Wang, R. Girshick, A. Gupta, K. He, "Non-local neural networks," in Proc. of the IEEE conference on computer vision and pattern recognition, pp.7794-7803, 2018.
2 J. Hu, L. Shen, G. Sun, "Squeeze-and-excitation networks," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 42, no. 8, pp. 2011-2023, 2020.   DOI
3 S. Woo, J. Park, J.-Y. Lee, I. So Kweon, "Cbam: Convolutional block attention module," in Proc. of the European conference on computer vision (ECCV), pp.3-19, 2018.
4 V. Badrinarayanan, A. Kendall, R. Cipolla, "Segnet: A deep convolutional encoder-decoder architecture for image segmentation," IEEE transactions on pattern analysis and machine intelligence, vol. 39, no. 12, pp. 2481-2495, 2017.   DOI
5 Y. Yuan, M. Chao, Y.-C. Lo, "Automatic skin lesion segmentation using deep fully convolutional networks with jaccard distance," IEEE transactions on medical imaging, vol.36, no.9, pp.1876-1886, 2017.   DOI
6 V. Nair, G. E. Hinton, "Rectified linear units improve restricted boltzmann machines," in Proc. of the 27th International Conference on International Conference on Machine Learning(ICML), pp.807-814, 2010.
7 S. Ioffe, "Batch renormalization: Towards reducing minibatch dependence in batch-normalized models," in Proc. of Advances in neural information processing systems, pp.1942-1950, 2017.
8 G. Lin, C. Shen, A. Van Den Hengel, I. Reid, "Efficient piecewise training of deep structured models for semantic segmentation," in Proc. of the IEEE conference on computer vision and pattern recognition, pp.3194-3203, 2016.
9 Z. Lin, M. Feng, C. N. d. Santos, M. Yu, B. Xiang, B. Zhou, Y. Bengio, "A structured self-attentive sentence embedding," arXiv preprint, 2017.
10 O. Ronneberger, P. Fischer, T. Brox, "U-net: Convolutional networks for biomedical image segmentation," in Proc. of International Conference on Medical image computing and computer-assisted intervention, pp.234-241, 2015.
11 G. Sforza, G. Castellano, S. K. Arika, R. W. LeAnder, R. J. Stanley, W. V. Stoeckerand, J. R. Hagerty, "Using adaptive thresholding and skewness correction to detect gray areas in melanoma in situ images," IEEE Transactions on Instrumentation and Measurement, vol.61, no.7, pp.1839-1847, 2012.   DOI
12 T. -Y. Lin, P. Goyal, R. Girshick, K. He, P. Dollar, "Focal loss for dense object detection," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 42, no. 2, pp. 318-327, 2020.   DOI
13 K. He, X. Zhang, S. Ren, J. Sun, "Deep residual learning for image recognition," in Proc. of the IEEE conference on computer vision and pattern recognition, pp.770-778, 2016.
14 C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, Z. Wojna, "Rethinking the inception architecture for computer vision," in Proc. of the IEEE conference on computer vision and pattern recognition, pp.2818-2826, 2016.
15 H. Zhang, I. Goodfellow, D. Metaxas, A. Odena, "Self-attention generative adversarial networks," in Proc. of International conference on machine learning, pp.7354-7363, 2019.
16 N. C. Codella, D. Gutman, M. E. Celebi, B. Helba, M. A. Marchetti, S. W. Dusza, A. Kalloo, K. Liopyris, N. Mishra, H. Kittler, "Skin lesion analysis toward melanoma detection: A challenge at the 2017 international symposium on biomedical imaging (isbi), hosted by the international skin imaging collaboration (isic)," in Proc. of 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), pp.168-172, 2018.
17 L.-C. Chen, G. Papandreou, I. Kokkinos, K. Murphy, A. L. Yuille, "Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs," IEEE transactions on pattern analysis and machine intelligence, vol.40, no.4, pp.834-848, 2017.   DOI
18 Z. Mirikharaji, S. Izadi, J. Kawahara, G. Hamarneh, "Deep auto-context fully convolutional neural network for skin lesion segmentation," in Proc. of 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), pp.877-880, 2018.
19 S. Pathan, K. G. Prabhu, P. C. Siddalingaswamy, "Techniques and algorithms for computer aided diagnosis of pigmented skin lesions-A review," Biomedical Signal Processing and Control, vol.39, pp.237-262, 2018.   DOI
20 GLOBOCAN, 2020. https://gco.iarc.fr/today/home
21 B. Peng, L. Zhang, D. Zhang, "Automatic image segmentation by dynamic region merging," IEEE Transactions on image processing, vol.20, no.12, pp.3592-3605, 2011.   DOI
22 K. Simony, A. Zisserman, "Very deep convolutional networks for large-scale image recognition," arXiv preprint, 2014.
23 C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, A. Rabinovich, "Going deeper with convolutions," in Proc. of the IEEE conference on computer vision and pattern recognition, pp.1-9, 2015.
24 O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, "Imagenet large scale visual recognition challenge," International journal of computer vision, vol.115, no.3, pp.211-252, 2015.   DOI
25 T. Shen, T. Zhou, G. Long, J. Jiang, S. Pan, C. Zhang, "Disan: Directional self-attention network for rnn/cnn-free language understanding," in Proc. of the AAAI Conference on Artificial Intelligence, pp. 5446-5455, 2018.
26 R. Garnavi, M. Aldeen, M. E. Celebi, A. Bhuiyan, C. Dolianitis, G. Varigos, "Automatic segmentation of dermoscopy images using histogram thresholding on optimal color channels," World Academy of Science, Engineering and Technology International Journal of Biomedical and Biological Engineering, Vol. 5, No. 7, pp. 275-283, 2011.
27 M. Jaderberg, K. Simonyan, A. Zisserman, "Spatial transformer networks," Advances in neural information processing systems, vol.2, pp.2017-2025, 2015.
28 D. Gutman, N. C. Codella, E. Celebi, B. Helba, M. Marchetti, N. Mishra, A. Halpern, "Skin lesion analysis toward melanoma detection: A challenge at the international symposium on biomedical imaging (ISBI) 2016, hosted by the international skin imaging collaboration (ISIC)," arXiv preprint, 2016.
29 S. Vesal, N. Ravikumar, A. Maier, "SkinNet: A deep learning framework for skin lesion segmentation," in Proc. of 2018 IEEE Nuclear Science Symposium and Medical Imaging Conference Proceedings (NSS/MIC), pp.1-3, 2018.
30 R. Girshick, J. Donahue, T. Darrell, J. Malik, "Rich feature hierarchies for accurate object detection and semantic segmentation," in Proc. of the IEEE conference on computer vision and pattern recognition, pp.580-587, 2014.
31 R. B. Oliveira, N. Marranghello, A. S. Pereira, J. M. R. Tavares, "A computational approach for detecting pigmented skin lesions in macroscopic images," Expert Systems with Applications, vol.61, pp.53-63, 2016.   DOI
32 N. Codella, V. Rotemberg, P. Tschandl, M. E. Celebi, S. Dusza, D. Gutman, B. Helba, A. Kalloo, K. Liopyris, M. Marchetti, H. Kittler, A. Halpern, "Skin lesion analysis toward melanoma detection 2018: A challenge hosted by the international skin imaging collaboration (isic)," arXiv preprint, 2019.
33 A. Wong, J. Scharcanski, P. Fieguth, "Automatic skin lesion segmentation via iterative stochastic region merging," IEEE Transactions on Information Technology in Biomedicine, vol.15, no.6, pp.929-936, 2011.   DOI
34 Z. Liu, J. Zerubia, "Skin image illumination modeling and chromophore identification for melanoma diagnosis," Physics in Medicine & Biology, vol.60, no.9, pp.3415, 2015.   DOI
35 F. Chollet, "Xception: Deep learning with depthwise separable convolutions," in Proc. of the IEEE conference on computer vision and pattern recognition, pp.1251-1258, 2017.
36 L. Bi, J. Kim, E. Ahn, A. Kumar, M. Fulham, D. Feng, "Dermoscopic image segmentation via multistage fully convolutional networks," IEEE Transactions on Biomedical Engineering, vol.64, no.9, pp.2065-2074, 2017.   DOI
37 L.-C. Chen, G. Papandreou, I. Kokkinos, K. Murphy, A. L. Yuille, "Semantic image segmentation with deep convolutional nets and fully connected crfs," arXiv preprint, 2014.
38 L.-C. Chen, G. Papandreou, F. Schroff, H. Adam, "Rethinking atrous convolution for semantic image segmentation," arXiv preprint, 2017.
39 L.-C. Chen, Y. Zhu, G. Papandreou, F. Schroff, H. Adam, "Encoder-decoder with atrous separable convolution for semantic image segmentation," in Proc. of the European conference on computer vision (ECCV), pp.833-851, 2018.