Browse > Article
http://dx.doi.org/10.3837/tiis.2022.07.001

A Tuberculosis Detection Method Using Attention and Sparse R-CNN  

Xu, Xuebin (School of Computer Science and Technology, Xi'an University of Posts and Telecommunications)
Zhang, Jiada (School of Computer Science and Technology, Xi'an University of Posts and Telecommunications)
Cheng, Xiaorui (School of Computer Science and Technology, Xi'an University of Posts and Telecommunications)
Lu, Longbin (School of Computer Science and Technology, Xi'an University of Posts and Telecommunications)
Zhao, Yuqing (School of Computer Science and Technology, Xi'an University of Posts and Telecommunications)
Xu, Zongyu (School of Computer Science and Technology, Xi'an University of Posts and Telecommunications)
Gu, Zhuangzhuang (School of Computer Science and Technology, Xi'an University of Posts and Telecommunications)
Publication Information
KSII Transactions on Internet and Information Systems (TIIS) / v.16, no.7, 2022 , pp. 2131-2153 More about this Journal
Abstract
To achieve accurate detection of tuberculosis (TB) areas in chest radiographs, we design a chest X-ray TB area detection algorithm. The algorithm consists of two stages: the chest X-ray TB classification network (CXTCNet) and the chest X-ray TB area detection network (CXTDNet). CXTCNet is used to judge the presence or absence of TB areas in chest X-ray images, thereby excluding the influence of other lung diseases on the detection of TB areas. It can reduce false positives in the detection network and improve the accuracy of detection results. In CXTCNet, we propose a channel attention mechanism (CAM) module and combine it with DenseNet. This module enables the network to learn more spatial and channel features information about chest X-ray images, thereby improving network performance. CXTDNet is a design based on a sparse object detection algorithm (Sparse R-CNN). A group of fixed learnable proposal boxes and learnable proposal features are using for classification and location. The predictions of the algorithm are output directly without non-maximal suppression post-processing. Furthermore, we use CLAHE to reduce image noise and improve image quality for data preprocessing. Experiments on dataset TBX11K show that the accuracy of the proposed CXTCNet is up to 99.10%, which is better than most current TB classification algorithms. Finally, our proposed chest X-ray TB detection algorithm could achieve AP of 45.35% and AP50 of 74.20%. We also establish a chest X-ray TB dataset with 304 sheets. And experiments on this dataset showed that the accuracy of the diagnosis was comparable to that of radiologists. We hope that our proposed algorithm and established dataset will advance the field of TB detection.
Keywords
Tuberculosis; Chest X-ray; Computer-aided diagnosis; Object detection; Attention;
Citations & Related Records
연도 인용수 순위
  • Reference
1 P. Sun, R. Zhang, Y. Jiang, T. Kong, C. Xu, W. Zhan, M. Tomizuka, L. Li, Z. Yuan, C. Wang, and P. Luo, "Sparse r-cnn: End-to-end object detection with learnable proposals," in Proc. of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 14454-14463, 2021.
2 S. Vajda, A. Karargyris, S. Jaeger, K. C. Santosh, S. Candemir, Z. Y. Xue, S Antaniet, and G. Thoma, "Feature selection for automatic tuberculosis screening in frontal chest radiographs," Journal of medical systems, vol. 42, no. 8, pp. 1-11, 2018.   DOI
3 E. Tasci, C. Uluturk, and A. Ugur, "A voting-based ensemble deep learning method focusing on image augmentation and preprocessing variations for tuberculosis detection," Neural Computing and Applications, vol. 33, no. 22, pp. 15541-15555, 2021.   DOI
4 N. Bodla, B. Singh, R. Chellappa, and L.S. Davis, "Soft-NMS--improving object detection with one line of code," in Proc. of the IEEE International Conference on Computer Vision (ICCV), pp. 5561-5569, 2017.
5 N. Carion, F. Massa, G. Synnaeve, N. Usunier, A. Kirillov, and S. Zagoruyko, "End-to-end object detection with transformers," in Proc. of European Conference on Computer Vision (ECCV), pp. 213-229, 2020.
6 T. Y. Lin, P. Dollar, R. Girshick, K. He, B. Hariharan, and S. Belongie, "Feature pyramid networks for object detection," in Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2117-2125, 2017.
7 J. Ma, W. Shao, H. Ye, L. Wang, H. Wang, Y. Zheng, and X. Xue, "Arbitrary-oriented scene text detection via rotation proposals," IEEE Transactions on Multimedia, vol. 20, no. 11, pp. 3111-3122, 2018.   DOI
8 T. Y. Lin, M. Maire, S. Belongie, J. Hays, P. Perona, D. Ramanan, P. Dollar, and C. L. Zitnick, "Microsoft coco: Common objects in context," in Proc. of European Conference on Computer Vision (ECCV), pp. 740-755, 2014.
9 J. Hu, L. Shen, and G. Sun, "Squeeze-and-excitation networks," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 42, no. 8, pp. 2011-2023, 2020.   DOI
10 Y. Lecun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-based learning applied to document recognition," Proceedings of the IEEE, vol. 86, no. 11, pp. 2278-2324, 1998.   DOI
11 R. Girshick, "Fast r-cnn," in Proc. of the IEEE International Conference on Computer Vision (ICCV), pp. 1440-1448, 2015.
12 J. Chakaya, M. Khan, F. Ntoumi, E. Aklillu, R. Fatima, P. Mwaba, N. Kapata, S. Mfinanga, S. E. Hasnain, P. D. M. C. Katoto, A. N. H. Bulabula, N. A. Sam-Agudu, J. B. Nachega, S. Tiberi, T. D. McHugh, I. Abubakar, and A. Zumla, "Global Tuberculosis Report 2020-Reflections on the Global TB burden, treatment and prevention efforts," International Journal of Infectious Diseases, vol. 113, pp. S7-S12, 2021.   DOI
13 E. Harding, "WHO global progress report on tuberculosis elimination," The Lancet Respiratory Medicine, vol. 8, no. 1, p. 19, 2020.   DOI
14 S. Candemir, S. Jaeger, K. Palaniappan, J. P. Musco, R. K. Singh, Z. Xue, A. Karargyris, S. Antani, G. Thoma, and C. J. McDonald, "Lung segmentation in chest radiographs using anatomical atlases with nonrigid registration," IEEE transactions on medical imaging, vol. 33, no. 2, pp. 577-590, 2014.   DOI
15 M. R. A. Van Cleeff, L. E. Kivihya-Ndugga, H. Meme, J. A. Odhiambo, and P. R. Klatser, "The role and performance of chest X-ray for the diagnosis of tuberculosis: a cost-effectiveness analysis in Nairobi, Kenya," BMC infectious diseases, vol. 5, no. 1, pp. 1-9, 2005.   DOI
16 J. Dinnes, J. Deeks, H. Kunst, A. Gibson, E. Cummins, N. Waugh, F. Drobniewski, and A. Lalvani, "A systematic review of rapid diagnostic tests for the detection of tuberculosis infection," Health Technology Assessment, vol. 11, no. 3, pp. 1-196, 2007.
17 F. Pasa, V. Golkov, F. Pfeiffer, D. Cremers, and D. Pfeiffer, "Efficient deep network architectures for fast chest X-ray tuberculosis screening and visualization," Scientific reports, vol. 9, no. 1, pp. 1-9, 2019.   DOI
18 H. Rezatofighi, N. Tsoi, J. Gwak, A. Sadeghian, I. Reid, and S. Savarese, "Generalized intersection over union: A metric and a loss for bounding box regression," in Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 658-666, 2019.
19 R. B. Jeyavathana, R. Balasubramanian, and A. Pandian, "An Efficient Feature Extraction Method for Tuberculosis detection using Chest Radiographs," International Journal of Applied Environmental Sciences, vol. 12, no. 2, pp. 227-240, 2017.
20 K. He, G. Gkioxari, P. Dollar, and R. Girshick, "Mask r-cnn," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 42, no. 2, pp. 386-397, 2020.   DOI
21 M. Tan, and Q. Le, "Efficientnet: Rethinking model scaling for convolutional neural networks," in Proc. of International Conference on Machine Learning (ICML), pp. 6105-6114, 2019.
22 E. J. Hwang, S. Park, K. N. Jin, J. I. Kim, S. Y. Choi, and J. H. Lee, "Development and validation of a deep learning-based automatic detection algorithm for active pulmonary tuberculosis on chest radiographs," Clinical Infectious Diseases, vol. 69, no. 5, pp. 739-747, 2019.   DOI
23 T. Rahman, A. Khandakar, M. A. Kadir, K. R. Islam, K. F. Islam, R. Mazhar, T. Hamid, M. T. Islam, S. Kashem, Z. B. Mahbub, M. A. Ayari, and M. E. Chowdhury, "Reliable tuberculosis detection using chest X-ray with deep learning, segmentation and visualization," IEEE Access, vol 8, pp. 191586-191601, 2020.   DOI
24 J. Redmon, and A. Farhadi, "YOLO9000: better, faster, stronger," in Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 7263-7271, 2017.
25 A. Chauhan, D. Chauhan, and C. Rout, "Role of gist and PHOG features in computer-aided diagnosis of tuberculosis without segmentation," PloS one, vol. 9, no. 11, pp. e112980, 2014.   DOI
26 Y. Liu, Y. H. Wu, Y. Ban, H. Wang, and M. M. Cheng, "Rethinking computer-aided tuberculosis diagnosis," in Proc. of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2643-2652, 2020.
27 H. M. Blumberg, and J. D. Ernst, "The challenge of latent TB infection," Jama, vol. 316, no. 9, pp. 931-933. 2016.   DOI
28 Q. Li, W. Cai, X. Wang, Y. Zhou, D. D. Feng, and M. Chen, "Medical image classification with convolutional neural network," in Proc. of 2014 13th International Conference on Control Automation Robotics & Vision (ICARCV), pp. 844-848, 2014.
29 W. Rawat, and Z. Wang, "Deep convolutional neural networks for image classification: A comprehensive review," Neural computation, vol. 29, no. 9, pp. 2352-2449, 2017.   DOI
30 Z. Q. Zhao, P. Zheng, S. T. Xu, and X. Wu, "Object detection with deep learning: A review," IEEE transactions on neural networks and learning system, vol. 30, no. 11, pp. 3212-3232, 2019.   DOI
31 S. Candemir, and S. Antani, "A review on lung boundary detection in chest X-rays," International journal of computer assisted radiology and surgery, vol. 14, no. 4, pp. 563-576, 2019.   DOI
32 R. Guo, K. Passi, and C. K. Jain, "Tuberculosis diagnostics and localization in chest X-rays via deep learning models," Frontiers in Artificial Intelligence, vol. 3, 2020.
33 M. Ayaz, F. Shaukat, and G. Raja, "Ensemble learning based automatic detection of tuberculosis in chest x-ray images using hybrid feature descriptors," Physical and Engineering Sciences in Medicine, vol. 44, no. 1, pp. 183-194, 2021.   DOI
34 S. M. Pizer, E. P. Amburn, J. D. Austin, R. Cromartie, and K. Zuiderveld, "Adaptive histogram equalization and its variations," Computer Vision Graphics & Image Processing, vol. 39, no. 3, pp. 355-368, 1987.   DOI
35 P. Andersen, M. E. Munk, J. M. Pollock, and T. M. Doherty, "Specific immune-based diagnosis of tuberculosis," The Lancet, vol. 356, no. 9235, pp. 1099-1104, 2000.   DOI
36 A. Bekmurzayeva, M. Sypabekova, and D. Kanayeva, "Tuberculosis diagnosis using immunodominant, secreted antigens of Mycobacterium tuberculosis," Tuberculosis, vol. 93, no. 4, pp. 381-388, 2013.   DOI
37 A. Konstantinos, "Testing for tuberculosis," Australian Prescriber, vol. 33, pp. 12-18, 2010.   DOI
38 C. Miller, K. Lonnroth, G. Sotgiu, and G. B. Migliori, "The long and winding road of chest radiography for tuberculosis detection," European Respiratory Journal, vol. 49, no. 5, p. 1700364, 2017.   DOI
39 J. Yanase, and E. Triantaphyllou, "A systematic survey of computer-aided diagnosis in medicine: Past and present developments," Expert Systems with Applications, vol. 138, pp. 112821, 2019.   DOI
40 W. Liu, D. Anguelov, D. Erhan, C. Szegedy, S. Reed, C.Y. Fu, and A.C. Berg, "Ssd: Single shot multibox detector," in Proc. of European Conference on Computer Vision (ECCV), pp. 21-37, 2016.
41 T. Y. Lin, P. Goyal, R. Girshick, K. He, and P. Dollar, "Focal loss for dense object detection," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 42, no. 2, pp. 318-327, 2020.   DOI
42 S. Ren, K. He, R. Girshick, and J. Sun, "Faster r-cnn: Towards real-time object detection with region proposal networks," Advances in neural information processing systems, vol. 28, pp. 91-99, 2015.
43 C. Szegedy, A. Toshev, and D. Erhan, "Deep neural networks for object detection," in Proc. of the 26th International Conference on Neural Information Processing Systems, Vol. 2, pp. 2553-2561, 2013.
44 J. Redmon, and A. Farhadi, "Yolov3: An incremental improvement," arXiv preprint arXiv: 1804.02767, 2018.
45 J. C. M. dos Santos, G. A. Carrijo, C. D. F. dos Santos Cardoso, J. C. Ferreira, P. M. Sousa, and A. C. Patrocinio, "Fundus image quality enhancement for blood vessel detection via a neural network using CLAHE and Wiener filter," Research on Biomedical Engineering, vol. 36, pp. 107-119, 2020.   DOI
46 R. Hooda, S. Sofat, S. Kaur, A. Mittal, and F. Meriaudeau, "Deep-learning: A potential method for tuberculosis detection using chest radiography," in Proc. of 2017 IEEE International Conference on Signal and Image Processing Applications (ICSIPA), pp. 497-502, 2017.
47 S. Gao, M. M. Cheng, K. Zhao, X. Y. Zhang, M. H. Yang, and P. Torr, "Res2net: A new multi-scale backbone architecture," IEEE transactions on pattern analysis and machine intelligence, vol. 43, no. 2, pp. 652-662, 2021.   DOI
48 Z. Cai, and N. Vasconcelos, "Cascade r-cnn: Delving into high quality object detection," in Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 6154-6162, 2018.
49 S. Jaeger, S. Candemir, S. Antani, Y. X. J. Wang, P. X. Lu, and G. Thoma, "Two public chest X-ray datasets for computer-aided screening of pulmonary diseases," Quantitative imaging in medicine and surgery, vol. 4, no. 6, pp. 475-477, 2014.
50 S. Sajeev, M. Bajger, and G. Lee, "Segmentation of breast masses in local dense background using adaptive clip limit-CLAHE," in Proc. of 2015 International Conference on Digital Image Computing: Techniques and Applications (DICTA), pp. 1-8, 2015.
51 R. M. James, and A. Sunyoto, "Detection Of CT-Scan Lungs COVID-19 Image Using Convolutional Neural Network And CLAHE," in Proc, of 2020 3rd International Conference on Information and Communications Technology (ICOIACT), pp. 302-307, 2020.
52 J. Gu, Z. Wang, J. Kuen, L. Ma, A. Shahroudy, B. Shuai, and T. Chen, "Recent advances in convolutional neural networks," Pattern Recognition, vol. 77, pp. 354-377, 2018.   DOI
53 K. He, X. Zhang, S. Ren, and J. Sun, "Deep residual learning for image recognition," in Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770-778, 2016.
54 G. Huang, Z. Liu, L. Van Der Maaten, and K. Q. Weinberger, "Densely connected convolutional networks," in Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4700-4708, 2017.
55 L. Perez, and J. Wang, "The effectiveness of data augmentation in image classification using deep learning," arXiv preprint arXiv:1712.04621, 2017.
56 J. Redmon, S. Divvala, R. Girshick, A. Farhadi, "You only look once: Unified, real-time object detection," in Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 779-788, 2016.
57 K. Satheeshkumar, and A. N. J. Raj, "Developments in computer aided diagnosis used for Tuberculosis detection using chest radiography: A survey," Journal of Engineering and Applied Sciences, vol. 11, no. 9, pp. 5530-5539, 2006.
58 S. Jaeger, A. Karargyris, S. Candemir, L. Folio, J. Siegelman, F. Callaghan, Z. Xue, K. Palaniappan, R. K. Singh, S. Antani, G. Thoma, Y. Wang, P. Lu, and C. J. McDonald, "Automatic tuberculosis screening using chest radiographs," IEEE transactions on medical imaging, vol. 33, no. 2, pp. 233-245, 2014.   DOI