Browse > Article
http://dx.doi.org/10.5051/jpis.2104080204

Deep learning improves implant classification by dental professionals: a multi-center evaluation of accuracy and efficiency  

Lee, Jae-Hong (Department of Periodontology, Daejeon Dental Hospital, Institute of Wonkwang Dental Research, Wonkwang University College of Dentistry)
Kim, Young-Taek (Department of Periodontology, National Health Insurance Service Ilsan Hospital)
Lee, Jong-Bin (Department of Periodontology, Gangneung-Wonju National University College of Dentistry)
Jeong, Seong-Nyum (Department of Periodontology, Daejeon Dental Hospital, Institute of Wonkwang Dental Research, Wonkwang University College of Dentistry)
Publication Information
Journal of Periodontal and Implant Science / v.52, no.3, 2022 , pp. 220-229 More about this Journal
Abstract
Purpose: The aim of this study was to evaluate and compare the accuracy performance of dental professionals in the classification of different types of dental implant systems (DISs) using panoramic radiographic images with and without the assistance of a deep learning (DL) algorithm. Methods: Using a self-reported questionnaire, the classification accuracy of dental professionals (including 5 board-certified periodontists, 8 periodontology residents, and 31 dentists not specialized in implantology working at 3 dental hospitals) with and without the assistance of an automated DL algorithm were determined and compared. The accuracy, sensitivity, specificity, confusion matrix, receiver operating characteristic (ROC) curves, and area under the ROC curves were calculated to evaluate the classification performance of the DL algorithm and dental professionals. Results: Using the DL algorithm led to a statistically significant improvement in the average classification accuracy of DISs (mean accuracy: 78.88%) compared to that without the assistance of the DL algorithm (mean accuracy: 63.13%, P<0.05). In particular, when assisted by the DL algorithm, board-certified periodontists (mean accuracy: 88.56%) showed higher average accuracy than did the DL algorithm, and dentists not specialized in implantology (mean accuracy: 77.83%) showed the largest improvement, reaching an average accuracy similar to that of the algorithm (mean accuracy: 80.56%). Conclusions: The automated DL algorithm classified DISs with accuracy and performance comparable to those of board-certified periodontists, and it may be useful for dental professionals for the classification of various types of DISs encountered in clinical practice.
Keywords
Artificial intelligence; Deep learning; Dental implants; Dentist;
Citations & Related Records
Times Cited By KSCI : 2  (Citation Analysis)
연도 인용수 순위
1 Lee JH, Jeong SN. Efficacy of deep convolutional neural network algorithm for the identification and classification of dental implant systems, using panoramic and periapical radiographs: a pilot study. Medicine (Baltimore) 2020;99:e20787.   DOI
2 Kim JR, Shim WH, Yoon HM, Hong SH, Lee JS, Cho YA, et al. Computerized bone age estimation using deep learning based program: evaluation of the accuracy and efficiency. AJR Am J Roentgenol 2017;209:1374-80.   DOI
3 Sung J, Park S, Lee SM, Bae W, Park B, Jung E, et al. Added value of deep learning-based detection system for multiple major findings on chest radiographs: a randomized crossover study. Radiology 2021;299:450-9.   DOI
4 Schwendicke F, Singh T, Lee JH, Gaudin R, Chaurasia A, Wiegand T, et al. Artificial intelligence in dental research: Checklist for authors, reviewers, readers. J Dent 2021;107:103610.   DOI
5 Srinivasan M, Meyer S, Mombelli A, Muller F. Dental implants in the elderly population: a systematic review and meta-analysis. Clin Oral Implants Res 2017;28:920-30.   DOI
6 Lee JH, Kim YT, Jeong SN, Kim NH, Lee DW. Incidence and pattern of implant fractures: a long-term follow-up multicenter study. Clin Implant Dent Relat Res 2018;20:463-9.   DOI
7 Lee DW, Kim NH, Lee Y, Oh YA, Lee JH, You HK. Implant fracture failure rate and potential associated risk indicators: an up to 12-year retrospective study of implants in 5,124 patients. Clin Oral Implants Res 2019;30:206-17.
8 Waring J, Lindvall C, Umeton R. Automated machine learning: review of the state-of-the-art and opportunities for healthcare. Artif Intell Med 2020;104:101822.   DOI
9 Lee JH, Kim YT, Lee JB, Jeong SN. A performance comparison between automated deep learning and dental professionals in classification of dental implant systems from dental imaging: a multi-center study. Diagnostics (Basel) 2020;10:910.   DOI
10 Faes L, Wagner SK, Fu DJ, Liu X, Korot E, Ledsam JR, et al. Automated deep learning design for medical image classification by health-care professionals with no coding experience: a feasibility study. Lancet Digit Health 2019;1:e232-42.   DOI
11 Lee DW, Kim SY, Jeong SN, Lee JH. Artificial intelligence in fractured dental implant detection and classification: evaluation using dataset from two dental hospitals. Diagnostics (Basel) 2021;11:233.   DOI
12 Lee JH, Kim DH, Jeong SN, Choi SH. Diagnosis and prediction of periodontally compromised teeth using a deep learning-based convolutional neural network algorithm. J Periodontal Implant Sci 2018;48:114-23.   DOI
13 Simonis P, Dufour T, Tenenbaum H. Long-term implant survival and success: a 10-16-year follow-up of non-submerged dental implants. Clin Oral Implants Res 2010;21:772-7.   DOI
14 Takahashi T, Nozaki K, Gonda T, Mameno T, Wada M, Ikebe K. Identification of dental implants using deep learning-pilot study. Int J Implant Dent 2020;6:53.   DOI
15 Howe MS, Keys W, Richards D. Long-term (10-year) dental implant survival: a systematic review and sensitivity meta-analysis. J Dent 2019;84:9-21.   DOI
16 Jokstad A, Braegger U, Brunski JB, Carr AB, Naert I, Wennerberg A. Quality of dental implants. Int Dent J 2003;53:409-43.   DOI
17 Esposito M, Ardebili Y, Worthington HV. Interventions for replacing missing teeth: different types of dental implants. Cochrane Database Syst Rev 2014:CD003815.
18 Jaarda MJ, Razzoog ME, Gratton DG. Geometric comparison of five interchangeable implant prosthetic retaining screws. J Prosthet Dent 1995;74:373-9.   DOI
19 Al-Wahadni A, Barakat MS, Abu Afifeh K, Khader Y. Dentists' most common practices when selecting an implant system. J Prosthodont 2018;27:250-9.   DOI
20 Lee JH, Kim DH, Jeong SN. Diagnosis of cystic lesions using panoramic and cone beam computed tomographic images based on deep learning neural network. Oral Dis 2020;26:152-8.   DOI
21 Sukegawa S, Yoshii K, Hara T, Yamashita K, Nakano K, Yamamoto N, et al. Deep neural networks for dental implant system classification. Biomolecules 2020;10:984.   DOI
22 Hadj Said M, Le Roux MK, Catherine JH, Lan R. Development of an artificial intelligence model to identify a dental implant from a radiograph. Int J Oral Maxillofac Implants 2020;36:1077-82.
23 Kim JE, Nam NE, Shim JS, Jung YH, Cho BH, Hwang JJ. Transfer learning via deep neural networks for implant fixture system classification using periapical radiographs. J Clin Med 2020;9:1117.   DOI
24 Lee JH, Kim DH, Jeong SN, Choi SH. Detection and diagnosis of dental caries using a deep learningbased convolutional neural network algorithm. J Dent 2018;77:106-11.   DOI