Browse > Article
http://dx.doi.org/10.17135/jdhs.2020.20.4.206

Feasibility Study of Google's Teachable Machine in Diagnosis of Tooth-Marked Tongue  

Jeong, Hyunja (Department of Dental Hygiene, Daegu Health College)
Publication Information
Journal of dental hygiene science / v.20, no.4, 2020 , pp. 206-212 More about this Journal
Abstract
Background: A Teachable Machine is a kind of machine learning web-based tool for general persons. In this paper, the feasibility of Google's Teachable Machine (ver. 2.0) was studied in the diagnosis of the tooth-marked tongue. Methods: For machine learning of tooth-marked tongue diagnosis, a total of 1,250 tongue images were used on Kaggle's web site. Ninety percent of the images were used for the training data set, and the remaining 10% were used for the test data set. Using Google's Teachable Machine (ver. 2.0), machine learning was performed using separated images. To optimize the machine learning parameters, I measured the diagnosis accuracies according to the value of epoch, batch size, and learning rate. After hyper-parameter tuning, the ROC (receiver operating characteristic) analysis method determined the sensitivity (true positive rate, TPR) and specificity (false positive rate, FPR) of the machine learning model to diagnose the tooth-marked tongue. Results: To evaluate the usefulness of the Teachable Machine in clinical application, I used 634 tooth-marked tongue images and 491 no-marked tongue images for machine learning. When the epoch, batch size, and learning rate as hyper-parameters were 75, 0.0001, and 128, respectively, the accuracy of the tooth-marked tongue's diagnosis was best. The accuracies for the tooth-marked tongue and the no-marked tongue were 92.1% and 72.6%, respectively. And, the sensitivity (TPR) and specificity (FPR) were 0.92 and 0.28, respectively. Conclusion: These results are more accurate than Li's experimental results calculated with convolution neural network. Google's Teachable Machines show good performance by hyper-parameters tuning in the diagnosis of the tooth-marked tongue. We confirmed that the tool is useful for several clinical applications.
Keywords
Hyper-parameter tuning; Machine learning; Oral health; Teachable Machine; Tooth-marked-tongue;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Abdalla-Aslan R, Yeshua T, Kabla D, Leichter I, Nadler C: An artificial intelligence system using machine-learning for automatic detection and classification of dental restorations in panoramic radiography. Oral Surg Oral Med Oral Pathol Oral Radiol 130: 593-602, 2020. https://doi.org/10.1016/j.oooo.2020.05.012   DOI
2 Lee JH, Kim DH, Jeong SN, Choi SH: Detection and diagnosis of dental caries using a deep learning-based convolutional neural network algorithm. J Dent 77: 106-111, 2018. https://doi.org/10.1016/j.jdent.2018.07.015   DOI
3 Teachable machine: Train a computer to recognize your own images, sounds, & poses. Retrieved September 30, 2020, from https://teachablemachine.withgoogle.com# Google(2019, November 1).
4 Jang KH, Jeong HJ: Oral anatomy. Komoonsa, Seoul, pp.47-142, 2005.
5 Slavkin HC, Baum BJ: Relationship of dental and oral pathology to systemic illness. JAMA 284: 1215-1217, 2000. https://doi.org/10.1001/jama.284.10.1215   DOI
6 Shi D, Tang C, Blackley SV, et al.: An annotated dataset of tongue images supporting geriatric disease diagnosis. Data Brief 32: 106153, 2020. https://doi.org/10.1016/j.dib.2020.106153   DOI
7 Solos I, Liang Y: A historical evaluation of Chinese tongue diagnosis in the treatment of septicemic plague in the pre-antibiotic era, and as a new direction for revolutionary clinical research applications. J Integr Med 16: 141-146, 2018. https://doi.org/10.1016/j.joim.2018.04.001   DOI
8 Hong SS: Diagnosis of oriental medicines. Koonja, Seoul, pp.54-55, 2009.
9 Li X, Zhang Y, Cui Q, Yi X, Zhang Y: Tooth-marked tongue recognition using multiple instance learning and CNN features. IEEE Trans Cybern 49: 380-387, 2019. https://doi.org/10.1109/TCYB.2017.2772289   DOI
10 Tooth-marked-tongue: Dataset. Retrieved September 30, 2020, from https://www.kaggle.com/clearhanhui/biyesheji#Kaggle(2020, March 11).
11 Im YG: Atlas of clinical diagnosis 2: tongue diagnosis. Jungdam, Seoul, pp.74-76, 2003.
12 Kaggle: Tour machine learning and data science community. etrieved September 30, 2020, from https://www.kaggle.com#Google(2010, April 1).
13 Omar L, Ivrissimtzis I: Using theoretical ROC curves for analysing machine learning binary classifiers. Pattern Recognit Lett 128: 447-451, 2019. https://doi.org/10.1016/j.patrec.2019.10.004   DOI
14 Cho KH, Kim JS, Hong JP, Eo GS: Tongue diagnosis for clinicians: integrating oriental and western medicines. Koonja, Seoul, pp.4-49, 2007.
15 Ma J, Wen G, Wang C, Jiang L: Complexity perception classification method for tongue constitution recognition. Artif Intell Med 96: 123-133, 2019. https://doi.org/10.1016/j.artmed.2019.03.008   DOI
16 Tania MH, Lwin K, Hossain MA: Advances in automated tongue diagnosis techniques. Integr Med Res 8: 42-56, 2019. https://doi.org/10.1016/j.imr.2018.03.001   DOI
17 Chamunyonga C, Edwards C, Caldwell P, Rutledge P, Burbery J: The impact of artificial intelligence and machine learning in radiation therapy: considerations for future curriculum enhancement. J Med Imaging Radiat Sci 51: 214-220, 2020. https://doi.org/10.1016/j.jmir.2020.01.008   DOI
18 Lopez-Ubeda P, Diaz-Galiano MC, Martin-Noguerol T, Urena-Lopez A, Martin-Valdivia MT, Luna A: Detection of unexpected findings in radiology reports: a comparative study of machine learning approaches. Expert Syst Appl 160: 113647, 2020. https://doi.org/10.1016/j.eswa.2020.113647   DOI