The Journal of Advanced Prosthodontics

The Korean Academy of Prosthodonitics (대한치과보철학회)
권호 표지
DOI QR코드

DOI QR Code

Rating criteria to evaluate student performance in digital wax-up training using multi-purpose software

  • Mino, Takuya (Department of Oral Rehabilitation and Regenerative Medicine, Okayama University Graduate School of Medicine, Dentistry and Pharmaceutical Sciences) ;
  • Kurosaki, Yoko (Department of Oral Rehabilitation and Implantology, Okayama University Hospital) ;
  • Tokumoto, Kana (Department of Oral Rehabilitation and Regenerative Medicine, Okayama University Graduate School of Medicine, Dentistry and Pharmaceutical Sciences) ;
  • Higuchi, Takaharu (Department of Oral Rehabilitation and Implantology, Okayama University Hospital) ;
  • Nakanoda, Shinichi (Insidefield Corporation) ;
  • Numoto, Ken (Department of Oral Rehabilitation and Implantology, Okayama University Hospital) ;
  • Tosa, Ikue (Department of Oral Rehabilitation and Regenerative Medicine, Okayama University Graduate School of Medicine, Dentistry and Pharmaceutical Sciences) ;
  • Kimura-Ono, Aya (Department of Oral Rehabilitation and Implantology, Okayama University Hospital) ;
  • Maekawa, Kenji (Department of Oral Rehabilitation and Regenerative Medicine, Okayama University Graduate School of Medicine, Dentistry and Pharmaceutical Sciences) ;
  • Kim, Tae Hyung (Removable Prosthodontics, Division of Restorative Sciences, Herman Ostrow School of Dentistry of University of Southern California) ;
  • Kuboki, Takuo (Department of Oral Rehabilitation and Regenerative Medicine, Okayama University Graduate School of Medicine, Dentistry and Pharmaceutical Sciences)
  • Received : 2022.01.05
  • Accepted : 2022.08.22
  • Published : 2022.08.31
Download PDF
⟨ Previous Next ⟩

Abstract

PURPOSE. The aim of this study was to introduce rating criteria to evaluate student performance in a newly developed, digital wax-up preclinical program for computer-aided design (CAD) of full-coverage crowns and preliminarily investigate the reliability and internal consistency of the rating system. MATERIALS AND METHODS. This study, conducted in 2017, enrolled 47 fifth-year dental students of Okayama University Dental School. Digital wax-up training included a fundamental practice using computer graphics (CG), multipurpose CAD software programs, and an advanced practice to execute a digital wax-up of the right mandibular second molar (#47). Each student's digital wax-up work (stereolithography data) was evaluated by two instructors using seven qualitative criteria. The total qualitative score (0-90) of the criteria was calculated. The total volumetric discrepancy between each student's digital wax-up work and a reference prepared by an instructor was automatically measured by the CAD software. The inter-rater reliability of each criterion was analyzed using a weighted kappa index. The relationship between the total volume discrepancy and the total qualitative score was analyzed using Spearman's correlation. RESULTS. The weighted kappa values for the seven qualitative criteria ranged from 0.62 - 0.93. The total qualitative score and the total volumetric discrepancy were negatively correlated (ρ = -0.27, P = .09, respectively); however, this was not statistically significant. CONCLUSION. The established qualitative criteria to evaluate students' work showed sufficiently high inter-rater reliability; however, the digitally measured volumetric discrepancy could not sufficiently predict the total qualitative score.

Keywords

References

  1. Iacopino AM. The influence of "new science" on dental education: current concepts, trends, and models for the future. J Dent Educ 2007;71:450-62. https://doi.org/10.1002/j.0022-0337.2007.71.4.tb04296.x
  2. Miyazaki T, Hotta Y, Kunii J, Kuriyama S, Tamaki Y. A review of dental CAD/CAM: current status and future perspectives from 20 years of experience. Dent Mater J 2009;28:44-56. https://doi.org/10.4012/dmj.28.44
  3. Fasbinder DJ. Computerized technology for restorative dentistry. Am J Dent 2013;26:115-20.
  4. Callan RS, Blalock JS, Cooper JR, Coleman JF, Looney SW. Reliability of CAD CAM technology in assessing crown preparations in a preclinical dental school environment. J Dent Educ 2014;78:40-50. https://doi.org/10.1002/j.0022-0337.2014.78.1.tb05655.x
  5. Douglas RD, Hopp CD, Augustin MA. Dental students' preferences and performance in crown design: conventional wax-added versus CAD. J Dent Educ 2014; 78:1663-72. https://doi.org/10.1002/j.0022-0337.2014.78.12.tb05845.x
  6. Reifeis PE, Kirkup ML, Willis LH, Browning WD. Introducing CAD/CAM into a predoctoral dental curricu- lum: a case study. J Dent Educ 2014;78:1432-41. https://doi.org/10.1002/j.0022-0337.2014.78.10.tb05817.x
  7. Afshari FS, Sukotjo C, Alfaro MF, McCombs J, Campbell SD, Knoernschild KL, Yuan JC. Integration of digi- tal dentistry into a predoctoral implant program: program description, rationale, and utilization trends. J Dent Educ 2017;81:986-94. https://doi.org/10.21815/jde.017.050
  8. Schwindling FS, Deisenhofer UK, Porsche M, Rammelsberg P, Kappel S, Stober T. Establishing CAD/CAM in preclinical dental education: evaluation of a handson module. J Dent Educ 2015;79:1215-21. https://doi.org/10.1002/j.0022-0337.2015.79.10.tb06015.x
  9. de Azevedo Rde A, da Rosa WL, da Silva AF, Correa MB, Torriani MA, Lund RG. Comparative effectiveness of dental anatomy carving pedagogy: a systematic review. J Dent Educ 2015;79:914-21. https://doi.org/10.1002/j.0022-0337.2015.79.8.tb05981.x
  10. Cardoso JA, Barbosa C, Fernandes S, Silva CL, Pinho A. Reducing subjectivity in the evaluation of pre-clinical dental preparations for fixed prosthodontics using the Kavo PrepAssistant. Eur J Dent Educ 2006;10:149-56. https://doi.org/10.1111/j.1600-0579.2006.00409.x
  11. Haj-Ali R, Feil P. Rater reliability: short- and long-term effects of calibration training. J Dent Educ 2006;70: 428-33. https://doi.org/10.1002/j.0022-0337.2006.70.4.tb04097.x
  12. Sharaf AA, AbdelAziz AM, El Meligy OA. Intra- and inter-examiner variability in evaluating preclinical pe- diatric dentistry operative procedures. J Dent Educ 2007;71:540-4. https://doi.org/10.1002/j.0022-0337.2007.71.4.tb04307.x
  13. Licari FW, Knight GW, Guenzel PJ. Designing evaluation forms to facilitate student learning. J Dent Educ 2008;72:48-58. https://doi.org/10.1002/j.0022-0337.2008.72.1.tb04452.x
  14. Satterthwaite JD, Grey NJ. Peer-group assessment of pre-clinical operative skills in restorative dentistry and comparison with experienced assessors. Eur J Dent Educ 2008;12:99-102. https://doi.org/10.1111/j.1600-0579.2008.00509.x
  15. Kwon SR, Restrepo-Kennedy N, Dawson DV, Hernandez M, Denehy G, Blanchette D, Gratton DG, Aquilino SA, Armstrong SR. Dental anatomy grading: comparison between conventional visual and a novel digital assessment technique. J Dent Educ 2014;78:1655-62. https://doi.org/10.1002/j.0022-0337.2014.78.12.tb05844.x
  16. Kunkel TC, Engelmeier RL, Shah NH. A comparison of crown preparation grading via PrepCheck versus grading by dental school instructors. Int J Comput Dent 2018;21:305-311.
  17. Renne WG, McGill ST, Mennito AS, Wolf BJ, Marlow NM, Shaftman S, Holmes JR. E4D compare software: an alternative to faculty grading in dental education. J Dent Educ 2013;77:168-75. https://doi.org/10.1002/j.0022-0337.2013.77.2.tb05459.x
  18. Hamil LM, Mennito AS, Renne WG, Vuthiganon J. Dental students' opinions of preparation assessment with E4D compare software versus traditional methods. J Dent Educ 2014;78:1424-31. https://doi.org/10.1002/j.0022-0337.2014.78.10.tb05816.x
  19. Garrett PH, Faraone KL, Patzelt SB, Keaser ML. Comparison of dental students' self-directed, faculty, and software-based assessments of dental anatomy waxups: a retrospective study. J Dent Educ 2015;79:1437-44. https://doi.org/10.1002/j.0022-0337.2015.79.12.tb06043.x
  20. Gratton DG, Kwon SR, Blanchette D, Aquilino SA. Impact of digital tooth preparation evaluation technology on preclinical dental students' technical and self-evaluation skills. J Dent Educ 2016;80:91-9. https://doi.org/10.1002/j.0022-0337.2016.80.1.tb06062.x
  21. Kurosaki Y, Mino T, Maekawa K, Izumi K, Kuboki T. Digital transfer of the subgingival contour and emergence profile of the provisional restoration to the final bone-anchored fixed restoration. J Prosthodont Res 2019;63:125-9. https://doi.org/10.1016/j.jpor.2018.10.004
  22. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977;33: 159-74. https://doi.org/10.2307/2529310
  23. Gratton DG, Kwon SR, Blanchette DR, Aquilino SA. Performance of two different digital evaluation systems used for assessing pre-clinical dental students' prosthodontic technical skills. Eur J Dent Educ 2017;21: 252-60. https://doi.org/10.1111/eje.12231