Browse > Article
http://dx.doi.org/10.7236/IJIBC.2021.13.4.22

Evaluating Corrective Feedback Generated by an AI-Powered Online Grammar Checker  

Moon, Dosik (Dept of English, Hanyang Cyber University)
Publication Information
International Journal of Internet, Broadcasting and Communication / v.13, no.4, 2021 , pp. 22-29 More about this Journal
Abstract
This study evaluates the accuracy of corrective feedback from Grammarly, an online grammar checker, on essays written by cyber university learners in terms of detected errors, suggested replacement forms, and false alarms.The results indicate that Grammarly has a high overall error detection rate of over 65%, being particularly strong at catching errors related to articles and prepositions. In addition, on the detected errors, Grammarly mostly provide accurate replacement forms and very rarely make false alarms. These findings suggest that Grammarly has high potential as a useful educational tool to complement the drawbacks of teacher feedback and to help learnersimprove grammatical accuracy in their written work. However, it is still premature to conclude that Grammarly can completely replace teacher feedback because it has the possibility (approximately 35%) of failing to detect errors and the limitationsin detecting errors in certain categories. Since the feedback from Grammarly is not entirely reliable, caution should be taken for successful integration of Grammarly in English writing classes. Teachers should make judicious decisions on when and how to use Grammarly, based on a keen awareness of Grammarly's strengths and limitations.
Keywords
Online Grammar Checker; Corrective Feedback; Grammarly; Grammatical Accuracy;
Citations & Related Records
연도 인용수 순위
  • Reference
1 S. Sahu, Y. K. Vishwakarma, J. Kori, and J. S. Thakur, "Evaluating performance of different grammar checking tools. International Journal," Vol. 9, No. 2, 2020. DOI: https://10.30534/ijatcse/2020/201922020   DOI
2 Dosik, Moon, "Learner-Generated Digital Listening Materials Using Text-to-Speech for Self-Directed Listening Practice," International Journal of Internet, Broadcasting and Communication, Vol.12, No.4, pp. 148-155, 2020. DOI: https://doi.org/10.7236/IJIBC.2020.12.4.148   DOI
3 P. John and N. Woll, "Using Grammar Checkers in an ESL Context: An Investigation of Automatic Corrective Feedback," Calico Journal, Vol. 37, No. 2, pp. 169-192, 2020. DOI: https://doi.org/10.1558/cj.36523   DOI
4 J. S. Barrot, "Integrating Technology into ESL/EFL Writing through Grammarly," RELC Journal, 0033688220966632, 2020. DOI: https://doi.org/10.1177/0033688220966632   DOI
5 H.-J. H. Chen, "Evaluating two web-based grammar checkers Microsoft ESL Assistant and NTNU statistical grammar checker," Computational Linguistics and Chinese Language Processing, Vol. 14, No.2, pp. 161-180, 2009.
6 J. Woodworth and K. Barkaoui, "Perspectives on Using Automated Writing Evaluation Systems to Provide Written Corrective Feedback in the ESL Classroom," TESL Canada Journal, Vol. 37, No. 2, pp. 234-247, 2020. DOI: https://doi.org/10.18806/tesl.v37i2.1340   DOI
7 R. De Felice and S. G. Pulman, "A classifier-based approach to preposition and determiner error correction in L2 English," in Proc. the 22nd International Conference on Computational Linguistics, Aug. 18 - 22, pp.169-176, 2008. DOI: https://doi.org/10.3115/1599081.1599103   DOI
8 R. O'Neill and A. Russell, "Stop! Grammar time: University students' perceptions of the automated feedback program Grammarly", Australasian Journal of Educational Technology, Vol. 35, No. 1, pp. 42-56, 2019. DOI: https://doi.org/10.14742/ajet.3795   DOI
9 R. O'Neill and A. M. Russell, "Grammarly: Help or hindrance? Academic learning advisors' perceptions of an online grammar checker." Journal of Academic Language and Learning, Vol. 13, No. 1, pp. 88-107, 2019. DOI: https://journal.aall.org.au/index.php/jall/article/view/591
10 I. Lee, "Revisiting teacher feedback in EFL writing from sociocultural perspectives," TESOL Quarterly, Vol. 48, no. 1 pp. 201-213, 2014. DOI: https://doi.org/10.1002/tesq.153   DOI
11 J. Zhang, H. Ozer, and R. Bayazeed, "Grammarly vs. Face-to-face Tutoring at the Writing Center: ESL Student Writers' Perceptions," Praxis: A Writing Center Journal, Vol. 17, No. 20, pp. 33-47, 2020. DOI: https://doi.org/10.26153/tsw/8523   DOI
12 M. Nova, "Utilizing Grammarly in evaluating academic writing: A narrative research on EFL students' experience," Premise: Journal of English Education, Vol. 7, No. 1, pp. 80-97, 2018. DOI: https://doi.org/10.24127/pj.v7i1.1300   DOI
13 X. Yi, J. Gao, and W. B. Dolan, (2008). "A web-based English proofing system for English as a second language users," in Proc. the Third International Joint Conference on Natural Language Processing, Jan. 8-10, pp. 619-624, 2008.
14 L. Karyuatry, D. Muhammad, R. Arif, and A. D. Nisrin, "Grammarly as a tool to improve students' writing quality: Free online proofreader across the boundaries," Edulitics Journal, Vol. 3, No. 1, pp. 36-42, 2018. DOI: https://doi.org/10.30595/jssh.v2i1.2297   DOI
15 S. Koltovskaia, "Student engagement with automated written corrective feedback (AWCF) provided by Grammarly: A multiple case study," Assessing Writing, Vol. 44, No. 2, pp. 1-12, 2020. DOI: https://doi.org/10.1016/j.jslw.2021.100816   DOI