Browse > Article
http://dx.doi.org/10.14352/jkaie.2016.20.2.197

Automatic Generation of Multiple-Choice Questions Based on Statistical Language Model  

Park, Youngki (School of Computer Science and Engineering, Seoul National University)
Publication Information
Journal of The Korean Association of Information Education / v.20, no.2, 2016 , pp. 197-206 More about this Journal
Abstract
A fill-in-the-blank with choices are widely used in classrooms in order to check whether students' understand what is being taught. Although there have been proposed many algorithms for generating this type of questions, most of them focus on preparing sentences with blanks rather than generating multiple choices. In this paper, we propose a novel algorithm for generating multiple choices, given a sentence with a blank. Because the algorithm is based on a statistical language model, we can generate relatively unbiased result and adjust the level of difficulty with ease. The experimental results show that our approach automatically produces similar multiple-choices to those of the exam writers.
Keywords
Statistical Language Model; Multiple-Choice Questions; Fill-in-the-blank with Choices;
Citations & Related Records
Times Cited By KSCI : 4  (Citation Analysis)
연도 인용수 순위
1 Acerbi, A., Lampos, V., Garnett P. & Bentley RA. (2013). The Expression of Emotions in 20th Century Books. PLoS ONE, 8(3).
2 Alsubait, T., Parsia, B. & Sattler, U. Generating Multiple Choice Questions From Ontologies: Lessons Learnt. Proceedings of the 11th International Workshop on OWL: Experiences and Directions, 73-84.
3 Bae, Y. & Do, J. (2013). Study on Smart Learning Contents Development using Storyline. Journal of the Korean Association of Computer Education, 17(2), 135-146.
4 Google n-gram viewer. https://books.google.com/ngrams
5 Google n-gram viewer (Wikipedia). https://en.wikipedia.org/wiki/Google_Ngram_Viewer
6 Hoshino, A. & Nakagawa, H. (2005). A Real-time Multiple-choice Question Generation for Language Testing: a Preliminary Study. Proceedings of the 2nd Workshop on Building Educational Applications Using NLP, 17-20.
7 Kim, S. & Kim, K. (2012). Design and Implementation learning English words Smart-phone application for Elementary school students on Android platform by Focus on form. Journal of the Korean Association of Computer Education, 16(2), 223-231.
8 Lee, S. & Ryu, H. (2013). Suggestion on the Key Factors of Smart Education. Journal of the Korean Association of Computer Education, 17(2), 101-113.
9 Lin, J., Quan, D., Sinha, V., Bakshi, K., Huynh, D., Katz, B. & Karger D. R. (2003). The role of context in question answering systems. Proceedings of the Extened Abstracts on Human Factors in Computing Systems, 1006-1007.
10 Pintos. http://pintos-os.org/
11 Roth, S. (2014). Fashionable functions. A Google ngram view of trends in functional differentiation(1800-2000). International Journal of Technology and Human Interaction, 10(2), 34-58.
12 Soul M. & Son. C. (2012). A Survey on Teacher's Perceptions about the Current State of Using Smart Learning in Elementary Schools. Journal of the Korean Association of Computer Education, 16(3), 309-318.
13 Sumita, E., Sugaya F. & Yamamoto, S. (2005). Measuring non-native speakers' proficiency of English by using a test with automatically-generated fill-in-the-blank questions. Proceedings of the second workshop on Building Educational Applications Using NLP, 61-68.
14 Thompson, A. S. (2015). Are Your Participants Multilingual? The Role of Self-assessment in SLA Research. Language in Focus, 1(1), 51-65.   DOI
15 Wood, C. L., Mustian A. L. & Cooke N. L. (2010). Comparing Whole-Word and Morphograph Instruction During Computer-Assisted Peer Tutoring on Students' Acquisition and Generalization of Vocabulary. Remedial and Special Education, 33(1), 39-47.   DOI