• Journal of Science Education
• /
• v.37 no.3
• /
• pp.458-475
• /
• 2013

According to instruction of standard-based assessment system, teachers with higher level of competence in student assessment are required. The purpose of this study is to offer the basic data to enhance pre-service physics teachers' competency in student assessment. 17 pre-service physics teachers, who are sophomore in department of physics education, participated in the study for a whole semester. To do this, we gave the assignment of multiple choice question construction in physics conceptest for formative assessment to pre-service teachers and observed review questions constructed by them. We also analyzed multiple choice questions of 17 pre-service teachers. They had 5 classes for the review process of the question and improved their questions through it. 16 of 17 pre-service teachers completed test design. Our results show that pre-service teachers had a little low competence in test design for classroom assessment. In addition to, constructing and revising questions, almost of them didn't have various perspectives and didn't consider to get information about the pre-conceptions of students. These findings indicate that they have difficulties with constructing multiple choice question and more specific plan needs to enhance the overall student-assessment competency levels of pre-service teachers for successful settlement of the standard-based assessment system.

• The Journal of Korean Association of Computer Education
• /
• v.22 no.3
• /
• pp.55-65
• /
• 2019

In programming language learning system of flip learning methods, the evaluation of cyber lectures generally proceeds from online to multiple choice questions. In this case, the questions are randomly extracted from the question bank and given to individual learners. In order for these evaluation results to be reflected in the grades, the equity of the examination question is more important than anything else. Especially in the programming language subject, the degree of difficulty that learners think can be different depending on the type of problem. In this paper, we classify the types of multiple-choice problems into two categories, and manage the difficulty level by each type. And we propose a question selection algorithm that considers both difficulty level and type of question. Considering the characteristics of the programming language, experimental results show that the proposed algorithm is more efficient and fair than the conventional method.

• The Journal of Korean Association of Computer Education
• /
• v.23 no.1
• /
• pp.29-36
• /
• 2020

Various items were used as evaluation tools that identify the student's abilities accurately to confirm the completion of learning. Among them, the multiple choice item has the advantages of high objectivity and reliability in scoring, but it cannot remove the factor of guessing. In this paper, the multiple choice items are classified into two types according to the relationship between the questionnaire and the choices. One is the type used in the classical test theory with the probability of guessing 1/k for k choices and the other is the novel proposed type which introduces the concept of partial knowledge. In the proposed type, the probability of guessing when the number of knowledge i is (i+1)/k for k choices. Based on the assumptions of the previous theories about multiple choice items, we derive the guessing parameter about the proposed type. And we analyzed the effect of the guess on the correct answer in the existing type and the proposed type. This shows that the proposed type has more question guessing than the existing type.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.15 no.6
• /
• pp.3609-3615
• /
• 2014

This study examined the difference in the item characteristics in multiple-choice aptitude tests focusing on the response position, response length and question types. A university aptitude test consisting of 80 questions was used for this study. The subjects were 3120 senior high school students from 80 schools nation-wide (liberal arts-1650, natural sciences-1467 patients). The results suggest that item prediction is higher for numbers 2 and 3 (located in the middle) than numbers 1 and 4. The item discrimination was higher for pick-the-'wrong'-items than pick-the-'right'-items. In addition, longer choices are preferred. The suggestions for future research are provided based on these findings.

• The KIPS Transactions:PartA
• /
• v.15A no.2
• /
• pp.125-134
• /
• 2008

We implemented a system being able to suggest example sentences for multiple choice tests, considering the level of students. To build the system, we designed an automatic method for sentence generation, which made it possible to control the difficulty degree of questions. For the proper evaluation in the multiple choice tests, proper size of question pools is required. To satisfy this requirement, a system which can generate various and numerous questions and their example sentences in a fast way should be used. In this paper, we designed an automatic generation method using a linguistic resource called WordNet. For the automatic generation, firstly, we extracted keywords from the existing sentences with the morphological analysis and candidate terms with similar meaning to the keywords in Korean WordNet space are suggested. When suggesting candidate terms, we transformed the existing Korean WordNet scheme into a new scheme to construct the concept similarity matrix. The similarity degree between concepts can be ranged from 0, representing synonyms relationships, to 9, representing non-connected relationships. By using the degree, we can control the difficulty degree of newly generated questions. We used two methods for evaluating semantic similarity between two concepts. The first one is considering only the distance between two concepts and the second one additionally considers positions of two concepts in the Korean Wordnet space. With these methods, we can build a system which can help the instructors generate new questions and their example sentences with various contents and difficulty degree from existing sentences more easily.

• Proceedings of the PSK Conference
• /
• 2003.10b
• /
• pp.68.2-68.2
• /
• 2003

We performed this survey to hear Yeungnam University Graduates' opinion on the current curriculum for the purpose of creating an education system of “practically competent person” instead of simply “competent person”. Questionnaire was made up of 13 multiple-choice questions and 1 descriptive question by Curriculum Reform Task Force of Yeungnam University. The survey was administered to randomly chosen 50 graduates by e-mail on August 1, 2003 and was collected between August 1 and August 10, 2003 for the analysis of respondent’s reply. (omitted)

• Journal of information and communication convergence engineering
• /
• v.2 no.2
• /
• pp.97-101
• /
• 2004

This paper is about the use of existing evaluation methods, which evaluate learning determined by the score of an exam, which is either a multiple-choice type or single choice type question. These scores don't show the objective evaluations that cause some negative opinions about the scores. In this paper, we propose that the evaluation of the methods of self-directed learning use the triangle-type function of the fuzzy theory so that the learner can objectively evaluate their own learning ability. The proposed method classifies the result of learning into three fuzzy grades to calculate membership, and evaluate the result of an exam according to the final fuzzy grade degree as applied to the fuzzy grade sheets.

• The Journal of the Korea Contents Association
• /
• v.16 no.9
• /
• pp.694-701
• /
• 2016

The smart phone application to provide auto identification and answer explanation of multiple choice answer for each OMR answer item in the test paper different from ordinary OMR test by using smart phone is very useful in terms of a self learning and a smart learning. In this paper, smart phone application of OMR mark identification for each question item in test paper is proposed. QR code for each OMR answer is provided for the encrypted correct answer and the reference location of multiple choice answer rectangle location. The OMR answer region is extracted and the marked answer is identified in each question of test paper, in order to compare between the marking answer and the correct answer. Experimental result of smart phone application of the proposed algorithm for the OMR answer images with various size and direction shows excellent recognition performance.

• Asian Oncology Nursing
• /
• v.4 no.1
• /
• pp.82-90
• /
• 2004

Purpose: This study is part of questionnaire survey concerned with the views of nursing staff for cancer patients. This study was done to describe cancer pain management problem, pain management knowledge. Methods: The participants were 188 nurses at cancer ward. Data were collected from July 2003 to August 2003. Data were collected with multiple-choice items and one open-ended question, which were constructed structured questionnaire. The data were analyzed by means of SPSS statistical software and content analysis. Results: Experiences of pain education are 53.7%, pain assessment sheet not use 86%, pain management status are partial. Education need of pain management was 87.8% patients in pain were very often(23.9%) or rather often (35.1%) cancer patients. The nurses are respond to open question. Pain management problems as assessed by nurses are categorized 11 item. The health professional problems are Knowledge deficit pain management, Incontrollable pain, Doctor's busy. The patient problems afraid of narcotics for addiction, side effect, distinguishing between physical and suffering, economical problem. The scores of knowledge about pain was average 16.7 score. The pain knowledge showed significant correlation education need(r=.180, p=.013). The effective variable was need of $education({\beta}=.163)$. Conclusion: It was found that pain knowledge was middle score and pain management problem was multiple. The study highlights the need to increase pain education for health professional. Therefore, This study suggest that health professionals education should be done to improve pain management problem.

• The Journal of Korean Medicine
• /
• v.34 no.1
• /
• pp.69-79
• /
• 2013

Objectives: The aim of this survey was to investigate utilization, intended use, problems with and demand for medical devices by surveying members of the traditional Korean medical society. Methods: We distributed questionnaires to 13,957 traditional Korean medical doctors via e-mail, and received replies from 1,225. The questionnaire consisted of 4 multiple-choice questions for survey respondent information, 8 multiple-choice questions about the status of medical devices utilizing, and a short answer question about the demand for medical devices. Results: Use of medical devices in traditional Korean medical clinics is common. Diagnostic medical devices are mainly used to assess the patient's condition and to establish a close rapport with clients. In case of therapeutic medical devices, they are usually used for secondary treatment. Issues with traditional Korean medical devices currently in use were ineligibility for national health insurance, low reliability, uncertain validity, and high price. In development of traditional Korean medical equipment, the need for diagnostic medical devices was greater than for therapeutic, and the need for the recording and analysis of medical image data and visualization of medical information was great. Conclusions: There is growing demand for facilitating the development and commercialization of traditional Korean medical devices. To satisfy this demand, research on evaluation indicators that reflect functional and structural clinical information and how to clinically assess the indicators should proceed.