• 한국산업정보학회논문지
• /
• 제9권3호
• /
• pp.11-18
• /
• 2004

웹 기반 학습 시스템에서 평가를 위한 문제출제 방식에 대해 많은 연구가 이루어지고 있다. 이러한 원격 교육에서 출제되는 문제들은 고정 출제나 무작위 출제 방식 또는 난이도에 따른 자동 출제 방식을 사용하고 있다. 본 논문에서는 산업 기사 시험을 대비하는 학생들을 위한 웹 기반 학습 시스템을 설계함에 있어 기사 시험에 맞는 새로운 문제 출제 알고리즘을 제시한다. 일반적으로 기사 시험은 평균 점수에 맞는 난이도별 문제 출제와 함께 전체 학습 범위에서 골고루 시험 문제가 출제되어야 하는 특징이 있다. 따라서 제시된 알고리즘에서는 자동 문제 출제를 함에 있어 난이도뿐만이 아니라 전체 학습 범위에 대한 분포도 고려하여 문제를 골고루 출제한다. 이는 난이도에 의한 자동 출제 방식에 비해 기사 시험을 준비하는 학습자에게 보다 효과적인 학습 진단 방법을 제공할 수 있다.

• 한국환경교육학회지:환경교육
• /
• 제14권1호
• /
• pp.66-80
• /
• 2001

In this study, the current status and the desirable ways for improvement of the examination system for the employment of the environmental education teachers in the secondary school were investigated. For the study, first, problems and reasons, and the counterplan of policy on the teacher connected directly with the examination employing secondary school teachers through exploration of the related literatures were analyzed; second, it was identified that the essential quality which environmental education teachers should have ready; third, the curriculum of environmental education teacher training universities and the seventh environmental curriculum were examined to provide a basis of discussion on the principle of setting questions for the employment of environmental education teachers; fourth, the number of recruitment, the number of examinee, the principle of setting questions, the composition of questions, and the distribution of scores of the examination which were carried out in the school year 2000 and 2001 were compared and analyzed; finally, the basis of the above analyses, recommendations to consider the examination system for the employment of environmental education teachers in the secondary school were presented as follows: first, the team managing the examination for the employment should reflect the aims and special contents of environmental education to discuss and decide the principle of setting questions on the environmental course; second, the proportion of subject matter education in the examination for environmental education teachers should be increased; third, the validity of questions for the examination should be clarified and the difficulty level of the questions should be low.

• 수산해양교육연구
• /
• 제29권1호
• /
• pp.64-79
• /
• 2017

This study was to evaluate the suitability of scientific questions as qualification examination for high school graduation by content validity and item response with three examinees and two preliminary examinees. As a result, scientific questions were concentrated on two units of six units of total, and application appeared to be lacking problem area by 8% compared to understanding and application. Examinees and preliminary examinees chose correct answers most by hap or guess, sometimes by experience or common sense, and the least by scientific concept. In addition, they could chose correct answers by hap or guess because there were words that implied the correct answer in questions and answers, or because they could compared and/or analyzed questions and answers. With these results, two proposals were suggested as follows; (1) scientific questions of qualification examination for high school graduation should measure basic scientific literacy. (2) specific criteria for science literacy in qualification examination for high school graduation should be set.

• Journal of Chest Surgery
• /
• 제49권4호
• /
• pp.321-324
• /
• 2016

Medical student examination questions of 60 years ago are very rare to find irrespective of medical specialty. Recently, medical student examination questions for thoracic and cardiovascular surgery were found, which were presented between 1957 and 1959 at Seoul National University Medical College. All examination questions were hand-written in six pages by a professor as examiner. Among the six pages, four examination papers were dated and/or the target grade was identified, while the remaining two did not offer any information. These materials are thought to have a valuable historical meaning for the Korean medical community as well as the Department of Thoracic and Cardiovascular Surgery at Seoul National University Hospital.

• 한국의상디자인학회지
• /
• 제18권4호
• /
• pp.125-139
• /
• 2016

This study looked into how Colleges of Education around the country about how they are composing the curriculum to achieve the goal of Home Economics Subjects' national teachers training, how National Teacher's Examination's questions are set and which correlation is between university's curriculum composition and National Teacher's Examination questions and they were mainly focused on clothing area. For this study, 11 Colleges of Education's Home Management Major's curriculum and clothing area of Home Economic Subjects' National Teacher's Examination's questions from 2010~2016 were analyzed, and it will be summarized in the following. First, in College of Education's Home Management department, clothing area is organized with minimum of 4 to maximum of 12 different subjects. 'Textiles and Care for Textiles' and 'Design for Clothing' which is needed for the very basic subject completion for certificate to become a Home Economic Subject's teacher were included in all the university's curriculums and depending on the department's characteristics, 1~10 extra subjects were composited. Second, there were 34 questions on the exam of National Teacher's Examination in Home Economic subjects, and the results were 10~12 out of 80 each year according to the record of recent 7 years which is from 2010 to 2016. In the Clothing Area, 31 questions included various materials such as pictures, graphs, dialogues, explanations, examples and others, and 19 questions had more than 2 data overlapping. Third, as a result of looking into the correlation between the questions of Curriculum of Clothing Area of College and National Teacher's Examination, there were most questions from the curriculum of basic subject of completion. This means, 18 questions were related to 'Textiles and Care for Textiles' and 'Design for Clothing' and there was 8 questions related to 'Construction of Clothing' which was the second most. The result of this study will help effecting setting exam questions for Home Economic Subject's National Teacher's Examination and Home Management's Curriculum of Clothing Area College being amended.

• 치위생과학회지
• /
• 제24권1호
• /
• pp.62-70
• /
• 2024

Background: This study aimed to evaluate ChatGPT's performance accuracy in responding to questions from the national dental hygienist examination. Moreover, through an analysis of ChatGPT's incorrect responses, this research intended to pinpoint the predominant types of errors. Methods: To evaluate ChatGPT-3.5's performance according to the type of national examination questions, the researchers classified 200 questions of the 49th National Dental Hygienist Examination into recall, interpretation, and solving type questions. The researchers strategically modified the questions to counteract potential misunderstandings from implied meanings or technical terminology in Korea. To assess ChatGPT-3.5's problem-solving capabilities in applying previously acquired knowledge, the questions were first converted to subjective type. If ChatGPT-3.5 generated an incorrect response, an original multiple-choice framework was provided again. Two hundred questions were input into ChatGPT-3.5 and the generated responses were analyzed. After using ChatGPT, the accuracy of each response was evaluated by researchers according to the types of questions, and the types of incorrect responses were categorized (logical, information, and statistical errors). Finally, hallucination was evaluated when ChatGPT provided misleading information by answering something that was not true as if it were true. Results: ChatGPT's responses to the national examination were 45.5% accurate. Accuracy by question type was 60.3% for recall and 13.0% for problem-solving type questions. The accuracy rate for the subjective solving questions was 13.0%, while the accuracy for the objective questions increased to 43.5%. The most common types of incorrect responses were logical errors 65.1% of all. Of the total 102 incorrectly answered questions, 100 were categorized as hallucinations. Conclusion: ChatGPT-3.5 was found to be limited in its ability to provide evidence-based correct responses to the Korean national dental hygiene examination. Therefore, dental hygienists in the education or clinical fields should be careful to use artificial intelligence-generated materials with a critical view.

• 보건교육건강증진학회지
• /
• 제29권3호
• /
• pp.23-34
• /
• 2012

Objectives: This study aims to compare the contents of physical activity questions of Korean National Health and Nutrition Examination Survey(KNHANES), and to propose suggestions for improvement. Methods: Questions measuring physical activity prevalence of adults in the KNHANES from KNHANES I(1998) to the first year of KNHANES V(2010) were compared. Results: The questions used in each survey showed some problems in consistency and appropriateness. Major issues identified are as follows. First, the questions in each survey were not consistent, and would be inappropriate to make time series comparisons. Second, the purpose of physical activity was not clear. Third, the examples of physical activities suggested in the questions were not appropriate. Fourth, the intensity of physical activity were not adequately described. Fifth, by excluding walking from the moderate-intensity physical activity category, the prevalence of moderate-intensity physical activity could be underestimated. Sixth, it is difficult to measure the total amount of physical activity performed in one day because answers from the other domains cannot be clearly differentiated. Conclusions: The physical activity questions in the KNHANES questionnaire should be improved so that they are consistent with the purpose of survey, the respondents can easily understand the contents of the questions, and the questions can measure all physical activity performed in the different domains.

• 정보처리학회논문지A
• /
• 제9A권3호
• /
• pp.301-310
• /
• 2002

인터넷이 교육분야에도 활발히 사용되면서 자료검색부터 동영상 강의 나아가 인터넷을 통해 실시간으로 시험을 치르고 있다. 웹을 이용한 원격시험에 출제되는 문제들은 대부분 고정출제나 문제은행방식을 이용한 무작위 출제방식을 사용하고 있다. 본 논문의 문제은행시스템은 마크업 언어를 모르더라도 문제를 제작할 수 있으며, 웹 상에서 시험을 치르고난 후 정답률에 기초하여 난이도를 자동으로 재조정할 수 있다. 또한 학습자는 시험이 끝난뒤 피드백 학습을 할 수 있으며, 학습 후에는 학습자가 스스로 난이도를 조정하여 재시험을 치를 수 있게 하였다. 자동난이도 출제 방식은 출제가 간편해지며 평가의 예상평균점수를 미리 예측하고 시험결과가 계속 문항마다 누적되어 이를 바탕으로 출제되는 문제가 너무 쉽게 또는 너무 어렵게 출제되는 것을 막을 수 있다. 또한 원격시험은 대리시험 등 부정의 소지가 많아 유형이 다른 문제를 출제하게 되는데 여기서 오는 형평성 문제를 극복할 수 있게 된다.

• 한국수학교육학회지시리즈A:수학교육
• /
• 제49권4호
• /
• pp.395-410
• /
• 2010

Current mathematics of CSAT(College Scholastic Ability Test) faces time to prepare examination questions according to the new curriculum making this year the last. MEST(Minister of Education, Science and Technology) already decided the range of examination in 2008. However, the discuss about how to construct the questions and what form of questions should be set was not conducted enough. Mathematics items of CSAT will have to undergo changes both in 2012 and 2014. Also, reconstruction of the examination questions for the past 16 years and the exploration of the new direction are strongly required. To accord with these requirements, this study analyze Japan's college entrance exam, NCTUA(National Center Test for University Admissions) which is the most similar to our exams. And then on the basis of this, the applicable implication to set mathematics questions in 2012 and 2014 CSAT will be deducted.

• 한국임상약학회지
• /
• 제30권2호
• /
• pp.127-133
• /
• 2020

Competencies of entry-level pharmacists are evaluated by multiple-choice questions (MCQ) examination and objective structured clinical examination (OSCE). OSCE helps to evaluate student's communication skills and attitudes, which are difficult to evaluate by the MCQ exam. In Korea, pharmacy OSCE is not implemented; however, the needs of OSCE is growing. This study proposed OSCE exam contents and exam methods that can be implemented in colleges of pharmacy. Further study is needed to develop OSCE scenarios and questions, validate examination questions and evaluation methods by performing a pilot study, and provide feedback on the curriculum and study methods.