• 한국게임학회 논문지
• /
• 제15권4호
• /
• pp.157-168
• /
• 2015

게임의 난이도는 게임의 재미와 깊은 연관이 있다. 하지만 게임 레벨의 난이도를 적절하게 결정하는 것은 쉽지 않다. 대부분의 경우 사람의 실제 게임 플레이를 통한 테스트가 요구한다. 또한 정량적인 평가도 어렵다. 따라서 게임 레벨 난이도의 정량적 평가를 자동으로 수행하는 것은 게임 개발에 많은 도움이 될 것이다. 이 논문에서는 경로 탐색 알고리즘을 사용하여 게임 레벨의 길 찾기 난이도를 평가하였다. 길을 찾는 것은 많은 게임들의 기본 속성으로 게임 레벨의 전반적인 난이도를 대표한다. 그리고 우리는 게임 레벨의 탐색 가능 영역이 동적으로 확장되고 다시금 탐색이 요구되는 경우 이전 경로 탐색 결과를 재사용하여 난이도 평가 알고리즘의 성능을 최적화하였다.

• 한국수학교육학회지시리즈A:수학교육
• /
• 제46권4호
• /
• pp.407-421
• /
• 2007

The purpose of this study is to identify the item characteristics that are supposed to affect item difficulty and to estimate the regression equations for predicting item difficulty of mathematics in the College Scholastic Ability Test(CSAT). We selected six variables related to item characteristics based on learning theories: contents, cognitive domain, novelty, item type, number of concepts, and the amount of computation. With data of the CSAT mathematics test administered in 2004-2006, item difficulty was regressed on the six variables, the location of an item, and the item writer's judgment on difficulty. The novelty of an item was found to be a statistically insignificant variable in explaining item difficulty. Four regression equations with different sets of independent variables could explain $70%{\sim}80%$ of the item difficulty variance and were validated as predicting item difficulty of the mock CSAT in 2006.

• 한국항해학회지
• /
• 제20권1호
• /
• pp.1-10
• /
• 1996

The assesment of the safety of ship's transit in a curved narrow channel consists of the maneuvering safety determined by the chance of running aground, the maneuvering difficulty determined by ship's workload, and shiphandler's subjective evaluation. In this study, to examine the correlation between shiphandler's subjective evaluation and the maneuvering safety, the real-time and full-mission shiphandling simulator in the Korea Marine Training & Research Institute(KMTRI) was utilized. On the conning bridge of the shiphandling simulator, 50 experienced masters have conducted the modeled vessel of 60, 000 deadweight tonnage along the designed channel under 3 different environmental conditions. It was possible to assess and analyze theoretically the correlation between the shiphandler's subjective evaluation and maneuvering difficulty under each environmental condition by quantifying the data obtained from the tests. The results are as follows: $\circled1$ As the degree of maneuvering difficulty increases, the shiphandler's subjective evaluation increases in the designed channel under the designed environmental condition. $\circled2$ In the straight area, not the bend of the designed channel, maneuvering difficulty increases sharply under the environmental condition of current and wind coming from the stern.

• 한국수학교육학회지시리즈D:수학교육연구
• /
• 제10권3호
• /
• pp.215-227
• /
• 2006

After reviewing China's appearance and research on the Math open-ended problems, together with the application of those problems in mathematics test of Shanghai Senior Middle School Entrance Exams (SSMSEE) since 1999, this paper points out the difficulty in establishing an evaluation system for such problem. Through comparative study, the paper gives an operational definition of open-ended problem, and it attempts to establish an evaluation system and non-systematic competence targets that are appropriate to Math open-ended problems. Meanwhile, it describes the performance feature of those targets. By applying the standard international grading system of difficulty, it discusses the elements of difficulty in Math open-ended problems, and puts forward an evaluation as well as a level-of-difficulty forecasting system that is appropriate to the Middle School Entrance Exam.

• 한국안전학회지
• /
• 제7권3호
• /
• pp.60-65
• /
• 1992

As many industrial workers have been involved with computer terminal tasks, for example, monitor ing, inspection, or computer da4a entry etc., concerns for difficulty evaluation of computer terminal tasks are Increased. This study provides that eyeblink can be used as a means of difficulty evaluation of a computer terminal lask. Four subjects without color blindness are asked to perform the monitoring task of the binary choice type under five levels of task difficulty. In each task, eyeblink rates and eyeblink interval times were measured from the subjects. The results show that the eyeblink rate does decrease with an Increase in task difficulty. In addition, it was found that both eyeblink interval time and eyeblink Interval time variation increased with an increase in task difficulty. It was concluded that the change of eyeblink rate, eyeblink interval time and eyeblink interval time and eyeblink interval time variation could be regarded as a generalized response to the imposition of task difficulty.

• Journal of Korean Dental Science
• /
• 제12권2호
• /
• pp.58-65
• /
• 2019

Purpose: This study was aimed to investigate the possibility of utilizing smart device-based test (SBT) for competency evaluation in dental education and to analyze the student responses on overall competency evaluation using SBT method, in comparison to ubiquitous-based test (UBT). Materials and Methods: Questionnaire surveys have been conducted at Yonsei University College of Dentistry from 2015 to 2018 to obtain students' feedback on the application of SBT to competency evaluation. In addition, in order to supplement the competency evaluation procedure, considerations were explored by comparing the expected and actual difficulty of each item when preparing items for competency evaluation with SBT. Result: According to the survey results, student responses between the initial two years (2015 and 2016) differed from those in next two years (2017 and 2018). Students in 2017 and 2018 had more positive responses on competency evaluation with SBT. To determine the test validity, criterion-referenced evaluation was adopted to compare the data in 2017 and 2018 and slight differences in test difficulty in 2018 between the expected and actual difficulty of items were found. Conclusion: The results indicated that SBT was more appropriate for competency evaluation than UBT, based on four-year period of competency evaluation. The SBT was not affected by either the file size or the number of test-takers. Interestingly, students were not sensitive to test version of competency evaluation (paper-based test and SBT). This study suggests that the quality of the test items should be measured by continuous monitoring of the expected and actual difficulty of items for determining test validity. More detailed results and discussions of the findings are given for the development of test procedure and further potential research directions in dental education.

• 대한지구과학교육학회지
• /
• 제5권3호
• /
• pp.245-255
• /
• 2012

The purposes of this research are to analyze preservice elementary teachers' degree of difficulty in classes of seasonal variation and suggest the measures of classes so that preservice elementary teachers can progress classes of seasonal variation effectively. To achieve them, the research was conducted for 90 first graders completing teaching method of elementary science in P university of education from Sep. to Dec. 2012. This research was conducted, based on the results of in-depth interview for 9 preservice elementary teachers who performed classes of seasonal variation, survey on the degree of class difficulty and evaluation of classes on 8 classes theme of Earth sector in elementary science. The results of this research are as follows. The first, preservice elementary teachers had relatively high class difficulty for teaching seasonal variation among the sector of the earth in elementary science. The second, in the evaluation of preservice elementary teachers' classes, the more the subject showed high class difficulty, the more the score of class evaluation was low. The reason is analyzed that high class difficulty reduces teacher's confidence. The third, preservice elementary teachers had insufficient knowledges and concepts which are basically necessary for the classes of seasonal variation. Especially, it was more serious for preservice elementary teachers who didn't learn Earth-science during their high school time. The fourth, it is necessery that concrete and systematical teaching method should be developed so as to improving preservice elementary teachers' teaching method for the classes of seasonal variation.

• 한국컴퓨터정보학회논문지
• /
• 제21권4호
• /
• pp.39-46
• /
• 2016

While the difficulty of the music can be classified by a variety of standard, conventional methods are classified by the subjective judgment based on the experience of many musicians or conductors. Music score is difficult to evaluate as there is no quantitative criterion to determine the degree of difficulty. In this paper, we propose a new classification method for determining the degree of difficulty of the music. In order to determine the degree of difficulty, we convert the score, which is expressed as a traditional music score, into electronic music sheet. Moreover, we calculate information about the elements needed to play sheet music by distance of notes, tempo, and quantifying the ease of interpretation. Calculating a degree of difficulty of the entire music via the numerical data, we suggest the difficulty evaluation of the score, and show the difficulty of music through experiments.

• 한국산업정보학회논문지
• /
• 제27권2호
• /
• pp.11-24
• /
• 2022

LMS 기반의 온라인 평가를 위해 출제되는 문제들은 교수자가 직접 출제하거나 또는 카테고리별로 나뉘어진 문제은행에서 난이도에 따른 자동 출제 방식을 주로 이용한다. 이중에서 난이도에 따른 자동출제 방식은 평가자들에게 출제되는 문제가 서로 다를수 있기 때문에 무엇보다 객관적이고 효율적인 방법으로 문제의 난이도를 관리하는 것이 중요하다. 본 논문에서는 문제의 정답률뿐만 아니라 해당 문제를 해결하는데 사용된 소요시간을 같이 고려한 난이도 재조정 알고리즘을 제시한다. 이를 위해 머신러닝의 로지스틱 회귀 분류 알고리즘을 이용하였으며, 학습모델의 예측 확률값을 기반으로 기준 임계값을 설정하여 각 문항별 난이도 재조정에 활용하였다. 그 결과 정답률에만 의존한 문항별 난이도에 많은 변화가 일어남을 확인할 수 있었다. 또한 조정된 난이도의 문제를 이용하여 그룹별 평가를 수행한 결과, 정답률 기반의 난이도 문제에 비해서 대부분의 그룹에서 평균 점수가 향상됨을 확인할 수 있었다.

• 전자공학회논문지 IE
• /
• 제45권4호
• /
• pp.68-73
• /
• 2008

본 연구는 웹 기반 학습평가를 위한 학습자 중심의 문제추천 시스템을 제안하였다. 문제추천 과정을 위하여 문항난이도가 이용되었으며, 각 문제들은 문제은행에 저장 및 관리되었다. 문항난이도는 학습과정 중 재 산출되며 다음 학습에서 피드백되었다. 학습자 중심 문제추천을 위해, 학습자는 학습 전 학습단원을 선택할 수 있으며 학습난이도를 설정할 수 있도록 하였다. 제안방법의 적용결과 대부분의 학습자들이 학습난이도 조절로 인하여 성적이 향상됨을 알 수 있었다.