• Title/Summary/Keyword: Difficulty evaluation

Search Result 837, Processing Time 0.024 seconds

Difficulty Evaluation of Game Levels using A Path-Finding Algorithm (경로 탐색 알고리즘을 이용한 게임 레벨 난이도 평가)

  • Chun, Youngjae;Oh, Kyoungsu
    • Journal of Korea Game Society
    • /
    • v.15 no.4
    • /
    • pp.157-168
    • /
    • 2015
  • The difficulty of the game is closely related to the fun of the game. However, it is not easy to determine the appropriate level of difficulty of the game. In most cases, human playtesting is required. But even so, it is still hard to quantitatively evaluate difficulty of the game. Thus, if we perform quantitative evaluation of the difficulty automatically it will be very helpful in game developments. In this paper, we use a path finding algorithm to evaluate difficulty of exploration in a game level. Exploration is a basic attribute in common video games and it represents the overall difficulty of the game level. We also optimize the proposed evaluation algorithm by using previous exploration histories when available area in an game level is dynamically expanded and the new search is required.

Estimating the regression equations for predicting item difficulty of mathematics in the College Scholastic Ability Test (대학수학능력시험 수리 영역 문항 난이도 예측을 위한 회귀모형 추정)

  • Lee, Sang-Ha;Lee, Bong-Ju;Son, Hong-Chan
    • The Mathematical Education
    • /
    • v.46 no.4
    • /
    • pp.407-421
    • /
    • 2007
  • The purpose of this study is to identify the item characteristics that are supposed to affect item difficulty and to estimate the regression equations for predicting item difficulty of mathematics in the College Scholastic Ability Test(CSAT). We selected six variables related to item characteristics based on learning theories: contents, cognitive domain, novelty, item type, number of concepts, and the amount of computation. With data of the CSAT mathematics test administered in 2004-2006, item difficulty was regressed on the six variables, the location of an item, and the item writer's judgment on difficulty. The novelty of an item was found to be a statistically insignificant variable in explaining item difficulty. Four regression equations with different sets of independent variables could explain $70%{\sim}80%$ of the item difficulty variance and were validated as predicting item difficulty of the mock CSAT in 2006.

  • PDF

A Study on the Correlation between Shiphandler's Subjective Evaluation and Maneuvering Difficulty in Curved Narrow Channel (굴곡된 협수로 통항에서 조반자의 주관적 위험감지도와 조종인난도와의 상관관계에 관한 기초 연구)

  • 이동섭;윤점동;정태권
    • Journal of the Korean Institute of Navigation
    • /
    • v.20 no.1
    • /
    • pp.1-10
    • /
    • 1996
  • The assesment of the safety of ship's transit in a curved narrow channel consists of the maneuvering safety determined by the chance of running aground, the maneuvering difficulty determined by ship's workload, and shiphandler's subjective evaluation. In this study, to examine the correlation between shiphandler's subjective evaluation and the maneuvering safety, the real-time and full-mission shiphandling simulator in the Korea Marine Training & Research Institute(KMTRI) was utilized. On the conning bridge of the shiphandling simulator, 50 experienced masters have conducted the modeled vessel of 60, 000 deadweight tonnage along the designed channel under 3 different environmental conditions. It was possible to assess and analyze theoretically the correlation between the shiphandler's subjective evaluation and maneuvering difficulty under each environmental condition by quantifying the data obtained from the tests. The results are as follows: $\circled1$ As the degree of maneuvering difficulty increases, the shiphandler's subjective evaluation increases in the designed channel under the designed environmental condition. $\circled2$ In the straight area, not the bend of the designed channel, maneuvering difficulty increases sharply under the environmental condition of current and wind coming from the stern.

  • PDF

Application and Consideration on Open-ended Problems in Mathematics Tests of Shanghai Senior Middle School Entrance Examination

  • Ding Wang
    • Research in Mathematical Education
    • /
    • v.10 no.3 s.27
    • /
    • pp.215-227
    • /
    • 2006
  • After reviewing China's appearance and research on the Math open-ended problems, together with the application of those problems in mathematics test of Shanghai Senior Middle School Entrance Exams (SSMSEE) since 1999, this paper points out the difficulty in establishing an evaluation system for such problem. Through comparative study, the paper gives an operational definition of open-ended problem, and it attempts to establish an evaluation system and non-systematic competence targets that are appropriate to Math open-ended problems. Meanwhile, it describes the performance feature of those targets. By applying the standard international grading system of difficulty, it discusses the elements of difficulty in Math open-ended problems, and puts forward an evaluation as well as a level-of-difficulty forecasting system that is appropriate to the Middle School Entrance Exam.

  • PDF

컴퓨터 터미날 감시작업의 난이도 평가에 대한 연구

  • 김유창
    • Journal of the Korean Society of Safety
    • /
    • v.7 no.3
    • /
    • pp.60-65
    • /
    • 1992
  • As many industrial workers have been involved with computer terminal tasks, for example, monitor ing, inspection, or computer da4a entry etc., concerns for difficulty evaluation of computer terminal tasks are Increased. This study provides that eyeblink can be used as a means of difficulty evaluation of a computer terminal lask. Four subjects without color blindness are asked to perform the monitoring task of the binary choice type under five levels of task difficulty. In each task, eyeblink rates and eyeblink interval times were measured from the subjects. The results show that the eyeblink rate does decrease with an Increase in task difficulty. In addition, it was found that both eyeblink interval time and eyeblink Interval time variation increased with an increase in task difficulty. It was concluded that the change of eyeblink rate, eyeblink interval time and eyeblink interval time and eyeblink interval time variation could be regarded as a generalized response to the imposition of task difficulty.

  • PDF

Student Responses to Smart Device-Based Test on Competency Evaluation in Dental Education

  • Kim, Jooah;Kim, Soo-Yoon
    • Journal of Korean Dental Science
    • /
    • v.12 no.2
    • /
    • pp.58-65
    • /
    • 2019
  • Purpose: This study was aimed to investigate the possibility of utilizing smart device-based test (SBT) for competency evaluation in dental education and to analyze the student responses on overall competency evaluation using SBT method, in comparison to ubiquitous-based test (UBT). Materials and Methods: Questionnaire surveys have been conducted at Yonsei University College of Dentistry from 2015 to 2018 to obtain students' feedback on the application of SBT to competency evaluation. In addition, in order to supplement the competency evaluation procedure, considerations were explored by comparing the expected and actual difficulty of each item when preparing items for competency evaluation with SBT. Result: According to the survey results, student responses between the initial two years (2015 and 2016) differed from those in next two years (2017 and 2018). Students in 2017 and 2018 had more positive responses on competency evaluation with SBT. To determine the test validity, criterion-referenced evaluation was adopted to compare the data in 2017 and 2018 and slight differences in test difficulty in 2018 between the expected and actual difficulty of items were found. Conclusion: The results indicated that SBT was more appropriate for competency evaluation than UBT, based on four-year period of competency evaluation. The SBT was not affected by either the file size or the number of test-takers. Interestingly, students were not sensitive to test version of competency evaluation (paper-based test and SBT). This study suggests that the quality of the test items should be measured by continuous monitoring of the expected and actual difficulty of items for determining test validity. More detailed results and discussions of the findings are given for the development of test procedure and further potential research directions in dental education.

The Study of Elementary Preservice Teacher's Classes on Seasonal Variation (초등예비교사들의 계절변화 수업에 대한 연구)

  • Kim, Soon-Shik
    • Journal of the Korean Society of Earth Science Education
    • /
    • v.5 no.3
    • /
    • pp.245-255
    • /
    • 2012
  • The purposes of this research are to analyze preservice elementary teachers' degree of difficulty in classes of seasonal variation and suggest the measures of classes so that preservice elementary teachers can progress classes of seasonal variation effectively. To achieve them, the research was conducted for 90 first graders completing teaching method of elementary science in P university of education from Sep. to Dec. 2012. This research was conducted, based on the results of in-depth interview for 9 preservice elementary teachers who performed classes of seasonal variation, survey on the degree of class difficulty and evaluation of classes on 8 classes theme of Earth sector in elementary science. The results of this research are as follows. The first, preservice elementary teachers had relatively high class difficulty for teaching seasonal variation among the sector of the earth in elementary science. The second, in the evaluation of preservice elementary teachers' classes, the more the subject showed high class difficulty, the more the score of class evaluation was low. The reason is analyzed that high class difficulty reduces teacher's confidence. The third, preservice elementary teachers had insufficient knowledges and concepts which are basically necessary for the classes of seasonal variation. Especially, it was more serious for preservice elementary teachers who didn't learn Earth-science during their high school time. The fourth, it is necessery that concrete and systematical teaching method should be developed so as to improving preservice elementary teachers' teaching method for the classes of seasonal variation.

A Method for Measuring the Difficulty of Music Scores

  • Song, Yang-Eui;Lee, Yong Kyu
    • Journal of the Korea Society of Computer and Information
    • /
    • v.21 no.4
    • /
    • pp.39-46
    • /
    • 2016
  • While the difficulty of the music can be classified by a variety of standard, conventional methods are classified by the subjective judgment based on the experience of many musicians or conductors. Music score is difficult to evaluate as there is no quantitative criterion to determine the degree of difficulty. In this paper, we propose a new classification method for determining the degree of difficulty of the music. In order to determine the degree of difficulty, we convert the score, which is expressed as a traditional music score, into electronic music sheet. Moreover, we calculate information about the elements needed to play sheet music by distance of notes, tempo, and quantifying the ease of interpretation. Calculating a degree of difficulty of the entire music via the numerical data, we suggest the difficulty evaluation of the score, and show the difficulty of music through experiments.

A study on the difficulty adjustment of programming language multiple-choice problems using machine learning (머신러닝을 활용한 프로그래밍언어 객관식 문제의 난이도 조정에 대한 연구)

  • Kim, EunJung
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.27 no.2
    • /
    • pp.11-24
    • /
    • 2022
  • For the questions asked for LMS-based online evaluation the professor directly set exam questions, or use the automatic question-taking method according to the level of difficulty using the question bank divided by category. Among them, it is important to manage the difficulty of questions in an objective and efficient way, above all, in the automatic question-taking method according to difficulty. Because the questions presented to the evaluators may be different. In this paper, we propose an difficulty re-adjustment algorithm that considers not only the correct rate of a problem but also the time taken to solve the problem. For this, a logistic regression classification algorithm was used of machine learning, and a reference threshold was set based on the predicted probability value of the learning model and used to readjust the difficulty of each item. As a result, it was confirmed that there were many changes in the difficulty of each item that depended only on the existing correct rate. Also, as a result of performing group evaluation using the adjustment difficulty problem, it was confirmed that the average score improved in most groups compared to the difficulty problem based on the percentage of correct answers.

A Learner Tailoring Question Recommendation System for Web based Learning Evaluation System (웹 기반 학습평가를 위한 학습자 중심 문제추천 시스템)

  • Jeong, Hwa-Young;Kim, Eun-Won;Hong, Bong-Hwa
    • 전자공학회논문지 IE
    • /
    • v.45 no.4
    • /
    • pp.68-73
    • /
    • 2008
  • In this research, we proposed a learner tailoring question recommendation system for web based learning evaluation system. For teaming evaluation process, this system used the item difficulty Each question was stored and managed to the question bank. Item difficulty was recalculated during teaming process and feedback in next course. For learner tailoring question recommendation, learner could choice the teaming part and set the learning difficulty. In application result of proposal method, almost learner could improve learning score by controling teaming difficulty.