• Title/Summary/Keyword: question difficulty

Search Result 128, Processing Time 0.02 seconds

A Learner Tailoring Question Recommendation System for Web based Learning Evaluation System (웹 기반 학습평가를 위한 학습자 중심 문제추천 시스템)

  • Jeong, Hwa-Young;Kim, Eun-Won;Hong, Bong-Hwa
    • 전자공학회논문지 IE
    • /
    • v.45 no.4
    • /
    • pp.68-73
    • /
    • 2008
  • In this research, we proposed a learner tailoring question recommendation system for web based learning evaluation system. For teaming evaluation process, this system used the item difficulty Each question was stored and managed to the question bank. Item difficulty was recalculated during teaming process and feedback in next course. For learner tailoring question recommendation, learner could choice the teaming part and set the learning difficulty. In application result of proposal method, almost learner could improve learning score by controling teaming difficulty.

A CSP based Learner Tailoring Question Recommendation Process using Item Response Theory (문항반응이론을 이용한 CSP 기반의 학습자 중심 문제추천 프로세스)

  • Jeong, Hwa-Young
    • Journal of Internet Computing and Services
    • /
    • v.10 no.5
    • /
    • pp.145-152
    • /
    • 2009
  • Applications such as study guides and adaptive tutoring must rely on a fine grained student model to tailor their interaction with the user. They are useful for Computer Adaptive Testing (CAT), for example, where the test items can be administered in order to maximize the information. I study how to design learner tailoring question process for recommendation. And this process can be applied the CAT and I use the formal language such as CSP in each process development for efficient process design. I use the item difficulty of item response theory for question recommendation process and learner can choice the difficulty step for learning change to control the difficulty of question in next learning. Finally, this method displayed the structural difference to compare between existent and this process.

  • PDF

A study on the difficulty adjustment of programming language multiple-choice problems using machine learning (머신러닝을 활용한 프로그래밍언어 객관식 문제의 난이도 조정에 대한 연구)

  • Kim, EunJung
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.27 no.2
    • /
    • pp.11-24
    • /
    • 2022
  • For the questions asked for LMS-based online evaluation the professor directly set exam questions, or use the automatic question-taking method according to the level of difficulty using the question bank divided by category. Among them, it is important to manage the difficulty of questions in an objective and efficient way, above all, in the automatic question-taking method according to difficulty. Because the questions presented to the evaluators may be different. In this paper, we propose an difficulty re-adjustment algorithm that considers not only the correct rate of a problem but also the time taken to solve the problem. For this, a logistic regression classification algorithm was used of machine learning, and a reference threshold was set based on the predicted probability value of the learning model and used to readjust the difficulty of each item. As a result, it was confirmed that there were many changes in the difficulty of each item that depended only on the existing correct rate. Also, as a result of performing group evaluation using the adjustment difficulty problem, it was confirmed that the average score improved in most groups compared to the difficulty problem based on the percentage of correct answers.

A Study on Selection Method and Mediateness Degree of Difficulty of Examination Questions in Web-based Education System (웹기반 학습 시스템의 평가 문제에 대한 출제 방법 및 난이도 재조정에 대한 연구)

  • Kim Eun-Jung
    • The KIPS Transactions:PartD
    • /
    • v.12D no.3 s.99
    • /
    • pp.471-480
    • /
    • 2005
  • Most questions made for remote examinations on web-based education system use methods of making questions using fixed questions or randomly using item pools or automatically using degree of difficulty. Particularly, automatically selection methods using degree of difficulty is the kernel of a question that objectivity of the first degree of difficulty for questions and an effective questions selection using degree of difficulty and mediateness degree of difficulty based result of examination. This paper is use automatically selection methods for examination on web-based education system. Firstly, we present new question selection algorithms as regards degree of difficulty and distribution between all units. Secondly, we present new algorithms of mediateness degree of difficulty as regards education ability of students for adjust the degree of difficulty. We identified this algorithms is more effective as compared with previously algorithms on web-based education system.

The effect of anchor extremity and question difficulty on anchoring effect (기준점의 극단성과 문항 난이도가 기준점 효과에 미치는 영향)

  • Lee, Myoungjin;Lee, Yoonhyoung;Kim, Kyungil
    • Korean Journal of Cognitive Science
    • /
    • v.33 no.1
    • /
    • pp.77-93
    • /
    • 2022
  • Previous studies have reported that a plausible reference point has a greater anchoring effect than an extreme reference point. It is also known that the anchoring effect decreases when the individual's level of knowledge related to a given item is high. However, there has been no study examining the interaction of the plausibility of the reference point and the difficulty of the given question. Therefore, in this study, the effect of the reference plausibility and the difficulty of the questions on the anchoring effect were examined. The relationship between the response confidence and the anchoring effect was also examined. To do so, easy and difficult questions, plausible and extreme reference points were selected through preliminary research. The experiment was conducted following the 'standard anchoring task procedure'. As results, the extremity of the reference point and the difficulty of the question affected the size of the anchoring effect respectively. The difficulty of the question also affected the confidence of the response. Specifically, when a plausible reference point was presented and when a difficult question was presented, the anchoring effects were increased. In addition, the lower the confidence in one's performances, the greater the influence of the reference point when an extreme reference point was presented. These results show that the plausibility of the given reference point and the difficulty of the item have different effects on the magnitude of the anchoring effect and the degree of confidence. The results of this study support the attitude change perspective regarding the anchoring effect, which suggests that the anchoring effect varies depending on the characteristics of the reference point and the individual's knowledge.

Degree of Difficulty Adjustment Algorithms of Selection Question using Education Ability in WBI (WBI 시스템에서 학습능력을 고려한 출제 문제의 난이도 재조정 알고리즘)

  • Kim Eun-Jung;Ryu Hee-Yeol
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.9 no.4
    • /
    • pp.47-55
    • /
    • 2004
  • Most questions made for remote examinations on web-based education system use methods of making questions using fixed questions or randomly using item pools or automatically using degree of difficulty. Particularly, automatically selection methods using degree of difficulty is the kernel of a question that objectivity of examination questions by degree of difficulty adjustment based result of examination. This paper is use automatically selection methods for examination on web-based education system. Therefore we present new algorithms of mediateness degree of difficulty as regards education ability of students for adjust the degree of difficulty. We identified this algorithms is more effective as compared with previously algorithms on web-based education system

  • PDF

A Study on Difficulty Equalization Algorithm for Multiple Choice Problem in Programming Language Learning System (프로그래밍 언어 학습 시스템에서 객관식 문제의 난이도 균등화 알고리즘에 대한 연구)

  • Kim, Eunjung
    • The Journal of Korean Association of Computer Education
    • /
    • v.22 no.3
    • /
    • pp.55-65
    • /
    • 2019
  • In programming language learning system of flip learning methods, the evaluation of cyber lectures generally proceeds from online to multiple choice questions. In this case, the questions are randomly extracted from the question bank and given to individual learners. In order for these evaluation results to be reflected in the grades, the equity of the examination question is more important than anything else. Especially in the programming language subject, the degree of difficulty that learners think can be different depending on the type of problem. In this paper, we classify the types of multiple-choice problems into two categories, and manage the difficulty level by each type. And we propose a question selection algorithm that considers both difficulty level and type of question. Considering the characteristics of the programming language, experimental results show that the proposed algorithm is more efficient and fair than the conventional method.

Dynamic Degree of Difficulty Adjustment Policy for E-learning Databank Based Selection System (이러닝 문제은행기반 출제 시스템을 위한 동적 난이도 조정 정책)

  • Kim, Eun-Jung;Lee, Sang-Kwan;Kim, Seong-Kon
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2008.08a
    • /
    • pp.160-164
    • /
    • 2008
  • Most questions made for remote examinations on E-learning databank based selection system use methods of making questions automatically using degree of difficulty. This methods is the kernel of a question selection that degree of difficulty as make test questions, and then needs continuous management for degree of difficulty. This paper present improved algorithms for dynamically adjustment of degree of difficulty based on examination result that is more efficient set of question. We identified this algorithms is more effective as compared with previously algorithms on web-based education system.

  • PDF

Affection-enhanced Personalized Question Recommendation in Online Learning

  • Mingzi Chen;Xin Wei;Xuguang Zhang;Lei Ye
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.17 no.12
    • /
    • pp.3266-3285
    • /
    • 2023
  • With the popularity of online learning, intelligent tutoring systems are starting to become mainstream for assisting online question practice. Surrounded by abundant learning resources, some students struggle to select the proper questions. Personalized question recommendation is crucial for supporting students in choosing the proper questions to improve their learning performance. However, traditional question recommendation methods (i.e., collaborative filtering (CF) and cognitive diagnosis model (CDM)) cannot meet students' needs well. The CDM-based question recommendation ignores students' requirements and similarities, resulting in inaccuracies in the recommendation. Even CF examines student similarities, it disregards their knowledge proficiency and struggles when generating questions of appropriate difficulty. To solve these issues, we first design an enhanced cognitive diagnosis process that integrates students' affection into traditional CDM by employing the non-compensatory bidimensional item response model (NCB-IRM) to enhance the representation of individual personality. Subsequently, we propose an affection-enhanced personalized question recommendation (AE-PQR) method for online learning. It introduces NCB-IRM to CF, considering both individual and common characteristics of students' responses to maintain rationality and accuracy for personalized question recommendation. Experimental results show that our proposed method improves the accuracy of diagnosed student cognition and the appropriateness of recommended questions.

Examination Questions Selection Algorithm in Web-based Engineer Test Education System (웹 기반 기사시험 학습 시스템에서의 문제 출제 알고리즘)

  • Kim Eun-Jung
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.9 no.3
    • /
    • pp.11-18
    • /
    • 2004
  • It is making researches in questions selection method for examination in web-based education system. Most questions made for these remote examinations use methods of making questions using fixed questions or randomly using item pools or automatically using degree of difficulty. This paper proposes a new examination questions selection algorithm in web-based education system for engineer test. Generally, Engineer test is characterized by adequate examination questions selection for degree of difficulty and equally between all units. Therefore this algorithm selected examination questions equally well as regards degree of difficulty and distribution between all units. This algorithm providers more effective education examination method as compared with previous algorithm.

  • PDF