• Title/Summary/Keyword: 난이도 분석

Search Result 611, Processing Time 0.024 seconds

Neural Question Difficulty Estimator with Bi-directional Attention in VideoQA (비디오 질의 응답 환경에서 양방향 어텐션을 이용한 질의 난이도 분석 모델)

  • Yoon, Su-Hwan;Park, Seong-Bae
    • Annual Conference on Human and Language Technology
    • /
    • 2020.10a
    • /
    • pp.501-506
    • /
    • 2020
  • 질의 난이도 분석 문제는 자연어 질의문을 답변할 때 어려움의 정도를 측정하는 문제이다. 질의 난이도 분석 문제는 문서 독해, 의학 시험, 비디오 질의 등과 같은 다양한 데이터셋에서 연구되어 왔다. 본 논문에서는 질의문과 질의문에 응답하기 위한 정보들 간의 관계를 파악하는 것으로 질의 난이도 분석 문제를 접근하여 이를 BERT와 Dual Multi-head Attention을 사용하여 모델링 하였다. 본 논문에서 제안하는 모델의 우수성을 증명하기 위하여 최근 자연언어이해 부분에서 높은 성능을 보여주는 기 학습 언어 모델과 이전 연구의 질의 난이도 분석 모델과의 성능을 비교하였고, 제안 모델은 대표적인 비디오 질의 응답 데이터셋인 DramaQA의 Memory Complexity에서 99.76%, Logical Complexity에서는 89.47%의 정확도로 가장 높은 질의 난이도 분석 성능을 보여주었다.

  • PDF

Analyzing Beaver Challenge Questions as a Computing Computing Assessment Tool : Based on Item Response Theory (컴퓨팅 사고력 평가 도구로써 비버 챌린지 문항 분석: 문항반응이론을 기반으로)

  • Kim, Eun-Ji;Lee, Tae-Wuk
    • Proceedings of The KACE
    • /
    • 2018.01a
    • /
    • pp.107-110
    • /
    • 2018
  • 본 연구에서는 컴퓨팅 사고력 평가도구로써 비버 챌린지 문항을 활용하기 위하여 문항반응이론을 통해 비버 챌린지 문항을 분석하고, 비버 챌린지에서 기존에 제시하는 난이도와 문항반응이론을 통한 난이도 간의 상관관계를 분석하였다. 분석 결과 비버 챌린지는 쉽고 변별력이 높은 검사로 나타났으나, 비버 챌린지에서 제시하는 난이도와 문항반응이론을 통한 난이도 간의 상관관계는 없었다. 난이도에 따라 가점과 감점이 이루어지는 비버 챌린지 채점 기준을 고려할 때 정확한 컴퓨팅 사고력 측정을 위해서는 난이도에 대한 수정 및 보완이 필요하다.

  • PDF

Measuring Level of Difficulty of Fingerprint Database based on Sample Quality (영상 품질 기반의 지문 데이터베이스의 난이도 정량화)

  • Ryu, Ji-Eun;Jang, Ji-Hyeon;Kim, Hak-Il
    • Journal of the Korea Institute of Information Security & Cryptology
    • /
    • v.18 no.5
    • /
    • pp.59-69
    • /
    • 2008
  • The purpose of this paper is to measure the level of difficulty of fingerprint database based on sample quality. This paper proposes distribution of a sample quality analyzer and a difference of sample quality analyzer to measure the level of difficulty. Experimental results demonstrate that there are stronger correlation between matching performance and level of difficulty based on difference of sample quality than other measure. Especially, level of difficulty based on OQ Block of MPQ co-occurrence matrix shows highest correlation with matching performance, and moreover it can predict the matching performance of unknown databases.

A Study on the Measurement and Analysis of Mental Workload for the Tracking Task (트랙킹 작업에 있어서 정신 부하 측정 및 분석방법에 관한 연구)

  • 하은호;김동윤;고한우;김동선;송지웅
    • Proceedings of the Korean Society for Emotion and Sensibility Conference
    • /
    • 2000.11a
    • /
    • pp.48-52
    • /
    • 2000
  • 본 연구에서는 긴장 스트레스를 평가하기 위하여 작업 중에 긴장 조건을 부가하고 행동량, 주관량, 생리량을 계측하여 통계적으로 긴장 상태 유무와 작업 난이도에 따른 변화를 분석하였다. 긴장 스트레스를 유발시키기 위하여 20대 남자 대학생 3D명에게 세 가지 레벨의 트랙킹 작업을 수행하게 하면서 긴장상태를 유발하여 행동량, 주관신고와 생리신호를 측정하였다. 행동량과 주관신고의 결과를 사용하여 본 연구에서 상정된 작업난이도와 긴장조건이 적절한 가를 살펴보고 생리신호를 사용하여 작업난이도와 긴장감을 분석하였다. 난이도가 낮을 때 HRV의 회귀도와 GSR의 평균값은 긴장 조건이 있을 때가 없을 때에 비해서 통계적으로 유의하게 높게 나타났으며 난이도가 높을 때에는 피부온도의 값이 긴장 조건이 있을 때가 없을 때에 비해서 통계적으로 유의하게 높게 나타났다. 또한 긴장 조건이 있는 경우 작업의 난이도가 높을 때에 낮을 때에 비해서 호흡수의 값이 높게 나타났다. 따라서, 본 연구에서 상정한 긴장감은 양호하게 부가되었고 긴장감은 생리신호를 사용하여 측정할 수 있을 것으로 분석되었다.

  • PDF

A Study of Variables Related to Item Difficulty in College Scholastic Ability Test (대학수학능력시험 난이도 관련 변인 탐색)

  • 박문환
    • Journal of Educational Research in Mathematics
    • /
    • v.14 no.1
    • /
    • pp.71-88
    • /
    • 2004
  • The purpose of this study was to examine particular variables that play a significant role in the difficulty of math test items in College Scholastic Ability Test (CSAT). The study also aimed to develop a model of measuring the item difficulty. Variables correlated to item difficulty were drawn from the review of the related literature and the analysis of the content and difficulty of the past test items of CSAT. The first instrument was designed by using the correlated variables. According to the results of correlation analysis, the second instrument was made by deleting the variables which showed relatively low correlation with item difficulty and by refining some variables. Several models were proposed by using the revised instrument. The comparison of the R square and cross validity of each model reveals that integrated regression model was the most stable and accurate among the proposed models. The study also showed that statistically significant predictors were choice format, content domain, behavior domain, and the degree of item familiarity in the order of proportion of variance accounted by the predictors. Despite the limited scope of the present research, it can be suggested that its findings provide useful insights into predicting math test item difficulty.

  • PDF

시뮬레이션 시나리오 난이도별 초급항해사의 운항기술 능력 분석

  • Lee, Myeong-Gi;Park, Yeong-Su;Park, Sang-Won
    • Proceedings of the Korean Institute of Navigation and Port Research Conference
    • /
    • 2018.11a
    • /
    • pp.189-190
    • /
    • 2018
  • 국내 해기 교육기관에서는 초급항해사들이 운항 경험과 기술을 습득할 수 있도록 선박조종시뮬레이션 교육을 필수로 이수하도록 한다. 그러나 이러한 시뮬레이션 교육은 교육 기간 및 내용에 대해서만 국내외 지침에 명시되어 각 교육기관에서는 자체 커리큘럼에 의하여 시뮬레이션 시나리오를 구성하고 있다. 하지만 실제 어떠한 환경의 해역에서 시뮬레이션 실습을 수행하였는지는 초급항해사가 경험과 기술을 습득하는데 중요한 역할을 한다. 따라서 본 연구에서는 PARK Model을 이용하여 시뮬레이션 시나리오의 난이도를 추정하고, 난이도에 따라 초급항해사의 운항기술을 타선박과의 이격거리, DCPA, PARK Model 위험도 값, 항로탈거리의 요소로 그 변화를 분석하였다. 이는 추후에 난이도 별로 시나리오를 구성하여 균일한 교육 커리큘럼을 수립하는데 기초 자료로 사용될 수 있을 것이다.

  • PDF

Factors of Predicting Difficulty of Mathematics Test Items in College Scholastic Ability Test (고등학교 수리영역 시험의 난이도 예측 요인 분석)

  • Ko, Ho-Kyoung;Yi, Hyun-Sook
    • Journal of the Korean School Mathematics Society
    • /
    • v.10 no.1
    • /
    • pp.113-127
    • /
    • 2007
  • This study explored the possibility of building a statistical model predicting difficulty of mathematics test items through the analysis of nation-wide scholastic ability test results for the past 5 years. Multiple linear regression analysis was conducted in predicting difficulty of mathematics test items. We adopted three major areas for independent variables: the content area, the behavior area, and the test item format area, each of which was categorized into more detailed sub-areas. For the dependent variable, the proportion of correct answer was used to represent the item difficulty. Statistically significant independent variables were included in the regression model based on the stepwise selection method. Several important factors affecting difficulty of mathematics test items for each area were identified. R-squares for the final regression model were fairly high, implying that the regression equation can be used to predict difficulty of test items at an acceptable level. Lastly, the regression model was cross-validated using independently collected data. We believe that this study will provide basic but very critical information for predicting the proportion of correct answer by showing the factors that should be considered for developing mathematics test items for the college entrance examination or high school classroom test.

  • PDF

Comparative Analysis of Driving Difficulty of Automated Vehicles in Therms of Road Infrastructure Using AHP Method (AHP 기법을 활용한 도로 인프라 측면에서의 자율주행차량 주행 난이도 비교분석)

  • Wee, Jeongran;Lee, Jongdeok
    • The Journal of The Korea Institute of Intelligent Transport Systems
    • /
    • v.20 no.6
    • /
    • pp.214-227
    • /
    • 2021
  • The purpose of this study is to find the driving difficulty of automated vehicles in terms of road infrastructure operation. It was judged out of this study that the level of automated driving would be enhanced if the road situation recognition ability was advanced through the presentation of infrastructure information during the difficult driving situations. The difficulty evaluation index was divided into three stages, and a survey of experts and an AHP were conducted. The result of the AHP showed that the driving difficulty of the interrupted flow was much higher than that of the uninterrupted flow. The AHP results also showed that and the driving difficulty of unsignalized intersections and roundabouts under an interrupted flow was evaluated as the highest. The top six driving situations with high difficulty were also evaluated to occur under unsignalized intersections and roundabouts.

An analysis of characteristics of open-ended tasks presented in sequences of high school mathematics textbooks: Focusing on cognitive demands (고등학교 수학교과서의 수열 단원에 포함된 개방형 과제의 특징 분석: 인지적 난이도 관점을 중심으로)

  • Oh, Young-Seok;Kim, Dong-Joong
    • The Mathematical Education
    • /
    • v.62 no.2
    • /
    • pp.257-268
    • /
    • 2023
  • The purpose of the study is to analyze the characteristics of open-ended tasks in terms of cognitive demands. For this purpose, we analyzed characteristics of open-ended tasks presented in the sequence units of three high school mathematics textbooks. The results of the study have revealed that low cognitive demand levels of open-ended tasks had characteristics including procedures within previous tasks or within those tasks. On the other hand, high cognitive demand levels of open-ended tasks had characteristics of actively exploring new conditions to gain access to what is being sought, requesting a basis for judgement, linking various representations to the concepts of sequences, or requiring a variety of answers. These results are significant in that they not only specified the characteristics of open-ended tasks with high cognitive demands in terms of the intended curriculum, but also provided a direction for the development of open-ended taks with high congitive demands.

A Study on Cases of Difficulty Variables in High School Mathematics Items (고등학교 수학 문제의 난이도 요인 분석을 위한 사례 연구)

  • Lee, Kwang-Ho;Ko, Ho-Kyoung
    • Journal of the Korean School Mathematics Society
    • /
    • v.13 no.2
    • /
    • pp.323-343
    • /
    • 2010
  • The purpose of the study was to analyze difficulty analyzed through a quantitative method examining rate of correct answerers to each questions in the side of difficulty that students solving questions felt by finding variables to predict difficulty of questions in an objective way, not in an intuitive way, and examining what variables difficulty that each student solving questions felt depended on. The study divided 6 students in the 3rd grade of a high school into a two-person group or a three-person group and observed their question-solving process the total 11times for three months from March, to May. The study an alyzed what variables difficulty that each student felt depended on through semi-structuralized interview. As a result, the study could see that difficulty of questions depended on contents, strangeness of material, behavioral range, type of questions and complexity of questions.

  • PDF