• Title/Summary/Keyword: An evaluation item

검색결과 473건 처리시간 0.043초

대학수학능력시험 수리 영역 문항 난이도 예측을 위한 회귀모형 추정 (Estimating the regression equations for predicting item difficulty of mathematics in the College Scholastic Ability Test)

  • 이상하;이봉주;손홍찬
    • 한국수학교육학회지시리즈A:수학교육
    • /
    • 제46권4호
    • /
    • pp.407-421
    • /
    • 2007
  • The purpose of this study is to identify the item characteristics that are supposed to affect item difficulty and to estimate the regression equations for predicting item difficulty of mathematics in the College Scholastic Ability Test(CSAT). We selected six variables related to item characteristics based on learning theories: contents, cognitive domain, novelty, item type, number of concepts, and the amount of computation. With data of the CSAT mathematics test administered in 2004-2006, item difficulty was regressed on the six variables, the location of an item, and the item writer's judgment on difficulty. The novelty of an item was found to be a statistically insignificant variable in explaining item difficulty. Four regression equations with different sets of independent variables could explain $70%{\sim}80%$ of the item difficulty variance and were validated as predicting item difficulty of the mock CSAT in 2006.

  • PDF

초등학교 5학년 학생들의 분수 연산능력 평가 문항에 대한 분석 (An Analysis of Assessment Item on the Fraction Computation Ability for Fifth Grade Student)

  • 이강섭;김규상
    • 한국수학교육학회지시리즈C:초등수학교육
    • /
    • 제8권2호
    • /
    • pp.61-68
    • /
    • 2004
  • The purpose of this study is to develope and analyze the assessment items which can be used in evaluation of the fraction computation ability for fifth grade students. The item development team consists of three elementary school teachers and three mathematics education expert. The developed items was analyzed item analysis after applying to 135 fifth grade students. As a results of item analysis, it shows meaningful over the level of a standard basis: reliability: 0.80; validity: item 1(1.05), item 2(1.10), item 3(.85), item 4(.90), item 5(1.08); item difficulty: item 1(-.22), item 2(-.41), item 3(.23), item 4(.40), item 5(-.01); item discrimination: item 1(.73), item 2(.73), item 3(.67), item 4(.51), item 5(.56). This means that the test tool could be useful in the evaluation of the fraction computation ability.

  • PDF

Dialog-based multi-item recommendation using automatic evaluation

  • Euisok Chung;Hyun Woo Kim;Byunghyun Yoo;Ran Han;Jeongmin Yang;Hwa Jeon Song
    • ETRI Journal
    • /
    • 제46권2호
    • /
    • pp.277-289
    • /
    • 2024
  • In this paper, we describe a neural network-based application that recommends multiple items using dialog context input and simultaneously outputs a response sentence. Further, we describe a multi-item recommendation by specifying it as a set of clothing recommendations. For this, a multimodal fusion approach that can process both cloth-related text and images is required. We also examine achieving the requirements of downstream models using a pretrained language model. Moreover, we propose a gate-based multimodal fusion and multiprompt learning based on a pretrained language model. Specifically, we propose an automatic evaluation technique to solve the one-to-many mapping problem of multi-item recommendations. A fashion-domain multimodal dataset based on Koreans is constructed and tested. Various experimental environment settings are verified using an automatic evaluation method. The results show that our proposed method can be used to obtain confidence scores for multi-item recommendation results, which is different from traditional accuracy evaluation.

수학교과에서 자동문항생성 기반의 디지털 평가 활용 방안: CAFA 시스템을 중심으로 (The utility of digital evaluation based on automatic item generation in mathematics: Focusing on the CAFA system)

  • 김성연
    • 한국수학교육학회지시리즈A:수학교육
    • /
    • 제61권4호
    • /
    • pp.581-595
    • /
    • 2022
  • 본 연구의 목적은 수학 교과에서 자동문항생성을 활용하여 지식의 핵심 구조인 온톨로지모형 기반의 문항모형을 CAFA 시스템을 통해 제작하는 절차를 명세하고, 생성된 문항 사례들을 탐색하는 데 있다. 이를 위한 사례로 수학 3의 대푯값과 산포도 단원의 평가준거 성취기준을 바탕으로 개념과 계산을 포함한 내용적 특성과 적용을 포함한 과정적 특성을 바탕으로 형성평가에 적합한 문항모형을 제작하였다. 하나의 문항모형에서 생성된 문항 유형은 최선답형, 정답형, 합답형, 미완성문장형, 부정형, 진위형, 배합형 등이었으며, 매체로는 Google Chart, HTML, TTS, 그림, 비디오 등을 활용할 수 있는 것으로 나타났다. 이를 바탕으로 자동문항생성 기반의 디지털 평가 활용방안에 대한 시사점을 학생, 예비교사, 일반교사 그리고 특수교육 측면에서 논의하고, 본 연구의 한계점과 향후 연구방향을 제시하였다.

레퍼토리 그리드 ( Repertory Grid) 발전수법을 이용한 주거환경의 평가구조모델 추출 (Application of Repertory Grid Developmental Method to Extraction of Structural Model in Housing Environment)

  • 이진숙
    • 한국주거학회논문집
    • /
    • 제2권1호
    • /
    • pp.69-76
    • /
    • 1991
  • It is the purpose of this study to abtain a basic information about how the users evaluate housing environment. The structural model of housing environment which is employed Repertory Grid Developmental Method is extracted. This model Is composed of 4 classifications : 1) psychological evaluation, 2) visual evaluation, 3) variation, 4) spaciousness.The extracted model can be expected to be used as follows : 1) It is to provide the knowlege of user's evaluation of housing enironment with designers so that they can explore the optimum solution in environ-mental design. 2) It will be an useful data for selecting an evaluation item in psychological evaluation study using SD(Semantic Differential)method. 3) On the physical experiments, it will be an useful data to select an evaluation item.

  • PDF

설계VE팀의 역량 평가항목에 관한 연구 (A Study on Competency Evaluation Item of Design Phase VE Team)

  • 서하나;이학기
    • 한국건설관리학회:학술대회논문집
    • /
    • 한국건설관리학회 2007년도 정기학술발표대회 논문집
    • /
    • pp.797-800
    • /
    • 2007
  • 건설 프로젝트에서의 VE는 예산낭비와 비효율적 요인을 서전제거하는 유용한 도구로 활용되고 있다. 이에 따라 2006년부터 건설교통부에서는 "설계의경제성등검토"를 총공사비 100억원 이상으로 확대 시행하고 있다. 그러나 이러한 제도적 뒷받침이나 기술적인 노력에도 불구하고 국내 설계VE는 수행과정에서 문제점이 지적되고 있어 효과가 극대화되지 못하고 있다. 효과적인 설계VE팀 구성으로 설계VE의 성과를 극대화하기 위해서는 설계VE팀의 역량평가에 대한 체크리스트의 개발이 필요하다. 따라서 본 연구는 설계VE팀의 역량평가 체크리스트 개발을 위한 기초자료로써 역량 평가항목을 도출하고 가중치를 산정하고자 하였다. 이를 위하여 설계VE팀의 특성에 따른 역량인자를 도출하여 팀 지식, 팀워크스킬, 팀 태도로 구별하여 구성하였다. 도출된 역량인자의 중요도에 대해 1차 설문조사를 실시하여 신뢰도와 타당도를 검증하고, 그 결과로 도출된 제 1, 2, 3계층의 역량 평가항목에 대하여 계층 분석적 의사결정기법을 활용한 2차 설문조사를 실시하여 가중치를 산정하였다.

  • PDF

비주얼베이직을 이용한 문항중심 프로그램의 설계 및 현황 (Design and Implementation of Item pool-Based Program using Visual Basic)

  • 문병원;박순철
    • 대한전자공학회:학술대회논문집
    • /
    • 대한전자공학회 2003년도 하계종합학술대회 논문집 Ⅲ
    • /
    • pp.1371-1374
    • /
    • 2003
  • This paper designs and implements of Item pool-Based Program using Visual Basic, a sort of self- study system. This paper is implemented the system which makes and remakes the test items using item-pool data with different method from an ordinary fixed form of evaluation. This system helps teachers to make a various test type of items by searching data through the item-pool and accounting it to the test items. This system will also improve the learner's understanding of the problems and desire for self-solving a problem.

  • PDF

A STUDY ON THE IMPROVEMENT OF POST-EVALUATION ITEM FOR PERFORMANCE MEASUREMENT IN THE BUILDING CONSTRUCTION

  • Lee, Eun-Ji;Ha, Hee-Yoon;Ko, Hyun;Kim, Jae-won;Kim, Jae-Jun
    • 국제학술발표논문집
    • /
    • The 2th International Conference on Construction Engineering and Project Management
    • /
    • pp.407-416
    • /
    • 2007
  • The construction industry in South Korea is experiencing great changes: it is becoming developed on a larger scale, specialized to a high degree and rapidly incorporating with other industries. This development has resulted in higher demand of construction industry. Accordingly, the transparency and an objective method of evaluation in the process of projects in the construction industry are gaining more importance. Clients' and customers' needs also require more specific objective evaluation to find whether their projects are successfully performed or not. This study aims to discuss problems on the current post-evaluation items including the qualitative item analysis such as customer satisfaction. Moreover, this paper suggests the improved ways in which enable the application of the effective evaluation system to the construction industry.

  • PDF

추천 다양화 방법을 적용한 콜드 아이템 추천 정확도 향상 (Improved Cold Item Recommendation Accuracy by Applying an Recommendation Diversification Method)

  • 한정규;천세진
    • 한국멀티미디어학회논문지
    • /
    • 제25권8호
    • /
    • pp.1242-1250
    • /
    • 2022
  • When recommending cold items that do not have user-item interactions to users, even we adopt state-of-the-arts algorithms, the predicted information of cold items tends to have lower accuracy compared to warm items which have enough user-item interactions. The lack of information makes for recommender systems to recommend monotonic items which have a few top popular contents matched to user preferences. As a result, under-diversified items have a negative impact on not only recommendation diversity but also on recommendation accuracy when recommending cold items. To address the problem, we adopt a diversification algorithm which tries to make distributions of accumulated contents embedding of the two items groups, recommended items and the items in the target user's already interacted items, similar. Evaluation on a real world data set CiteULike shows that the proposed method improves not only the diversity but also the accuracy of cold item recommendation.

총체적 관점에서 기업 스마트 비즈니스 능력 평가 연구 (Evaluation of Firm Smart Business Capability: an Entire Capability Perspective)

  • 윤취영
    • 한국정보처리학회:학술대회논문집
    • /
    • 한국정보처리학회 2016년도 추계학술발표대회
    • /
    • pp.573-576
    • /
    • 2016
  • Many firms are efficiently applying smart business technology and smart business model to their management activities in order to raise their business results in a smart business environment. Firm's smart business capability is very crucial for the efficient execution of its management activities and to improve the performance of business tasks in a global business environment. An evaluation framework is necessary for effectively evaluating a firm's smart business capability to manage and improve its smart business capability in a total smart business perspective. We generated the first 21-item based on previous literature. This research found an 11-item framework that can efficiently evaluate an enterprise smart business capability by verifying based on previous studies. This framework can be used for effectively evaluating a firm's smart business capability in a comprehensive perspective.