• Title/Summary/Keyword: An evaluation item

Search Result 473, Processing Time 0.031 seconds

Estimating the regression equations for predicting item difficulty of mathematics in the College Scholastic Ability Test (대학수학능력시험 수리 영역 문항 난이도 예측을 위한 회귀모형 추정)

  • Lee, Sang-Ha;Lee, Bong-Ju;Son, Hong-Chan
    • The Mathematical Education
    • /
    • v.46 no.4
    • /
    • pp.407-421
    • /
    • 2007
  • The purpose of this study is to identify the item characteristics that are supposed to affect item difficulty and to estimate the regression equations for predicting item difficulty of mathematics in the College Scholastic Ability Test(CSAT). We selected six variables related to item characteristics based on learning theories: contents, cognitive domain, novelty, item type, number of concepts, and the amount of computation. With data of the CSAT mathematics test administered in 2004-2006, item difficulty was regressed on the six variables, the location of an item, and the item writer's judgment on difficulty. The novelty of an item was found to be a statistically insignificant variable in explaining item difficulty. Four regression equations with different sets of independent variables could explain $70%{\sim}80%$ of the item difficulty variance and were validated as predicting item difficulty of the mock CSAT in 2006.

  • PDF

An Analysis of Assessment Item on the Fraction Computation Ability for Fifth Grade Student (초등학교 5학년 학생들의 분수 연산능력 평가 문항에 대한 분석)

  • Lee Kang Sup;Kim Kyou Sang
    • Education of Primary School Mathematics
    • /
    • v.8 no.2 s.16
    • /
    • pp.61-68
    • /
    • 2004
  • The purpose of this study is to develope and analyze the assessment items which can be used in evaluation of the fraction computation ability for fifth grade students. The item development team consists of three elementary school teachers and three mathematics education expert. The developed items was analyzed item analysis after applying to 135 fifth grade students. As a results of item analysis, it shows meaningful over the level of a standard basis: reliability: 0.80; validity: item 1(1.05), item 2(1.10), item 3(.85), item 4(.90), item 5(1.08); item difficulty: item 1(-.22), item 2(-.41), item 3(.23), item 4(.40), item 5(-.01); item discrimination: item 1(.73), item 2(.73), item 3(.67), item 4(.51), item 5(.56). This means that the test tool could be useful in the evaluation of the fraction computation ability.

  • PDF

Dialog-based multi-item recommendation using automatic evaluation

  • Euisok Chung;Hyun Woo Kim;Byunghyun Yoo;Ran Han;Jeongmin Yang;Hwa Jeon Song
    • ETRI Journal
    • /
    • v.46 no.2
    • /
    • pp.277-289
    • /
    • 2024
  • In this paper, we describe a neural network-based application that recommends multiple items using dialog context input and simultaneously outputs a response sentence. Further, we describe a multi-item recommendation by specifying it as a set of clothing recommendations. For this, a multimodal fusion approach that can process both cloth-related text and images is required. We also examine achieving the requirements of downstream models using a pretrained language model. Moreover, we propose a gate-based multimodal fusion and multiprompt learning based on a pretrained language model. Specifically, we propose an automatic evaluation technique to solve the one-to-many mapping problem of multi-item recommendations. A fashion-domain multimodal dataset based on Koreans is constructed and tested. Various experimental environment settings are verified using an automatic evaluation method. The results show that our proposed method can be used to obtain confidence scores for multi-item recommendation results, which is different from traditional accuracy evaluation.

The utility of digital evaluation based on automatic item generation in mathematics: Focusing on the CAFA system (수학교과에서 자동문항생성 기반의 디지털 평가 활용 방안: CAFA 시스템을 중심으로)

  • Kim, Sungyeun
    • The Mathematical Education
    • /
    • v.61 no.4
    • /
    • pp.581-595
    • /
    • 2022
  • The purpose of this study is to specify the procedure for making item models based on ontology models using automatic item generation in the mathematics subject through the CAFA system, and to explore the generated item instances. As an illustration for this, an item model was designed as a part of formative assessment based on the content characteristics, including concepts and calculations, and process characteristics, including application, using the representative values and the measures of dispersion in Mathematics of the 9th grade based on the evaluation criteria achievement standards. The item types generated in one item model were a best answer type, a correct answer type, a combined-response type, an incomplete statement type, a negative type, a true-false type, and a matching type. It was found that HTML, Google Charts, TTS, figures, videos and so on can be used as media. The implications of the use of digital evaluation based on automatic item generation were suggested in the aspects of students, pre-service teachers, general teachers, and special education, and the limitations of this study and future research directions were presented.

Application of Repertory Grid Developmental Method to Extraction of Structural Model in Housing Environment (레퍼토리 그리드 ( Repertory Grid) 발전수법을 이용한 주거환경의 평가구조모델 추출)

  • 이진숙
    • Journal of the Korean housing association
    • /
    • v.2 no.1
    • /
    • pp.69-76
    • /
    • 1991
  • It is the purpose of this study to abtain a basic information about how the users evaluate housing environment. The structural model of housing environment which is employed Repertory Grid Developmental Method is extracted. This model Is composed of 4 classifications : 1) psychological evaluation, 2) visual evaluation, 3) variation, 4) spaciousness.The extracted model can be expected to be used as follows : 1) It is to provide the knowlege of user's evaluation of housing enironment with designers so that they can explore the optimum solution in environ-mental design. 2) It will be an useful data for selecting an evaluation item in psychological evaluation study using SD(Semantic Differential)method. 3) On the physical experiments, it will be an useful data to select an evaluation item.

  • PDF

A Study on Competency Evaluation Item of Design Phase VE Team (설계VE팀의 역량 평가항목에 관한 연구)

  • Seo, Ha-Na;Lee, Hak-Ki
    • Proceedings of the Korean Institute Of Construction Engineering and Management
    • /
    • 2007.11a
    • /
    • pp.797-800
    • /
    • 2007
  • Value Engineering(VE) is being applied as an useful tool to eliminate the waste of cost and noneffective factors previously in construction projects. Ministry of construction and transportation' has been accordingly enforcing extensionally design phase VE to the construction costing more than 10 billion won, an importance of design phase VE. Although there are legal supports and technical effects, an effect about an introduction of design phase VE can not be applied properly because of several problems at the process. So, in this study, try to find out competency factors of design phase VE to enforce a competency of VE team as a basic database for developing a check list, and estimate weight. For the result, find out a competency evaluation item and organize as a team knowledge, a team work skill and a team attitude. Perform a first survey to verify a reliability and propriety regarding the found competency evaluation, perform the second survey competency as to evaluation item of the found 1, 2, 3 class and then estimate the weight by AHP.

  • PDF

Design and Implementation of Item pool-Based Program using Visual Basic (비주얼베이직을 이용한 문항중심 프로그램의 설계 및 현황)

  • 문병원;박순철
    • Proceedings of the IEEK Conference
    • /
    • 2003.07d
    • /
    • pp.1371-1374
    • /
    • 2003
  • This paper designs and implements of Item pool-Based Program using Visual Basic, a sort of self- study system. This paper is implemented the system which makes and remakes the test items using item-pool data with different method from an ordinary fixed form of evaluation. This system helps teachers to make a various test type of items by searching data through the item-pool and accounting it to the test items. This system will also improve the learner's understanding of the problems and desire for self-solving a problem.

  • PDF

A STUDY ON THE IMPROVEMENT OF POST-EVALUATION ITEM FOR PERFORMANCE MEASUREMENT IN THE BUILDING CONSTRUCTION

  • Lee, Eun-Ji;Ha, Hee-Yoon;Ko, Hyun;Kim, Jae-won;Kim, Jae-Jun
    • International conference on construction engineering and project management
    • /
    • 2007.03a
    • /
    • pp.407-416
    • /
    • 2007
  • The construction industry in South Korea is experiencing great changes: it is becoming developed on a larger scale, specialized to a high degree and rapidly incorporating with other industries. This development has resulted in higher demand of construction industry. Accordingly, the transparency and an objective method of evaluation in the process of projects in the construction industry are gaining more importance. Clients' and customers' needs also require more specific objective evaluation to find whether their projects are successfully performed or not. This study aims to discuss problems on the current post-evaluation items including the qualitative item analysis such as customer satisfaction. Moreover, this paper suggests the improved ways in which enable the application of the effective evaluation system to the construction industry.

  • PDF

Improved Cold Item Recommendation Accuracy by Applying an Recommendation Diversification Method (추천 다양화 방법을 적용한 콜드 아이템 추천 정확도 향상)

  • Han, Jungkyu;Chun, Sejin
    • Journal of Korea Multimedia Society
    • /
    • v.25 no.8
    • /
    • pp.1242-1250
    • /
    • 2022
  • When recommending cold items that do not have user-item interactions to users, even we adopt state-of-the-arts algorithms, the predicted information of cold items tends to have lower accuracy compared to warm items which have enough user-item interactions. The lack of information makes for recommender systems to recommend monotonic items which have a few top popular contents matched to user preferences. As a result, under-diversified items have a negative impact on not only recommendation diversity but also on recommendation accuracy when recommending cold items. To address the problem, we adopt a diversification algorithm which tries to make distributions of accumulated contents embedding of the two items groups, recommended items and the items in the target user's already interacted items, similar. Evaluation on a real world data set CiteULike shows that the proposed method improves not only the diversity but also the accuracy of cold item recommendation.

Evaluation of Firm Smart Business Capability: an Entire Capability Perspective (총체적 관점에서 기업 스마트 비즈니스 능력 평가 연구)

  • Yoon, Chui Young
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2016.10a
    • /
    • pp.573-576
    • /
    • 2016
  • Many firms are efficiently applying smart business technology and smart business model to their management activities in order to raise their business results in a smart business environment. Firm's smart business capability is very crucial for the efficient execution of its management activities and to improve the performance of business tasks in a global business environment. An evaluation framework is necessary for effectively evaluating a firm's smart business capability to manage and improve its smart business capability in a total smart business perspective. We generated the first 21-item based on previous literature. This research found an 11-item framework that can efficiently evaluate an enterprise smart business capability by verifying based on previous studies. This framework can be used for effectively evaluating a firm's smart business capability in a comprehensive perspective.