• Title/Summary/Keyword: Automatic Item Generation

Search Result 13, Processing Time 0.029 seconds

Application of AIG Implemented within CLASS Software for Generating Cognitive Test Item Models

  • SA, Seungyeon;RYOO, Hyun Suk;RYOO, Ji Hoon
    • Educational Technology International
    • /
    • v.23 no.2
    • /
    • pp.157-181
    • /
    • 2022
  • Scale scores for cognitive domains have been used as an important indicator for both academic achievement and clinical diagnosis. For example, in education, Cognitive Abilities Test (CogAT) has been used to measure student's capability in academic learning. In a clinical setting, Cognitive Impairment Screening Test utilizes items measuring cognitive ability as a dementia screening test. We demonstrated a procedure of generating cognitive ability test items similar as in CogAT but the theory associated with the generation is totally different. When creating cognitive test items, we applied automatic item generation (AIG) that reduces errors in predictions of cognitive ability but attains higher reliability. We selected two cognitive ability test items, categorized as a time estimation item for measuring quantitative reasoning and a paper-folding item for measuring visualization. As CogAT has widely used as a cognitive measurement test, developing an AIG-based cognitive test items will greatly contribute to education field. Since CLASS is the only LMS including AIG technology, we used it for the AIG software to construct item models. The purpose of this study is to demonstrate the item generation process using AIG implemented within CLASS, along with proving quantitative and qualitative strengths of AIG. In result, we confirmed that more than 10,000 items could be made by a single item model in the quantitative aspect and the validity of items could be assured by the procedure based on ECD and AE in the qualitative aspect. This reliable item generation process based on item models would be the key of developing accurate cognitive measurement tests.

The utility of digital evaluation based on automatic item generation in mathematics: Focusing on the CAFA system (수학교과에서 자동문항생성 기반의 디지털 평가 활용 방안: CAFA 시스템을 중심으로)

  • Kim, Sungyeun
    • The Mathematical Education
    • /
    • v.61 no.4
    • /
    • pp.581-595
    • /
    • 2022
  • The purpose of this study is to specify the procedure for making item models based on ontology models using automatic item generation in the mathematics subject through the CAFA system, and to explore the generated item instances. As an illustration for this, an item model was designed as a part of formative assessment based on the content characteristics, including concepts and calculations, and process characteristics, including application, using the representative values and the measures of dispersion in Mathematics of the 9th grade based on the evaluation criteria achievement standards. The item types generated in one item model were a best answer type, a correct answer type, a combined-response type, an incomplete statement type, a negative type, a true-false type, and a matching type. It was found that HTML, Google Charts, TTS, figures, videos and so on can be used as media. The implications of the use of digital evaluation based on automatic item generation were suggested in the aspects of students, pre-service teachers, general teachers, and special education, and the limitations of this study and future research directions were presented.

A Method for Automatic Check of Omitted Design Item in Structural Calculation Document of Steel Box Bridges (강박스 교량을 대상으로 한 구조계산서의 누락된 설계항목 검토 자동화 방법론)

  • Park, Sang-Il;An, Hyun-Jung;Kim, Bong-Geun;Lee, Sang-Ho
    • Proceedings of the Computational Structural Engineering Institute Conference
    • /
    • 2007.04a
    • /
    • pp.813-818
    • /
    • 2007
  • A method for automatic check of omitted design item in structural calculation document of steel box bridges is proposed. A method for automatic check of omitted design item in structural calculation document of steel box bridges is proposed. Information processing for the proposed method is divided into two steps: automatic generation of document structure in XML Schema Definition (XSD) format and extract omitted design items by using the XML Schema matching technique. The automatic omitted element filter is developed on the basis of the proposed method, and the accuracy of the developed module is examined with case study subjected to existing structural calculation document samples.

  • PDF

A Study of Virtual 3D Fashion Coordination (가상 3D 패션 코디네이션 연구)

  • 강인애;김효숙;최창석
    • Journal of the Korean Home Economics Association
    • /
    • v.40 no.6
    • /
    • pp.159-171
    • /
    • 2002
  • Today, many people seek for their own personal character which is distinguished from another people and they utilize fashion coordination as the was of expression their own image. In addition, interest in electronic commerce and cuber shopping mall on the internet is increasing. For this reason, visual and interesting virtual fashion coordination system is needed. The purpose of this study is to propose possibility of fashion coordination by virtual 3D model. For this study, 1. We make a 3D standard body model by automatic generation. 2. We make 3D fashion item (sleeveless top and flare skirt) by automatic generation. 3. We combine 3D body model with fashion item by special point, grouping and gap being between body and clothes. 4. We make textile palettes and textile DB for texture mapping and rendering. As a effect of this study, 1. It can give the chance to coordinate clothes suitable for their own character and bodyshape on the cuber space more speedily and variously. 2. It can help fashion internet shopping mall company can save a time, expenses and tries to advertise their new products, offer service for customers and lead customers to purchasing. 3. It can accumulate a database of design and textile for using by fashion and textile industry.

Exploring the Reliability of an Assessment based on Automatic Item Generation Using the Multivariate Generalizability Theory (다변량일반화가능도 이론을 적용한 자동문항생성 기반 평가에서의 신뢰도 탐색)

  • Jinmin Chung;Sungyeun Kim
    • Journal of Science Education
    • /
    • v.47 no.2
    • /
    • pp.211-224
    • /
    • 2023
  • The purpose of this study is to suggest how to investigate the reliability of the assessment, which consists of items generated by automatic item generation using empirical example data. To achieve this, we analyzed the illustrative assessment data by applying the multivariate generalizability theory, which can reflect the design of responding to different items for each student and multiple error sources in the assessment score. The result of the G-study showed that, in most designs, the student effect corresponding to the true score of the classical test theory was relatively large after residual effects. In addition, in the design where the content domain was fixed, the ranking of students did not change depending on the item types or items. Similarly, in the design where the item format was fixed, the difficulty showed little variation depending on the content domains. The result of the D-study indicated that the original assessment data achieved a sufficient level of reliability. It was also found that higher reliability than the original assessment data could be obtained by reducing the number of items in the content domains of operation, geometry, and probability and statistics, or by assigning higher weights to the domains of letters and formulas, and function. The efficient measurement conditions presented in this study are limited to the illustrative assessment data. However, the method applied in this study can be utilized to determine the reliability and to find efficient measurement conditions for the various assessment situations using automatic item generation based on measurement traits.

Korean Word Learning System Using Automatic Question Generation Technique (자동 문제 생성 기술을 이용한 한국어 어휘학습시스템)

  • Choe, Su-Il;Im, Ji-Hui;Choe, Ho-Seop;Ock, Cheol-Young
    • Korean Journal of Cognitive Science
    • /
    • v.17 no.4
    • /
    • pp.271-286
    • /
    • 2006
  • In this paper, we introduce automatic question generation technique using the language resources like User-Word Intelligent Network(U-WIN) and Korean dictionary including quite a for of information. And we present Korean word learning system with this technique. The item pool method which almost learning-system are using makes some problems. As a solution of the problems, we classified into 8 question type and implemented the Korean word learning system which is making the Korean question automatically by using the morphological and semantic information according to the automatic question generation pattern of each type.

  • PDF

A Study on the Effectiveness of LMS for Improving College Student's Mathematics Performance using a Propensity Score Matching Method

  • Heejoo PARK;Sunyoung BU;Jihoon RYOO
    • Educational Technology International
    • /
    • v.25 no.1
    • /
    • pp.67-92
    • /
    • 2024
  • This study aims to verify the practical effectiveness of learning management system (LMS) by introducing a LMS enhancing digital assessment utilizing automatic item generation in order to strengthen college student's mathematics performance. Teaching assisted with digital assessment in the LMS was applied to college mathematics classes, and the research question is whether or not students in the classes utilizing the LMS perform better than the regular classes. In particular, a calculus course, which is the foundation of important artificial intelligence technology in the future, was utilized in this study. The participants of this study were 248 freshmen in science and engineering who were taking calculus courses at a small to mid-size university. A total of 156 freshmen were selected after applying a propensity score matching method (PSMM), 78 from classes utilizing the LMS and 78 from regular classes without the LMS assisted with the digital assessment. As a result, it was found that there was a statistically significant difference in the math academic growth of students who used the LMS and those who did not. In other words, when LMS was used in calculus, students' academic growth was greater. The results of this study are meaningful in that they observed students' academic growth and confirmed that LMS enables a positive role in students' academic growth. In addition, if digital assessment is strengthened and LMS that enables individualized learning analysis is introduced and implemented in educational institutions, it is expected to play a major role in strengthening students' academic performance.

Automatic Inference of Standard BOQ(Bill of Quantities) Items using BIM and Ontology (BIM과 온톨로지를 활용한 표준내역항목 추론 자동화)

  • Lee, Seul-Ki;Kim, Ka-Ram;Yu, Jung-Ho
    • Korean Journal of Construction Engineering and Management
    • /
    • v.13 no.3
    • /
    • pp.99-108
    • /
    • 2012
  • The rough design information is only available from BIM(Building Information Model) based schematic design. So, it is difficult to obtain sufficient information for generating BOQ. Like 2D design, there are some problems that the results are depend on what the choice of cost estimator. However, the most research of BIM based cost estimation are focus on quantity takeoff, the consideration of work item for generating BOQ is insufficient. Therefore, this paper present automatic inference process of work items in a BOQ using ontology. The proposed process and ontology is validated through applying tiling construction. If the proposed process is utilized, it is expected the basis of developing generation method for consistent BOQ by resolving intervention of cost estimator's arbitrary decision.

Automatic Ontology Generation for Item Recommendation to Customer (고객 상품 추천을 위한 온톨로지 자동 생성)

  • 구미숙;황정희;류근호
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2004.10b
    • /
    • pp.235-237
    • /
    • 2004
  • 최근 인터넷 기술의 발전으로 인해 정보량이 급증함으로써 이들 정보자원을 효과적으로 검색하기 위한 방법으로 메타데이터를 이용하여 필요한 정보 자원에 정확하게 접근하는 방법이 다양한 분야에서 제안되고 있다. 메타데이터는 정보자원을 효과적으로 검색하고 데이터를 재가공하여 다양한 각종 정보자원에 대한 정보 및 기록 관리를 할 수 있다. 이 논문에서는 정보를 효율적으로 검색하기 위하여 XML을 이용한 온톨로지 기반의 메타데이터를 이용한다. 홈쇼핑 사이트의 고객인 소비자를 대상으로 효율적인 정보 추천 및 검색을 위해, 상품 토픽맵 온톨로지를 구축하고 소비자에게 알맞은 쇼핑 정보를 전달하기 위한 정보검색 시스템을 설계 구축한다. 온톨로지의 자동적 구축은 데이터 마이닝 기법인 COBWEB의 개념 계층적 클러스터링 알고리즘을 이용하였다. 기존의 전문가에 의한 수동적인 온톨로지 구축을 자동화 시키므로써, 대량의 온톤로지를 구축하여 정보검색에 효율을 기할 수 있다.

  • PDF

Research on the Utilization of Recurrent Neural Networks for Automatic Generation of Korean Definitional Sentences of Technical Terms (기술 용어에 대한 한국어 정의 문장 자동 생성을 위한 순환 신경망 모델 활용 연구)

  • Choi, Garam;Kim, Han-Gook;Kim, Kwang-Hoon;Kim, You-eil;Choi, Sung-Pil
    • Journal of the Korean Society for Library and Information Science
    • /
    • v.51 no.4
    • /
    • pp.99-120
    • /
    • 2017
  • In order to develop a semiautomatic support system that allows researchers concerned to efficiently analyze the technical trends for the ever-growing industry and market. This paper introduces a couple of Korean sentence generation models that can automatically generate definitional statements as well as descriptions of technical terms and concepts. The proposed models are based on a deep learning model called LSTM (Long Sort-Term Memory) capable of effectively labeling textual sequences by taking into account the contextual relations of each item in the sequences. Our models take technical terms as inputs and can generate a broad range of heterogeneous textual descriptions that explain the concept of the terms. In the experiments using large-scale training collections, we confirmed that more accurate and reasonable sentences can be generated by CHAR-CNN-LSTM model that is a word-based LSTM exploiting character embeddings based on convolutional neural networks (CNN). The results of this study can be a force for developing an extension model that can generate a set of sentences covering the same subjects, and furthermore, we can implement an artificial intelligence model that automatically creates technical literature.