• Title/Summary/Keyword: An evaluation item

Search Result 473, Processing Time 0.028 seconds

Exploring the direction of Assessment in Korean High School Mathematics through College Scholastic Ability Test Mathematics Domain Changes (대학수학능력시험 수학 영역의 변화를 통해 살펴본 고등학교 수학 평가의 방향 탐색)

  • Choi, Inseon;Lee, Sehyung;Moon, Duyeol
    • Journal of the Korean School Mathematics Society
    • /
    • v.26 no.2
    • /
    • pp.137-158
    • /
    • 2023
  • This study aimed to analyze the shifts in the mathematics domains of the College Scholastic Ability Test (CSAT) since its inception in 1993, with the intent of identifying improvements for the future. The goal is to provide insights for exploring the direction of assessment in Korean high school mathematics education. To this end, we focused on the test system, content area, and behavioral area within the CSAT mathematics domains. Key findings include: first, the test structure influences the assessment factors and item types, in addition to the examination time and number of items. Second, by analyzing the content area, we established a correlation between the national curriculum and assessment area, and confirmed the importance of setting the assessment area. Third, the examination of the behavioral area tended to the item-type fixation, demonstrating the necessity of the ongoing modifications in evaluation item types. Building upon these findings, we discuss the direction of an evaluation that considers the evolving demands and shifts within mathematics education.

An Adaptive Tutoring System based on CAT using Item Response Theory and Dynamic Contents Providing (문항반응 이론에 의한 컴퓨터 적응적 평가와 동적 학습내용 구성에 기반한 적응형 고수 시스템)

  • Choi Sook-Young;Yang Hyung-Jeong;Baek Hyon-Ki
    • Journal of KIISE:Software and Applications
    • /
    • v.32 no.5
    • /
    • pp.438-448
    • /
    • 2005
  • This paper proposes an adaptive tutoring system that provides learning materials dynamically according to the learners' teaming character and ability. Our system, in which a learning phase and a test phase are linked together, supports the personalized instruction-learning by providing the teaming materials by level in the learning phase according to the teaming ability estimated in the test phase. We design and implement a tutoring system consisted of an evaluation component and a learning component. An evaluation component uses a computerized adaptive test(CAT) based on item response theory to evaluate learners' ability while a learning component employs fuzzy level set theory so that teaming contents are provided to learners according to learners' level.

Prediction of the Level of Influence of Average particle Size and Color n Evaluation of Building Material (재료의 색채와 입도가 건축 재료 평가에 미치는 영향도 예측)

  • 이진숙;진은미;오도석
    • Korean Institute of Interior Design Journal
    • /
    • no.26
    • /
    • pp.57-63
    • /
    • 2001
  • The aim of this study is to measure sensitivity reaction of human being with a physical properties of color and average size of particle for building materials and predict the influence of color and average size of particle in evaluation of building materials. As a results, 1) In results of qualitative evaluation construction, all 16 adjectives were extracted by higher evaluation items and ,total 14 adjectives were extracted as evaluation adjectives except adjectives of a contrary concept in each other. 2) According to the result of factor analysis, all 4 group of $\ulcirner$potency$\lrcirner$, $\ulcirner$activity$\lrcirner$, $\ulcirner$evaluation$\lrcirner$, $\ulcirner$warmness$\lrcirner$ were extracted. In this time, $\ulcirner$potency$\lrcirner$ as the first factor indicates the most hign original value. Consequently, $\ulcirner$potency$\lrcirner$ factor have an hign influence in evaluation of building materials. 3) As a influence analysis of evaluation variable by evaluation item $\ulcirner$potency$\lrcirner$ factor have an high influence by influence of average size of a particle, $\ulcirner$activity$\lrcirner$ factor have influence hignly by influence of brightness, $\ulcirner$evaluation$\lrcirner$ factor have an hign influence by influence of average site of a particle and the hue, $\ulcirner$warmness$\lrcirner$ factor have an hign influence mainly by influence of the hue

  • PDF

An Inquiry into Prediction of Learner's Academic Performance through Learner Characteristics and Recommended Items with AI Tutors in Adaptive Learning (적응형 온라인 학습환경에서 학습자 특성 및 AI튜터 추천문항 학습활동의 학업성취도 예측력 탐색)

  • Choi, Minseon;Chung, Jaesam
    • Journal of Information Technology Services
    • /
    • v.20 no.4
    • /
    • pp.129-140
    • /
    • 2021
  • Recently, interest in AI tutors is rising as a way to bridge the educational gap in school settings. However, research confirming the effectiveness of AI tutors is lacking. The purpose of this study is to explore how effective learner characteristics and recommended item learning activities are in predicting learner's academic performance in an adaptive online learning environment. This study proposed the hypothesis that learner characteristics (prior knowledge, midterm evaluation) and recommended item learning activities (learning time, correct answer check, incorrect answer correction, satisfaction, correct answer rate) predict academic achievement. In order to verify the hypothesis, the data of 362 learners were analyzed by collecting data from the learning management system (LMS) from the perspective of learning analytics. For data analysis, regression analysis was performed using the regsubset function provided by the leaps package of the R program. The results of analyses showed that prior knowledge, midterm evaluation, correct answer confirmation, incorrect answer correction, and satisfaction had a positive effect on academic performance, but learning time had a negative effect on academic performance. On the other hand, the percentage of correct answers did not have a significant effect on academic performance. The results of this study suggest that recommended item learning activities, which mean behavioral indicators of interaction with AI tutors, are important in the learning process stage to increase academic performance in an adaptive online learning environment.

Development and Application of an Evaluation Model for Biotope Appraisal in terms of Species and Biotope Preservation (종과 비오톱 보전을 위한 가치평가 모형 개발 및 적용)

  • Cho, Hyun-Ju;Lee, Hyun-Taek;SaGong, Jung-Hee;Ra, Jung-Hwa
    • Journal of the Korean Society of Environmental Restoration Technology
    • /
    • v.13 no.5
    • /
    • pp.59-80
    • /
    • 2010
  • This research This research aims at developing systemic evaluation model in terms of biotope preservation through reports, literatures, and expert survey analysis by implementing biotope structure analysis in area level with selecting Hyunpoong and Yuga-myeon, Dalseong county, Daegu metropolitan city as a site. First of all, as a result of biotope type classification of research site, biotope type groups are classified into total 13, and its biotope types are divided into total 61. Also, as a result of literature analysis, total 18 items are drawn such as diversity of biotope typical species as a index item to assess the preservation value of biotope, and the first evaluation index are divided into 10 and the second ones are divided into 8 according to characteristic of index items. As a result of expert survey analysis, All 10 index items, first evaluation index, show high importance average (above 4.7). As a result of implementation of main cause for categorizing evaluation index by characteristic, there are 3 factors such as 'obstructive factor.' Based on above survey analysis result, as a result of estimating the weight of each item, 'restoration factor' showed the highest, 3.4541, but 'factor of habitat stability' showed 3.1468, which is the lowest The systemic value evaluation was set by comprehensively analyzing these results. As a result of biotope preservation value evaluation through applying research site, total 19 types which are abundant in vegetation are classified into I class, 12 types in II class, 5 types in III class, 10 types in IV class, and 15 types in V class respectively. Lastly, as a result of second evaluation, it is analyzed that there are 17 special meaningful space to preserve species and biotope(1a, 1b) and 61 meaningful space to preserve species (2a, 2b, 2c).

Development of an Inspection Item and its Application for the Hygienic Improvement of Food service Establishments Using (식품접객 업소의 위생개선을 위한 검사항목 개발과 활용에 관한 연구 -HACCP 모델을 이용한 기여인자 분석방법으로)

  • 홍종해;이용욱
    • Journal of Food Hygiene and Safety
    • /
    • v.7 no.2
    • /
    • pp.133-145
    • /
    • 1992
  • The sanitation inspection is the most frequently used procedure to protect foods prepared in foodservice establishments. In order to enhance foodservice inspections and to improve post-inspection remedial measures, more practical evaluation methods for sanitation are required. The HACCP approach is based upon factors which contribute to foodborne disease rather than of factors which relate to aesthetics. Contributing factors for foodborne diseases from food service establishments reported in USA, Candada, and England were analyzed to identify potential hazards during practical foodservice operations. Hazards were classified at critical control points by risk ranking, Twenty-two observable practical indicators relating to each contributing factor were selected and adjusted to standardized procedures and hazard determiners at critical control points, The weights for each inspection item were ranked as 1, 2, 3, 4, or 5 according to the risk level of contributing factors. And also application for the inspection item in different 6 types of work procedures were suggested for the use of specialized foodservice establishment and cafeteria, and of manager's self inspection in each establishment.

  • PDF

Development of an Inspection Item and its Application for the Hygienic Improvement of Foodservice Establishments Using - Hazard Analysis Critical Control Point(HACCP) Model- (식품접객업소(食品接客業所)의 위생개선(衛生改善)을 위(爲)한 검사항목(檢査項目) 개발(開發)과 활용(活用)에 관(關)한 연구(硏究) -HACCP 모델을 이용(利用)한 기여인자(寄與因子) 분석방법(分析方法)으로-)

  • Hong, Chong-Hae;Lee, Yong-Wook
    • Proceedings of the Korean Society of Food Hygiene and Safety Conference
    • /
    • 1992.07a
    • /
    • pp.33-45
    • /
    • 1992
  • The sanitation inspection is the most frequently used procedure to protect foods prepared in foodservice establishments. In order to enhance foodservioe inspections and to improve post-inspection remedial measures, more practical evaluation methods for sanitation are required. The HACCP approach is based upon factors which contribute to foodborne disease rather than on factors which relate to aesthetics. Contributing factors for foodborne disease from foodservice establishments reported in USA, Canada, and England were analyzed to identify potential hazards during practical foodservioe operations. Hazards were classified at critical control points by risk ranking. Twenty-two observable practical indicators relating to each contributing factor were selected and adjusted to standardized procedures and hazard determiners at critical contral points. The weights for each inspection item were ranked as 1, 2, 3, 4 or 5 according to the risk level of contributing factors. And also application for the inspection item in different 6 types of work procedures was suggested for the use of specialized foodservice establishment and cafeteria, and of manager's self inspection in each establishment.

  • PDF

A Study on the Model of Training Performance Measurement Specialized to Cyber Security Trainee for Cyber Security Professionals Acquisition (사이버보안 전문인력 획득을 위한 사이버보안 훈련생에 특화된 훈련성과 측정 모델에 관한 연구)

  • Kim, Kihoon;Eom, Jungho
    • Journal of Korea Society of Digital Industry and Information Management
    • /
    • v.12 no.4
    • /
    • pp.59-69
    • /
    • 2016
  • We proposed a specialized model of performance measurement to measure the training performance of the trainees in cyber practical training. Cyber security professionals are cultivating their expertise, skills, and competencies through cyber practical training in specialized education and training institutions. The our proposed process of trainee evaluation is consisted of an evaluation component discovery, evaluation item selection, evaluation index catalog, ratings and criteria decision, and calculation formula. The trainee evaluation is consisted of a formative evaluation during the training and an overall evaluation after finished training. Formative evaluation includes progress evaluation and participation evaluation, and overall evaluation includes practice evaluation and learning evaluation. The evaluation is weighted according to the importance of evaluation type. Because it is evaluated actual skills and abilities, competencies are assigned a high weight, while knowledge and attitudes are assigned a low weight. If cyber security trainees are evaluated by the proposed evaluation model, cyber security professionals can be cultivated by each skill and knowledge level and can be deployed by importance of security task.

A Relative Effectiveness of Item Types for Estimating Science Ability in TIMSS-R (문항 유형에 따른 과학 능력 추정의 효율성 비교)

  • Park, Chung;Hong, Mi-Young
    • Journal of The Korean Association For Science Education
    • /
    • v.22 no.1
    • /
    • pp.122-131
    • /
    • 2002
  • Recently, performance assessment that makes growing use of free response items in a large scale assessment has been emphasized. This study is an empirical examination of the effectiveness of free response items in comparison with multiple choice items. Using the information function in Item Response Theory (IRT) framework, item information of free response items and multiple-choice items from the Third International Mathematics and Science Study-Repeat (TlMSS-R) were obtained. Test information of the whole science area as well as each area of science contents was computed. On average, free response items yielded more information than multiple choice items, especially in earth science, physics, chemistry, and life science. This study also showed that free response items were appropriate for students in high science ability. Also, free response items estimated students' science ability more accurately than multiple choice items with smaller number of free response items.

Factors of Predicting Difficulty of Mathematics Test Items in College Scholastic Ability Test (고등학교 수리영역 시험의 난이도 예측 요인 분석)

  • Ko, Ho-Kyoung;Yi, Hyun-Sook
    • Journal of the Korean School Mathematics Society
    • /
    • v.10 no.1
    • /
    • pp.113-127
    • /
    • 2007
  • This study explored the possibility of building a statistical model predicting difficulty of mathematics test items through the analysis of nation-wide scholastic ability test results for the past 5 years. Multiple linear regression analysis was conducted in predicting difficulty of mathematics test items. We adopted three major areas for independent variables: the content area, the behavior area, and the test item format area, each of which was categorized into more detailed sub-areas. For the dependent variable, the proportion of correct answer was used to represent the item difficulty. Statistically significant independent variables were included in the regression model based on the stepwise selection method. Several important factors affecting difficulty of mathematics test items for each area were identified. R-squares for the final regression model were fairly high, implying that the regression equation can be used to predict difficulty of test items at an acceptable level. Lastly, the regression model was cross-validated using independently collected data. We believe that this study will provide basic but very critical information for predicting the proportion of correct answer by showing the factors that should be considered for developing mathematics test items for the college entrance examination or high school classroom test.

  • PDF