• The Mathematical Education
• /
• v.60 no.2
• /
• pp.209-228
• /
• 2021

The purpose of this study is developed the Item Feature Analysis (IFA) frameworks for curriculum-based assessments, focusing on Math competency and representation in secondary schools and implemented the IFA in National Assessment of Educational Achievement. To conduct the study, previous studies were analyzed, and feasibility studies were conducted twice. As a result of the study, we structured the IFA framework based on the 2015 revised mathematics curriculum in Korea and developed a method to analyze the characteristics of the math items. The results of structuring the framework for math included two categories: math competency in the content aspects, and representation type in the formal aspects. Specifically, 12 features of math competency and 8 features of representation type were identified, and an item feature analysis framework composed of these features was developed. The math competency was developed based on the subject competency of 2015 national curriculum. Math assessments in high schools, which have been changed to the competency-based assessments, had more frequency of the feature of math competency compared to middle schools. In this study, implemented the IFA in National Assessment of Educational Achievement and explored the way of ensuring the validity. These have been proved as critical applications for ensuring the validity of curriculum-based student assessment as well as building a tool for assessment.

• Human Ecology Research
• /
• v.62 no.2
• /
• pp.197-216
• /
• 2024

The dual aims of this study were i) to explore the effectiveness of an assessment method that can measure the competencies learned through high school home economics and ii) develop a competency-based assessment framework for high school home economics, including components of competency-based assessment, item development system, and other elements. The study involved the following stages: literature analysis, draft development, concretization, validity verification, and final version. Based on the results of the literature analysis and expert deliberation, a competency-based assessment framework for high school home economics was developed which comprised three dimensions: 'core idea' × 'process' × 'context and value'. Based on this, an item analysis table was presented to systematize various activities for the competency-based assessment of high school home economics, following which a holistic rubric suitable for competency assessment tasks was proposed by referring to the newly developed 'process' dimension assessment criteria. This study is significant in that it is the first to propose a competency-based assessment framework that systematically presents a variety of assessment activities. These will facilitate the development of assessment standards and tools that teachers can refer to or trust in the changing school environment due to the introduction of the standard-based assessment system based on a high school credit system, and the guarantee of a minimum achievement level.

• Proceedings of the Korean Institute of Building Construction Conference
• /
• 2012.05a
• /
• pp.151-152
• /
• 2012

Recently, there are growing interests in building LCCO₂ Assessment to reduce carbon emissions. However, existing methods of assessment system include inefficiency in the process of CO₂ calculation requiring considerable data input. Therefore, the purpose of this study is to develop an efficient building assessment system appropriate to material production in construction stage. To that end, quantity input technology was limited to data mapping. Also quantity calculation based on work breakdown structure and item codes consisted of hierarchical structure that is based on facet classification were analyzed. As a result, connectivity links of quantity calculation and CO₂ functional units through item codes for data mapping, and assessment system including calculation and database parts were developed.

• School Mathematics
• /
• v.14 no.4
• /
• pp.517-529
• /
• 2012

Assessment in the school should be done consistently in accordance with the national curriculum. This study analyzed the process that preservice teachers developed the question items. The preservice teachers already equipped with the knowledge about the curriculum, didn't reflect it to items at first. However, in the review and modification process with colleague discussions, they get the curriculum coherence faithfully. And the item completeness gets higher such as to conform to the item intent, to help the students easily understand the item and to have the consistency between items.

• Journal of Science Education
• /
• v.37 no.2
• /
• pp.348-358
• /
• 2013

The purpose of this study is to develop the science item on computer-based performance assessment which is able to replace the assessment with actual experimental apparatus. The survey on the necessities and the difficulties of the assessment with actual experimental apparatus was conducted with 57 physics teachers. By reflecting the results of the survey, the computer-based assessment items which are related with constructing circuits with an ammeter and a voltmeter were developed. The developed computer-based assessment items were organized in similarity to assessment conducted with actual experimental apparatus, proper feedback was provided by students' performance in the process of assessment so as to grading performance results automatically. To achieve them, the algorithm was developed so that computer can judge the accuracy of students' performance results.

• Journal of Korean Elementary Science Education
• /
• v.32 no.2
• /
• pp.139-158
• /
• 2013

This study investigated elementary students' (grade 4~6) learning progressions for water cycling drawn from iterative assessments using ordered multiple-choice (OMC) items. An assessment system, which consisted of construct map, item design, outcome space, and measurement model, was employed in this study to examine children's learning progressions. At the first stage of the assessment system, a construct map was designed on which children's conceptual understandings from naive to most sophisticated were represented. At the item design stage, 8 OMC items were drawn from the construct map. Each item option of the OMC items was scored from 0 to 3 according to its level of understanding at the stage of outcome space. As a measurement model, Rasch model, a branch of item response theory, was applied to interpreting the outcomes of the OMC items. This cycle of assessment system was furtherly implemented iteratively in order to elaborate on the first version of water cycling learning progression. In conclusion, children's understanding of water cycling could be described in two aspects: water distribution and water movement. We identified children's conjectural developmental pathways about water cycling existed from superficial and naive accounts to more complex and abstract accounts.

• The Mathematical Education
• /
• v.61 no.4
• /
• pp.581-595
• /
• 2022

The purpose of this study is to specify the procedure for making item models based on ontology models using automatic item generation in the mathematics subject through the CAFA system, and to explore the generated item instances. As an illustration for this, an item model was designed as a part of formative assessment based on the content characteristics, including concepts and calculations, and process characteristics, including application, using the representative values and the measures of dispersion in Mathematics of the 9th grade based on the evaluation criteria achievement standards. The item types generated in one item model were a best answer type, a correct answer type, a combined-response type, an incomplete statement type, a negative type, a true-false type, and a matching type. It was found that HTML, Google Charts, TTS, figures, videos and so on can be used as media. The implications of the use of digital evaluation based on automatic item generation were suggested in the aspects of students, pre-service teachers, general teachers, and special education, and the limitations of this study and future research directions were presented.

• Korean Journal of Remote Sensing
• /
• v.23 no.5
• /
• pp.335-346
• /
• 2007

This study is aiming at improving the Environmental Conservation Value Assessment Map(ECVAM) of National Land in Korea. The ECVAM items are composed of legal and environmental/ecological assessments. A popular method applied to ECVAM is an overlay environmental/ecological assessment items. The purpose of this study is to offer complementary items of the ECVAM by examining assessment items. In this study we assessed the ECVAM by five methods. Method 1 is Grade 1 areas of each administrative district; Method 2 is comparing overlapped areas of each assessment items Grade 1, 2 and permission of each assessment items duplication; Method 3 is Grade 1, 2 areas by only singular assessment items; Method 4 is Grade 1 areas only of Method 2; and Method 5 is Grade 2 areas only of Method 2. Method 1 showed Seoul and other metropolitan cities revealed a large proportion of Grade I regions by the legal assessment items. Gang won-Do, showed a large proportion of Grade I regions by the environmental/ecological assessment item. Method 2 showed 93.4% of diameter Grade II(standard for stability); forest diameter item accounted for 99.9% by Method 3, Method 4 showed 95.7% of forest diameter, and forest density accounted for 66.4% by Method 5. This study contributes to reduce the complexity in the process of manufacturing ECVAM of National Land, and to raise the flexibility in the process of managing and updating this map.

• Physical Therapy Korea
• /
• v.18 no.3
• /
• pp.94-102
• /
• 2011

The purpose of this study was to review existing assessment tools for patients with low back pain and improve them through combination. A total of 314 patients with low back pain participated. Their condition was assessed using the Oswestry Disability Questionnaire (ODQ), the Quebec Back Pain Disability Scale (QBPD), and the Back Pain Functional Scale (BPFS). Rasch analysis was applied to identify inappropriate items, item difficulties, and the separation index. In this study, the 'sex life' item of the ODQ (10 items) and the 'sleeping' item of the BPFS (12 items) showed misfit statistics, whereas all items of the QBPD (20 items) were appropriate. After combining the ODQ, QBPD and BPFS, Rasch analysis was applied. The 'pain intensity', and the 'sex life' item of the ODQ and the 'throw a ball' item of QBPD showed misfit statistics. These 3 items were retained for further analysis. The remaining 42 combined ODQ-QBPD-BPFS items were arranged according to difficulty. For all subjects, the most difficult item was 'pain intensity', whereas the easiest was 'take food out of the refrigerator'. As the separation index of 42 combined ODQ-QBPD-BPFS was higher than that of the three questionnaires separately, difficulty of items varied with some need for rearrangement. The results of this study confirmed the possibility and need for a new back pain disability assessment tool, and produced one. Further study is needed to refine the questionnaire in consideration of psychosocial and occupational factors.

• Korean Journal of Comparative Education
• /
• v.28 no.5
• /
• pp.1-19
• /
• 2018

The purpose of educational assessments such as the Trends in International Mathematics and Science Study (TIMSS) is to compare groups such as countries. When the unit of measurement is above the student level, group-level diagnostic assessment based on multilevel item response theory (ML-IRT) can be considered just as cognitive diagnosis models are developed from item response theory. This study suggests an ML-IRT-based group-level diagnostic assessment model by modifying an item feature model by Park and bolt (2008). The model is illustrated on the recently released TIMSS 2015 Grade 8 mathematics assessment. The results provide skill profiles for the studied countries and the nine cognitive attributes; that is, the attribute effects can be compared across the countries and also across the attributes. By controlling unexplained variance, the suggested model may provide more reliable and more informative group-level comparisons. The results are interpreted using an example. Limitations and directions for future research are also discussed.