• Journal of the Korean earth science society
• /
• v.22 no.6
• /
• pp.469-479
• /
• 2001

This study investigated the trends in the number of applicants and mean score and applicants’ responses on the test items of Earth Science in the College Scholastic Ability Test (CSAT) implemented for 3 years (1999-2001). The percentage of applicants of science track were 43.14% in 1995, but reduced through 29.5% in 2001 to 26.92% in 2002 CSAT For elective subject, about 22% of science track students applied to Earth Science II which ranked third to Biology II and Chemistry II. In 1999, test items were developed to have the expected difficulty 40 ${\sim}$ 59% (6 items) to 60 ${\sim}$ 79% (10 items). But in 2001 every 16 items were developed to have difficulty 60 ${\sim}$ 79%, which was caused by the policy of so called ‘easy CSAT’. Thus the mean score of ‘Earth Science II’ was increased from 50.26 in 1999 through 64.47 in 2000, to 67.58 in 2001. Applicants were generally very good at solving test items focusing on process skills only and familar items but poor at solving test items related to the motion of the earth and planets and sea wave, especially items calling two or more concepts. Thus special measures to cope with the decrease in applicants of science track should be provided. And it is recommended to develop test items with wider range of difficulty and to reduce test items calling process skills only. And special consideration should be given to teaching the content area with poor achievement and high actual difficulty compared to the expected.

• School Mathematics
• /
• v.13 no.2
• /
• pp.307-321
• /
• 2011

Recognizing the importance of affective factors in mathematical learning and achievement, international comparative assessment as PISA and TIMSS survey affective achievement as well as scholastic achievement. On the affective survey those items of PISA are categorized by 5 factors ; interest of mathematics, instrumental motivation, Mathematics self-efficacy, mathematics anxiety, mathematics self-concept) and those of TIMSS are categorized by 3 factors; Positive affect toward mathematics (PATM), Students' Self-Confidence in Learning Mathematics(SCM), and Students' Valuing Mathematics(SVM). In this study we carried out Exploratory Factor Analysis, Confirmatory Factor Analysis and Measurement Equivalence/Invariance to find whether the constructs are well defined and divided. As a result of our analysis, some factors were overlapped in PISA whereas the items of TIMSS were categorized as intended in TIMSS study. Based on these results, it is confirmed that the questionnaire items need to be developed to understand our students affective characteristics. Also, how questionnaire of large-scaled international assessment can give implication to the development of the questionnaire of Korean specific.

• The Mathematical Education
• /
• v.63 no.2
• /
• pp.165-186
• /
• 2024

Despite the growing attention on artificial intelligence-based automated scoring technology as a support method for the introduction of descriptive items in school environments and large-scale assessments, there is a noticeable lack of foundational research in mathematics compared to other subjects. This study developed an automated scoring model for two descriptive items in first-year middle school mathematics using the Random Forest algorithm, evaluated its performance, and explored ways to enhance this performance. The accuracy of the final models for the two items was found to be between 0.95 to 1.00 and 0.73 to 0.89, respectively, which is relatively high compared to automated scoring models in other subjects. We discovered that the strategic selection of the number of evaluation categories, taking into account the amount of data, is crucial for the effective development and performance of automated scoring models. Additionally, text preprocessing by mathematics education experts proved effective in improving both the performance and interpretability of the automated scoring model. Selecting a vectorization method that matches the characteristics of the items and data was identified as one way to enhance model performance. Furthermore, we confirmed that oversampling is a useful method to supplement performance in situations where practical limitations hinder balanced data collection. To enhance educational utility, further research is needed on how to utilize feature importance derived from the Random Forest-based automated scoring model to generate useful information for teaching and learning, such as feedback. This study is significant as foundational research in the field of mathematics descriptive automatic scoring, and there is a need for various subsequent studies through close collaboration between AI experts and math education experts.

• Journal of the Korean School Mathematics Society
• /
• v.9 no.3
• /
• pp.287-308
• /
• 2006

In this study, an instrument of mathematical problem solving ability test was considered, and the difference between gifted and regular students in the ability were investigated by the test. The instrument consists of 10 items, and verified its quality due to reliability, validity and discrimination. Participants were 168 regular students and 150 gifted from seventh grade. As a result, not only problem solving but also problem finding and problem posing could be the characteristics of the giftedness.

• Communications of Mathematical Education
• /
• v.32 no.3
• /
• pp.435-453
• /
• 2018

The results analysis of National Assessment of Educational Achievement(NAEA) can provide various implications for teaching and learning in the school field. In this study we analyzed the deviation of NAEA achievement level-based correct-answer rate and the distribution of the responses percentages for three years from 2015 to 2017 focused on multiple-choice items. First we calculated the deviation of correct-answer rate between advanced level and proficient level and between proficient level and basic level, and then we selected the items whose deviation of correct-answer rate is more than the third quartile. We explored what the content areas, behavior areas and achievement standards of each item are and what the achievement standards and characteristics of these questions are. Based on the results of the analysis, we intended to derive implications for appropriate teaching-learning methods at each achievement-level.

• Journal of Educational Research in Mathematics
• /
• v.22 no.2
• /
• pp.229-259
• /
• 2012

The purpose of the present study is to develop instrument of mathematical belief of middle school and high school students and to analysis results of test using the instrument. Based on the results of literature review, mathematical belief is the cumulative effects of self-assessment and self-concept in mathematical learning and achievement experience. Four sub-components of mathematical belief is identified belief of school mathematics, belief of mathematical problem solving, mathematical self-concept, belief of mathematical teaching and learning. The instrument was developed to investigate mathematical belief by reflecting Korean middle school and high school students' psychological characters. To develop the appropriate items for the mathematical belief, after reviewing literature thoroughly, first version of the instrument was developed and exploratory factor analysis and confirmatory factor analysis were conducted. Then, to reduce the effect of the gender difference and achievement level difference, Correlation Analysis and 1-way ANOVA was performed. Also, using multiple group confirmatory factor analysis, this instrument was investigated to see whether this can be used for both middle school and high school. The final items for middle school students is consisted 7 items of belief of school mathematics, 9 items of belief of mathematical problem solving, 11 items of mathematical self-concept, 10 items of belief of mathematical teaching and learning. Instrument of mathematical belief for high school students is consisted 9 items of belief of school mathematics, 9 items of belief of mathematical problem solving, 11 items of mathematical self-concept, 11 items of belief of mathematical teaching and learning. This study examined the differences about mathematical belief's sub-factors shown by three groups of mathematics achievement level. Students of higher achievement level showed that the degree of most factors ware the highest excepting stereotype of belief of school mathematics. Also, Male students preferred more positive in mathematics belief than female students.

• The Mathematical Education
• /
• v.53 no.2
• /
• pp.219-237
• /
• 2014

In this study we desire to deduce implications for mathematics curriculum, teaching- learning, and evaluation from the data of Nation Assessment of Educational Achievement. For this, first we extracted the items written by the same achievement standard over two years from 2010 to 2012. Next we investigated whether the items are the representative items of a certain proficiency level and classified into the case of the items of the same proficiency level and the case of the items of different proficiency levels. Based on these we analysed learning characteristic of the each proficiency level. From the results of the above, we proposed what should be changed in mathematics curriculum, what should be considered in teaching-learning, and what should be paid attention to test item development.

• Journal of the Korean School Mathematics Society
• /
• v.19 no.4
• /
• pp.441-457
• /
• 2016

The purpose of this study is to analyze Korean students' mathematics achievement characteristics and draw implications for better math education in schools through comparing the results of three east Asian top level countries, Korea, Singapore, and Japan in PISA 2012 results. As a results, the rate of correct answers of Korea students was relatively low compared with those of Singapore, but relatively higher than Japan. From the results of effect size, similar results from t-test was discovered. As shown in analysis according to sub-elements in math assessment framework, the Korean students had low effect size in every sub-elements than Singapore. and they had high effect size at most of sub-elements than Japan, except "personal" context. In top performing level(above level 5), the Korean students had high effect size at "quantities" in mathematical contents, and "employ" in mathematical processes compared with Singapore. And they had row effect size at 6 sub-elements compared with Japan.

• Journal of Educational Research in Mathematics
• /
• v.25 no.3
• /
• pp.303-321
• /
• 2015

This research purposes to find out the mathematical cognitive characteristics of Korean students and compare it with that of TIMSS 2011 high-achieving countries based on the Cognitive Diagnostic Theory. Based on framework and questions of TIMSS 2011, we select cognitive attributes. Using the data of 8th grade students' mathematical achievement in TIMSS 2011, we compare and analyze the top 15-countries students' cognitive traits. As a result, cognition domain of TIMSS 2011 is reclassified as 9 cognitive attributes. we could distinguish between easy attributes and difficult attributes that students in each country relatively think. Especially, Students of Korea relatively think Recall/Recognize, Compute, Classify/Measure and Represent are easy. On the other hand, relatively they have difficulties in Retrieve, Implement, and Generalize. Based on this research result, It is necessary to establish an educational measures for each attributes which students have difficulties.

• Journal of Gifted/Talented Education
• /
• v.21 no.4
• /
• pp.847-860
• /
• 2011

In this study, the instrument of mathematical thinking ability tests were considered, and the differences between gifted and regular high school students in the ability were investigated by the test. The instrument consists of 9 items, and verified its quality due to reliability. Participants were 353 regular and 252 gifted high school students from tenth grade. As a result, not only organizing ability of information but also ability of space perception and visualization and intuitive insight ability could be the characteristics of the mathematical giftedness.