• Journal of the Korean Chemical Society
• /
• v.52 no.3
• /
• pp.295-302
• /
• 2008

In this study, the test that were used in entrance examination for chemistry class in a Science-Gifted Education Center for middle school students were analyzed by using criteria for identification and measurement of scientific giftedness and a classical test theory. The result of analysis exhibited that most of problems measured more than two elements of scientific giftedness and required applications of scientific knowledge of middle school level to solve problems. In the analysis of sub-elements of scientific giftedness, originality, fluency in creativity and finding problems/formulating hypothesis, planning inquiry, interpreting data in science process skills were dominant while drawing conclusion and generalization processes were lacking. In correlation analysis between total score and each type of problems, total score was most influenced by the problems measuring science inquiry linked with scientific knowledge. Item difficulty is moderately high and item discrimination is moderate.

• Journal of Korean Elementary Science Education
• /
• v.40 no.2
• /
• pp.191-209
• /
• 2021

This study analyzed how characteristics of process-focused assessment are implemented in the distributed process-focused assessment examples in elementary school science education. To this end, through a review of previous studies, the analysis perspectives on the characteristics of the process-focused assessment were extracted into six categories. Using the analysis framework, it was described how process-focused assessment examples in elementary school science education developed by metropolitan office of education reflected the characteristics of process-focused assessment. As a result of the study, the characteristics of process-focused assessment were often formally reflected in sample materials. For example, there was a lack of skills on how to effectively integrate instruction and evaluation in practical terms. In many cases, feedback simply induced a recall of a learned concept or simply guides a related scientific concept. In some cases, the characteristics of process-focused assessment did not appear prominently in the sample materials. Also the developed sample materials were divided into the same type as the existing science and performance assessment questionnaire, a narrative·essay type, and a type similar to experimental workbook.

• Journal of Gifted/Talented Education
• /
• v.20 no.1
• /
• pp.61-77
• /
• 2010

The purpose of this study was to analyze the items that were used in entrance examination for science gifted education center for middle school students by using content analysis and classical item analysis. In content analysis, objective type items exhibited mathematics and physics were dominant. Science giftedness & creativity items were dominant. And essay type items consisted of physics items, have evaluated creative problem solving ability. Item difficulty and discrimination index, on the whole, were appropriate. Comparing with objective type, essay type has higher discrimination index. In correlation analysis between total score and score of each type of items, total score has the highest correlation with essay type items and science giftedness & creativity. It was recommended that mathematics, physics and chemistry items with focusing giftedness & creativity could give some implications for future selection methods of science gifted education center.

• Journal of Science Education
• /
• v.42 no.3
• /
• pp.322-333
• /
• 2018

The purpose of this study is to identify the types and characteristics of the integrative thinking that learners with diverse learning backgrounds use in solving earth science problems. Four students in middle school were surveyed using questionnaires to know students' science learning background and test items with integrated content. A total of 200 items, 40 integrated items and 160 general items, were administered ten times. The students did not show a consistent relationship in terms of correct answer percentage in general items and that of in integrated items. In order to understand the type of integrative thinking of each student, after students solve an item, we analyzed the percentage of correct answers by types and interviewed them and analyzed the contents to identify the characteristics of the thinking used in solving each item. As a result, the types of integrative thinking used in problem solving were classified into three types, knowledge-based, real life-based, and integrated inquiry-based types. It is necessary to study various ways to improve the integrative thinking ability considering the characteristics of students in science teaching and learning.

• Journal of the Korean Chemical Society
• /
• v.65 no.1
• /
• pp.48-57
• /
• 2021

This study analyzed the science assessment items that were conducted by the paper and the computer-based assessment in the TIMSS 2019 pre-test, which is an international academic achievement assessment. We examined whether the test mode influenced the percentage of items answered correctly by each graders. As a result, there was no significant difference in the correct answer rates of science items according to the test media in 4th and 8th graders. Looking at the each graders, the difference in the percentage of correct answers was relatively large in the fourth grader rather than the eighth grader. In terms of items, the difference in the percentage of correct answers was relatively larger for the constructed items than the multiple choice questions. As a result of analyzing the content of science and assessment items on the influence of the test media, the multiple choice items showed little difference between the paper and the computer-based assessment items, but the answer-type items tended to have a lower percentage of correct answers than the paper-based assessment. In addition, by grade, 4th graders showed lower percentages of correct answers in the constructed items than 8th graders. This study provides implications related to the development and introduction of computer-based assessment in Korea, and suggests an educational implications for computer-based assessment to be well established as school evaluation.

• Journal of The Korean Association For Science Education
• /
• v.18 no.4
• /
• pp.617-626
• /
• 1998

Inquiry approach in teaching science has been widespread in Korea since the Third National Curriculum in 1970's. But the effect of the approach has never been evaluated systematically in Korea, so the science educators do not know if the inquiry approach really works and if any critical problems inhibit the effect of the approach. In this context, the NAEP of the Unied States and the APU of the United Kingdom were model programs for assessing the effect of the inquiry approach in teaching science. The purpose of this study is to develop an assessment system for evaluating the effect of inquiry teaching in elementary and secandary schools. For this purpose, an assessment framework and 240 test items were developed and tried with a sample of 8,906 students. The results say that the developed tests are reliable. The average Cronbach $\alpha$ reliability coefficient of the tests was 0.69. The discrimination index(point-biserial correlation coefficient) ranged from 0.39 to 0.54 with a mean of 0.49, which indiate they are excellent in discriminating students in terms of their inquiry achievement. The test items were also analyzed by "item response theory." The results also say that the items are successfully developed.

• 한국지구과학회:학술대회논문집
• /
• 2010.04a
• /
• pp.17-17
• /
• 2010

본 연구는 학생들의 과학 경험의 정도를 정량화 하는데 있어 통일된 측정 도구를 제시하는 것이다. 측정 도구를 구성하는 요인들은 선행연구를 통해 학교 안 과학 경험은 일반 활동 경험, 과학 탐구 경험, 실험 기구 경험으로 세분화 되며 학교 밖 과학 경험은 일반 활동 경험, 취미 활동 경험, 현장 견학 경험 6개의 영역으로 구분을 할 수 있었다. 각각의 요인을 구성하는 질문은 NAEP(1987)에서 사용된 과학 경험 검사 도구와 신영준(2000)의 과학 경험 검사 도구의 문항 중 일부를 발췌하고 더불어 과학 경험에 대한 개방적인 설문지를 통하여 1차 검사를 실시하여 얻은 답변 중 빈도가 많은 답변과 중등 교과서의 탐색적 분석을 통해 영역별 10문항씩 6개 영역의 문항을 선정하였다. 사전 설문조사와 선행 연구를 바탕으로 개발한 검사지를 고등학교 1학년 학생 413명을 대상으로 2차 검사를 실시하였다. 개발한 측정 도구의 타당도는 내용타당도와 구인타당도로 검사하였다. 내용타당도는 2명의 현직 중등교사와 2명의 과학교육전문가가 각 문항이 측정하고자 하는 목적에 부합하는지 심사하였고, 구인타당도는 요인분석을 통해 검사하였다. 신뢰도는 Cronbach $\alpha$를 통하여 문항을 분석하였다. 6개의 영역의 요인에 대하여 타당도와 신뢰도 분석 결과 6개 영역으로 구성된 60문항의 측정 도구는 학생들의 과학 경험을 측정하는 도구로서 적절하다는 결론을 내렸다.

• Journal of The Korean Association For Science Education
• /
• v.40 no.3
• /
• pp.253-269
• /
• 2020

This study aims to develop items to diagnose pre-service physics teachers' understanding of the conceptual knowledge of modern physics, based on the achievement criteria presented in the 2015 revised national science curriculum, and to identify the validity and reliability of the newly developed items. Data were collected from 467 pre-service physics teachers in the Physical Education Department or Science Education Department (Physics Education Major) of 15 universities across the nation. In this study the content validity, substantive validity, the internal structure validity, generalization validity, and the external validity proposed by Messick (1995) were examined by various statistical tests. The results of the MNSQ analysis showed that there was no nonconformity in the 23 items. The internal structure validity was confirmed by the standardized residual variance analysis, which shows that the 22 items was unidimensional. The generalization validity was confirmed by differential item functioning (DIF) analysis about groups lectured or not modern physics/quantum mechanics. In addition, item analysis and test analysis based on classical test theory were performed. The mean item difficulty is 0.66, mean item discrimination is 0.47 and mean point biserial coefficient obtained was 0.41. These results for item parameters satisfied the criteria respectively. The reliability of the internal consistency of the KR-20 is 0.77 and the Ferguson's delta obtained was δ = 0.972. By Rasch model analysis, the item difficulty (item measures) was discussed.

• Korean Journal of Childcare and Education
• /
• v.10 no.3
• /
• pp.137-158
• /
• 2014

The present study aimed to develop an instrument to assess young children's understanding of science inquiry skills. For the purposes of the study, based on analysis of literature and evaluation tools related to young children's science inquiry skills, five categories of understanding science inquiry skills including observing, classifying, predicting, measuring, and discussing were selected. Then 30 test items were developed and verified three times through opinions from science education and early childhood education professionals and teachers. Finally, a total of 19 test items within five categories were developed. The 19 items' item difficulty, item discrimination, and item internal consistency were verified statistically. In addition, concurrent validity and test-retest reliability of the items were verified by the significant correlation coefficients. The instrument developed in this study was administered to 300 children who were 3, 4, and 5 years old. The results showed that 5 year old children had better competence to understand science inquiry skills than 4 and 3 year old children, while there were no differences in the competence between boys and girls.

• Journal of The Korean Association For Science Education
• /
• v.24 no.6
• /
• pp.1235-1244
• /
• 2004

The purpose of the study was to produce resources to help develop instructional methods and programs for school science to reduce gender differences in science achievement by analyzing TIMSS-R results according to item type, benchmark, and content category. Korean male students performed higher than Korean female students and gender differences of Korean students were higher than international means in all item types including multiple-choice, short answer, and extended response type. GDI(Gender Difference Index) of Korean students was lower than international mean in top 10% benchmark but higher than international means in other benchmarks. Korean male students also exhibited higher performance than Korean female students in all content categories except scientific inquiry and the nature of science category. Regarding items that GDIs were higher than 10, the number of items belonged to life science and earth science category was relatively larger and a high percentage of them was not included in school science curriculum. In addition, the items were equally distributed in each performance category. In sum, the study showed various gender differences according to item type, benchmark, and content category. The results could be used to find appropriate instructional methods to reduce gender differences in science achievement.