• The Journal of the Acoustical Society of Korea
• /
• v.30 no.5
• /
• pp.295-302
• /
• 2011

The purpose of this study was to develop Korean Consonant Perception Test (KCPT), that is a phonemic level including elementary data to evaluate speech and consonant perception ability of the normal and the hearing impaired qualitatively and quantitatively. KCPT was completed with meaningful monosyllabic words out of possible all Korean monosyllabic words, considering articulation characteristics, the degree of difficulty, and the frequency of the phonemic appearance, after assembling a tentative initial and final consonants testing items using four multiple-choice method which were applied to the seven final consonant regulation and controlled with the familiarity of the target words. Conclusively, the final three hundred items were developed including two- and one-hundred items for initial and final testing items, respectively, with the evaluation of the 20 normal hearing adults. Through this process, the final KCPT was composed upon the colloquial frequency following identification of no speakers' variances statistically and elimination of the highly difficult items. The 30 hearing impaired were tested with KCPT and found that the half lists, A and B, were not different statistically and the initial and final testing items were appropriate for evaluating initial and final consonants, respectively.

• Journal of the Korean Chemical Society
• /
• v.59 no.5
• /
• pp.445-453
• /
• 2015

In 2005, descriptive assessment was introduced to increase students’ higher mental ability like problem-solving ability and creativity. Every year the ratio of descriptive assessment increases and it is regarded as an alternative evaluation to a multiple-choice item which measures simplicity knowledge. Externally the descriptive assessment took a root in school, but we can’t say definitely that it meets its original goal. In this paper, science descriptive assessment items of 5 middle schools in Gyeonggi-do were analysed; examiners was interviewed about how well they understood the characteristic of the assessment items. According to the analysis, characteristic of the items are ① unequal distribution of unit, ② difference of item’s type by unit, and ③ disappearance of measuring higher mental ability. It is considered that there are several factors of these characteristic - the lack of teachers’ ability to make assessment item; understanding of assessment instrument. These factors can be explained by the lack of assessment expertise. So the society’s effort is needed to raise teacher’s ability for the descriptive assessment.

• Journal of the Korean earth science society
• /
• v.26 no.6
• /
• pp.511-523
• /
• 2005

The purpose of this study is to analyze the 1st and 2nd Korea Earth Science Olympiad (KESO) items, in order to find informations to enhance item quality. To do this, internal and external item classification frameworks are developed. Item difficulty (P), discrimination index (DI), correlation, and reliability are estimated by using classical test theory. Generalizability is also estimated by applying the generalizability theory. The results of item classification are as follows: (1) ‘Geology’, ‘astronomy’ and ‘data analysis and interpretation’ are dominant in content and inquiry process domain, respectively. Nearly every item has textbook context. (2) There is no difference between the preliminary and final tests in terms of their thinking skills sections. (3) As a whole, the ratio of items with pictures is high in item representation. However, multiple-choice and short answer items are more common in preliminary competition, and essay type items are found more often in final competition. The ratio of simple items is high in middle school section and preliminary competition, but composite items are dominant in high school section and final competition. The findings of item analysis are as follows: (1) In the middle school section, P is low and DI is moderate. But in the high school section, there is a considerable differences between science high schools and other high schools in general. (2) The highest correlation is reported between the scores of meteorology domain and total score in middle school, whereas in high school astronomy domain and total score show the highest correlation. (3) General high school section show the highest Cronbach $\alpha$ and generalizability. (4) General high school section show acceptable generalizability coefficient (> 0.80), but middle and science high school section should increase the number of items to reach acceptable generalizability level.

• Korean Journal of Cognitive Science
• /
• v.21 no.2
• /
• pp.283-307
• /
• 2010

In this study, a new open-ended format math testing system for elementary school students has been proposed. This system is an application of the recently proposed Constructive Multiple-choice Testing (CMT) system on math testing. The CMT system is a testing system in which the examinee has to respond to an item twice, first in an open ended format, and then in the multiple choice format. The advantages of this system is that process information can easily be obtained and that the examinee can receive feedback immediately after the test, based on his/her multiple choice responses. This open-ended format math testing system includes the manager mode, which allows the generation of the test items and student account management, and the testing mode, which allows the students to input their solution process using the menu bar and the keyboard. When two groups, one tested using the CMT system and the other tested using the paper and pencil test, were compared, there was no significant difference in average scores between the two groups although the testing time was longer for the group tested using the CMT system. This result suggests that the open-ended format math testing system proposed in this study can be used effectively in the actual classroom setting.

• Journal of The Korean Association For Science Education
• /
• v.22 no.4
• /
• pp.882-891
• /
• 2002

The purpose of this study was to investigate elementary school students' views on the nature of science and to compare their views by gender. Participants were 159 sixth graders in Seoul. An instrument consisting of five multiple-choice items were developed on the bases of previous studies. At the end of each item, students were also asked to write their reason in details for selecting a specific option. The results indicated that the students' views on the nature of science, on the whole, were neither accurate nor adequate from the viewpoints of modern epistemology. On comparing their views by gender, however, no significant differences were found except the item concerning the 'nature of model'.

• Journal of The Korean Association For Science Education
• /
• v.34 no.8
• /
• pp.703-718
• /
• 2014

This study sought to investigate learning progressions for astronomical systems which synthesized the motion and structure of Earth, Earth-Moon system, solar system, and the universe. For this purpose we developed ordered multiple-choice items, applied them to elementary and middle school students, and provided validity evidence based on the consequence of assessment for interpretation of learning progressions. The study was conducted according to construct modeling approach. The results showed that the OMCs were appropriate for investigating learning progressions on astronomical systems, i.e., based on item fit analysis, students' responses to items were consistent with the measurement of Rasch model. Wright map analysis also represented that the assessment items were very effective in examining students' hypothetical pathways of development of understanding astronomical systems. At the lower anchor of the learning progression, while students perceived the change of location and direction of celestial bodies with only two-dimensional earth-based view, they failed to connect the locations of celestial bodies with Earth-Moon system model, and they could recognized simple patterns of planets in the solar system and milky way. At the intermediate levels, students interpreted celestial motion using the model of Earth rotation and revolution, Earth-Moon system, and solar system with space-based view, and they could also relate the elements of astronomical structures with the models. At the upper anchor, students showed the perspective change between space-based view and earth-based view, and applied it to celestial motion of astronomical systems, and they understood the correlation among sub-elements of astronomical systems and applied it to the system model.

• Journal of The Korean Association For Science Education
• /
• v.28 no.1
• /
• pp.32-46
• /
• 2008

The purpose of this study was to analyse the qualitative and quantitative characteristics of paper-pencil tests for exploring its appropriateness as a selection tool of the gifted in science. For this purpose, we developed two (internal and external) item analysis frameworks, and applied these frameworks to analyse qualitative characteristics. Also, we analysed the relationship between two characteristics. The results of analysing qualitative characteristics revealed that the portion of items with acceleration context exceeding middle school curriculum level was relatively large, which caused low content validity. Furthermore, there was considerable deviation in content and context by subject matter and year, which caused test unstability. Items measuring knowledge domain was the most prevalent, and too much weight on data interpretation & analysis domain in inquiry process skills. In case of creativity test, the portion of items measuring convergent thinking was much larger than that of divergent or associative thinking. Most of these items were represented by using pictures and tables rather than using graphs. Item types of multiple-choice and short answers were superior to essay types. Discrimination index, on the whole, was appropriate (above 0.3), but item difficulty showed a vast deviation ($0.01{\sim}0.90$). Correlation coefficients among subject matters and test tools were very low, and test reliabilities were also low. Low item difficulty & high discrimination index item types were distinguishable. Items with acceleration context were more discriminating than enrichment context. Implications of developing quality paper-pencil test items in the selection of gifted students are discussed.

• Journal of The Korean Association For Science Education
• /
• v.24 no.6
• /
• pp.1235-1244
• /
• 2004

The purpose of the study was to produce resources to help develop instructional methods and programs for school science to reduce gender differences in science achievement by analyzing TIMSS-R results according to item type, benchmark, and content category. Korean male students performed higher than Korean female students and gender differences of Korean students were higher than international means in all item types including multiple-choice, short answer, and extended response type. GDI(Gender Difference Index) of Korean students was lower than international mean in top 10% benchmark but higher than international means in other benchmarks. Korean male students also exhibited higher performance than Korean female students in all content categories except scientific inquiry and the nature of science category. Regarding items that GDIs were higher than 10, the number of items belonged to life science and earth science category was relatively larger and a high percentage of them was not included in school science curriculum. In addition, the items were equally distributed in each performance category. In sum, the study showed various gender differences according to item type, benchmark, and content category. The results could be used to find appropriate instructional methods to reduce gender differences in science achievement.

• Journal of The Korean Association For Science Education
• /
• v.22 no.1
• /
• pp.76-92
• /
• 2002

OECD/PISA(Programme for International Student Assessment) is significant in that it is the first international comparative study assessing 15-year-old students' scientific literacy. Based on Korean students' results of percent correct in 35 science items, several characteristics such as followings were revealed. First, from the perspectives of science application area, Korean students showed the highest achievement in the area of 'science in technology' followed by in the areas of 'science in life and health' and 'science in earth and environment'. Male students achieved significantly better than female counterparts in all three areas. Second, the achievement in items of science knowledge was significantly higher than in items of scientific processes. Whereas the achievement difference between science knowledge- and scientific process items was larger for male students. Third, from the perspectives of application contexts, Korean students showed the highest achievement in the historical context and the lowest achievement in the personal context. Fourth, from the perspectives of item format, Korean students performed significantly better in open-constructed items rather than in multiple-choice items. Fifth, Korean students showed low performance in items of biotechnology and environment-related issue, which was more prominent for female students. Sixth, whereas male students performed significantly better than female students in most aspects, it is noteworthy that there was no significant gender differences in items of scientific processes and females performed significantly better than male students in open-constructed items which require long sentence.

• Journal of The Korean Association For Science Education
• /
• v.30 no.4
• /
• pp.452-471
• /
• 2010

As the Korean College scholastic Ability Test (CSAT) has been implemented for 17 years since 1994, it is becoming more and more difficult to make new items that haven't been previously used to measure students' thinking ability. Therefore, it is necessary to keep conducting research on making new test items that can measure students' scholastic ability reliably. For this reason, multiple choice items on the Japanese university entrance exam, which is a Japanese National Center Test for University Admissions (NCTUA) equivalent of CSAT, were analyzed in order to draw implications for CSAT item development. In this study, we analyzed the Japanese NCTUA administered in January 2009 to investigate the structure of its science test. We also analyzed the NCTUA items by the domains of contents and behaviors, and tried to predict item difficulty from the perspective of Korean applicants. Major findings are as follows: Most NCTUA items measure understanding knowledge or low level thinking ability. Also the alloted time for each item is longer than CSAT. The number of test items, and the number of choice and alloted points for each item are diverse, unlike CSAT. The number of items using real-life materials are much more, but the items are not rigorous in sentence expression compared to CSAT. And the difference of difficulty level among science tests were larger with reference to CSAT. Also science score is required for most applicants regardless whether they are taking liberal arts or going onto the science track.