• Journal of The Korean Association For Science Education
• /
• v.29 no.3
• /
• pp.277-290
• /
• 2009

In the era of the outcome-based education, multiple-choice test has been widely employed owing to its efficiency that enables educators to evaluate a quantity of students with much objectiveness. However, the prevalent test has not been reconsidered enough to overcome its apparent shortcomings: examiners' effort for developing plausible and faultless distracters defending from every falsification, and students' random guessing on key choices. For alleviating such defects, tiered test as an experimental format of multiple-choice tests has been suggested in science education. Since there has not accumulated much study on the implementation of tiered tests, our research aim is set to construct a framework suggesting statistical indexes for rationally discerning tiered units that develop an effective tiered test. Graded both by our tiered-scoring and by the conventional partial-scoring, the preliminary tiered test in secondary physics attests the improvement in its discrimination and difficulty distribution. The findings reveal that the two indexes discern effective tiered items: discrimination increase (Ct-p) and difficulty decrease (Dp-t). Based on the index information, 4 heterogeneous tier types are recommended in the content of secondary physics: directional manipulation, repeated calculation, diverse explanation, and plural variables.

• The Korea Journal of Herbology
• /
• v.37 no.2
• /
• pp.13-21
• /
• 2022

Objectives : The evaluation of academic achievement is pivotal for establishing accurate direction and adequate level of medical education. The purpose of this study was to firstly establish innovative item analysis technique of Item Response Theory (IRT) for analyzing multiple-choice test of herbology in the traditional Korean medicine education which has not been available for the difficulty of test theory and statistical calculation. Methods : The answers of 390 students (2012-2018) to the 14 item herbology test in college of Korean medicine were used for the item analysis. As for the multidimensional analysis of item characteristics, difficulty, discrimination, and guessing parameters along with item-total correlation and percentage of correct answer were calculated using Classical Test Theory (CTT) and IRT. Results : The validity parameters of strong and weak items were illustrated in multiple perspectives. There were 4 items with six acceptable index scores, and 5 items with only one acceptable index score. The item discrimination of IRT was found to have no significant correlation with difficulty and discrimination indices of CTT emphasizing attention of professionals of medical education as for the test credibility. Conclusion : The critical suggestions for the development, utilization and revision of test items in the e-learning and evidence-based Teaching era were made based on the results of item analysis using IRT. The current study would firstly provide foundation for upgrading the quality of Korean medicine education using test theory.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.15 no.6
• /
• pp.3609-3615
• /
• 2014

This study examined the difference in the item characteristics in multiple-choice aptitude tests focusing on the response position, response length and question types. A university aptitude test consisting of 80 questions was used for this study. The subjects were 3120 senior high school students from 80 schools nation-wide (liberal arts-1650, natural sciences-1467 patients). The results suggest that item prediction is higher for numbers 2 and 3 (located in the middle) than numbers 1 and 4. The item discrimination was higher for pick-the-'wrong'-items than pick-the-'right'-items. In addition, longer choices are preferred. The suggestions for future research are provided based on these findings.

• Journal of The Korean Association For Science Education
• /
• v.30 no.4
• /
• pp.452-471
• /
• 2010

As the Korean College scholastic Ability Test (CSAT) has been implemented for 17 years since 1994, it is becoming more and more difficult to make new items that haven't been previously used to measure students' thinking ability. Therefore, it is necessary to keep conducting research on making new test items that can measure students' scholastic ability reliably. For this reason, multiple choice items on the Japanese university entrance exam, which is a Japanese National Center Test for University Admissions (NCTUA) equivalent of CSAT, were analyzed in order to draw implications for CSAT item development. In this study, we analyzed the Japanese NCTUA administered in January 2009 to investigate the structure of its science test. We also analyzed the NCTUA items by the domains of contents and behaviors, and tried to predict item difficulty from the perspective of Korean applicants. Major findings are as follows: Most NCTUA items measure understanding knowledge or low level thinking ability. Also the alloted time for each item is longer than CSAT. The number of test items, and the number of choice and alloted points for each item are diverse, unlike CSAT. The number of items using real-life materials are much more, but the items are not rigorous in sentence expression compared to CSAT. And the difference of difficulty level among science tests were larger with reference to CSAT. Also science score is required for most applicants regardless whether they are taking liberal arts or going onto the science track.

• Journal of The Korean Association For Science Education
• /
• v.15 no.4
• /
• pp.379-393
• /
• 1995

In spite of school science learning, the students' conceptions have not been changed easily. Therefore, to make students overcome their non scientific conceptions has been an important issue in science education. The purpose of this study was to identify the conceptions of students and teachers on the motion of the earth and the moon. The instrument was developed for estimating students' understandings of the concepts related to the motion of the earth and the moon. The validity of the instrument was examined by the specialists in Science Educator and Astronomer. At the same time, the two field trials had been executed, and the items were modified. Also, it consists of 12 items including 9 two-tier multiple choice items and 3 multiple choice items. The population of this study consists of 250 eighth-, 299 tenth-, 292 eleventh-grade students, 134 science teachers in secondary school. SPSS/PC+ was adopted for the statistical analysis. The type of misconceptions possessed students were as follows: 1) At 12:00 noon, the sun is directly overhead. 2) First quarter moon is a half of overall surface of the moon. 3) Air don't rotate with the earth surface because it keeps apart from the earth surface. 4) Summer is warmer than winter, because the earth is nearer from the sun in summer. 5) Whenever season is changed, the direction of rotation axis of the earth is changed. 6) The moon is the brightest at the position of new moon, because the distance between the moon and the sun is the shortest and the moon is received strongest sunlight. 7) The moon is not seen at the position of real full moon, because it is covered with shadow of the earth. 8) When the moon is not seen in the earth, sunlight is not reached at the moon. The major findings were as follows : 1) The middle school students had more misconceptions than those of high school students. And female students had more misconceptions than those of male ones. 2) The rate of correct answer and the type of conception in the tenth grade students were very similar with eleventh grade students. 3) The higher cognitive level, the better development of scientific conception and the less misconception. Also, the correlation coefficient between scientific conception score and GALT score was 0.57. 4) The students in scientific part had higher the rate of correct answer than those of students in human part and the former had less misconception than the latter. 5) The rate of correct answer about model and figure items was lower than descriptive ones, because they did not understand about figures itselves. These types of misconceptions will be used for science instruction and studies of other conceptions need.

• Journal of muscle and joint health
• /
• v.5 no.2
• /
• pp.206-221
• /
• 1998

The purpose of this study was to validate translated Multidimensional Assessment of Fatigue(MAF) scale. The scale is a 16-item scale that measures four dimensions of fatigue : severity, distress, impact, timing. Fourteen items are numerical rating scales and 2 items have multiple choice responses. Data were collected from the 137 patients with rheumatoid arthritis after content validation. Criterion validity was tested by correlation coefficient with Piper Fatigue Scale, which resulted in 0.7573(p<.0000). Construct validity was tested by item analysis and factor analysis. Corrected item-total correlation coefficients were 0.63-0.88. And factor analysis showed 2 factors : fatigue degree factor and fatigue impact factor. These two factors explained 73.5% of total variance. Reliability of internal consistency was 0.96 in Cronbach's alpha. Further validation study is necessary in each factor in other settings with other subjects.

• The International Journal of Costume Culture
• /
• v.9 no.1
• /
• pp.52-59
• /
• 2006

The purposes of this study were to investigate and to compare the actual state of clothing gift giving behavior according to gender. A survey using questionnaire was conducted on 417 university students in the Cheongju area, Korea. The questionnaire was composed of questions concerning demographic factors, clothing gift giving behavior and purchasing behavior, and of multiple choice and 5-point scales depending on the characteristics of the questions. Frequency, descriptive analysis, x$^2$-test and t-test were used for a data analysis. Most of the students had experience of giving the clothing for a gift more than once during the year. They usually purchased the clothing for their parents and Fiends. The items of clothing were low purchasing risk items like sweater, T-shirts, underwear and shirts or blouse. The main reason for purchasing clothing gift for their parents and friends was based on mostly practical motivation.

• Journal of Korean Elementary Science Education
• /
• v.32 no.4
• /
• pp.423-436
• /
• 2013

This research purports to analyze released items and G4 students' science achievement from TIMSS 2011 according to their academic achievement levels and gender. By doing so, it aims to draw educational implications for Korea from analyses results. Korea showed a lower rate of students at the advanced international benchmark - the highest achievement level - compared to Singapore. The difference was the smallest in Life Science among three content domains and knowing among three cognitive domains. The results of analysis according to gender showed that male students' achievement was significantly higher in Physical Science and Earth Science, and their achievement was also higher in the cognitive domains of Knowing and Applying. From the analysis of the released items, it was revealed that the students' achievement was low in items related to classification of organisms, functions of heart, matters that combust or emit light, and the concept of rotation. Moreover, students drew some illogical conclusions based on their personal experience. Male students were found to show high achievements in items that were not included in curriculum, constructed-response items in the form of short-answer questions, and multiple-choice items in the Knowing domain. Female students were found to show high achievement in items that were included in curriculum, constructed-response items that require reasons and methods, and items that represent experimental situations. Male students showed high achievement in forces concept and movements concept of bodies in the universe, while female students showed high achievement in solubility concept.

• Journal of The Korean Association For Science Education
• /
• v.19 no.1
• /
• pp.146-158
• /
• 1999

Since 1960' s. aims of science education have changed from attainment of scientific concepts. principles and laws to improvement of science process(or inquiry) skills. According to the science education philosophy like this. our nation has adopted improvement and evaluation of science process(or inquiry) skills in science education. The purpose of this study was to examine the performance of high school students on 4 types of multiple choice items used to access students ability to identify independent and dependent variables. Stimulus materials were either a question focusing on the relationship between two variables. a hypothesis. a description of an experiment. or a description of results of an experiment. Student performance on these item types was compared to this performance on a standard Piagetian interview task of variable identification. The results of the study included: (1) the "hypothesis" type was the most difficult, while the "question" type appeared to be the easiest; (2) the "procedure" item type had a higher correlation with the total interview than any other item type. Among conclusions reached in this study was that although all four item types operated similarly. they did not correlate very highly with the performance assessment by interview.

• The Journal of the Acoustical Society of Korea
• /
• v.30 no.5
• /
• pp.295-302
• /
• 2011

The purpose of this study was to develop Korean Consonant Perception Test (KCPT), that is a phonemic level including elementary data to evaluate speech and consonant perception ability of the normal and the hearing impaired qualitatively and quantitatively. KCPT was completed with meaningful monosyllabic words out of possible all Korean monosyllabic words, considering articulation characteristics, the degree of difficulty, and the frequency of the phonemic appearance, after assembling a tentative initial and final consonants testing items using four multiple-choice method which were applied to the seven final consonant regulation and controlled with the familiarity of the target words. Conclusively, the final three hundred items were developed including two- and one-hundred items for initial and final testing items, respectively, with the evaluation of the 20 normal hearing adults. Through this process, the final KCPT was composed upon the colloquial frequency following identification of no speakers' variances statistically and elimination of the highly difficult items. The 30 hearing impaired were tested with KCPT and found that the half lists, A and B, were not different statistically and the initial and final testing items were appropriate for evaluating initial and final consonants, respectively.