• Journal of The Korean Association For Science Education
• /
• v.18 no.4
• /
• pp.643-650
• /
• 1998

In order to assess students' higher mental abilities, such as scientific inquiry thinking skills, the essay type items would be more adequate than the multiple choice itmes. However, due to the present condition in which a huge number of students take the examination at the same time, it is inevitable to use the multiple choice type. For this reason, it is necessary to develop a new type of multiple choice items which can reduce the disadvantages of the traditional multiple choice type and can achieve a similar level of validity as subjective type assessment. The three-tier multiple choice test items which can be used for a large sample of students and especially for scientific inquiry thinking abilities, are proposed and examined. The three-tier multiple choice test items asked firstly conclusion or the results of calculation or experimental apparatus, secondly the processes of calculation or of developing conclusion, thirdly asking relevant scientific concepts. For the item analysis, 1 point was given to the correct answer, while 0 point was given to the wrong one. The data were processed through the computer program developed in Turbo C 2.0 language with an IBM compatable personal computer. The average score in the sub-items asking for scientific concepts was lower than that in the sub-items asking for results or processes. The score of guessing by chance in the three-tier multiple choice items was only 0.13%, so that the probability of making correct answers by just guessing would be extremely low. The three-tier multiple choice items, even if they are objective items, are thought to assess thinking skills of the scientific inquiry meaningfully excluding the possibility of guessing by chance.

• The Korea Journal of Herbology
• /
• v.37 no.2
• /
• pp.13-21
• /
• 2022

Objectives : The evaluation of academic achievement is pivotal for establishing accurate direction and adequate level of medical education. The purpose of this study was to firstly establish innovative item analysis technique of Item Response Theory (IRT) for analyzing multiple-choice test of herbology in the traditional Korean medicine education which has not been available for the difficulty of test theory and statistical calculation. Methods : The answers of 390 students (2012-2018) to the 14 item herbology test in college of Korean medicine were used for the item analysis. As for the multidimensional analysis of item characteristics, difficulty, discrimination, and guessing parameters along with item-total correlation and percentage of correct answer were calculated using Classical Test Theory (CTT) and IRT. Results : The validity parameters of strong and weak items were illustrated in multiple perspectives. There were 4 items with six acceptable index scores, and 5 items with only one acceptable index score. The item discrimination of IRT was found to have no significant correlation with difficulty and discrimination indices of CTT emphasizing attention of professionals of medical education as for the test credibility. Conclusion : The critical suggestions for the development, utilization and revision of test items in the e-learning and evidence-based Teaching era were made based on the results of item analysis using IRT. The current study would firstly provide foundation for upgrading the quality of Korean medicine education using test theory.

• Journal of the Korean Society of Tobacco Science
• /
• v.27 no.1 s.53
• /
• pp.141-152
• /
• 2005

This study focused on the relationships among leaf and smoke components and sensory properties following tobacco leaf blending. A completely randomized experimental design was used to evaluate components of leaf and smoke and sensory properties for sample cigarettes with four mixtures of flue cured and burley tobacco (40:60, 60:40, 80:20 and 100:0). Eleven leaf components, six smoke components, and eight sensory properties of smoking taste were analyzed. A sensory evaluation method known as quantitative descriptive analysis was used to evaluate perceptual strength on a fifteen score scale. Raw data from ten trained panelists were obtained and statistically analyzed. Based on the MANOVA, clustering analysis, correlation matrix and partial least square (PLS) method were applied to find out which smoke component most affected sensory properties. The PLS method was used to remove the influence between explanatory variables in the leaf, smoke components derived from the results. High correlations (p<0.0l) were found among ten specific leaf and smoke components and sensory attributes. Total nitrogen, ammonia, total volatile base, and nitrate in the leaf were significantly correlated (p<0.05) with impact, bitterness, tobacco taste, irritation, smoke volume, and smoke pungency. From the results of PLS analysis, influence variables are used to explain about the correlation. In terms of bitterness, with only two explanatory variables, Leaf $NO_3$ and Leaf crude fiber were enough for guessing their correlation. In the distance weighted least square fitting analysis, carbon monoxide highly influenced bitterness, hay like taste, and smoke volume.