• Journal of The Korean Association For Science Education
• /
• v.37 no.2
• /
• pp.225-237
• /
• 2017

In this study, we investigated the characteristics of the individual processes of pre-service chemistry teachers in making written test items. For this, we analyzed the think-aloud processes of eight pre-service chemistry teachers while making six written test items about gas laws and their in-depth interview scripts. The characteristics of the processes were found to be divided into six categories; the lack of systemicity in planning stage for making written test items, the lack of awareness and consideration for the interrelationship between instruction and assessment, the diverse criteria in determining test item types, the difficulties in judging behavioral domains and difficulties of items in the table of specification, the limitation in using teacher's guides and misunderstanding of teacher's guides, and the limitation in point and/or content of review and differences depending on the time of review. These can provide some significant guidelines and implications in finding ways to improve pre-service chemistry teachers' ability to make written test items.

• Journal of the Korean Chemical Society
• /
• v.54 no.6
• /
• pp.781-786
• /
• 2010

The purpose of this study was to investigate errors on written tests of science, matters, in middle school 7th grade. Errors were defined something you have done which is considered to be incorrect or wrong, or which should not have been done. We found and classified errors, and then examined the frequency of types of errors on the written tests. A total of 167 test items from 10 middle schools were analyzed for this study. Errors on the written tests were classified into 5 types: insufficient information; unnecessary information; inaccurate information; information against curriculum; and unclear information. A total of 81 errors were counted out of 167 test items. The results of this study are expected to help teachers develop written test items to convey definite meanings by text and would be used as basic information for improving written test item standards.

• Journal of The Korean Association For Science Education
• /
• v.24 no.1
• /
• pp.17-28
• /
• 2004

The purpose of this study is to determine the patterns of differences between genders in science achievement. Eleventh grade, 140 female and male students were sampled from a school in Seoul. According to the analysis results of pilot study, 20 items were finally selected for the main study. To sharpen our interpretations of the factors and provide some confirmation, we supplemented the statistical analysis with a more detailed cognitive study of the items using think-aloud protocols and interviews with student test takers. The analysis of this study took into account the different item formats, contexts, and presentation styles. The findings are as follows: First, there was no significant gender difference between multiple-choice and open-ended items. Second, male students achieved significantly better in the context of everyday life in multiple-choice items. Third, male students favored items presented as written texts. Fourth, in problem-solving process, female students tend to apply their science concepts, whereas male students tend to apply their everyday experiences. The results of this investigation indicate that gender difference in science achievement depends heavily on item characteristics.

• Journal of Korean Society for Quality Management
• /
• v.11 no.1
• /
• pp.10-17
• /
• 1983

This paper studies item-life test plans with the specified item mean life $T_1$ (MTBF) - Producer's risk ${\alpha}$ and item mean life $T_2$ (MTBF, $T_2$ < $T_1$) - Consumer's risk ${\beta}$ when the probability of item survival follows the Weibull distribution (known shape parameter) as a expansion of [1]. And Operating Characteristic Curves and Average Life-testing Times of item-life test plans are computed for this paper and [1]. Cost analysis procedures are same as [1]. These results are computed by using computer program written in Level II Basic for Apple II Plus Micro-computer. Both this paper and [6] reduce the life-testing time for Weibull distribution in comparision with Exponential distribution, but results of [6] were computed for different criterions from this paper.

• The Mathematical Education
• /
• v.53 no.2
• /
• pp.219-237
• /
• 2014

In this study we desire to deduce implications for mathematics curriculum, teaching- learning, and evaluation from the data of Nation Assessment of Educational Achievement. For this, first we extracted the items written by the same achievement standard over two years from 2010 to 2012. Next we investigated whether the items are the representative items of a certain proficiency level and classified into the case of the items of the same proficiency level and the case of the items of different proficiency levels. Based on these we analysed learning characteristic of the each proficiency level. From the results of the above, we proposed what should be changed in mathematics curriculum, what should be considered in teaching-learning, and what should be paid attention to test item development.

• Journal of The Korean Association For Science Education
• /
• v.36 no.5
• /
• pp.769-781
• /
• 2016

This study investigated the interactions among the PCK components of pre-service secondary chemistry teachers considered in the processes of making written test items individually and in small groups. The processes of making written test items individually for 8 pre-service teachers was studied through the think-aloud method. The analysis of the results revealed that the 'assessment in science education' of the five PCK components was most frequently used in making test items. 'Curriculum for science education,' 'subject matter knowledge,' and 'students' were also frequently used although fewer than the previous component. However, 'instructional strategies and instruction for science education' was hardly used. The integrations between two or three components with various types were frequently found. However, integrations among four to five components were not found. The processes of making written test items in two small groups consisting of four pre-service teachers were observed. The analysis of the results revealed that the PCK components used in small groups were similar to those in the individual processes. However, 'curriculum for science education' was less frequently used, and the numbers of subcategories used at a relatively high frequency increased from other four components in small groups. In the aspects of integration, the proportion of the integrations between two components decreased and that for three components increased compared with those in the individual processes. The integrations among four or five components were also newly found. However, the integrations of 'curriculum for science education' with the other components were less frequently found. The integrations of 'instructional strategies and instruction for science education' with other components were still hardly found.

• Journal of The Korean Association For Science Education
• /
• v.38 no.5
• /
• pp.611-623
• /
• 2018

This study investigated verbal behaviors and interactions in the processes of making written test items using paired think aloud problem solving for pre-service secondary chemistry teachers. The processes of making written test items using paired think-aloud problem solving in four small groups consisting of two pre-service chemistry teachers were recorded and transcribed. The analysis of the results revealed that 'item making' for ten subcategories for solver's verbal behaviors were most frequently exhibited regardless of 'integration' among the components of pedagogical content knowledge (PCK). The solver's 'provide', 'modify', 'require agreement', 'ask', 'agree', and 'justify' were also frequently exhibited although fewer than 'item making'. Especially, the solver's 'ask' was more frequently used in 'non-integration', whereas 'justify' was more frequently used in 'integration'. In listener's verbal behaviors consisted of eight subcategories, 'point out', 'ask', and 'agree' were frequently exhibited regardless of 'integration'. Listener's 'ask' and 'agree' were exhibited more in 'non-integration', whereas 'point out' was exhibited more in 'integration'. Many verbal interactions were analyzed to be in 'symmetrical type' more than 'solver-dominant type' or 'listener-dominant type'. 'Symmetrical type' was also more frequently exhibited in 'integration', whereas 'solver-dominant type' was more frequently exhibited in 'non-integration'. There were little differences between 'integration' and 'non-integration' in 'listener-dominant type'. In 23 subcategories of 'symmetrical type', 'ask-provide' and 'point out-justify' were most frequently found. Especially, 'ask-provide' was more frequently found in 'non-integration', whereas 'point out-justify' was more frequently found in 'integration'. 'Point out-modify' was the most frequent in 4 subcategories of 'listener-dominant type', while 'item making-agree' in three subcategories of 'solver-dominant type' regardless of 'integration'. However, only a little of other subcategories of the three types were found.

• Journal of The Korean Association For Science Education
• /
• v.36 no.3
• /
• pp.389-397
• /
• 2016

This study aims to test the efficacy of English-based automated computer scoring models and machine translation to score Korean college students' written responses on natural selection concept items. To this end, I collected 128 pre-service biology teachers' written responses on four-item instrument (total 512 written responses). The machine translation software (i.e., Google Translate) translated both original responses and spell-corrected responses. The presence/absence of five scientific ideas and three $na{\ddot{i}}ve$ ideas in both translated responses were judged by the automated computer scoring models (i.e., EvoGrader). The computer-scored results (4096 predictions) were compared with expert-scored results. The results illustrated that no significant differences in both average scores and statistical results using average scores was found between the computer-scored result and experts-scored result. The Pearson correlation coefficients of composite scores for each student between computer scoring and experts scoring were 0.848 for scientific ideas and 0.776 for $na{\ddot{i}}ve$ ideas. The inter-rater reliability indices (Cohen kappa) between computer scoring and experts scoring for linguistically simple concepts (e.g., variation, competition, and limited resources) were over 0.8. These findings reveal that the English-based automated computer scoring models and machine translation can be a promising method in scoring Korean college students' written responses on natural selection concept items.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.17 no.12
• /
• pp.62-70
• /
• 2016

This study investigated the development of a Korean version of the Ayurvedic constitution questionnaire and sought to verify its validity and reliability. Each study subject completed a self-administered questionnaire consisting of 63 questions. The Ayurvedic constitutions were placed into 7 categories. The results from 271 subjects revealed that the internal consistency reliability (Cronbach's ${\alpha}$) in the 41 item biometric signature part of the questionnaire was 0.757. The Cronbach's ${\alpha}$ for the 22 item psychological part was 0.616, whereas the Cronbach's ${\alpha}$ for the entire 63 items was 0.840. Taken together, the results indicate that the Korean version of the Ayurvedic questionnaire was valid. Within the questionnaire, the fourth item about body and the ninth item about psychological showed item-total correlations with negative total values, thereby indicating inconsistent (less reliable) responses. The remaining 61 items had a 0.864 degree of reliability. The results for the pure Vata Pitta and Kapha body types showed a high level of internal consistency reliability, presumably because those participants were of a pure constitution type. The Kappa factor for inter-item coincidence between the judgment of Ayurvedic constitution experts and the judgment derived from the written test scores was 0.619, thereby indicating questionnaire validity. The results of this study may be useful in further development of a Korean version of the Ayurveda constitution questionnaire.

• Language and Information
• /
• v.7 no.2
• /
• pp.81-101
• /
• 2003

This paper introduces a computerized version of the Korean Standard Pronunciation Rules that can be used in speech engineering systems such as Korean speech synthesis and recognition systems. For this purpose, we build Petri net models for each item of the Standard Pronunciation Rules, and then integrate them into the sound conversion table. The reversion of the Korean Standard Pronunciation Rules regulates the way of matching sounds into grammatically correct written characters. This paper presents not only the sound conversion table but also the character conversion table obtained by reversely converting the sound conversion table. Malting use of these tables, we have implemented a Korean character into a sound system and a Korean sound into the character conversion system, and tested them with various data sets reflecting all the items of the Standard Pronunciation Rules to verify the soundness and completeness of our tables. The test results show that the tables improve the process speed in addition to the soundness and completeness.