• The Korea Journal of Herbology
• /
• v.37 no.2
• /
• pp.13-21
• /
• 2022

Objectives : The evaluation of academic achievement is pivotal for establishing accurate direction and adequate level of medical education. The purpose of this study was to firstly establish innovative item analysis technique of Item Response Theory (IRT) for analyzing multiple-choice test of herbology in the traditional Korean medicine education which has not been available for the difficulty of test theory and statistical calculation. Methods : The answers of 390 students (2012-2018) to the 14 item herbology test in college of Korean medicine were used for the item analysis. As for the multidimensional analysis of item characteristics, difficulty, discrimination, and guessing parameters along with item-total correlation and percentage of correct answer were calculated using Classical Test Theory (CTT) and IRT. Results : The validity parameters of strong and weak items were illustrated in multiple perspectives. There were 4 items with six acceptable index scores, and 5 items with only one acceptable index score. The item discrimination of IRT was found to have no significant correlation with difficulty and discrimination indices of CTT emphasizing attention of professionals of medical education as for the test credibility. Conclusion : The critical suggestions for the development, utilization and revision of test items in the e-learning and evidence-based Teaching era were made based on the results of item analysis using IRT. The current study would firstly provide foundation for upgrading the quality of Korean medicine education using test theory.

• Journal of the Korean School Mathematics Society
• /
• v.10 no.1
• /
• pp.113-127
• /
• 2007

This study explored the possibility of building a statistical model predicting difficulty of mathematics test items through the analysis of nation-wide scholastic ability test results for the past 5 years. Multiple linear regression analysis was conducted in predicting difficulty of mathematics test items. We adopted three major areas for independent variables: the content area, the behavior area, and the test item format area, each of which was categorized into more detailed sub-areas. For the dependent variable, the proportion of correct answer was used to represent the item difficulty. Statistically significant independent variables were included in the regression model based on the stepwise selection method. Several important factors affecting difficulty of mathematics test items for each area were identified. R-squares for the final regression model were fairly high, implying that the regression equation can be used to predict difficulty of test items at an acceptable level. Lastly, the regression model was cross-validated using independently collected data. We believe that this study will provide basic but very critical information for predicting the proportion of correct answer by showing the factors that should be considered for developing mathematics test items for the college entrance examination or high school classroom test.

• Journal of Korean Academy of Nursing
• /
• v.39 no.2
• /
• pp.259-269
• /
• 2009

Purpose: The aim of this study was to develop a breast feeding adaptation scale (BFAS) to evaluate adaptation to breastfeeding for breastfeeding mothers and their infants and to test the validity and reliability of the instrument. Methods: The study was conducted as follows: application of the conceptual framework, identification of the content domains, items generation, and test of validity and reliability. In order to test validity and reliability, two panels of experts reviewed items and subcategories of the preliminary questionnaire and then data were collected from 329 mothers who were up to 4 weeks postpartum and breastfeeding. Descriptive statistics, t-test, factor analysis, and Cronbach's alpha were used to analyze the data. Results: The conceptual framework was based on the Roy adaptation model. The content domains were developed via literature review, review of instruments, and data acquired from the interviews of breastfeeding mothers and nurses. A total of 69 items belonging to 8 domains were generated. A reduction to 44 preliminary items was accomplished through content validity analysis. Factor analysis extracted 8 factors with a total of 27 items on a 5-point Likert scale. Content validity, construct validity, criterion validity, and reliability of the BFAS were established. Conclusion: The newly developed BFAS is a reliable and valid instrument with which the adaptation of breastfeeding mothers and their infants to the breastfeeding behavior can be evaluated.

• 대한공업교육학회지
• /
• v.32 no.2
• /
• pp.23-46
• /
• 2007

The purpose of this study was to present improvement directions of college scholastic ability test on industry department. Industry department test were classify and abstracted sampling test on contents and movement domain, analyzed example items of college scholastic ability test on industry department. Research methods used in this study were review of related literature, the item analysis and item pattern analysis between college scholastic ability test on introduction to industry and curriculum, contents of textbook. After finding a problem of developing items, trying to find a solution to the problem and developing an up-to-date method of items was to present improvement. Based on the result of the study, some recommendations for future researches were made as follows: First, a phenomenon of making same contents items over again and no making items not on made the items ever have to cut. Second, Time to read and make sense of items have to reduce because depend on the degree of difficulty related on time to understand of items. Third, the depth of textbook contents has to develop on curriculum this year. Fourth, the succeeding study on linkage between college scholastic ability test and simulation of college scholastic ability test. Fifth, verification validity on contents of new movement domain is developed new and striking test items.

• Research in Community and Public Health Nursing
• /
• v.19 no.2
• /
• pp.247-259
• /
• 2008

Purpose: This study was conducted to develop a teacher-efficacy scale which is adequate for heath education teachers. Method: A preliminary questionnaire was made based on the hypothetical factors. A total of 364 health education teachers answered to the preliminary test, and the potential factors of teacher-efficacy were checked out by exploratory factor analysis (EFA). In the main test 378 health education teachers answered, the factor structure was drawn by EFA, and confirmatory factor analysis (CFA) was conducted to test and the fitness of the factor model. Results: Through the preliminary test, 5 potential factors were found, which were instruction, health-service, administrative task, interpersonal relationship, and community connection. Also, 48 items were reduced to 31 items. Through the main test, from the 34 items were extracted 4 factors with 24 items, And then teacher-efficacy scale was developed, which included the subscales of instruction efficacy, health-service efficacy, task-interpersonal efficacy, and community connection efficacy. Conclusion: Different from that for other subject teachers, the factor structure for health teachers had 4 factors with 24 items. The scale developed in this study is consistent with health teachers' work areas, and for this reason, has significance as a adequate and valid scale to measure teacher-efficacy of health education teachers.

• Journal for History of Mathematics
• /
• v.25 no.2
• /
• pp.97-111
• /
• 2012

This paper aims to identify the area of knowledge required for constructing test items by comparing the consulting contents with the area of MKT(Mathematical Knowledge for Teaching). This paper collects the consulting results by the consulting group of A provincial office of education from 2007 to 2009, and analyzes and categorizes the results. The knowledge for constructing test items are known by the analysis on the consulting contents. Training and consulting for teachers are necessary to enable them to recognize the importance of these categories and improve the quality of test items.

• Journal of Korean Elementary Science Education
• /
• v.18 no.2
• /
• pp.21-33
• /
• 1999

The purpose of this study was to develop an Instrument for the Measurement of Cognitive Conflict Levels of students who confronted with an anomalous situation in science teaming. Anomalous situation is generated when students' prediction is disconsistent with the observed fact. In this study, the researchers identified 4 components of cognitive conflict and developed three items for each component. The items were developed and revised by four pilot tests. In the first pilot test, 55 elementary school students participated in the test In the second pilot test, 88 students of the 5th and 6th grader participated in the test. The instrument of measuring cognitive conflict levels was given to the subjects right after demonstrating anomalous situation. For the demonstration, two different problem situations were developed: one was a pulley problem and the other was electric bulbs in parallel. Answered reasons for each items were analyzed to assess students' understanding on each items. In third pilot test, 125 elementary school students participated in the test. A factor analysis of the responses was carried out and reliability of the test was assessed by calculating internal consistency values. The items were finalized by three pilot tests. After 1 month after the third pilot test, researchers conducted the finalized test items to 323 students of the 5th and 6th grader. The final instrument showed moderate reliability (Cronbach-α 0.82∼0.87) and good content validity(0.93). A factor analysis of the response was carried out. 4 main factors completely coincided with 4 components that we supposed to be the conducts of cognitive conflict. The instrument can provide a means for both teachers and researchers to assess the cognitive conflict of a large number of students within a single class period. The results can be used by teachers to better understand the process of conceptual change of their students and to match instruction and materials accordingly.

• Journal of Korean Academy of Nursing
• /
• v.30 no.5
• /
• pp.1333-1346
• /
• 2000

This study is a methodical research to develop a health behavior assessment scale for patients with rheumatoid arthritis, and to test the validity and reliability of the instrument. The research procedure was as follows; 1) The first step was to develop conceptual framework based on a comprehensive review of the literature, in-depth interviews patients with rheumatoid arthritis. This conceptual framework was organized in eight dimensions; pain management, exercise, rest, diet control, active committment, self-management, positive thinking, interpersonal maintenance. Initially 56 items were selected from 164 statement. 2) These items were reviewed by panel of eight specialists and the Index of Content validity (CVI) was calculated, and forty six items were selected which met more than 70% on the CVI. 3) 174 rheumatoid arthritis pateints were interviewed, and data was gathered from Jan. 25 to Feb. 18, 1999 for test reliabilities and validities of the scale. The item analysis was carried out and 40 items were selected. Factor analysis by varimax rotation was carried out to test construct validity. The internal consistency by chronbach's $\alpha$ was calculated. The findings were as follows; 1) Item analysis and factor analysis were carried out to test the validity of the health behavior assessment scale. The item analysis was based on the corrected item`s to total correlation coefficient (.30 or more), and information about the alpha estimate. However, this was only if this item was deleted from the scale. As a result of the item analysis, forty items were selected. Thirty items were selected by a initial factor analysis by varimax rotation, and ten items were deleted because of factor complexity. In the secondary factor analysis, eight factors were labled as 'positive thinking', 'exercise', 'rest', 'pain management', 'active committment', 'self-management', 'diet control', and 'interpersonal maintenance', each similar with the conceptual framework. 2) Chronbach's $\alpha$ coefficient to test reliability of the scale was. 903 for total the thirty items. The Scale for assessing health behavior developed in this study was identified to be a tool with a high degree of reliability and validity. Therefore this scale can be effectively utilized for assessment in the health behaviors of the patients with rheumatoid arthritis.

• Journal of Oriental Neuropsychiatry
• /
• v.26 no.2
• /
• pp.143-160
• /
• 2015

Objectives: The study purpose was to test the validity and reliability of the core emotional assessment questionnaire based on the seven emotions. Methods: Survey data were from 651 individuals and contained 141 items determined from a previous pilot study. Among the participants, 241 were retested. First, following analysis of the internal consistency reliability of the 141 items, we deleted items with Cronbach-$\alpha$ coefficient below 0.5. We then selected 100 final items after the first factor analysis. Second, the final 100 items were evaluated by internal consistency reliability, test-retest reliability, factor analysis, and correlational analysis. Results: Cronbach-$\alpha$ coefficient for the final 100 items were 0.866~0.956 and the test-retest reliability were above 0.70. The 100 items categorized into 7 factors explained 53.8% of the total variance. Analyzing the correlation of each chiljeong, we had a high positive correlation above 0.70 between sa and bi, bi and u, gong and kyeong. Conclusions: The final 100 items used for the core emotional assessment questionnaire based on the seven emotions showed satisfactory reliability and validity. Thus, it may be an appropriate instrument for measuring Chiljeong in the general population.

• The Journal of Korean Association of Computer Education
• /
• v.10 no.6
• /
• pp.29-38
• /
• 2007

The purpose of this study is developing of Korean scale for measuring elementary school pupil's online game addiction tendency by scientific development process. The pilot test was conducted in three times, and the items analysis, reliability analysis, and factor analysis was conducted at every test, so the inquiries for main survey composed of 30 inquiry items was decided. Some referential variables was included in the inquiries for main survey such as inquiry items for testing the actual using conditions and attitude of online game, the aggressive behavior scale, the impulsive behavior scale, the solitude scale, and the self-control scale. 2,584 fifth and sixth grade students in elementary school participated in main survey. For main survey results, items analysis and reliability analysis was conducted and validity was verified by exploratory factor analysis and correlation analysis. Finally, the final inquiry items composed of 7 factors, 30 items and the grouping criterion were developed through the standardization process.