• Journal of Gifted/Talented Education
• /
• v.17 no.1
• /
• pp.1-26
• /
• 2007

The purpose of this study was to develop a math test for identification of the mathematically gifted on the basis of their math creative problem solving ability and to evaluate the goodness of the test. Especially, testing reliability and validity of scoring method on the basis of fluency only for evaluation of math creative problem solving ability was one of the main purposes. Ten closed math problems and 5 open math problems were developed requiring math thinking abilities such as intuitive insight, organization of information, inductive and deductive reasoning, generalization and application, and reflective thinking. The 10 closed math test items of Type I and the 5 open math test items of Type II were administered to 1,032 Grade 7 students who were recommended by their teachers as candidates for gifted education programs. Students' responses were scored by math teachers. Their responses were analyzed by BIGSTEPS and 1 parameter model of item analyses technique. The item analyses revealed that the problems were good in reliability, validity, item difficulty and item discriminating power even when creativity was scored based on the single criteria of fluency. This also confirmed that the open problems which are less-defined, less-structured and non-entrenched were good in measuring math creative problem solving ability of the candidates for math gifted education programs. In addition, it was found that the math creative problem solving tests discriminated applicants for the two different gifted educational institutions.

• The Journal of Korean Association of Computer Education
• /
• v.9 no.6
• /
• pp.11-18
• /
• 2006

The purpose of this paper is to draw problems from analyzing "General Computer" questions of Career Searching Section in the College Scholastic Ability Test in 2005 and 2006 and to offer some suggestions about them. For the qualitative research, this paper analyzed content validity. For the quantitative research, this paper analyzed item difficulty and item discrimination by using Bayesian 1.0 based on 2-parameter item response model and this paper analyzed item reliability and distracters by using Testan 1.0. By analyzing "General Computer" questions, this paper would like to improve the quality of items and estimate item difficulty. Therefore, "General Computer" questions could be suggested as materials for developing reliable and discriminative questions.

• Journal of The Korean Association For Science Education
• /
• v.40 no.3
• /
• pp.253-269
• /
• 2020

This study aims to develop items to diagnose pre-service physics teachers' understanding of the conceptual knowledge of modern physics, based on the achievement criteria presented in the 2015 revised national science curriculum, and to identify the validity and reliability of the newly developed items. Data were collected from 467 pre-service physics teachers in the Physical Education Department or Science Education Department (Physics Education Major) of 15 universities across the nation. In this study the content validity, substantive validity, the internal structure validity, generalization validity, and the external validity proposed by Messick (1995) were examined by various statistical tests. The results of the MNSQ analysis showed that there was no nonconformity in the 23 items. The internal structure validity was confirmed by the standardized residual variance analysis, which shows that the 22 items was unidimensional. The generalization validity was confirmed by differential item functioning (DIF) analysis about groups lectured or not modern physics/quantum mechanics. In addition, item analysis and test analysis based on classical test theory were performed. The mean item difficulty is 0.66, mean item discrimination is 0.47 and mean point biserial coefficient obtained was 0.41. These results for item parameters satisfied the criteria respectively. The reliability of the internal consistency of the KR-20 is 0.77 and the Ferguson's delta obtained was δ = 0.972. By Rasch model analysis, the item difficulty (item measures) was discussed.

• The Korean Journal of Elementary Counseling
• /
• v.9 no.2
• /
• pp.143-162
• /
• 2010

The purpose of this study is to construct Parent Attachment Scale for Children. Adapting the item consisting method used in Experiences in Close Relationships-Revised(ECR-R), Parent Attachment Scale for Children was constructed to measure child's attachment style with their parent, reliably and validly. Also, reliability and item trait informations based on item response theory were reviewed. First preliminary items were derived from the original items of ECR-R and existing Attachment Inventories. These items were modified and complemented to be easier and keep the original meaning of each item. Second preliminary items were administrated to 4~6th grades students(N=576). Finally, Parent Attachment Scale for Children were consisted with 30 items based on two-parameter graded response model. Internal consistency ranges of the scales of Parent Attachment Scale for Children are as follows : Avoidance scale is .94~.96; Anxiety scale is .85~.88. Test-retest reliability ranges are as follows; Avoidance scale is .71~.80; Anxiety scale is .53~.68. Item discrimination and item information value were within an appropriated range. Hierarchical cluster analysis with Ward's Method revealed four types of attachment style : Secure, Dismissing, Preoccupied, Fearful. Other implications and limitations of this study were discussed.

• The Journal of the Korea Contents Association
• /
• v.22 no.9
• /
• pp.439-450
• /
• 2022

Purpose: This study was to develop the Preventive Self-Management Knowledge related to Premature Labor (PSMK-PL) scale for women of childbearing age. Methods: Preliminary items were developed based on the literature and interview results of those who experienced premature labor. The online survey was conducted and the data of 250 women were analyzed using the DIMTEST and DETECT programs by applying the item response theory. Internal consistency reliability was analyzed with Cronbach's alpha (95% CI). Results: Among the 30 preliminary items, six items were deleted. The difficulty and discrimination of the 24 final three-dimensional scales were all acceptable, respectively. Cronbach's alpha (95% CI) was .89 (.87~.91). Conclusion: The PSMK-PL scale generally consisted of items with validity, and the reliability was acceptable.

• 한국체육학회지인문사회과학편
• /
• v.58 no.1
• /
• pp.295-308
• /
• 2019

The purpose of the present study is to apply a health belief model to the serious perception of an increase in youth obesity, and to develop and validate a measurement tool for youth obesity prevention among this group who are experiencing increasing rates of obesity. The specific goals of this study are to 1) apply a health belief model to develop a measurement tool for obesity prevention among youth who are seeing rising rates of obesity, and 2) provide an integrated validation procedure and foundation for developing this measurement tool. A total of 1801 high school students[sample1: 902(male:464,female:438); sample2: 899(male:464,female:438)] were recruited and collected data from 12 high school in Seoul and Kyonggi area. For this study the analytic framework of unified validity was developed which can comprehensively reflect unified validity be Messick(1995), framework for conducting a strong program of construct validation by Benson(1998), the unified validity implementation method of Rasch model suggested by Wolfe and Smith(2007a, 2007b). Furthermore, after dividing the developed analytic framework into each stage(the substantive domain), the evidence of validity of Youth Obesity Prevention Scale(YOPS) applying Health Belief Model was systematically suggested. The YOPS suggested the evidence about the substantive domain of unified validity. The developed YOPS was consist of Susceptibility, Severity, Benefits, Barriers and Cues to Action. After 3 stage in substantive domain, the components of YOPS(5factors and 28items) satisfied the unidimensionality, and the 5 point Likert scale had the significant discrimination of the respondents' response.

• Journal of the Korea Society of Computer and Information
• /
• v.28 no.3
• /
• pp.177-187
• /
• 2023

This study aims to validate a tool evaluating MOOCs for higher education from the perspective of education service. Based on the results of related researches, a potential model for evaluating MOOCs (4 factors and 8 sub-factors) was made. An evaluation tool consisting of 18 survey items was delivered to 138 college students. After data cleaning, 136 surveys were used for exploratory factor analysis (principal component analysis. varimax rotation) and reliability analysis that confirmed the fitness of the potential model. Four exploratory constructs and seven sub-factors were extracted: Factor I was labeled as 'Systemic Learning Experience,' Factor II, 'Value Experience,' Factor III, 'Co-creation of Value Experience,' and Factor IV, 'High Order Learning Experience.' Reliability estimates using Cronbach's alpha indicated that the evaluation tool had good internal consistency. In conclusion, the evaluation tool for MOOCs in higher education was proven to be valid and reliable.

• Korean Journal of School Psychology
• /
• v.9 no.3
• /
• pp.485-503
• /
• 2012

Academic engagement has been known as a strong predictor of students' cognitive and affective outcomes in an educational context. Despite increasing interest and theoretical usefulness of this construct, a few researchers seem to be interested in the validation of instruments to measure academic engagement for Korean students. Thus, this study would like to introduce one of academic scales widely used, UWES-S(Utrecht Work Engagement Scale-Student) (Schaufeli et al., 2002a: 2002b) and to validate the UWES-S for Korean college students. To validate the Korean version of the UWES-S, 651 college students (285 for Field Trial, 366 for Main Study) were used. The procedure is as follows. First, we used an integrated adaptation procedure to produce a Korean version of the UWES-S. Second, EFA(exploratory factor analyses) was applied to explore the factor structure of the UWES-S on the field trial data. Third, the psychometric properties of the UWES-S items were examined by graded response model(GRM). Also CFA(confirmatory factor analysis) was used to examine its internal construct validity for the data from the main study. Finally, the external validity of the UWES-S was scrutinized with the related variables such as academic motivation and satisfaction. As a result, the Korean version of the UWES-S with 13 items was accepted that the four items were excluded from its original version. Second, the internal validity was supported that the 3 factor CFA model(vigor, dedication, absorption) fit the data well. Third, we supported the partial mediation model that academic engagement played as a mediating variable between academic motivation(internal/external) and academic satisfaction. Finally, the differences between a validation of UWES-S for Korean college and high school students, the necessity of construct equivalence testing, and direction for future research of scale validating were discussed.

• Korean Journal of Culture and Social Issue
• /
• v.28 no.4
• /
• pp.627-659
• /
• 2022

This study aimed to translate and validate the Positive and Negative Ex-Relationship Thoughts (PANERT), a scale measuring the positive and negative valence of thoughts about past relationships in early adulthood. For this purpose, PANERT was translated into Korean and the study surveyed on 337 single male and female adults in their 20. Then, the gender difference between major variables was analyzed. After going through item analysis, all twelve original items were used to construct the Korean version of PANERT. The confirmatory factor analysis(CFA) supported the two factors structure of the Korean version of PANERT: positive vs, negative thought content valence. Also, the reliability coefficients of each two factors were all satisfactory. As a result of a correlation analysis, the criterion-related validity of the two sub-factors was good with other related scales(Intrusive rumination scale of K-ERRI, K-DASS-21-D, and K-PANAS-Revised) except for changes of self-perception. Finally, the research model was built to examine the mediating effect of two affect responses(positive and negative) in the relationship between two thought content valences and depression. In this process, the convergence and discriminant validity of the Korean version of PANERT were confirmed and the indirect effect was also confirmed in the structural equation model. In conclusion, the Korean version of PANERT consists of two factors and twelve items in total. Also, it is a reliable and valid tool for measuring the thought content valences in the romantic relationship breakup experience of early adults.

• Journal of The Korean Association For Science Education
• /
• v.19 no.4
• /
• pp.516-527
• /
• 1999

The purpose of this study was to find out the responses of students confronted with discrepant situation about inertia concept. We had developed two discrepant situation patterns according to conceptual change model(Kwon, 1989). And we examined the students' responses to the discrepant situations of the 3 inertia problems by interview method. In the result of this study. many students in discrepant situation 1 failed to explain the situation Some students gave up their preconception and showed new conception that was different from preconception. But most of their new conceptions were not scientific conception. In discrepant situation 2. the major characteristics of students responses were the assimilation strategies. Many students modified their preconception in some part but didn't change it. After discrepant situation. students' conceptions were changed more diverse conceptions than preconceptions.