• Journal of The Korean Association For Science Education
• /
• v.40 no.3
• /
• pp.253-269
• /
• 2020

This study aims to develop items to diagnose pre-service physics teachers' understanding of the conceptual knowledge of modern physics, based on the achievement criteria presented in the 2015 revised national science curriculum, and to identify the validity and reliability of the newly developed items. Data were collected from 467 pre-service physics teachers in the Physical Education Department or Science Education Department (Physics Education Major) of 15 universities across the nation. In this study the content validity, substantive validity, the internal structure validity, generalization validity, and the external validity proposed by Messick (1995) were examined by various statistical tests. The results of the MNSQ analysis showed that there was no nonconformity in the 23 items. The internal structure validity was confirmed by the standardized residual variance analysis, which shows that the 22 items was unidimensional. The generalization validity was confirmed by differential item functioning (DIF) analysis about groups lectured or not modern physics/quantum mechanics. In addition, item analysis and test analysis based on classical test theory were performed. The mean item difficulty is 0.66, mean item discrimination is 0.47 and mean point biserial coefficient obtained was 0.41. These results for item parameters satisfied the criteria respectively. The reliability of the internal consistency of the KR-20 is 0.77 and the Ferguson's delta obtained was δ = 0.972. By Rasch model analysis, the item difficulty (item measures) was discussed.

• 한국지구과학회:학술대회논문집
• /
• 2010.04a
• /
• pp.17-17
• /
• 2010

본 연구는 학생들의 과학 경험의 정도를 정량화 하는데 있어 통일된 측정 도구를 제시하는 것이다. 측정 도구를 구성하는 요인들은 선행연구를 통해 학교 안 과학 경험은 일반 활동 경험, 과학 탐구 경험, 실험 기구 경험으로 세분화 되며 학교 밖 과학 경험은 일반 활동 경험, 취미 활동 경험, 현장 견학 경험 6개의 영역으로 구분을 할 수 있었다. 각각의 요인을 구성하는 질문은 NAEP(1987)에서 사용된 과학 경험 검사 도구와 신영준(2000)의 과학 경험 검사 도구의 문항 중 일부를 발췌하고 더불어 과학 경험에 대한 개방적인 설문지를 통하여 1차 검사를 실시하여 얻은 답변 중 빈도가 많은 답변과 중등 교과서의 탐색적 분석을 통해 영역별 10문항씩 6개 영역의 문항을 선정하였다. 사전 설문조사와 선행 연구를 바탕으로 개발한 검사지를 고등학교 1학년 학생 413명을 대상으로 2차 검사를 실시하였다. 개발한 측정 도구의 타당도는 내용타당도와 구인타당도로 검사하였다. 내용타당도는 2명의 현직 중등교사와 2명의 과학교육전문가가 각 문항이 측정하고자 하는 목적에 부합하는지 심사하였고, 구인타당도는 요인분석을 통해 검사하였다. 신뢰도는 Cronbach $\alpha$를 통하여 문항을 분석하였다. 6개의 영역의 요인에 대하여 타당도와 신뢰도 분석 결과 6개 영역으로 구성된 60문항의 측정 도구는 학생들의 과학 경험을 측정하는 도구로서 적절하다는 결론을 내렸다.

• Journal of Gifted/Talented Education
• /
• v.23 no.1
• /
• pp.109-128
• /
• 2013

The purpose of this study is to verify the validity of KEDI Leadership Inventory (Simplified) for elementary and secondary school student. The existing Leadership Inventory is outdated by excessive or insufficient items. To verify reliability and validity of this KEDI Leadership Inventory (Simplified), we analyze internal consistency of scale for reliability and construct validity, convergent and discriminative validity. criterion-related validity. The internal consistency of the scale is relatively high from .610 to .838 for elementary school student, and from .734 to .936 for secondary school student To verify construct validity, we analyze a confirmatory factor analysis using AMOS whether revealed that the structural equation model including 5 construct validity in KEDI Leadership Inventory(Simplified) showed fit index at a satisfactory level as follows. The major fit indexes are showed as follows; CFI (.954), TLI (.943), RMSEA (.068) in the scale for elementary school student, CFI (.935), TLI (.915), RMSEA (.070) in the scale for secondary school student. Futhermore, to secure criterion-related validity, this KEDI Leadership Inventory(Simplified) showed significant correlations with student's leader position in their classroom for r=.358 (p<.01), and gifted education students are significantly higher .50 than no gifted student. This KEDI Leadership Inventory (Sim'plified) is made up of parsimonious 20 items, so that teachers can be convenient to identify intra-inter personal leadership characteristics of a student and recommend the student for gifted education institution.

• Journal of the Korean School Mathematics Society
• /
• v.9 no.3
• /
• pp.405-424
• /
• 2006

The purpose of this study was to develop the instruments which can measure behavior characteristics as a component of Mathematically Giftedness with in middle school period. This study prescribed the variable factors of measurement after classify the characteristics of Mathematically Giftedness through literature studies. And it produced instruments those are finally composed of 51 items through the preliminary test. The participants for the study were 424 Korean middle school students. Statistical analyses were carried out to verify the validities and reliability. Reliability(Cronbach $\alpha$) was in behavior characteristics, .95. Content validity was found to be satisfactory by internal validity evaluation on the test items. Internal validity were analyzed by BIGSTEPTS based on Rasch's 1-parameter item-response model. Construct validity was also found to be satisfactory through factor analysis which showed the four factors which the identification instruments were intended to measure such as, General mathematical mental ability, Mathematical Ability, Processing and Obtaining mathematical information Anility and Mathematical Disposition Ability. In conclusion, the instruments about behavior characteristics of Mathematically Giftedness during middle school period developed by this study are highly reliable on its reliability and validity.

• Korean Journal of School Psychology
• /
• v.9 no.3
• /
• pp.485-503
• /
• 2012

Academic engagement has been known as a strong predictor of students' cognitive and affective outcomes in an educational context. Despite increasing interest and theoretical usefulness of this construct, a few researchers seem to be interested in the validation of instruments to measure academic engagement for Korean students. Thus, this study would like to introduce one of academic scales widely used, UWES-S(Utrecht Work Engagement Scale-Student) (Schaufeli et al., 2002a: 2002b) and to validate the UWES-S for Korean college students. To validate the Korean version of the UWES-S, 651 college students (285 for Field Trial, 366 for Main Study) were used. The procedure is as follows. First, we used an integrated adaptation procedure to produce a Korean version of the UWES-S. Second, EFA(exploratory factor analyses) was applied to explore the factor structure of the UWES-S on the field trial data. Third, the psychometric properties of the UWES-S items were examined by graded response model(GRM). Also CFA(confirmatory factor analysis) was used to examine its internal construct validity for the data from the main study. Finally, the external validity of the UWES-S was scrutinized with the related variables such as academic motivation and satisfaction. As a result, the Korean version of the UWES-S with 13 items was accepted that the four items were excluded from its original version. Second, the internal validity was supported that the 3 factor CFA model(vigor, dedication, absorption) fit the data well. Third, we supported the partial mediation model that academic engagement played as a mediating variable between academic motivation(internal/external) and academic satisfaction. Finally, the differences between a validation of UWES-S for Korean college and high school students, the necessity of construct equivalence testing, and direction for future research of scale validating were discussed.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.18 no.10
• /
• pp.611-623
• /
• 2017

The purpose of this study is to develop and validate the Korean Job Crafting Scale. First, previous studies on the concept and measurement of job crafting were reviewed, and items were developed based on this review. The content validity of the scale was examined using a focus group interview consisting of 10 HRM professionals. Following modification of the items, the measurements were administered to 305 employees from 8 Korean firms, and exploratory factor analysis was conducted in order to examine the factorial validity of the scale. Subsequently, confirmatory factor analysis was implemented concerning data collected from 295 employees who work in 7 Korean firms. Results indicated that the measurement model sufficiently explained the data at an appropriate level, and the subscales featured convergent and discriminant validity. If the scale developed in this study is validated in further studies, it can be employed to conduct research regarding job crafting in Korean organizations.

• Korean Journal of Child Studies
• /
• v.31 no.3
• /
• pp.235-254
• /
• 2010

The purpose of this study was to examine the feasibility and validity of the Application of Cognitive Function Scale as developed by Lidz and Jepsen (1997). Data were collected from 4 to 5-years-old children. The analysis for item adequacy indicated that the passing rate increases according to age. Futhermore the analysis for test adequacy indicated that internal consistency reliability was .85 in the pre-test and .80 of post-test in terms of the cognitive function scale, and .90 of pre-test and .93 in the post-test in relation to the behavior observation scale. In conclusion, our analysis of the ACFS shows sufficiently high scores in terms of both validity and reliability, so as to indicate that this test is an appropriate way to measure the cognitive function and non-intellective function of young Korean children.

• Journal of the Korea Convergence Society
• /
• v.11 no.2
• /
• pp.331-339
• /
• 2020

The purpose of this study was to develop and validate future teacher competencies diagnosis tools required for pre-service teachers. In this study, the hypothesis model was established by hierarchizing basic competency and job competency in three dimensions such as knowledge, practice, and personality as teachers' competencies required in future society. Based on this hypothesis model, 54 preliminary questions were developed, and competencies diagnosis test was conducted for 237 pre-service teachers in J area, Korea. The results of this study are as follows: First, as a result of this study, a total of 53 questions were extracted, including 18 questions with 6 factors in the knowledge dimension, 17 questions with 6 factors in the practice dimension, and 18 questions with 6 factors in the personality dimension. Second, the goodness-of-fit of future teacher competencies diagnosis model required was verified, and convergence and discriminant validity were verified. The results of this study were discussed. Finally, the implications and suggestions for further research were presented.

• Korean Journal of Culture and Social Issue
• /
• v.28 no.2
• /
• pp.187-217
• /
• 2022

The aim of this study is to examine the psychometric properties of the Korean version of the Post-traumatic Stress Disorder Checklist for DSM-5(PCL-5). For this purpose, online surveys were conducted for two times with a one year interval using the data from 1,077 Korean adults at time 1, and 563 Korean adults at time 2. First, from the result of the confirmatory factor analysis, comparing the model fit of the 1, 4, 6, and 7-factor model, the 4, 6, and 7-factor model showed a acceptable fit, and the best fit was seen in the order of the 7, 6, 4-factor model. Second, the internal consistency, omega coefficient, construct validity, average variance extracted, and test-retest reliability results were all satisfactory.. Third, a correlation analysis with the K-PC-PTSD-5 and the sub-factors of BSI-18 was conducted to check the validity of the Korean Version of PCL-5. As a result, a positive correlation was seen with both K-PC-PTSD-5 and BSI-18. Fourth, a hierarchical multiple regression was performed to examine whether the Korean Version of PCL-5 predicts future PTSD, depression, anxiety, and somatization. As a result, the Korean Version of PCL-5 measured at time 1 significantly predicted PTSD, depression, anxiety, and somatization symptoms at time 2. Fifth, by analyzing the ROC curve, the discriminant power of PCL-5 for screening PTSD symptom groups was confirmed, and the best cut-off score was suggested. As a result of the longitudinal validation of Korean version of PCL-5, it was found that this scale is a reliable and valid measure for Korean adults. By looking into the predictive validity of the scale, it was found that the Korean version of PCL-5 can predict not only PTSD symptoms but also PTSD-related symptoms such as depression, anxiety, and somatization. Also, this study differs from previous validation studies measuring PTSD symptoms in that it suggested a cut-off score to help differentiate PTSD symptom groups.

• Korean Journal of Child Studies
• /
• v.30 no.1
• /
• pp.59-75
• /
• 2009

The purpose of this study was to verify the validity and reliability for the Test of Oral Reading and Comprehension Skill (Gardner, 2000) for Korean lower level elementary school children. Subjects were 122 first to third grade students, tested individually. The vocabulary and comprehension sub-tests of K-WISC III and the reading comprehension test of Basic Academic Skills Assessment (Kim, 2000) were used to verify concurrent validity. Internal reliability was determined by internal consistency coefficients. Results verified concurrent validity. Test scores differed significantly by grade level. Test reliability was also confirmed. In conclusion, the Oral Reading and Comprehension Skill Test (Gardner, 2000) is reliable and valid for examination of reading comprehension skills for Korean lower level elementary school children.