• The Journal of Korean Association of Computer Education
• /
• v.9 no.6
• /
• pp.11-18
• /
• 2006

The purpose of this paper is to draw problems from analyzing "General Computer" questions of Career Searching Section in the College Scholastic Ability Test in 2005 and 2006 and to offer some suggestions about them. For the qualitative research, this paper analyzed content validity. For the quantitative research, this paper analyzed item difficulty and item discrimination by using Bayesian 1.0 based on 2-parameter item response model and this paper analyzed item reliability and distracters by using Testan 1.0. By analyzing "General Computer" questions, this paper would like to improve the quality of items and estimate item difficulty. Therefore, "General Computer" questions could be suggested as materials for developing reliable and discriminative questions.

• The Journal of the Korea Contents Association
• /
• v.17 no.4
• /
• pp.520-531
• /
• 2017

The purpose of this study was to test the validity and reliability of the Korean version of the Tuberculosis Interview Instrument (K-TII). The instrument was first translated into Korean, back-translated to English, and reviewed. After the translation process, the instrument was revised from 52 items to 37 items by researchers and an expert according to the systematic review. In addition, these items were reduced to 32 items after the content validity test was done by 9 experts. As a result of pilot study conducted in 20 early childhood teachers, 32 items were selected for the preliminary instrument. Data collected from 289 early childhood teachers were used to test the validity and reliability of the preliminary instrument. The result of factor analysis showed that the instrument categorized into 7 factors explaining 71% of the total variance and 27 items were retained for the final instrument. The result of Cronbach's ${\alpha}$ coefficient was .88. In conclusion, the K-TII may be a suitable instrument for assessing tuberculosis prevention behaviors in early childhood teachers in Korea.

• 한국체육학회지인문사회과학편
• /
• v.58 no.1
• /
• pp.295-308
• /
• 2019

The purpose of the present study is to apply a health belief model to the serious perception of an increase in youth obesity, and to develop and validate a measurement tool for youth obesity prevention among this group who are experiencing increasing rates of obesity. The specific goals of this study are to 1) apply a health belief model to develop a measurement tool for obesity prevention among youth who are seeing rising rates of obesity, and 2) provide an integrated validation procedure and foundation for developing this measurement tool. A total of 1801 high school students[sample1: 902(male:464,female:438); sample2: 899(male:464,female:438)] were recruited and collected data from 12 high school in Seoul and Kyonggi area. For this study the analytic framework of unified validity was developed which can comprehensively reflect unified validity be Messick(1995), framework for conducting a strong program of construct validation by Benson(1998), the unified validity implementation method of Rasch model suggested by Wolfe and Smith(2007a, 2007b). Furthermore, after dividing the developed analytic framework into each stage(the substantive domain), the evidence of validity of Youth Obesity Prevention Scale(YOPS) applying Health Belief Model was systematically suggested. The YOPS suggested the evidence about the substantive domain of unified validity. The developed YOPS was consist of Susceptibility, Severity, Benefits, Barriers and Cues to Action. After 3 stage in substantive domain, the components of YOPS(5factors and 28items) satisfied the unidimensionality, and the 5 point Likert scale had the significant discrimination of the respondents' response.

• Education of Primary School Mathematics
• /
• v.17 no.2
• /
• pp.159-171
• /
• 2014

Spatial ability has been valued as one component of intelligence and as an talented domain. And it is associated with the achievements in science, technology, engineering, and mathematics (STEM) disciplines. So, the instrument for measuring spatial ability is very important. The purpose of this study is to develop Spatial Visualization Tests for Elementary School Children and examine internal consistency reliability evidence and construct validity evidence on confirmatory factor analysis of that instrument. For this purpose, 'The Spatial Visualization Tests for Elementary School Children was administered to 1482 Korean elementary school students. As a result, this study show that internal consistency reliability evidence using Cronbach' alpha showed item consistency and construct validity evidence from confirmatory factor analysis in the Spatial Visualization Tests for Elementary School Children. And also, this study show ed that item difficulty and item discrimination of the Spatial Visualization Tests for Elementary School Children were within an acceptable range.

• Journal of the Korea Society of Computer and Information
• /
• v.28 no.9
• /
• pp.177-188
• /
• 2023

The purpose of this study is to develop and validate a scale for measuring digital literacy by identifying the factors consisting of digital literacy and extracting items for each factor. Preliminary items for the Delphi study were developed through the analysis of previous literature and the deliberation of the research team. As a result of two rounds of the expert Delphi study, 65 items were selected for the main survey. The validation of the items was carried out in the process of exploratory and confirmatory factor analyses, reliability test, and criterion validity test using the data collected in the main survey. As a result, a 4-factor structure composed of 31 questions(factor 1: digital technology & data literacy- 9 questions, factor 2: digital content & media literacy- 8 questions, factor 3: digital communication & community literacy- 9 questions, factor 4: digital wellness literacy - 5 questions) was confirmed. Also, the goodness of fit indices of the model were found to be good and the result of reliability test revealed the scale had a very appropriate level of Cronbach's alpha(α=.956). In addition, a statistically significantly positive correlations(p<.001) were found between digital literacy and internet self-efficacy and between digital literacy and self-directed learning ability, which were predicted in the existing evidence, therefore the criterion validity of the developed scale was secured. Finally, practical and academic implications of the study are provided and future study and limitations of the study are discussed.

• Journal of Science Education
• /
• v.40 no.3
• /
• pp.189-202
• /
• 2016

This study aimed to investigate pre-service science teachers' perceptions of significance and usefulness of evolution and genetics. To this end, 82 pre-service biology teachers and 159 non-biology science teachers answered the items to measure the perceptions of significance and usefulness of evolution and genetics. The validity and reliability were examined using Cronbach alpha, two-dimensional rating scale model Rasch analysis, and factor analysis. The finding illustrated that the test items met the benchmark to be valid and reliable test items. Second, pre-service teachers' perception of significance and usefulness of evolution was independent to that of genetics. The level of pre-service teachers' perception of significance and usefulness of evolution was lower than the level of genetics. Lastly, the levels of pre-service teachers' perceptions of significance and usefulness of evolution and genetics were not significantly different across academic years and majors (biology and non-biology). The findings of this study stressed the importance of teaching significance and usefulness of evolution and genetics in pre-service science teacher education program.

• Journal of The Korean Association For Science Education
• /
• v.34 no.2
• /
• pp.123-134
• /
• 2014

This study aims to develop and validate an instrument to measure students' attitude toward convergence. To do so, we have defined five constructs (i.e. knowledge about convergence, personal relevance, social relevance, interest and self-efficacy) of 'attitude toward convergence' based on literature review, developed items, and collected data from 233 11th grade science track students. The validity of these items have been evaluated by Messick's framework (1995) (i.e. content, substantive, structural aspects of validity), experts' review, Rasch analysis, and confirmatory factor analysis using structural equation modeling. Our results have confirmed the five constructs and 23 selected items have met the benchmark of item validity. Moreover, the theoretical model illustrating that the high level of attitude toward convergence increases the level of science motivation has also been supported by the data. The items developed in this study will be used to measure students' attitude toward convergence and to estimate the effect of learning program for convergence science.

• (The) Korean Journal of Educational Psychology
• /
• v.22 no.2
• /
• pp.367-384
• /
• 2008

The purpose of this study was to develop picture testing instrument for measuring children's causal reasoning ability on events that can occur in daily life. The measurement instrument contains three domain of human development; haman behavior domain, human psychology domain, and natural/physical domain. Through this study, researchers designed a concept model based on theoretical framework and prior studies and investigated the reliability and validity of the measurement instrument which was developed in accordance with the concept model. For the empirical validation research, a pretest was conducted to 336 elementary school students in grade 2 to 4 in Seoul. Considering reliability and validity of the developed measurement instrument and factor loadings, researchers sorted out 18 questions. And then 18 question test and KICE Critical Thinking Ability Test was conducted to 509 elementary school students in grade 1 to 4 in Seoul. According to the result of the tests, the researchers sorted out final 12 questions. The Cronbach's alpha, reliability of the children's causal reasoning ability test consisted of the final 12 question, was significant as .72. Also, the result of exploratory factor analysis showed that factors of this test were haman behavior domain, human psychology domain, and natural/physical domain. Moreover, the correlation between the KEDI Reasoning Ability Test(2003) scores and the scores of the test developed in the current study was significant as .55. Finally, the result of the analysis about children's grade differences, the development by discrepancy of age was significant in total points and that of each domain. The children's causal reasoning ability test developed by this study can be useful not only for the evaluation of children's thinking ability but also for screening of the handicapped children in thinking ability development.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.21 no.4
• /
• pp.236-247
• /
• 2020

This study was conducted with the aim of developing inspection tools to select and measure human resource figures and appropriate core competency of the educational goals pursued by S universities. Therefore, key competency factors were defined consistent with concept of talented figures and educational objectives of S universities, inspection tools were developed to measure core competences, and directions are presented for future education policies and curriculum compilation and securing data for rational operation. Based on key competency indicators, questions were developed in a self-reporting form that measures the consent level of the respondents by comprising seven areas of competence, 16 small areas (sub-capacity), and 46 questions. The main Test conducted an analysis of the questionnaires based on the survey results of 2,486 people to ensure the validity of the inspection by conducting a positive factor analysis and reliability analysis. The core competency diagnostic tool of S university is meaningful in this study which verifies the effectiveness of the curriculum and programs conducted at S university and as the first step for the rational operation of the core competency certification system to improve the competency appropriate for students.

• Journal of The Korean Association For Science Education
• /
• v.38 no.4
• /
• pp.495-504
• /
• 2018

This study was conducted to develop items to measure scientific core competency based on statements of scientific core competencies presented in the 2015 revised national science curriculum and to identify the validity and reliability of the newly developed items. Based on the explanations of scientific reasoning, scientific inquiry ability, scientific problem-solving ability, scientific communication ability, participation/lifelong learning in science presented in the 2015 revised national science curriculum, 25 items were developed by five science education experts. To explore the validity and reliability of the developed items, data were collected from 11,348 students in elementary, middle, and high schools nationwide. The content validity, substantive validity, the internal structure validity, and generalization validity proposed by Messick (1995) were examined by various statistical tests. The results of the MNSQ analysis showed that there were no nonconformity in the 25 items. The confirmatory factor analysis using the structural equation modeling revealed that the five-factor model was a suitable model. The differential item functioning analyses by gender and school level revealed that the nonconformity DIF value was found in only two out of 175 cases. The results of the multivariate analysis of variance by gender and school level showed significant differences of test scores between schools and genders, and the interaction effect was also significant. The assessment items of science core competency based on the 2015 revised national science curriculum are valid from a psychometric point of view and can be used in the science education field.