• Journal of The Korean Association For Science Education
• /
• v.40 no.3
• /
• pp.253-269
• /
• 2020

This study aims to develop items to diagnose pre-service physics teachers' understanding of the conceptual knowledge of modern physics, based on the achievement criteria presented in the 2015 revised national science curriculum, and to identify the validity and reliability of the newly developed items. Data were collected from 467 pre-service physics teachers in the Physical Education Department or Science Education Department (Physics Education Major) of 15 universities across the nation. In this study the content validity, substantive validity, the internal structure validity, generalization validity, and the external validity proposed by Messick (1995) were examined by various statistical tests. The results of the MNSQ analysis showed that there was no nonconformity in the 23 items. The internal structure validity was confirmed by the standardized residual variance analysis, which shows that the 22 items was unidimensional. The generalization validity was confirmed by differential item functioning (DIF) analysis about groups lectured or not modern physics/quantum mechanics. In addition, item analysis and test analysis based on classical test theory were performed. The mean item difficulty is 0.66, mean item discrimination is 0.47 and mean point biserial coefficient obtained was 0.41. These results for item parameters satisfied the criteria respectively. The reliability of the internal consistency of the KR-20 is 0.77 and the Ferguson's delta obtained was δ = 0.972. By Rasch model analysis, the item difficulty (item measures) was discussed.

• Communications of Mathematical Education
• /
• v.13 no.2
• /
• pp.641-653
• /
• 2002

수학 교육평가에서 고사 타당도의 측정은 매우 중요하다. 그것은 평가자가 목적하는 바의 준거에 따라 수험자들의 문제해결력 변별을 위한 고사들 간의 타당도 크기 측정과 또는 고사 문항의 선정, 배치를 통하여 한 고사의 타당도를 높이기 위한 문항별 타당도 계수를 측정 계산하는 것이다. 이 연구에서는 이 두 가지 고사 타당도의 크기 측정법을 이용하여 수학교육 평가 현장에서 직접적으로 적용할 수 있는 고사 타당도의 제고에 유효한 연구 결과를 제시한다.

• Journal of the Korean Data and Information Science Society
• /
• v.25 no.3
• /
• pp.567-578
• /
• 2014

PEAS (performance enhancement attitude scale) has been used to measure attitude and disposition toward doping in elite athlete. It is constructed of 17-item, 6-point scale. The purpose of this study was to verify validity of the PEAS for Korean elite player through Rasch model. The scale was administered to 438 Korean elite players. Principal component analysis was used to verify unidimensionality using SPSS program. Rasch measurement computer program, WISTEPS, was used to estimate goodness-of-fit of items and category structure. Differenctial item functioning by gender was also estimated by the WINSTEPS program. All alpha level was set at 0.05. First, principal component analysis showed that unidimensionality is satisfied as over 20.0% of variance of eigenvalue. Second, category probabilities curve showed 5-point scale was better than 6-point scaled statistically. Third, seven items (1, 9, 10, 12, 13, 14, 17) in the 17-item were not good model fit and three items (3, 12, 13) were estimated as the differential item functioning. This study showed that 9-item, 5-point scale is better PEAS to Korean elite player.

• The Mathematical Education
• /
• v.52 no.2
• /
• pp.231-245
• /
• 2013

MTEBI는 미국에서 초등 예비 교사들의 수학 교수 효능감을 측정하는데 자주 이용되는 척도이다. 이 연구의 목적은 MTEBI를 한국의 중등 예비 교사들에게 사용하는 것이 적합한지를 탐색하는 것이었다. 이를 위하여, 미국에 있는 대학원에 다니며 영어와 국어 둘 다 말할 수 있는 박사 학생 두 명이 MTEBI를 브리슬린의 이론대로 국문으로 번역하였고, 그 뒤에 한국에 있는 다수의 수학 교사 교육자들이 번역된 척도를 면밀하게 검토하였다. 한글판 척도를 먼저 작은 표본에서 초벌 실험하였는데, 두 개 문항이 도구의 신뢰도와 타당도를 현저하게 떨어뜨렸다. 본 연구에서는 이 두 개의 유용하지 못한 문항을 대신할 두 개 문항을 더한 23개 문항으로 구성된 척도에 대하여 정규성, 신뢰도, 요인 타당도 등을 658명의 표본에서 검사하였다. 초벌 연구에서 발견된 두 개의 유효하지 않는 문항은 본 연구에서도 역시 그와 같아서, 그 두 문항은 척도에서 제거되었다. 최종적으로 얻어진 21 문항 척도는 한국의 예비 수학 교사들의 수학 교수 효능감을 측정하는데 적합한 척도이다. 앞으로, MTEBI 한글판을 이용하여 한국에서 교사 효능감에 대한 연구가 활발하게 일어나기를 기대한다.

• Journal of The Korean Association For Science Education
• /
• v.36 no.1
• /
• pp.87-101
• /
• 2016

This study analyzes the content validity of descriptive tests developed for elementary schools, in order to acquire basic data to improve them. Various descriptive tests were collected and tested for differences in proportions between two-dimensional classification of educational objectives and the level of behavioral objectives. Results show that the descriptive tests developed by elementary school teachers mainly focused on "knowledge" and "understanding," and that content validity for behavioral levels to be low. Nine elementary school teachers were interviewed to understand the result. From the interviews, we found both internal and external factors that cause low content validity. The main internal factors were teachers' ability to make two-dimensional classification of educational objectives, the teachers' consideration of students' level, item level of difficulty, the ease of scoring, and path dependence. The main external factors were curriculum, parents, and administration. Based on the results, we suggested the factors related to elementary school teachers' PCK of descriptive tests.

• The Journal of the Korea Contents Association
• /
• v.13 no.5
• /
• pp.332-341
• /
• 2013

The purpose of this study was to develop a perception of importance on patient safety management scale (PI-PSM) for Hospital Employee. The PI-PSM was developed and vallidated as follows: item generation, vertification of content validity, pilot study, and test of validity and reliability. In order to verify preliminary instrument, data was collected from 280 hospital employees. Data were analyzed by Varimax factor analysis and Cronbach's ${\alpha}$. There were 21 items in final instrument categorized into 4 factors as 'concern about patient safety management (7 items)', 'confidence about patient safety management (5 items)', 'will for patient safety management (5 items)', and 'recognition about patient safety management (4 items)'. The total varience explanined was 60.4%. The internal consistency, Cronbach's ${\alpha}$. was .86, and reliability of the sucscales ranged from .69 to .87. The results of this study may useful to assess the perception of importance on patient safety management.

• Korean Journal of Social Welfare
• /
• v.67 no.2
• /
• pp.5-31
• /
• 2015

This study aims to develop the corporate philanthropy scale focusing on the guidelines of ISO26000 and to test its reliability and validity. For the purpose of this study, author conducted focus group interview, individually interview, consult and pilot test in order to clarify description and relevance of scale items. To test reliability and validation of scale, 94 staffs in charge of the corporate philanthropy work in the companies were surveyed as research subjects. The results of the explanatory factor analysis on scale found the six factor structure and 27 items. The construct validity and discriminant validity were confirmed through the confirmatory factor analysis. The reliability of the scale also remained at a high level. Based on these results, implications for corporate philanthropy was suggested.

• 한국노년학
• /
• v.41 no.1
• /
• pp.149-168
• /
• 2021

This study was to develop the Medication Adherence Scale in Elderly (MAS-E) with chronic disease and verify its reliability and validity. The MAS-E was developed in 5 steps: Configuration of conceptual frame by content analysis, preliminary items, pilot study, reliability and validity test, and development of final MAS-E with chronic disease. The questionnaires were collected from 345 adults with one-to-one interviews. Verification of its reliability and validity was divided into two phases. Reliability was tested using Cronbach's alpha, split-halves reliability, and test-retest. For validity tests, item analysis, factor analysis, total score-factor score correlation analysis, and criterion related validity were used. The developed scale consisted of 18 items and 4 factors - remember of taking medication (2 items), expectations for drug effects (5 items), practice taking medication according to instructions (8 items), communicating with health professionals (3 items), and explained 69.7% of total variance. The scale had significantly positive correlation (r = .72, p <.001) with the Morisky Medication Adherence Scale (MMAS-8). Cronbach's alpha was .91, Guttman split half coefficient was .80, and test-retest reliability was .912. Finding suggest that the MAS-E is a suitable scale to assess the status of medication adherence in elderly with chronic disease.

• The Journal of the Korea Contents Association
• /
• v.13 no.5
• /
• pp.354-365
• /
• 2013

The purpose of the study was to develop the home fall prevention checklist for community-dwelling older adults. And the validity and reliability of the checklist were tested. The preliminary questions were developed through content validity by twenty experts using the CVI(Content Validity Index). Following the establishment of content validity, 52 items of the checklist were developed. Responses of 299 community-dwelling older adults were analyzed to further establish both reliability and validity of the checklist. Reliability using cohen's kappa coefficient and test-retest reliability(rate of concordance(%)), and construct validity using known-group comparison technique were tested. 51 items were over 0.80 in the cohen's kappa coefficient of the checklist, 45 items were over 80.0% in test-retest reliability. Construct validity was established by known-group comparison(t=3.50, p=.001). Validity and reliability of the checklist were confirmed. This checklist will help further studies to develop more safe environment to prevent falls.

• Journal of the Korean Society of Child Welfare
• /
• no.36
• /
• pp.231-259
• /
• 2011

The purpose of this study is to examine the validity and reliability of the Parental Satisfaction Scale for Child Care Centers, which modified the Client Satisfaction Scale (CSS; Kim, 2009). The subjects of the study were 652 parents of children who were between the ages of one to five and who attended child care centers. The five-point rating scale consisted of 21 items with two sub-dimensions. The results from an exploratory factor analysis identified that there are two dimensions in this scale. Thus, in terms of the face validity of this scale, a two-dimensional scale with 21 items is found to be appropriate. However, the items that consist of the two sub-dimensions are found to be different from that of CSS. The concurrent validity and internal consistency reliability of the revised scale are relatively high. Also, the mean between the upper and lower groups with regard to item discrimination show significant difference. We conclude that the original CSS with minor revisions can be used as a valid and reliable instrument to assess parental satisfaction on child care centers.