• Journal of The Korean Association For Science Education
• /
• v.40 no.3
• /
• pp.253-269
• /
• 2020

This study aims to develop items to diagnose pre-service physics teachers' understanding of the conceptual knowledge of modern physics, based on the achievement criteria presented in the 2015 revised national science curriculum, and to identify the validity and reliability of the newly developed items. Data were collected from 467 pre-service physics teachers in the Physical Education Department or Science Education Department (Physics Education Major) of 15 universities across the nation. In this study the content validity, substantive validity, the internal structure validity, generalization validity, and the external validity proposed by Messick (1995) were examined by various statistical tests. The results of the MNSQ analysis showed that there was no nonconformity in the 23 items. The internal structure validity was confirmed by the standardized residual variance analysis, which shows that the 22 items was unidimensional. The generalization validity was confirmed by differential item functioning (DIF) analysis about groups lectured or not modern physics/quantum mechanics. In addition, item analysis and test analysis based on classical test theory were performed. The mean item difficulty is 0.66, mean item discrimination is 0.47 and mean point biserial coefficient obtained was 0.41. These results for item parameters satisfied the criteria respectively. The reliability of the internal consistency of the KR-20 is 0.77 and the Ferguson's delta obtained was δ = 0.972. By Rasch model analysis, the item difficulty (item measures) was discussed.

• Journal of the Korean Data and Information Science Society
• /
• v.25 no.3
• /
• pp.567-578
• /
• 2014

PEAS (performance enhancement attitude scale) has been used to measure attitude and disposition toward doping in elite athlete. It is constructed of 17-item, 6-point scale. The purpose of this study was to verify validity of the PEAS for Korean elite player through Rasch model. The scale was administered to 438 Korean elite players. Principal component analysis was used to verify unidimensionality using SPSS program. Rasch measurement computer program, WISTEPS, was used to estimate goodness-of-fit of items and category structure. Differenctial item functioning by gender was also estimated by the WINSTEPS program. All alpha level was set at 0.05. First, principal component analysis showed that unidimensionality is satisfied as over 20.0% of variance of eigenvalue. Second, category probabilities curve showed 5-point scale was better than 6-point scaled statistically. Third, seven items (1, 9, 10, 12, 13, 14, 17) in the 17-item were not good model fit and three items (3, 12, 13) were estimated as the differential item functioning. This study showed that 9-item, 5-point scale is better PEAS to Korean elite player.

• The Mathematical Education
• /
• v.52 no.2
• /
• pp.231-245
• /
• 2013

MTEBI는 미국에서 초등 예비 교사들의 수학 교수 효능감을 측정하는데 자주 이용되는 척도이다. 이 연구의 목적은 MTEBI를 한국의 중등 예비 교사들에게 사용하는 것이 적합한지를 탐색하는 것이었다. 이를 위하여, 미국에 있는 대학원에 다니며 영어와 국어 둘 다 말할 수 있는 박사 학생 두 명이 MTEBI를 브리슬린의 이론대로 국문으로 번역하였고, 그 뒤에 한국에 있는 다수의 수학 교사 교육자들이 번역된 척도를 면밀하게 검토하였다. 한글판 척도를 먼저 작은 표본에서 초벌 실험하였는데, 두 개 문항이 도구의 신뢰도와 타당도를 현저하게 떨어뜨렸다. 본 연구에서는 이 두 개의 유용하지 못한 문항을 대신할 두 개 문항을 더한 23개 문항으로 구성된 척도에 대하여 정규성, 신뢰도, 요인 타당도 등을 658명의 표본에서 검사하였다. 초벌 연구에서 발견된 두 개의 유효하지 않는 문항은 본 연구에서도 역시 그와 같아서, 그 두 문항은 척도에서 제거되었다. 최종적으로 얻어진 21 문항 척도는 한국의 예비 수학 교사들의 수학 교수 효능감을 측정하는데 적합한 척도이다. 앞으로, MTEBI 한글판을 이용하여 한국에서 교사 효능감에 대한 연구가 활발하게 일어나기를 기대한다.

• Communications of Mathematical Education
• /
• v.13 no.2
• /
• pp.641-653
• /
• 2002

수학 교육평가에서 고사 타당도의 측정은 매우 중요하다. 그것은 평가자가 목적하는 바의 준거에 따라 수험자들의 문제해결력 변별을 위한 고사들 간의 타당도 크기 측정과 또는 고사 문항의 선정, 배치를 통하여 한 고사의 타당도를 높이기 위한 문항별 타당도 계수를 측정 계산하는 것이다. 이 연구에서는 이 두 가지 고사 타당도의 크기 측정법을 이용하여 수학교육 평가 현장에서 직접적으로 적용할 수 있는 고사 타당도의 제고에 유효한 연구 결과를 제시한다.

• The Journal of the Korea Contents Association
• /
• v.13 no.5
• /
• pp.332-341
• /
• 2013

The purpose of this study was to develop a perception of importance on patient safety management scale (PI-PSM) for Hospital Employee. The PI-PSM was developed and vallidated as follows: item generation, vertification of content validity, pilot study, and test of validity and reliability. In order to verify preliminary instrument, data was collected from 280 hospital employees. Data were analyzed by Varimax factor analysis and Cronbach's ${\alpha}$. There were 21 items in final instrument categorized into 4 factors as 'concern about patient safety management (7 items)', 'confidence about patient safety management (5 items)', 'will for patient safety management (5 items)', and 'recognition about patient safety management (4 items)'. The total varience explanined was 60.4%. The internal consistency, Cronbach's ${\alpha}$. was .86, and reliability of the sucscales ranged from .69 to .87. The results of this study may useful to assess the perception of importance on patient safety management.

• 한국노년학
• /
• v.41 no.1
• /
• pp.149-168
• /
• 2021

This study was to develop the Medication Adherence Scale in Elderly (MAS-E) with chronic disease and verify its reliability and validity. The MAS-E was developed in 5 steps: Configuration of conceptual frame by content analysis, preliminary items, pilot study, reliability and validity test, and development of final MAS-E with chronic disease. The questionnaires were collected from 345 adults with one-to-one interviews. Verification of its reliability and validity was divided into two phases. Reliability was tested using Cronbach's alpha, split-halves reliability, and test-retest. For validity tests, item analysis, factor analysis, total score-factor score correlation analysis, and criterion related validity were used. The developed scale consisted of 18 items and 4 factors - remember of taking medication (2 items), expectations for drug effects (5 items), practice taking medication according to instructions (8 items), communicating with health professionals (3 items), and explained 69.7% of total variance. The scale had significantly positive correlation (r = .72, p <.001) with the Morisky Medication Adherence Scale (MMAS-8). Cronbach's alpha was .91, Guttman split half coefficient was .80, and test-retest reliability was .912. Finding suggest that the MAS-E is a suitable scale to assess the status of medication adherence in elderly with chronic disease.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.17 no.10
• /
• pp.345-356
• /
• 2016

The purpose of this study was to develop a scale to evaluate the safety competency of perioperative nurses and to examine its validity and reliability. The research process included the development of preliminary items through literature reviews and the construct validity examination of the conceptual framework for the preliminary scale. The content validity of the identified items was evaluated by experts, resulting in 30 preliminary items. The participants involved in testing the validity and reliability of the preliminary scale were 377 perioperative nurses. The data were analyzed using exploratory factor analysis, parallel analysis, confirmatory factor analysis, and internal consistency. To verify the construction factor of the preliminary scale, exploratory factor analysis and parallel analysis were performed, resulting in 3 factors and 27 items. The internal structure of the scale was schematized using confirmatory factor analysis and the goodness of fit of the final research model was very appropriate, as shown by the values of TLI=.90, CFI=.91, RMSEA=.07, and SRMR=.07. The final scale consisted of 27 items and 3 factors including knowledge (6 items), skill (13 items), and attitude (8 items). Cronbach' ${\alpha}$ for the final scale was .94, showing good internal consistency. This safety competency scale can be used for assessing the competency of perioperative nurses regarding patient safety, for developing patient safety studies and for the career development of perioperative nurses.

• 한국지구과학회:학술대회논문집
• /
• 2010.04a
• /
• pp.17-17
• /
• 2010

본 연구는 학생들의 과학 경험의 정도를 정량화 하는데 있어 통일된 측정 도구를 제시하는 것이다. 측정 도구를 구성하는 요인들은 선행연구를 통해 학교 안 과학 경험은 일반 활동 경험, 과학 탐구 경험, 실험 기구 경험으로 세분화 되며 학교 밖 과학 경험은 일반 활동 경험, 취미 활동 경험, 현장 견학 경험 6개의 영역으로 구분을 할 수 있었다. 각각의 요인을 구성하는 질문은 NAEP(1987)에서 사용된 과학 경험 검사 도구와 신영준(2000)의 과학 경험 검사 도구의 문항 중 일부를 발췌하고 더불어 과학 경험에 대한 개방적인 설문지를 통하여 1차 검사를 실시하여 얻은 답변 중 빈도가 많은 답변과 중등 교과서의 탐색적 분석을 통해 영역별 10문항씩 6개 영역의 문항을 선정하였다. 사전 설문조사와 선행 연구를 바탕으로 개발한 검사지를 고등학교 1학년 학생 413명을 대상으로 2차 검사를 실시하였다. 개발한 측정 도구의 타당도는 내용타당도와 구인타당도로 검사하였다. 내용타당도는 2명의 현직 중등교사와 2명의 과학교육전문가가 각 문항이 측정하고자 하는 목적에 부합하는지 심사하였고, 구인타당도는 요인분석을 통해 검사하였다. 신뢰도는 Cronbach $\alpha$를 통하여 문항을 분석하였다. 6개의 영역의 요인에 대하여 타당도와 신뢰도 분석 결과 6개 영역으로 구성된 60문항의 측정 도구는 학생들의 과학 경험을 측정하는 도구로서 적절하다는 결론을 내렸다.

• Therapeutic Science for Rehabilitation
• /
• v.10 no.3
• /
• pp.97-110
• /
• 2021

Objective : This study aimed to develop evaluation items based on Parten's social play developmental stages to measure social play in preschool children. Methods : Through a literature review, the investigation items according to Parten's social play developmental stages were collected. Two Delphi surveys were conducted using 22 expert panels. An understanding of the contents of the preliminary items was determined via parents of preschool children. The evaluation method was established through an expert advisory meeting. Results : Through data collection and the Delphi survey, a total of 89 items were drawn, including 12 unoccupied behaviors, 7 onlooker behaviors, 14 solitary play, 16 parallel play, 17 associative play, and 23 cooperative play items. The average content validity ratio of the Delphi survey was 0.85. The stability was 0.15. The consensus was 0.78. The final preliminary evaluation items comprised a total of 40 items, including 17 for associative play and 23 for cooperative play. Conclusion : An evaluation items that can measure social play in preschool children was developed, and its content validity was verified. It is expected to be used as an evaluation tool in clinical practice.

• Education of Primary School Mathematics
• /
• v.17 no.2
• /
• pp.159-171
• /
• 2014

Spatial ability has been valued as one component of intelligence and as an talented domain. And it is associated with the achievements in science, technology, engineering, and mathematics (STEM) disciplines. So, the instrument for measuring spatial ability is very important. The purpose of this study is to develop Spatial Visualization Tests for Elementary School Children and examine internal consistency reliability evidence and construct validity evidence on confirmatory factor analysis of that instrument. For this purpose, 'The Spatial Visualization Tests for Elementary School Children was administered to 1482 Korean elementary school students. As a result, this study show that internal consistency reliability evidence using Cronbach' alpha showed item consistency and construct validity evidence from confirmatory factor analysis in the Spatial Visualization Tests for Elementary School Children. And also, this study show ed that item difficulty and item discrimination of the Spatial Visualization Tests for Elementary School Children were within an acceptable range.