• Title/Summary/Keyword: 내적 신뢰도

Search Result 389, Processing Time 0.024 seconds

Development of Evaluation Tool for Educational Applications (교육용 앱 평가도구 개발 연구)

  • Lee, Jeong-Sook;Kim, Sung-Wan
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2013.01a
    • /
    • pp.149-152
    • /
    • 2013
  • 이 연구는 스마트교육환경에서의 교육용 앱을 평가하기 위한 신뢰롭고 타당한 도구를 개발하는데 있다. 기존 선행연구에 기초해서 교육용 앱의 평가를 위한 평가모형을 도출했으며, 이 모형은 4개의 평가영역(교수 학습측면, 화면디자인측면, 기술측면, 경제 윤리측면)과 13개 평가요소들로 구성되었다. 이 잠재모형의 통계적 타당성 검증을 위한 자료수집을 하고자, 경기도 소재 중학교 1곳과 고등학교 2곳의 학생 156명을 대상으로 교육용 앱을 평가하는데 있어서 각 평가문항이 갖는 중요도를 평가하였다. 수집된 자료를 탐색적 요인분석한 결과, 교육용 앱을 평가하는 영역으로 교수 학습(흥미성 자기주도성 실용성, 인지발달성), 화면디자인(디자인의 적합성, 어휘의 정확성), 기술(호환성, 안정성), 경제 윤리(경제성, 윤리성) 등 4개 영역이 제안되었다. 또한 문항내적일관성을 확인하고자 신뢰도 분석한 결과, 각 평가영역 별 Cronbach ${\alpha}$는 .88, .85, .82, .80으로 모두 적합한 수준을 보였다. 따라서, 이 연구를 통해 도출된 교육용 앱 평가도구는 통계적으로나 타당성과 신뢰성 측면에서 의미 있는 것으로 판단할 수 있다.

  • PDF

수학과 창의성 평가에서 개방형 문항의 특성과 중학교 학생들의 반응유형에 관한 연구

  • Lee, Gang-Seop;Hwang, Dong-Ju;Seo, Jong-Jin
    • Communications of Mathematical Education
    • /
    • v.16
    • /
    • pp.201-215
    • /
    • 2003
  • 이 연구에서는 창의적인 문제해결능력을 검사하는 도구로 널리 알려진 개방형 문항 5 문제를 수정 또는 번역하여 중학교 2학년 학생들에게 적용하고 그 결과를 분석하였다. 검사도구에 대한 양호도 분석 결과는 다음과 같다. 첫째, 문항 내적 일관성 신뢰도(Cronbach ${\alpha}$)의 계수는 0.8이다. 둘째, 문항반응이론에 근거한 문항의 적합도 지수는 모두 1.2미만으로서 분석모형에 적합한 문항이라고 볼 수 있다. 또한, 문항간의 난이도의 차이는 로짓트 점수가 0.6을 넘지 않은 범위에서 골고루 분포되어 있다. 셋째, 문항 신뢰도 지수가 모두 0.80보다 높은 것으로 나타나 사용된 문항들은 서로 잘 분리되어 창의적 문제해결력을 추정하고 변별하는데 무리가 없다. 학생들의 반응에 대한 분석 결과는 다음과 같다. 문항1에서 곡선을 이용한 반응은 영재학생들에서만 발견할 수 있었다. 문항2에 대한 각 반응의 독창성 점수는 모두 0이다 이것은 문항2가 널리 알려진 문제에 기인한 것으로 해석된다. 문항3은 영재학생들이 더 많은 반응을 보인 것으로 모든 반응이 독창성 점수를 부여받았다. 문항4에 대하여 일반학생들은 거의 반응을 하지 못하였다. 문항5는 대부분의 학생이 반응을 하였으며 반응의 종류도 가장 다양하였다.

  • PDF

Response Bias and Reliability of Patient Satisfaction Survey (환자만족도 조사의 응답편견과 신뢰도)

  • Cho, Young-Sik
    • Journal of dental hygiene science
    • /
    • v.3 no.2
    • /
    • pp.83-88
    • /
    • 2003
  • Patient satisfaction is now recognized as a outcome indicator of health care quality. The objective of this research was to evaluate a patient satisfaction survey instrument specially applicable to dental care, and to examines the reliability and the effect of response biases on reported satisfaction. The acceptability of satisfaction as a quality indicators was qualified by several measurement problems. The patient questionnaire was administered in four different study samples to examine the consistency of data. Cronbach's alpha was used as the measure of internal consistency. A aquiesent bias was found in the sample of 80(20%) respondents. Response biases affacted level of measured satisfaction. Highly acquiesent respondents were older, less well educated than nonaquiesent subject.

  • PDF

The Construct Validation of the Scale for Screening the Qualified Teachers for the Gifted in Music (음악(국악)영재 담당교사 평가문항의 구인타당화)

  • Won, YoungSil
    • Journal of Gifted/Talented Education
    • /
    • v.25 no.2
    • /
    • pp.237-259
    • /
    • 2015
  • Teachers in music(including Korean traditional music) gifted education are a significant variable in both identifying the giftedness of students and a successful instruction. The purpose of this study is to develop the Scale for Screening the Qualified Teachers for the Gifted in Korean traditional and western Music(SSQTGM), and to examine the validity and reliability of the SSQTGM. To achieve this purpose, this study administered the SSQTGM to 175 teachers of gifted students aged between 13 and 15 in middle schools for the arts. To validate the SSQTGM, I analyzed the criteria of the SSQTGM, and conducted an exploratory and confirmative factor analysis. I also examined an internal consistency. As a result of the exploratory factor analysis, I finally collected 41 items of the SSQTGM. Futhermore, I could identify psychological constructs of the qualified teachers for the gifted in Korean traditional and western music. In consequence of the confirmative factor analysis, the model provided a good fit to observe data. As a result of the reliability analysis, the internal consistency of knowledge in the music(korean traditional music) verified cronbach's ${\alpha}=.937$, and the expertise of the class management and instruction verified cronbach's ${\alpha}=.942$. Also, the teachers' aptitude and personality verified cronbach's ${\alpha}=.963$. This result of the construct validation reflects the fact that the SSQTGM is an available scale that can be applied in gifted education field instantly.

Development of Reminiscence Function Scale-Short Form: A Study on Reliability and Validity (단축형 회상기능척도(Reminiscence Function Scale-Short Form) 개발 : 신뢰도 및 타당도 연구)

  • Cha, Yu-Jin
    • The Journal of the Korea Contents Association
    • /
    • v.16 no.6
    • /
    • pp.225-235
    • /
    • 2016
  • This study aims at developing Reminiscence Function Scale-Short Form(RFS-S) and verifying it as a supplemental diagnosis instrument to judge differences between normal and mild cognitive impairment and useful measure to rate effects of reminiscence therapy in the clinical field through internal consistency reliability and criterion validity. The study also aims at figuring out factors affection reminiscence function by figuring out demographic features of RFS-S. The research subjects were the control group of 60 normal people and experimental group of 58 people with mild cognitive impairment and both groups were over 65 years old. For internal consistency reliability(Cronbach's alpha) between questions was reliable with 0.63. Convergent validities of RFS-S with SRT and CDR-SB were 0.20(p<.05) and -0.25(p<.001), respectively, as both showed significant correlations. As a result of criterion validity to analyze AUROC, it was 0.68(p<.001) and less accurate. Its optimal cut-off points were 17 and sensitivity according to them was 0.59, and specificity was 0.72, respectively. However, reminiscence function according to demographic variables did not show any significant differences. Therefore, it is expected that RFS-S will be used as a supplemental diagnosis instrument with higher reliability and validity for discerning differences between normal and mild cognitive impairment and as a useful one to verify effects of reminiscence therapy.

The Construct Validation of the OSTG-2 for Screening of The Gifted in Korean Traditional and Western Music (음악(국악)영재성 선별을 위한 교사관찰정보지(OSTG)의 구인타당화)

  • Won, YoungSil
    • Journal of Gifted/Talented Education
    • /
    • v.23 no.1
    • /
    • pp.1-24
    • /
    • 2013
  • The OSTG (Observation Scale for Teachers of the Gifted in Korean Traditional and Western Music) is one of the tools for screening of the Gifted in Korean traditional and Western music. So the validity and reliability of the OSTG-2 has an influence on securing validity of the whole identification process. The purpose of this study is to examine the validity and reliability of the OSTG-2 that input screening processing, and to suggest systematization of identification processing for the Gifted in Korean traditional and Western Music. For the achievement of this purpose, this study administered the OSTG-2 to 195 teachers of gifted students aged between 13 and 16 in the middle or high school for the arts. To validate the OSTG-2, I analyzed items of the OSTG-2, and conducted the exploratory and confirmative factor analysis. I also examined the internal consistency. As a result of the exploratory factor analysis, I collected 22 items of the OSTG-2 finally. Furthermore, I could identify psychological construct of the Gifted in Korean traditional and Western Music. The consequence of confirmative factor analysis, the model provided good fit to observed data. As a result of reliability analysis, the internal consistency of musicality verified cronbach' ${\alpha}$=.852, and the creativity verified cronbach' ${\alpha}$=.894, the task commitment verified cronbach' ${\alpha}$=.924. This result of validity study reflects the fact that the OSTG-2 is a valid scale and is able to input to gifted educational field instantly.

A Method for Developing Items to Assess Earth Science Creativity (지구과학 창의력 평가 문항 개발 방법에 관한 연구)

  • Lee, Hang-Ro
    • Journal of the Korean earth science society
    • /
    • v.24 no.3
    • /
    • pp.150-159
    • /
    • 2003
  • This study suggests methods of assessing scientific creativity and developing items, which can be achieved when both earth science knowledge and general creativity are applied at the same time. According to the results of this study, the cognitive ability gaps between creativity and scientific creativity were clearly defined by the terms' operational definition. Four factors in the Subcategory Of Scientific Creativity-fluency, flexibility, elaboration, and originality-were selected, and the possibility of developing items out of these factors was discovered. The operational definitions of the four factors were given and the criteria for assessment and scoring were set. The validity, reliability, discrimination, and difficulty, which were the conditions required for the assessment instruments, were verified through three field trials of inputting the assessment instruments for scientific creativity. The assessment instruments were composed of 8 items with 2items for each factor. The average item fitness index obtained was 0.99, Cronbach , the item inter-consistency was 0.79,the inter-rater reliability of each item was 0.78, the inter-rater reliability of each factor was 0.75, the item discrimination power was 0.19, and the item difficulty was 0.00. Because the results were within the permitted limit of the conditions required for assessment instruments, the assessment instruments developed for scientific creativity in this study can be said to be very favorable.

The Validation of Korean Student Career Construction Inventory: Focusing on emerging adulthood (한국판 학생 진로구성척도(Korean Student Career Construction Inventory)의 타당화 연구: 초기 성인기를 중심으로)

  • Pyo, Sohwi;Yang, Eunjoo
    • Korean Journal of School Psychology
    • /
    • v.17 no.2
    • /
    • pp.145-164
    • /
    • 2020
  • This study aims to validate the Korean Student Career Construction Inventory, a translated measure of career adaptation responses, with Korean college students. In order to do so, this study examines the relevant factor structure, internal consistency, test-retest reliability, criterion-related validity and measurement invariance between Korean undergraduate and graduate students. An online survey was completed by 294 participants, including the questions from the translated Korean Student Career Construction Inventory, in addition to measures of career adaptability and vocational identity. One hundred twenty five among the initial participants were tested again in three months for the examination of test-retest reliability. The results supported the four-factor structure of 18 items suggested by the original measure, as well as measurement invariance. The internal consistency and test-retest reliability were adequate. The Korean Student Career Construction Inventory was positively correlated with career adaptability, unidimensional vocational identity, and the dimensions of exploration and commitment of multidimensional vocational identity, but negatively with the dimension of reconsideration. The findings indicate that the Korean Student Career Construction Inventory has psychometric properties similar to the original form and can be used for both undergraduate and graduate students.

Item-Level Psychometrics of the 12 Items of the Coping Orientation to Problems Experienced Scale (스트레스 대처 척도 12개 항목에 대한 심리측정 속성)

  • Nam, Sanghun;Hilton, Claudia L.;Lee, Mi-Jung;Pritchard, Kevin T.;Bae, Suyeong;Hong, Ickpyo
    • Therapeutic Science for Rehabilitation
    • /
    • v.11 no.3
    • /
    • pp.65-80
    • /
    • 2022
  • Objective : This study examined the psychometric properties of the 12-item Coping Orientation to Problems Experienced Scale (COPE) using Rasch analysis. COPE is one of the instruments used to measure stress-coping skills. Methods : The study participants were 480 community-dwelling older adults. We tested the instrument's unidimensionality assumption using principal component analysis (PCA). Item fit was examined using infit-and-outfit mean-square (MnSq) and standardized fit statistics (ZSTD). The precision and item difficulty hierarchies of the instrument were examined. The item-difficulty hierarchy was investigated to identify the easy and difficult items. We tested differential item functioning (DIF) for sex and age groups. Results : PCA revealed that the instrument met the unidimensionality assumption (eigenvalue = 1.78). Among the 12 items, item 2 was removed because of misfit (Infit MnSq = 1.33, Infit ZSTD = 5.05, Outfit MnSq = 1.56, Outfit ZSTD = 7.15). The remaining 11 items demonstrated a conceptual item-difficulty hierarchy. The person strata value was 3.10, which is equivalent to a reliability index value of 0.81. There was no DIF for the sex and age groups (DIF contrast <0.27). Conclusion : The findings indicated that the revised COPE-11 has adequate item-level psychometric properties and can accurately measure stress coping skills.

Designing Questionnaires for Better Reliable Survey: Case Study of Using Railway Safety Culture Survey Data (신뢰성 향상을 위한 설문문항 설계: 철도안전문화 설문자료 사례를 중심으로)

  • Lim, Kwangkyun;Kim, Sigon
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.34 no.6
    • /
    • pp.1837-1844
    • /
    • 2014
  • The study of safety culture estimate has received a wide attentions in many other industries, rather in the contexture of railroad stands at an initial phase. A factor analysis and internal reliability test were conducted to check if the survey results are reliable by looking at how the factors are dimensioned and how the questionnaires are sub-grouped in accordance with such factors, and further if there are any other common attributes being extracted as a new factor. The designed 5 factors were expanded to 7 through the test, and they were renamed accordingly. The questionnaires are reorganized according to the new 7 factors. It implicates that thorough investigation of the common attributes is important in reducing the gaps between interviewers' and interviewees' understanding. Moreover, the results of internal reliability test represent the new design of questionnaire is reasonably acceptable with the high reliable values. We expect such approaches can be applied for the railway culture survey study to be more reliable and applicable.