• Title/Summary/Keyword: multivariate generalizability analysis

Search Result 5, Processing Time 0.016 seconds

Analysis of weights depending on scoring domains of the mathematical creativity test (수학적 창의성 검사의 채점 영역별 가중치 분석)

  • Kim, Sungyeun
    • The Mathematical Education
    • /
    • v.55 no.2
    • /
    • pp.147-169
    • /
    • 2016
  • This study analyzes the mathematical creativity test as an illustrative example with scoring domains of fluency, flexibility and originality in order to make suggestions for obtaining maximum reliability based on a composite score depending on combinations of each scoring domain weights. This is done by performing a multivariate generalizability analysis on the test scores, which were allowed to access publicly, of 30 mathematically gifted elementary school students, and therefore error variances, generalizability coefficients, and effective weights have been calculated. The main results were as follows. First, the optimal weights should adjust to .5, .4, and .1 based on the maximum generalizability coefficient even though the original weights in the mathematical creativity test were equal for each scoring domain with fluency, flexibility and originality. Second, the mathematical creativity test using the three scoring domains of fluency, flexibility, and originality showed higher reliability than using one scoring domain such as fluency. These results are limited to the mathematical creativity test used in this study. However, the methodology applied in this study can help determine the optimal weights depending on each scoring domain when the tests constructed in various researchers or educational fields are composed of multiple scoring domains.

Exploring the Application of Generalizability Theory to Mathematics Teacher Evaluation for Professional Development in Korea Based on the Analysis of Instructional Quality Assessment of Mathematics Teachers in the U.S. (미국 수학교사의 교수 질 평가도구 분석을 통한 우리나라 수학 교원능력개발평가에서의 일반화가능도 이론 활용성 탐색)

  • Kim, Sungyeun
    • Communications of Mathematical Education
    • /
    • v.28 no.4
    • /
    • pp.431-455
    • /
    • 2014
  • The purpose of this study was to suggest methods to apply generalizability theory to mathematics teacher evaluation using classroom observations in Korea by analysing mathematics teachers in the U.S. using the instructional quality of assessment instrument as an illustrative example. The subjects were 96 teachers participating in Year 3 and Year 4 from the Middle-school Mathematics and the Institutional Setting of Teaching (MIST) project funded by the National Science Foundation since 2007. The MIST project investigates the following question: What does it takes to support mathematics teachers' development of ambitious and equitable instructional practices on a large scale (MIST, 2007). This study examined data based on both the univariate generalizability analysis using GENOVA program and the multivariate generalizability analysis using mGENOVA program. Specifically, this study determined the relative effects of each error source and investigated optimal measuring conditions to obtain the suitable generalizability coefficients. The methodology applied in this study can be utilized to find effective optimal measurement conditions for the mathematics teacher evaluation for professional development in Korea. Finally, this study discussed limitations of the results and suggested directions for future research.

An Analysis of Measurement Equivalence in a Teaching Aptitude and Personality Test for Pre-service Mathematics Teachers between a Graduate School of Education and a College of Education (교육대학원과 사범대학 예비수학교사의 교직 적성·인성 검사에 대한 측정의 동등성 분석)

  • Kim, Sungyeun
    • The Mathematical Education
    • /
    • v.57 no.2
    • /
    • pp.179-196
    • /
    • 2018
  • The purpose of this study was to investigate the measurement equivalence and to suggest application ways in teaching aptitude and personality test results for pre-service mathematics teachers between a graduate school of education and a college of education. This study analyzed the scores of the teaching aptitude and personality test of 36 pre-service mathematics teachers enrolled in a graduate school of education and 111 pre-service mathematics teachers in a college of education by performing a multivariate generalizability analysis. The main results were as follows. First, graduate's pre-service mathematics teachers had a higher level of teaching aptitude and personality than that of college's pre-service mathematics teachers based on the total scores. In addition, graduate's pre-service mathematics teachers had higher levels of teaching aptitude and personality than those of college's pre-service mathematics teachers except for a creativity application domain based on the sub-domain scores. Second, cognitive domains were measured more precisely but affective domains were measured less precisely for graduate's pre-service mathematics teachers than for college's pre-service mathematics teachers. Third, regardless of school levels, Cronbach's ${\alpha}$ values, which might be overestimated by applying the classical test theory, were higher than dependability coefficients. Fourth, this study showed a somewhat negative result in ensuring the measurement equivalence for a problem solving exploration domain. However, regardless of school levels, this study indicated that the overall measurement was generally reliable on composite scores. Based on these results, it was confirmed that multivariate generalizability methodologies' approach can be useful for exploring the measurement equivalence issues. Finally, this study suggests how to utilize the results of the test, how to apply a multivariate generalizability analysis for detecting the measurement equivalence, and how to develop future research based on limitations.

Multigroup Generalizability Analysis of Creative Attitude Scale-Korea for Mathematically Gifted and General Students in Middle Schools (수학적 창의성 태도 검사에서 수학영재와 일반학생의 다집단 일반화가능도 분석)

  • Kim, Sungyeun
    • Communications of Mathematical Education
    • /
    • v.31 no.1
    • /
    • pp.49-70
    • /
    • 2017
  • The purpose of this study was to investigate the relative influence of multiple error sources and to find optimal measurement conditions that obtain a desired level of reliability of a creative attitude test in mathematical creativity. This study analyzed the scores of the Creative Attitude Scale-Korea allowed to access publicly of 125 general students and 109 mathematically gifted students by performing a multivariate generalizability analysis. The main results were as follows. First, based on reliability, the Creative Attitude Scale-Korea was measured less precisely for mathematically gifted students. On the contrary, based on the conditional standard error of measurement, it was measured less precisely for general students. However, the Creative Attitude Scale-Korea showed strong reliability in both groups. Second, the optimal weights should adjust to .3, .3, .4 in mathematically gifted students and .4, .4, .2 in general students with three scoring components of divergent attitude, problem solving attitude, and convergent attitude based on the maximum reliability. Third, to approach desirable reliability, it is possible to use one component of divergent attitude in general students but three components of divergent attitude, problem solving attitude, and convergent attitude in mathematically gifted students. Finally this study proposed application plans for the Creative Attitude Scale-Korea and future directions of research.

Factors Associated with Burnout of Nurses Working for Cancer Patients (말기 암 환자 간호사의 직무소진 관련 요인 분석)

  • Leou, Chung-Soon;Kim, Kwang-Kee;Kim, Jeoung-Hee
    • Journal of Hospice and Palliative Care
    • /
    • v.8 no.1
    • /
    • pp.45-51
    • /
    • 2005
  • Purpose: The purpose of this study is to examine the factors surrounding burnout of nurses caring for cancer patients. Methods: The sample of this study was conveniently selected among nurses who had hospice care experiences working in General Hospitals located in Seoul. This study was conducted by a self-administered questionnaire. Two hundred forty four questionnaires were retrieved and the response rate was 81.3%. The period of data collection was from February 25th to March 5th in 1994. Mean, standard deviation, T-test ANOVA, and multiple regression analysis were performed for statistical analysis. Results: The data showed that respondents reported to have burnout as many as 2.71 out of a 5.0 score. Bivariate analyses indicated that those who had hospice education reported to have a lower burnout than those without hospice education. Multivariate regression analyses revealed factors associated with burnout the nurses have had. They include being a Christian, higher job satisfaction, and experiences of hospice education. Hospice education reducing burnout for the nurses was observed by hierarchial multiple regression analyses, after controlling out the effect of coping methods, sociodemographic characteristics, job satisfaction, and job-related stresses on experience of burnout. This observation was not hue for physical and psychological burnout but for burnout in general and emotional one. But this was not confirmed among the nurses with type A personality. Conclusion: The findings of this study have a weakness in generalizability due to the sampling methodology used in this study. However, for the better hospice care further research with a probability sampling method are necessary.

  • PDF