Browse > Article

A study on validity and reliability of students' evaluation  

Lee, Ki-Hoon (School of Business, Jeonju University)
Publication Information
Journal of the Korean Data and Information Science Society / v.21, no.1, 2010 , pp. 87-98 More about this Journal
Abstract
This research deals the method to assess the validity and reliability of students' evaluation for lectures. Most papers for student's evaluation have focused the procedures for controlling the external effects, but this paper is trying to answer for "How reliable is the student rating?" An empirical study shows that the evaluations in Jeonju University have the fair validity and reliability. The generalizability theory is suggested to obtain the more comprehensive results rather than Cronbach's alpha to examine internal consistency.
Keywords
Generalizability; reliability; students' evaluation; validity;
Citations & Related Records
Times Cited By KSCI : 6  (Citation Analysis)
연도 인용수 순위
1 Cronbach, L. J., Rajaratnam, N. and Gleser, G. C. (1963). Theory of generalizability: A liberalization of reliability theory. The British Journal of Statistical Psychology, 16, 137-163.   DOI
2 Novick, M. R. and Lewis, C. (1967). Coefficient alpha and the reliability of composite measurements. Psychometrika, 32, 1. 1-13.   DOI   ScienceOn
3 Ahmadi, M., Helms, M. and Ralszadeh, F. (2001). Business students' perceptions of faculty evaluations. The International Journal of Educational Management, 15, 12-22.
4 김성연, 권치명 (2005). 통계적 기법을 활용한 균등화법에 의한 강의평가 개선방안 연구. <한국자료분석학회지>, 7, 1705-1721.   과학기술학회마을
5 American educational research association, American psychological association and national council on measurement in education (AERA, APA and NCME) (1999). Standard for educational and psychological testing, American Psychological Association, Washington D. C..
6 Baik, T. and Yang, G. (2008). Classroom lecture monitoring case study. Journal of the Korean Data & Information Science Society, 19, 1191-1200.   과학기술학회마을
7 Brennan, R. L. (2001). Generalizability theory, Springer, New York.
8 Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297-334.   DOI
9 Cronbach, L. J. (2004). My current thoughts on coefficient alpha and successor procedures. Educational and Psychological Measurement, 64, 391-418.   DOI   ScienceOn
10 Linn, R. L. and Gronlund, N. E. (2000). Measurement and assessment in teaching, 8th Ed., Upper Saddle River, NJ: Merrill.
11 Mehrens, W. A. (1997). The consequences of consequential validity. Educational Measurement: Issues and Practice, 16, 16-18.
12 Messick, S. (1998). Test validity: A matter of consequence. Social Indicators Research, 45, 35-44.   DOI   ScienceOn
13 Mushquash, C. and O'Connor, B. P. (2006). SPSS and SAS programs for generalizability theory analyses. Behavior Research Methods, 38, 542-547.   DOI   ScienceOn
14 Cronbach, L. J., Gleser, G. C., Nanda, H. and Rajaratnam, N. (1972). The dependability of behavioral measurements: Theory of generalizability for scores and profiles, Wiley, New York.
15 Popham, W. J. (1997). Consequential validity: Right concern-wrong concept. Educational Measurement: Issues and Practice, 16, 9-13.
16 김종태 (2004). A study of reliability of lecture evaluation by students. <한국데이터정보학회지>, 15, 183-191.   과학기술학회마을
17 Shavelson, R. J. and Webb, N. M. (1991). Generalizability theory: A primer, Sage, Newbury Park, CA.
18 Shepard, L. A. (1997). The centrality of test use and consequences for test validity. Educational Measurement: Issues and Practice, 16, 13-24.
19 김영진 (1994). 교수강의평가제-과연 생산성이 있는가. <생산성논집>, 8, 252-235.
20 류춘호, 이정호 (2003). 대학의 강의평가에 영향을 미치는 학생관련 요인에 관한 연구. <경영학연구>, 32, 789-807.
21 박노진 (2009). 핵심 문항들을 활용한 모델링-강의 평가 자료를 활용한 사례연구. <한국데이터정보학회지>, 20, 1075-1083.   과학기술학회마을
22 성태제 (2002). <타당도와 신뢰도>, 학지사, 서울.
23 이기훈 (2008). 크론바하 신뢰도 계수에 관한 이해. <산경논총>, 28, 43-54.
24 이종승 (1995). <교육연구법>, 배영사, 서울.
25 조장식, 강창완, 최승배 (2009). 강의평가에 대한 균등화방법의 비교. <한국데이터정보학회지>, 20, 65-75.   과학기술학회마을
26 한신일 (2002). 강좌규모와 강의평가의 관계분석. <고등교육연구>, 13, 155-173.
27 Spearman, C. (1910). Correlation calculated with faulty data. British Journal of Psychology, 3, 271-295.
28 Webb, N. M., Rowley, G. L. and Shavelson, R. J. (1988). Using generalizability theory in counseling and development. Measurement & Evaluation in Counseling & Development, 21, 81-90.
29 Kuder, G. F. and Richardson, M. W. (1937). The theory of the estimation of test reliability. Psychometrika, 2, 151-160.   DOI
30 Crumbley, D. L. and Fliedner, E.(2002). Accounting administrators' perceptions of student evaluation of teaching(SET) information. Quality Assurance in Education, 10, 213-222.   DOI   ScienceOn
31 Kulik, J. A. and McKeachie, W. J. (1975). The evaluation of teachers in higher education. Review of Research in Education, 3, 210-230.
32 Lee, K. H. and Lee, S. W. (2006). A study on controlling the external effect in student evaluation of testing. The Korean Communications in Statistics, 12, 589-601.   과학기술학회마을   DOI   ScienceOn
33 Linn, R. L. (1997). Evaluating the validity of assessments: The consequences of use. Educational Measurement: Issue and Practice, 16, 14-15.