Journal of Engineering Education Research (공학교육연구)

Korean Society for Engineering Education (한국공학교육학회)
권호 표지

Improving Course Evaluation System of Engineering Education

이공계 강의평가 결과의 실증적 분석을 통한 강의평가제도 개선방안

  • Published : 2007.12.30
Download PDF
⟨ Previous Next ⟩

Abstract

An evaluation system of teaching is one of authentic assessment tools for improving the quality of higher education. The purpose of this study is to cultivate the class evaluation system in the college of engineering based on the empirical analysis of the results of the class evaluation. Especially, this study investigates the validity evidence using the confirmatory factor analysis of the class evaluation. The data used in this study were acquired from 49,127 student's evaluation responses of 471 courses offered in colleges of natural science and engineering at a university in Korea. The reliabilities are quite good for every construct by producing an index value from 0.92 to 0.98. The results provides a guideline for an appropriate measurement model to report the information, to clarify quality and appropriateness of instrument items, to make recommendations for which items should be left or merged in the revised instrument. A special suggestion for improving student's evaluation of each course is to prepare a well-designed instruction for students explaining why and how to evaluate the course in order to produce reliable and valid results.

대학의 강의평가는 수업효과성에 대한 진단적 피드백을 제공하고 교수에 대한 의사결정에 도움을 주며 학생이 수강 시 활용할 수 있는 정보를 제공하는 등 광범위하게 사용되고 있다. 그러나 활용범위가 확대될 수록 강의평가도구의 타당성과 신뢰성이 제기되고 있으며, 강의평가 제도 자체에 대한 측정학적 연구가 요구되고 있다. 본 연구의 목적은 이공계 대학의 강의평가 결과에 대한 실증적 분석을 통하여 강의평가제도의 순기능을 극대화하기 위한 개선방안을 제안하는 것이다. 평가도구의 타당도와 신뢰도, 평가결과에 대한 문항반응 유형 등을 통계적으로 분석하기 위해 국내 대학교 이공계 개설강의 중 471개 과목의 385명 교수에 대한 총 49,127 명 학생의 강의평가 결과자료를 사용하였다. 분석 결과, 첫째, 강의평가의 유형별 차이를 줄이기 위하여 전공별 또는 수업유형별로 평가문항 군에서 문항을 선택하도록 개선할 것을 제안하고, 둘째, 평가결과점수 상하위 10% 해당하는 강의의 특성을 분석하여 결과활용의 방향을 제시하였다.

Keywords

References

  1. 길양숙, 김동진(2003). 수업평가 결과와 쟁점. 한국교육학회. 교육학연구, 41(3), 303-323
  2. 김성숙(1993). 관찰을 통한 교수 평가체계에 대한 측정의 일반화가능도 연구, 교육학 연구, 31(1), 23-40
  3. 김성숙(2006). e-learning 강의평가 도구의 일반화가능도와 평가활용의 최적화 조건, 교육평가연 구. 19(1), 305-322
  4. 김성열, 박재완, 김종철, 강현석(2001). 대학 학사과정 강의평가제 실태분석을 통한 교육업적 평 가모형 개발연구. 교육인적 자원부 정책연구, 2001-일-30
  5. 성태제(2002). 현대 교육평가. 학지사
  6. 송미섭, 지은림(1994). 강의평가 설문지에 관한 문항분석 연구. 교육평가연구, 7(2), 263-283
  7. 이종승(1993). 교수의 강의평가에 관한 연구. 충남대학교 교육연구소. 교육발전논총, 14(1), 83-95
  8. 지은림, 장정아(2006). 대학 교수자를 위한 강의 자가진단도구 개발의 타당화 및 관련 변인 탐색. 교육평가연구, 19(1), 51-71
  9. 한신일, 김혜정, 이정연(2005). 한국 대학의 강의 평가 실태 분석. 교육행정학 연구. 23(3), pp. 379-403
  10. AERA, APA, NCME (1985, 1999). Standards for educational and psychological testing, Washington D.C
  11. Algozzine, B., et. al. (2004). Student evaluation of college teaching: A practice in search of principles. College Teaching, 52(4), 134-141 https://doi.org/10.3200/CTCH.52.4.134-141
  12. Brinko, K. T. (1990). Instructional consultation with feedback in higher education. J. of Higher Education, 61, 65-83 https://doi.org/10.2307/1982035
  13. Broder, J. M., & Dorfman, J. H. (1994). Determinants of teaching quality: What's important to students?. Research in Higher Education, 35, 235-249 https://doi.org/10.1007/BF02496703
  14. Bukalski, P. J., & Zirpola, D. J. (1993). Guide for nontenured faculty members: Annual evaluation, promotion, and tenure. University Film and Association of Georgia State University
  15. Cook, S. S. (1989). Improving the quality of student ratings of instruction: A look at two strategies. Research in Higher Education, 30, 31-45 https://doi.org/10.1007/BF00992789
  16. Feldman, K. A. (1997). Identifying exemplary teachers and teaching : Evidence from student ratings. In R. P. Perry, & J.C. Smart(eds). Effective teaching in Higher Education : Research and Practice, New York: Agathon
  17. Grimes, P. W., Millea, M. J., & Woodruff, T. W. (2004). Grades-Who's to blame? Student evaluation of teaching and locus of control. J. of Economic Education, 35(2) 129-147 https://doi.org/10.3200/JECE.35.2.129-147
  18. Hoy, W. & Miskel, C. (2005). Educational Administration: Theory, Research, and Practice (7th ed.). New York: Mcgraw Hill
  19. Hoyt, D.P. & Palltett, W. H. (1999). Appraising teaching and effectiveness: Beyond student ratings, IDEA paper, 36, IDEA center, Kansas State University, 1-8
  20. L'Hommedieu, R., Mengers, R. J., & Brinko, K. T. (1990). Methodological explanations for the modest effects of feedback from student ratings. J. of Educational Psychology, 82, 232-241 https://doi.org/10.1037/0022-0663.82.2.232
  21. Marsh, H.W.(1994). Weighting for the right criteria in the instructional development and effectiveness assessment(IDEA) system: global and specific ratings of teaching effectiveness and their relation to course objectives. J. of educational psychology, 86(4), pp. 631-648 https://doi.org/10.1037/0022-0663.86.4.631
  22. Marsh, H.W., & Roche, L. (1993). The use of students' evaluation and an individually structured intervention to enhance university teaching effectiveness. American Educational Research Journal, 30, 217-251 https://doi.org/10.3102/00028312030001217
  23. McGreal, T. L. (1990). The use of rating scales in teacher evaluation: Concerns and recommendations. J. of Personnel Evaluation in Education, 4, 41-58
  24. McKeachie, W.J. (1996). Research on college : The historical background. J. of Educational Psychology, 82, 189-200
  25. McKee, B. G., & Dowaliby, F. J. (1985). The relationship between student, course, and instructor characteristics and hearing-impaired students' ratings of instruction. Volta- Review, 87, 77-86
  26. Murray, H. G. (1985). Classroom teaching behaviors related to college teaching effectiveness. New Directions for Teaching and Learning, 23, 21-34
  27. Ory, J. C. (2001). Faculty thoughts and concerns about students ratings. New Directions for Teaching and Learning. 87, 3-15
  28. Saroyan, A. & Amundsen, C. (2001). Evaluating University Teaching: time to take stock. Assessment & Evaluation on Higher Education, 36(4), 341-353
  29. Seldin, P. (1993). Rating student ratings of professors. The Education Digest, 70-72
  30. Shevlin, M., et. al. (2000). The validity of student evaluation of teaching in higher education: Love me, love my lectures. Assessment & Evaluation in Higher Education, 25(4), 397-405 https://doi.org/10.1080/713611436
  31. Smith, R. A., & Cranton, P. A. (1992). Students' perceptions of teaching skills and overall effectiveness across instructional settings. Research in Higher Education, 33, 747-764 https://doi.org/10.1007/BF00992056
  32. Spooren, P., Mortelmans, D. (2006). Teacher professionalism and student evaluation of teaching: Will better teachers receive higher ratings and will better students give higher ratings?. Educational Studies, 32(2), 201-214 https://doi.org/10.1080/03055690600631101
  33. Theall, M., Abrami,P.C. & Mets, L.A. (Eds). (2001). The Student Ratings Debate: Are They Valid? How can we best use them? San Francisco: Jossy-Bass
  34. Wilson, R. C. (1986). Improving faculty teaching-Effective use of student evaluations and consultants. Journal of Higher Education, 57, 196-211 https://doi.org/10.2307/1981481