Browse > Article

Improving Course Evaluation System of Engineering Education  

Kim, Hak-Il (College of Engineering, Inha University)
Kim, Sung-Sook (SGInstitute Inc.)
Kwon, Oh-Yang (College of Engineering, Inha University)
Lee, Cheon (College of Engineering, Inha University)
Row, Kyung-Ho (College of Engineering, Inha University)
Publication Information
Journal of Engineering Education Research / v.10, no.4, 2007 , pp. 58-77 More about this Journal
Abstract
An evaluation system of teaching is one of authentic assessment tools for improving the quality of higher education. The purpose of this study is to cultivate the class evaluation system in the college of engineering based on the empirical analysis of the results of the class evaluation. Especially, this study investigates the validity evidence using the confirmatory factor analysis of the class evaluation. The data used in this study were acquired from 49,127 student's evaluation responses of 471 courses offered in colleges of natural science and engineering at a university in Korea. The reliabilities are quite good for every construct by producing an index value from 0.92 to 0.98. The results provides a guideline for an appropriate measurement model to report the information, to clarify quality and appropriateness of instrument items, to make recommendations for which items should be left or merged in the revised instrument. A special suggestion for improving student's evaluation of each course is to prepare a well-designed instruction for students explaining why and how to evaluate the course in order to produce reliable and valid results.
Keywords
Evaluation of teaching; Evaluation instrument; Validity; Reliability;
Citations & Related Records
연도 인용수 순위
  • Reference
1 김성숙(1993). 관찰을 통한 교수 평가체계에 대한 측정의 일반화가능도 연구, 교육학 연구, 31(1), 23-40
2 Algozzine, B., et. al. (2004). Student evaluation of college teaching: A practice in search of principles. College Teaching, 52(4), 134-141   DOI
3 Brinko, K. T. (1990). Instructional consultation with feedback in higher education. J. of Higher Education, 61, 65-83   DOI   ScienceOn
4 Cook, S. S. (1989). Improving the quality of student ratings of instruction: A look at two strategies. Research in Higher Education, 30, 31-45   DOI
5 Marsh, H.W., & Roche, L. (1993). The use of students' evaluation and an individually structured intervention to enhance university teaching effectiveness. American Educational Research Journal, 30, 217-251   DOI   ScienceOn
6 Ory, J. C. (2001). Faculty thoughts and concerns about students ratings. New Directions for Teaching and Learning. 87, 3-15
7 Seldin, P. (1993). Rating student ratings of professors. The Education Digest, 70-72
8 Broder, J. M., & Dorfman, J. H. (1994). Determinants of teaching quality: What's important to students?. Research in Higher Education, 35, 235-249   DOI
9 Shevlin, M., et. al. (2000). The validity of student evaluation of teaching in higher education: Love me, love my lectures. Assessment & Evaluation in Higher Education, 25(4), 397-405   DOI   ScienceOn
10 AERA, APA, NCME (1985, 1999). Standards for educational and psychological testing, Washington D.C
11 Spooren, P., Mortelmans, D. (2006). Teacher professionalism and student evaluation of teaching: Will better teachers receive higher ratings and will better students give higher ratings?. Educational Studies, 32(2), 201-214   DOI   ScienceOn
12 Bukalski, P. J., & Zirpola, D. J. (1993). Guide for nontenured faculty members: Annual evaluation, promotion, and tenure. University Film and Association of Georgia State University
13 Hoyt, D.P. & Palltett, W. H. (1999). Appraising teaching and effectiveness: Beyond student ratings, IDEA paper, 36, IDEA center, Kansas State University, 1-8
14 Marsh, H.W.(1994). Weighting for the right criteria in the instructional development and effectiveness assessment(IDEA) system: global and specific ratings of teaching effectiveness and their relation to course objectives. J. of educational psychology, 86(4), pp. 631-648   DOI   ScienceOn
15 한신일, 김혜정, 이정연(2005). 한국 대학의 강의 평가 실태 분석. 교육행정학 연구. 23(3), pp. 379-403
16 성태제(2002). 현대 교육평가. 학지사
17 McGreal, T. L. (1990). The use of rating scales in teacher evaluation: Concerns and recommendations. J. of Personnel Evaluation in Education, 4, 41-58
18 Murray, H. G. (1985). Classroom teaching behaviors related to college teaching effectiveness. New Directions for Teaching and Learning, 23, 21-34
19 Wilson, R. C. (1986). Improving faculty teaching-Effective use of student evaluations and consultants. Journal of Higher Education, 57, 196-211   DOI   ScienceOn
20 지은림, 장정아(2006). 대학 교수자를 위한 강의 자가진단도구 개발의 타당화 및 관련 변인 탐색. 교육평가연구, 19(1), 51-71
21 Grimes, P. W., Millea, M. J., & Woodruff, T. W. (2004). Grades-Who's to blame? Student evaluation of teaching and locus of control. J. of Economic Education, 35(2) 129-147   DOI   ScienceOn
22 Smith, R. A., & Cranton, P. A. (1992). Students' perceptions of teaching skills and overall effectiveness across instructional settings. Research in Higher Education, 33, 747-764   DOI
23 김성숙(2006). e-learning 강의평가 도구의 일반화가능도와 평가활용의 최적화 조건, 교육평가연 구. 19(1), 305-322
24 Feldman, K. A. (1997). Identifying exemplary teachers and teaching : Evidence from student ratings. In R. P. Perry, & J.C. Smart(eds). Effective teaching in Higher Education : Research and Practice, New York: Agathon
25 McKeachie, W.J. (1996). Research on college : The historical background. J. of Educational Psychology, 82, 189-200
26 김성열, 박재완, 김종철, 강현석(2001). 대학 학사과정 강의평가제 실태분석을 통한 교육업적 평 가모형 개발연구. 교육인적 자원부 정책연구, 2001-일-30
27 Saroyan, A. & Amundsen, C. (2001). Evaluating University Teaching: time to take stock. Assessment & Evaluation on Higher Education, 36(4), 341-353
28 길양숙, 김동진(2003). 수업평가 결과와 쟁점. 한국교육학회. 교육학연구, 41(3), 303-323
29 이종승(1993). 교수의 강의평가에 관한 연구. 충남대학교 교육연구소. 교육발전논총, 14(1), 83-95
30 McKee, B. G., & Dowaliby, F. J. (1985). The relationship between student, course, and instructor characteristics and hearing-impaired students' ratings of instruction. Volta- Review, 87, 77-86
31 Theall, M., Abrami,P.C. & Mets, L.A. (Eds). (2001). The Student Ratings Debate: Are They Valid? How can we best use them? San Francisco: Jossy-Bass
32 L'Hommedieu, R., Mengers, R. J., & Brinko, K. T. (1990). Methodological explanations for the modest effects of feedback from student ratings. J. of Educational Psychology, 82, 232-241   DOI
33 송미섭, 지은림(1994). 강의평가 설문지에 관한 문항분석 연구. 교육평가연구, 7(2), 263-283
34 Hoy, W. & Miskel, C. (2005). Educational Administration: Theory, Research, and Practice (7th ed.). New York: Mcgraw Hill