Browse > Article
http://dx.doi.org/10.11627/jkise.2013.36.1.44

Equitable Peer Assessment Method in Collaboration Project Using Statistical Technique  

Cho, Miyeon (Department of Business Engineering, Karlsruhe Institute of Technology(KIT))
Ko, Sung-Seok (Department of Industrial Engineering, Konkuk University)
Publication Information
Journal of Korean Society of Industrial and Systems Engineering / v.36, no.1, 2013 , pp. 44-52 More about this Journal
Abstract
For evaluating participation in collaboration project, the peer assement method is mostly used and various scoring methods have been proposed. But, the reliability and validity of the peer assessment method are still doubted for all most method. In order to overcome these weaknesss, some guidelines and training methods have been recommended. In this article, however, statistical technique is proposed for measuring individual contributions to collaboration projects considering each assessor's reliability. The gist of our proposed algorithm is that an assessor's reliability depends on the evaluation policy, and this reliability is evaluated by an analysis of variance of the scores assigned by the assessor. We also show that the proposed method is very efficient by case study in university class.
Keywords
Peer Review; Contribution; Chi-square test;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 Marjo van Zundert, Effective peer assessment processes : Research findings and future directions. Learning and Instruction, 2009, Vol. 20, p 270-279.
2 Michaelsen, L.K., Team learning : a comprehensive approach for harnessing the power of small groups in higher education. To Improve the Academy, 1994, Vol. 11, p 107-122.
3 Panchal, J. and Fathianathan, M., Product Realization in The Age of Mass Collaboration, Proc. ASME 2008 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, 2008, p 3-6.
4 Parsons, D., Justice in the Classroom : Peer Assessment of Contributions in Group Projects, Proc. 17th NACCQ, 2004, p 145-151.
5 Raban, R. and Litchfield, A., Supporting peer assessment of individual contributions in groupwork, Proc. 23rd Annual Ascilite Conference, 2007, p 685-694.
6 Topping, K.J., Peer Assessment, Theory Into Practice, 2009, p 20-27.
7 Freeman, M., Peer assessment by groups of group work. Assessment and Evaluation in Higher Education, 1995, Vol. 20, p. 289-299.   DOI   ScienceOn
8 Gehringer, E.F., Assessing Studentsʼ Wiki Contributions, 2008 American Society for Engineering Education Annual Conference and Exposition, 2008.
9 Herbet, N., Peer assessment : Is it fair?, In Uniserve science assessment symposium proceeding. Sydney, 2006.
10 Kennedy, J.G., Peer-assessment in Group Projects : Is It Worth It?, Australian Computer Society, Inc, 2005, Vol. 42.
11 Ko, S.S. and Cho, M.Y., The Quality Control System on Online Collaboration System. Journal of the Society of Korea Industrial and Systems Engineering, 2010, Vol. 33, p 127-132.