• Journal of Engineering Education Research
• /
• v.27 no.1
• /
• pp.63-70
• /
• 2024

The capstone design classes in the College of Engineering are often team project-oriented, and teamwork skills are reported to positively impact problem-solving abilities. While team project courses have various advantages, they also come with challenges such as social loafing and issues related to free riders, which consistently hinder the positive effects of team project courses. To prevent these issues, there is a need to provide a clear evaluation-reward system for team members' contributions. In this study, we examined the reliability of peer evaluation scores for team members' contributions and reviewed methods to incorporate them into team project grades. The review results indicated that peer evaluation scores are deemed to have considerable reliability from a qualitative perspective. However, due to the relatively small team size in team project courses (3 to 6 members per team), using the arithmetic mean of peer evaluation scores is statistically challenging. As a complementary approach, this study proposes limiting the reflection ratio of peer evaluation scores and applying a more macroscopic processing method, not the arithmetic mean, to incorporate peer evaluation scores for team contributions into grades.

• Toxicological Research
• /
• v.20 no.1
• /
• pp.1-11
• /
• 2004

Evaluation of toxicological pathology is to some extend subjective judgments by pathologist and the accuracy of pathologist's works is based on the individual training and experiences. It has been required to establish a peer review system for toxicologic pathology and these review system has been employed by various practice of toxicological pathology. It would be pointed out that the possible causes of drifts in pathology are due to 1) lack of knowledge or experience of individual pathologists, 2) poorly maintained consistence of grading among animals in study, 3) different interpretation of findings between pathologists, or 4) pathology data processing. Example cases of diagnostic errors and current practice of peer review including tissue selection criteria, documentation and problem resolution for short-term and carcinogenicity studies were introduced. For sound regulatory system and high integrity of practice in toxicological pathology, current approaches of peer review system were reviewed.

• Journal of Korea Technology Innovation Society
• /
• v.13 no.3
• /
• pp.494-512
• /
• 2010

Recently diversity of research field is emphasized all over the world. Nations with advanced programs in research field keep developing new R&D programs for interdisciplinary studies. These new research atmospheres need objective validity in evaluation process. Peer review is recognized as a best evaluation method for national research and development programs. However, peer review system has restrictive boundary because of its subjectivity of the reviewer. Scientometrics has been developed as an alternative system to peer review. But the effectiveness of quantitative indicators which also has qualitative aspect is rarely analyzed in real program evaluation. In this study, we suggest distribution of marks of peer review and newly developed quantitative review through analyzing deviations between two different reviews in real national R&D program evaluation. Moreover, we could have significant correlation between two review systems in the same case study.

• Safe Food
• /
• v.8 no.1
• /
• pp.36-40
• /
• 2013

• Journal of Information Science Theory and Practice
• /
• v.12 no.1
• /
• pp.87-101
• /
• 2024

As the academic publishing environment evolves rapidly and the open science paradigm emerges, the demand for efficient and transparent peer review is growing. This study outlines efforts to actively introduce advanced concepts in scholarly communication into the submission and review system. AccessON Peer Review Management System Plus (ACOMS+), developed and operated by the Korea Institute of Science and Technology Information, is an online submission and peer review system that aims for open science. This study provides an overview of ACOMS+ and presents its four main features: open peer review, open access publishing and self-archiving, online quantitative/qualitative evaluation, and peer reviewer invitation. The directions for further developing ACOMS+ to fully support open science are also discussed. ACOMS+ is the first system in Korea to introduce the open peer review process and is distinguished as a system that supports open access publishing and digital transformation of academic journals. Furthermore, ACOMS+ is expected to contribute to the advancement of the academic publishing environment through the increasing shift toward open access publishing, transparent peer review, and open science.

• Journal of The Korean Association of Information Education
• /
• v.8 no.4
• /
• pp.471-480
• /
• 2004

Reading ability has been widely considered as one of the basic skills that every student should be conversant with because higher level of thinking power can be acquired through reading. Reading education allows students to build correct way of thinking as well as foster critical thinking ability. However, it can be observed that reading education has not been well addressed accordingly in schools mainly because teachers have only limited amount of time and ability to cope with. In this paper, we developed a Web-based peer evaluation system for improving reading and writing ability so that students are allowed to exchange ideas freely on the Web after reading books as well as evaluate other students' writings, which would facilitate reflective thinking through the computer-mediated communication activities. Students become graders of other students' writings so that they are exposed to different opinions and ideas through which deeper thoughts can be obtained. The learner-centered learning activity instead of teacher-centered may benefit students as well as teachers and the system implementing this idea shows that both students' attitudes and preferences were improved as the result of applying the system to a local elementary school.

• Journal of the Korea Society of Computer and Information
• /
• v.17 no.3
• /
• pp.175-183
• /
• 2012

The study investigates peer rating, one of the most commonly used sources of performance rating other than those of supervisors. On the whole, both field and laboratory studies indicate that peer assessment is a valid and reliable evaluation procedure, but on average, peer rating is not usually accurate. The aim of the investigation is to explore the relationship of beliefs and attitude about the performance appraisal system as well as a dispositional characteristic as self-monitoring with rating behavior. In particular, the study tests whether the relationship between rating context variables-appraisal self efficacy and appraisal validity- and rating behavior depends in part on the personality of the rater. Data from 445 undergraduate students are analyzed for hypotheses testing. The study finds evidences that the high on appraisal self efficacy and appraisal validity are more likely to affect discriminating rating tendency and to reduce rating level. Results also show that self-monitoring make the moderating effects between contextual factors and rating behaviors. Some implications, future research directions, and limitations are discussed.

• Proceedings of the IEEK Conference
• /
• 2002.06a
• /
• pp.343-346
• /
• 2002

This paper presents a Prototype system developed for a Bluetooth interfaced VoIP system. The VoIP phone is developed based on tile implementation of a CELP coder on the TI 16bit DSP Processor A PC interfaced with Bluetooth module is used to designing a access point system. Host controller protocol stack is implemented to realize gateway between the wireless and wired line networks. A server application program for user management and call processing, which is based on TCP/IP peer to peer connection, is implemented for tile evaluation of overall interface system.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.5 no.11
• /
• pp.2143-2159
• /
• 2011

The hybrid architecture of content delivery networks (CDN) and peer-to-peer overlay networks (P2P) is a promising technology enables effective real-time streaming services. It complements the advantages of quality control and reliability in a CDN, and the scalability of a P2P system. With real-time streaming services, however, high connection setup and media delivery latency are becoming the critical issues in deploying the CDN-P2P system. These issues result from biased peer selection without location awareness or content awareness, and can lead to significant service disruption. To reduce service disruption latency, we propose a group-based CDN-P2P hybrid architecture (iCDN-P2P) with a location/content-aware selection of peers. Specifically, a SuperPeer network makes a location-aware peer selection by employing a content addressable network (CAN) to distribute channel information. It also manages peers with content awareness, forming a group of peers with the same channel as the sub-overlay. Through a performance evaluation, we show that the proposed architecture outperforms the original CDN-P2P hybrid architecture in terms of connection setup delay and media delivery time.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.5 no.1
• /
• pp.157-176
• /
• 2011

An interest-based P2P constructs the peer connections based on similarities for efficient search of resources. A clustering technique using peer similarities as data is an effective approach to group the most relevant peers. However, the separation of groups produced from clustering lowers the scalability of a P2P network. Moreover, the interest-based approach is only concerned with user-level grouping where topology-awareness on the physical network is not considered. This paper proposes an efficient scalable search for the interest-based P2P system. A scalable multi-ring (SMR) based on fuzzy clustering handles the grouping of relevant peers and the proposed scalable search utilizes the SMR for scalability of peer queries. In forming the multi-ring, a minimized route function is used to determine the shortest route to connect peers on the physical network. Performance evaluation showed that the SMR acquired an accurate peer grouping and improved the connectivity rate of the P2P network. Also, the proposed scalable search was efficient in finding more replicated files throughout the peer network compared to other traditional P2P approaches.