• 제목/요약/키워드: Peer Evaluation System

검색결과 61건 처리시간 0.02초

팀원 기여도에 대한 동료평가의 신뢰성과 성적 반영 방법에 대한 연구 -종합설계교과목을 중심으로- (A Study on the Reliability of Peer-evaluation for Team Members' Contributions and Incorporating Method into Grades - Focusing on the Capstone Design -)

  • 장현재
    • 공학교육연구
    • /
    • 제27권1호
    • /
    • pp.63-70
    • /
    • 2024
  • The capstone design classes in the College of Engineering are often team project-oriented, and teamwork skills are reported to positively impact problem-solving abilities. While team project courses have various advantages, they also come with challenges such as social loafing and issues related to free riders, which consistently hinder the positive effects of team project courses. To prevent these issues, there is a need to provide a clear evaluation-reward system for team members' contributions. In this study, we examined the reliability of peer evaluation scores for team members' contributions and reviewed methods to incorporate them into team project grades. The review results indicated that peer evaluation scores are deemed to have considerable reliability from a qualitative perspective. However, due to the relatively small team size in team project courses (3 to 6 members per team), using the arithmetic mean of peer evaluation scores is statistically challenging. As a complementary approach, this study proposes limiting the reflection ratio of peer evaluation scores and applying a more macroscopic processing method, not the arithmetic mean, to incorporate peer evaluation scores for team contributions into grades.

독성병리 Peer Review의 중요성과 실제적 접근방법 (Importance of Peer Review in Toxicological Pathology and Its Practical Approach)

  • 손우찬;김배환;장동덕;한범석;양기화;이영순
    • Toxicological Research
    • /
    • 제20권1호
    • /
    • pp.1-11
    • /
    • 2004
  • Evaluation of toxicological pathology is to some extend subjective judgments by pathologist and the accuracy of pathologist's works is based on the individual training and experiences. It has been required to establish a peer review system for toxicologic pathology and these review system has been employed by various practice of toxicological pathology. It would be pointed out that the possible causes of drifts in pathology are due to 1) lack of knowledge or experience of individual pathologists, 2) poorly maintained consistence of grading among animals in study, 3) different interpretation of findings between pathologists, or 4) pathology data processing. Example cases of diagnostic errors and current practice of peer review including tissue selection criteria, documentation and problem resolution for short-term and carcinogenicity studies were introduced. For sound regulatory system and high integrity of practice in toxicological pathology, current approaches of peer review system were reviewed.

국가연구개발사업 계량평가 도입 효용성에 대한 실증적 분석- 세계수준의 연구중심대학(WCU)육성사업을 중심으로 - (Practical Analysis of Developed Bibliometric Indicators for Evaluation of National R&D Programs - Case Study of World Class University Program -)

  • 조우현;우정표;송충한
    • 기술혁신학회지
    • /
    • 제13권3호
    • /
    • pp.494-512
    • /
    • 2010
  • 전 세계적으로 융복합 지향적 연구활동이 강화됨에 띠라 연구분야의 다양성과 새로운 연구분야의 개척은 물론 국가간 협력을 통한 연구가 활발히 진행되고 있다. 이러한 새로운 형태의 연구가 계속 발굴되고 있는데 반해 그 연구를 정확히 평가하고 객관적으로 검증하는 방법에는 한계가 있는 현실이다. 동료평가(peer Review)만으로는 정확한 연구과제 평가가 제한적이라는 인식이 확대되고 있으나 이를 보완할 객관적인 평가방법의 제사는 아직 실증적으로 검증되지 못하고 있다. 따라서 본 논문에서는 최근 새롭게 추진된 국가연구개발사업에 동료평가와 신규 계량지표에 의한 평가를 적용하여 그 결과의 반영비율 및 상관도를 측정하였다. 그 결과 계량지표의 적용이 실증적으로 유의미한 결과를 갖는 것으로 분석되었다.

  • PDF

Online Submission and Review System for Open Science: A Case of AccessON Peer Review Management System Plus (ACOMS+)

  • Jaemin Chung;Eunkyung Nam;Sung-Nam Cho;Jeong-Mee Lee;Hyunjung Kim;Hye-Sun Kim;Wan Jong Kim
    • Journal of Information Science Theory and Practice
    • /
    • 제12권1호
    • /
    • pp.87-101
    • /
    • 2024
  • As the academic publishing environment evolves rapidly and the open science paradigm emerges, the demand for efficient and transparent peer review is growing. This study outlines efforts to actively introduce advanced concepts in scholarly communication into the submission and review system. AccessON Peer Review Management System Plus (ACOMS+), developed and operated by the Korea Institute of Science and Technology Information, is an online submission and peer review system that aims for open science. This study provides an overview of ACOMS+ and presents its four main features: open peer review, open access publishing and self-archiving, online quantitative/qualitative evaluation, and peer reviewer invitation. The directions for further developing ACOMS+ to fully support open science are also discussed. ACOMS+ is the first system in Korea to introduce the open peer review process and is distinguished as a system that supports open access publishing and digital transformation of academic journals. Furthermore, ACOMS+ is expected to contribute to the advancement of the academic publishing environment through the increasing shift toward open access publishing, transparent peer review, and open science.

초등학교의 독서교육을 위한 웹 기반 동료평가 시스템의 구현 (Implementation of a Web-based Peer Evaluation System for Reading Education in Elementary Schools)

  • 박창욱;문교식
    • 정보교육학회논문지
    • /
    • 제8권4호
    • /
    • pp.471-480
    • /
    • 2004
  • 독서를 통하여 높은 수준의 사고능력을 습득할 수 있으므로 독서능력은 모든 학생들이 갖추어야할 기본 능력으로 간주되고 있다. 또한 독서교육은 학생들에게 올바른 사고와 비판적 능력을 함양할 수 있다. 그러나 독서교육은 교사의 시간적 제약과 대응력의 부족으로 비중 있게 다루어지지 못했다. 이에 본 연구에서는 웹을 기반으로 하는 동료평가 시스템을 구현하여 독서교육에 활용하는 방안을 연구하였다. 학생들은 웹에서 자유롭게 독후감을 작성하고 다른 학생들이 쓴 독후감을 평가할 수 있다. 동료평가 과정은 단순히 점수화를 위한 것이 아니라 동료들의 평가와 조언을 활발하게 받아들이고 다른 사람의 글을 읽고 평가하면서 자신의 글에 대한 반성적 사고를 할 수 있다. 교사중심이 아닌 학습자중심의 활동으로 교사와 학습자 모두에게 유익을 주기 위함이다. 본 시스템을 초등학교 현장에 적용한 결과 학생들의 독서에 대한 태도와 선호도가 향상된 것으로 나타났다.

  • PDF

동료평가 시스템에서의 상황맥락 요인과 평가행동 (Contextual Factors and Rating Behavior in the Peer Evaluation System)

  • 박종혁
    • 한국컴퓨터정보학회논문지
    • /
    • 제17권3호
    • /
    • pp.175-183
    • /
    • 2012
  • 본 연구는 동료평가 시스템의 활용도 제고 방안을 모색하기 위한 목적으로 수행되었다. 동료평가는 신뢰성과 타당성을 확보함에도 불구하고 평가 참여자의 측정치 왜곡 등 부정확한 평가결과로 폭넓게 활용되지 못하고 있다. 최근의 성과평가 연구에서는 평가가 이루어지는 프로세스에 대한 이해를 도모하기 위해 조직차원의 상황맥락에 주목하고 있다. 본 연구는 평가행동에 영향을 미치는 상황맥락요인으로 평가 자신감 및 평가 타당성을, 개인 성격 특성으로 자기모니터링을 채택하고 평가행동에 미치는 영향을 검증하였다. 445명의 학생을 대상으로 자료를 수집하여 가설을 검증한 결과, 평가 자신감 및 평가 타당성은 정확한 평가행동을 유인함이, 또한 자기모니터링은 조절효과를 가짐이 검증되었다. 기타 시사점 및 향후 연구를 위한 제언도 포함하였다.

Bluetooth를 이용한 VOIP Phone 의 Wireless LAN Access System 개발 (Design and Implementation of a Bluetooth LAN access system for VoIP phone)

  • 김정근;김영덕;장태규
    • 대한전자공학회:학술대회논문집
    • /
    • 대한전자공학회 2002년도 하계종합학술대회 논문집(1)
    • /
    • pp.343-346
    • /
    • 2002
  • This paper presents a Prototype system developed for a Bluetooth interfaced VoIP system. The VoIP phone is developed based on tile implementation of a CELP coder on the TI 16bit DSP Processor A PC interfaced with Bluetooth module is used to designing a access point system. Host controller protocol stack is implemented to realize gateway between the wireless and wired line networks. A server application program for user management and call processing, which is based on TCP/IP peer to peer connection, is implemented for tile evaluation of overall interface system.

  • PDF

A CDN-P2P Hybrid Architecture with Location/Content Awareness for Live Streaming Services

  • Nguyen, Kim-Thinh;Kim, Young-Han
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제5권11호
    • /
    • pp.2143-2159
    • /
    • 2011
  • The hybrid architecture of content delivery networks (CDN) and peer-to-peer overlay networks (P2P) is a promising technology enables effective real-time streaming services. It complements the advantages of quality control and reliability in a CDN, and the scalability of a P2P system. With real-time streaming services, however, high connection setup and media delivery latency are becoming the critical issues in deploying the CDN-P2P system. These issues result from biased peer selection without location awareness or content awareness, and can lead to significant service disruption. To reduce service disruption latency, we propose a group-based CDN-P2P hybrid architecture (iCDN-P2P) with a location/content-aware selection of peers. Specifically, a SuperPeer network makes a location-aware peer selection by employing a content addressable network (CAN) to distribute channel information. It also manages peers with content awareness, forming a group of peers with the same channel as the sub-overlay. Through a performance evaluation, we show that the proposed architecture outperforms the original CDN-P2P hybrid architecture in terms of connection setup delay and media delivery time.

Scalable Search based on Fuzzy Clustering for Interest-based P2P Networks

  • Mateo, Romeo Mark A.;Lee, Jae-Wan
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제5권1호
    • /
    • pp.157-176
    • /
    • 2011
  • An interest-based P2P constructs the peer connections based on similarities for efficient search of resources. A clustering technique using peer similarities as data is an effective approach to group the most relevant peers. However, the separation of groups produced from clustering lowers the scalability of a P2P network. Moreover, the interest-based approach is only concerned with user-level grouping where topology-awareness on the physical network is not considered. This paper proposes an efficient scalable search for the interest-based P2P system. A scalable multi-ring (SMR) based on fuzzy clustering handles the grouping of relevant peers and the proposed scalable search utilizes the SMR for scalability of peer queries. In forming the multi-ring, a minimized route function is used to determine the shortest route to connect peers on the physical network. Performance evaluation showed that the SMR acquired an accurate peer grouping and improved the connectivity rate of the P2P network. Also, the proposed scalable search was efficient in finding more replicated files throughout the peer network compared to other traditional P2P approaches.