• Title/Summary/Keyword: peer-assessment

Search Result 150, Processing Time 0.03 seconds

Development and Application of a Web-Based Performance Assessment System Using Open Sources (오픈 소스를 활용한 웹기반 수행평가 시스템 개발 및 적용)

  • Kim, Jeong-Rang;Kim, Chul;Park, Sun-Ju;Ma, Dae-Sung;Park, Su-Chul;Hur, Sung
    • Journal of The Korean Association of Information Education
    • /
    • v.14 no.4
    • /
    • pp.659-666
    • /
    • 2010
  • Performance assessment is recognized as a proper evaluation method to integrate the teaching and learning process into the evaluation one and as an essential means to produce meaningful evaluation results. However, it has deteriorated into a teacher-centric evaluation method with the students excluded due to the cost and time issues and the heavy workload on the teachers. Those changes have affected the reliability of the assessment results. This study developed and applied a web-based performance assessment system by using Moodle, open source software, to help the teachers efficiently run performance assessment in school and the students increase their learning effects. As a result, it lifted the burden of system development from the shoulders of the teachers trying to do web-based performance assessment and solved the reliability issue raised in the old peer evaluation approach through diverse strategies offered by Moodle.

  • PDF

Facilitating Productive Reflection of Pre-service Elementary Teachers through Reflective Journal Writing and Discussion about Science Peer Teaching Practice (과학 모의 수업에 대한 반성 저널 쓰기와 토론을 통한 초등 예비교사의 생산적 반성 증진)

  • Yoon, Hye-Gyoung
    • Journal of Korean Elementary Science Education
    • /
    • v.32 no.2
    • /
    • pp.113-126
    • /
    • 2013
  • In this study, the researcher aimed to increase productive reflection of pre-service elementary teachers through reflective journal writing and discussion after science peer teaching practice. 'Productive reflection' involves consideration and analysis of interrelationships among aspects of teaching including learners and learning, subject matter knowledge, assessment, and instruction. During 8 week efforts, productive reflection has increased gradually in both individual journal and class discussion. However half of individual journals didn't show productive reflection even in the final stage. This implicated that development of reflective thinking is an achievable but progressive change. By describing the progress in discussion and participants' responses on journal writing and discussion activity, this study shed light on practical ways of enhancing reflective teacher education.

Comparison of Treatment Outcome Assessment for Class I Malocclusion Patients: Peer Assessment Rating versus American Board of Orthodontics-Objective Grading System

  • Hong, Mihee;Kook, Yoon-Ah;Baek, Seung-Hak;Kim, Myeng-Ki
    • Journal of Korean Dental Science
    • /
    • v.7 no.1
    • /
    • pp.6-15
    • /
    • 2014
  • Purpose: The purpose of this retrospective study is to investigate the degree of coincidence between the peer assessment rating (PAR) index and American Board of Orthodontics objective grading system (ABO-OGS) in the assessment of orthodontic treatment outcomes of Class I malocclusion cases. Materials and Methods: The sample consisted of 26 Class I patients. The PAR index was used for evaluation of pre-(T0) and posttreatment (T1) casts, and the ABO-OGS for assessment of T1 casts. If there was a reduction in PAR scores from T0 to T1 of more than 30%, the label 'PAR+' was given to the case, and if not, it was labeled 'PAR-'. If the ABO-OGS was less than 27, the label 'OGS+' was given to the case and if not, it was labeled 'OGS-'. 'A PAR-only qualified group' (PAR+), 'ABO-OGS-only qualified group' (OGS+), 'both indices qualified group' (PAR+/OGS+), and 'both indices disqualified group' (PAR-/OGS-) were compared with a Wilcoxon rank-sum test, sensitivity/specifi city test and Spearman's correlation test. Result: PAR scores for T0, T1, and percentage reduction were 21.1, 6.4, and 65.9%, respectively, and 35.4 for ABOOGS. The distribution of the 'PAR+/OGS+', 'PAR+', and 'PAR-/OGS-' group was 19.3%, 76.9%, and 3.8%, respectively. The T0-PAR, T1-PAR and PAR point reductions for the 'PAR+' group were significantly higher than those of 'PAR+/OGS+' groups (23.1 vs. 15.6; 6.7 vs. 4.6; and 16.5 vs. 11.0; all P<0.05). However, the PAR-percentage reduction and treatment duration between the two groups were not statistically different (70.0% vs. 67.0%, P=0.4325; 24.1 months vs. 25.0 months, P=0.4057). The T1-ABO-OGS score for 'PAR+' group was significantly higher than that of the 'PAR+/OGS+' groups (38.2 vs. 24.0, P<0.001). Conclusion: Since the fraction of the 'PAR+/OGS+' group was less than 20% and there was no significant correlation between PAR-percentage reduction and T1-ABO-OGS, development of a new index system for the accurate evaluation of treatment outcome is needed.

A Study on Multiple Sources Evaluation for Practical Education in the Core Basic Nursing Skills in Nursing Students (핵심기본간호술 실습교육에 대한 다면평가 연구)

  • Song, Hyo-Suk;Lim, So Hee
    • The Journal of Korean Academic Society of Nursing Education
    • /
    • v.22 no.1
    • /
    • pp.5-13
    • /
    • 2016
  • Purpose: The purpose of this study is to provide essential resources on various evaluation strategies by identifying relationships between professor-evaluation, peer-evaluation, and self-evaluation of the core basic nursing skills in nursing students. Methods: Forty third-year nursing students who participated in core basic nursing skills were given the same checklist that was used for assessment by the examiners. Then, the scores of the professor and the students were compared and analyzed with SPSS/WIN 18.0. Results: The scores of the student peer (178.54) and student self-evaluation(177.74) was significantly higher than the scores of professor-evaluation (172.05),(F=5.03, p=.008). There was a significant, positive correlation between the professor-evaluation and the student-peer-evaluation in skill-scores(r=.47, p=.002) and attitude-scores(r=.52, p<.001). In addition, the professor-evaluation and the self-evaluation each showed a significant, positive correlation in skill-scores(r=.61, p<.001) and attitude-scores(r=.36, p=.023). Conclusion: The study result indicates that in order to expand the evaluation method, the professor evaluation, as well as the student self and the peer evaluation, will contribute to improve the educational achievement of learners.

Effects of Socio-Demographic Characteristics and Peer Relations on the Emotional, Behavioral, and Comorbid Disorder Symptoms in Low-SES Children

  • Sohn, Byoung-Duk
    • International Journal of Human Ecology
    • /
    • v.11 no.1
    • /
    • pp.49-63
    • /
    • 2010
  • The current study examined the effects of socio-demographic characteristics and peer relations on the emotional, behavioral, and comorbid disorder symptoms among low-low-SES children, using the Young Lives Survey: an International Study of Childhood Poverty: Round 1, 2002. Participants were 1,000 8-year-old children (502 boys and 498 girls) from low-low-SES families. Data were analyzed using ANOVA, t-tests, post hoc test (Scheffe's method), correlations, and multiple logistic regression analyses according to the analysis strategy. There was a moderate correlation between selected socio-demographic variables and emotional/behavioral disorder symptoms, and the caregiver's marital status, child's health compared to others, child's work status corresponded to significant differences in their emotional/behavior levels. Regarding the logistic regression analysis, in addition to the effects of socio-demographic variables reflecting the characteristics of less-developed countries, marital status, child's working status, and conflicts with peers proved to be detrimental to emotional, behavioral, or comorbid disorder symptoms in low-SES children, who have been lack quality parenting, social resources, and child human rights. Results indicated the need to develop health care services that would address those problems and appropriate intervention and prevention programs targeting children in low-income families. Moreover, careful assessment and intervention for child's health status, child's working status and peer relationship problems are suggested as possible strategies for helping children at risk of exhibiting further problematic behaviors.

Recognition of Assessment Strategies of Pre-Service Elementary Teachers (예비초등교사들의 평가전략에 대한 인식 조사)

  • Ko, Eun-Sung;Park, Mimi;Lee, Eun Jung;Park, Min-Sun
    • Journal of Educational Research in Mathematics
    • /
    • v.27 no.2
    • /
    • pp.291-312
    • /
    • 2017
  • According to the current research of educational assessment, formative assessment which focuses on improving students' learning has been emphasized. Consequently, integration between instruction and assessment is crucial and various assessment strategies are required. In order to use different assessment strategies in classrooms, teachers should experience strategies and reflect their strengths and weaknesses. In this study, pre-service elementary teachers experienced six assessment strategies (feedback, providing assessment standard, providing exemplary cases, self assessment, peer assessment, and written assessment), and their perceptions toward each strategy were investigated. During one semester, pre-service teachers experienced each of them and they answered questionnaire at the end of the semester. From the results, it is found that pre-service teachers presented different strategies that were most helpful in their cognitive and affective domain according to their perception of assessment. The results imply that different assessment strategies should be applied in instruction and teachers should extend their perception of assessment purposes.

A Study on the Strategy of Performance Assessment based on Classroom (수업 연계 수행평가 전략 설계 방안 연구)

  • Won, Hyo-Heon;Heo, Gyun
    • Journal of Fisheries and Marine Sciences Education
    • /
    • v.27 no.1
    • /
    • pp.125-132
    • /
    • 2015
  • The purpose of this study was to search the concept and meaning of performance assessment(PA) in the classroom, and the to proposed some strategies to apply PA. The result of this study was presented below. First, differentiation strategy is necessary in the evaluation goal. Individualization will be an example of differentiation strategy in the evaluation of group goal. Second, various strategies are needed based on the subjects of evaluation. Self-evaluation, peer-evaluation, and small group-evaluation are some examples evaluation for the subjects. Third, there is a need for phase-strategy assessment. For the class associated performance assessment, we have to consider the evaluation activities based on the time likes before (pre), on, and after class. How to select the evaluation task is also one of the key sucess factors for improving the class associated performance assessment.

The Improvement and Completion of Outcome index: A new assessment system for quality of orthodontic treatment

  • Hong, Mihee;Kook, Yoon-Ah;Kim, Myeng-Ki;Lee, Jae-Il;Kim, Hong-Gee;Baek, Seung-Hak
    • The korean journal of orthodontics
    • /
    • v.46 no.4
    • /
    • pp.199-211
    • /
    • 2016
  • Objective: Given the considerable disagreement between the Peer Assessment Rating (PAR) index and the American Board of Orthodontics Cast-Radiograph Evaluation, we aimed to develop a novel assessment system-the Improvement and Completion of Outcome (ICO) index-to evaluate the outcome of orthodontic treatment. Methods: Sixteen criteria from 4 major categories were established to represent the pretreatment malocclusion status, as well as the degree of improvement and level of completion of outcome during/after treatment: dental relationship (arch length discrepancy, irregularity, U1-SN, and IMPA); anteroposterior relationship (overjet, right and left molar position, ANB); vertical relationship (anterior overbite, anterior open-bite, lateral open-bite, SN-MP); and transverse relationship (dental midline discrepancy, chin point deviation, posterior cross-bite, occlusal plane cant). The score for each criterion was defined from 0 or -1 (worst) to 5 (ideal value or normal occlusion) in gradations of 1. The sum of the scores in each category indicates the area and extent of the problems. Improvement and completion percentages were estimated based on the pre- and post-treatment total scores and the maximum total score. If the completion percentage exceeded 80%, treatment outcome was considered successful. Results: Two cases, Class I malocclusion and skeletal Class III malocclusion, are presented to represent the assessment procedure using the ICO index. The difference in the level of improvement and completion of treatment outcome can be clearly explained by using 2 percentage values. Conclusions: Thus, the ICO index enables the evaluation of the quality of orthodontic treatment objectively and consecutively throughout the entire treatment process.

Contextual Factors and Rating Behavior in the Peer Evaluation System (동료평가 시스템에서의 상황맥락 요인과 평가행동)

  • Park, Jong-Hyuk
    • Journal of the Korea Society of Computer and Information
    • /
    • v.17 no.3
    • /
    • pp.175-183
    • /
    • 2012
  • The study investigates peer rating, one of the most commonly used sources of performance rating other than those of supervisors. On the whole, both field and laboratory studies indicate that peer assessment is a valid and reliable evaluation procedure, but on average, peer rating is not usually accurate. The aim of the investigation is to explore the relationship of beliefs and attitude about the performance appraisal system as well as a dispositional characteristic as self-monitoring with rating behavior. In particular, the study tests whether the relationship between rating context variables-appraisal self efficacy and appraisal validity- and rating behavior depends in part on the personality of the rater. Data from 445 undergraduate students are analyzed for hypotheses testing. The study finds evidences that the high on appraisal self efficacy and appraisal validity are more likely to affect discriminating rating tendency and to reduce rating level. Results also show that self-monitoring make the moderating effects between contextual factors and rating behaviors. Some implications, future research directions, and limitations are discussed.

Debiasing the biases induced by defendant's character evidence (피고인의 성격증거로 유도된 편향 감소 방안)

  • Ko, Minjo;Park, Jooyong
    • Korean Journal of Forensic Psychology
    • /
    • v.11 no.1
    • /
    • pp.63-87
    • /
    • 2020
  • Judgment and decision-making studies have shown that people are easily influenced and biased by information irrelevant to the object of judgment. There is a great deal of research that indicates that bias exists in the legal judgment scene. One of them is a bias induced by defendants' character evidence. This study examined whether cognitive activities such as discussion, counterfactual thinking, and peer assessment could reduce the bias induced by the character evidece. In Experiment 1, 121 college students were asked to give the percentage they believed the defendant to be guilty. There was no cognitive activity for the control group. There were three different cognitive activities for the experimental group: discussion, counterfactual thinking and discussion, and counterfactual thinking and peer assessment. Results showed reduction in bias for all the experimental groups, and there was no difference between them. In Experiment 2, there were 125 participants from general population for the same procedure as in Experiment 1. Results showed reduction in bias only for the counterfactual thinking and discussion group. In general discussion, we speculated the implication of the results and the reason for the difference between the two experiments.

  • PDF