• 제목/요약/키워드: accuracy of peer assessment

검색결과 7건 처리시간 0.031초

동료평가 정확도 향상 방안의 비교: 평가 기준에 대한 학생들 간 토론 대 전문가 평가 사례 제시 (Student Discussion or Expert Example? How to Enhance Peer Assessment Accuracy)

  • 박정애;박주용
    • 인지과학
    • /
    • 제30권4호
    • /
    • pp.175-197
    • /
    • 2019
  • 고차적 사고를 요구하는 글쓰기는 배운 지식을 활용하고 발전시키게 한다. 학습 장면에서 글쓰기를 더 많이 활용하기 위해서는 동료평가를 도입하는 동시에 동료평가의 정확도를 높일 필요가 있다. 본 연구에서는 동료평가의 정확도를 높이는 방안으로, 평가 기준에 대해 학생들끼리 토론하게 하거나 전문가의 평가를 참고하도록 하는 두 방안을 탐색하였다. 대학생 150명을 대상으로 한 실험 결과, 동료평가 후 전문가의 평가를 참고했던 집단이 평가했던 글을 다시 평가할 때는 평가 정확도가 향상되었지만, 새로운 글을 평가할 때는 향상되지 않았다. 반면에, 동료평가 후 평가 기준에 대하여 토론을 진행했던 집단은 평가했던 글을 다시 평가할 때는 평가 정확도가 향상되지 않았지만, 새로운 글을 평가할 때는 향상됨을 발견하였다. 또한 토론 집단의 경우 평가 기준에 대한 토론에서 총 발언 수가 많아질수록 평가 정확도가 높아졌다. 이상의 결과는 평가 기준에 대한 토론에서 적극적이고 자발적인 논의가 활발할수록 이후 동료평가의 정확도가 향상됨을 시사한다.

Ayres Sensory Integration (ASI$^{(R)}$) 중재 교육에 따른 치료사의 치료 수행도 변화 (Delivery of Therapist's Intervention to the Education of Ayres Sensory Integration$^{(R)}$ (ASI$^{(R)}$))

  • 신예나;홍은경
    • 대한감각통합치료학회지
    • /
    • 제12권1호
    • /
    • pp.13-23
    • /
    • 2014
  • 목적: 본 연구의 목적은 ASI$^{(R)}$의 중재 교육을 6명의 작업치료사에게 실시하고, 교육 전과 후에 ASI$^{(R)}$의 중심원리 수행도를 자기-평가, 타인-평가, 전문가-평가로 알아보는 것이다. 연구 방법: 2013년 11월 30일부터 2014년 6월 30일까지 총 6명의 작업치료사를 대상으로 연구가 이루어졌다. 총 8주 동안 6회의 ASI$^{(R)}$ 중재 교육을 실시하였고, 대상자들이 ASI$^{(R)}$ 중재 교육 전에 촬영한 치료 동영상과 교육 후에 촬영한 치료 동영상을 평가하였다. 평가는 교육전과 후에 자기-평가, 타인-평가, 전문가-평가로 실시하였고, 이 자료를 바탕으로 Mann-Whitney, ICC (Intra-Class Correlation)로 분석하였다. 결과: 영역III(평가기록), IV(공간과 도구), V(부모, 교사와의 의사소통)의 구조적 요소 합의 결과는 $79.33{\pm}18.27$점이었다. 평가방법에 따른 ASI$^{(R)}$ 중재 교육 전과 후의 과정요소 차이를 살펴본 결과, 자기-평가에서는 '감각조절 제공', '활동선택에서 협력', '활동의 성공보장', '놀이에 대한 아동의 내적 동기를 지지', '치료적 연합', '과정요소의 합'에서 교육 전보다 교육 후에 점수가 향상되었다. 타인-평가에서는 '물리적 안정성 보장'을 제외한 모든 항목에서 통계학적으로 유의한 차이를 보였다. 전문가-평가에서는 '감각의 기회제공'을 제외한 모든 항목에서 통계학적으로 유의한 차이를 보였다. ASI$^{(R)}$ 중재 교육 전에 실시한 자기-평가와 전문가-평가에서는 '물리적 안정성 보장'항목에서 통계학적으로 유의한 차이를 보였다. 교육 후에 실시한 자기-평가와 전문가-평가에서도 '물리적 안정성 보장' 항목에서 차이를 보였다. 결론: 본 연구의 결과는 정확한 감각통합중재를 위해 ASI$^{(R)}$의 중재 교육이 필요함을 강조하고, 치료사 스스로의 치료적 스타일을 점검하는 것이 중요하다는 것을 제시한다.

고등학교 논의기반 탐구 과학수업에서 학생 평가활동이 주장과 증거 형성에 미치는 영향 (Impact of Student Assessment Activities on Claim and Evidence Formation in High School Argument-Based Inquiry)

  • 이선우;남정희
    • 대한화학회지
    • /
    • 제62권3호
    • /
    • pp.203-213
    • /
    • 2018
  • 이 연구는 논의기반 탐구 과학수업에서 학생 평가활동이 고등학생들의 주장과 증거 형성에 어떠한 영향을 미치는지 알아보고자 하였다. 이를 위해 인문계 고등학교 1학년 166명을 대상으로 논의기반 탐구 과학수업을 실시하였으며, 실험집단 학생(84명)들은 모둠의 주장과 증거에 대한 평가 기회를 제공받았고 비교집단 학생(82명)들은 이 단계를 생략하였다. 학생 평가활동이 학생들의 주장과 증거 형성에 미치는 영향 알아보기 위해 학생들이 작성한 주장과 증거 그리고 학생 평가활동의 결과를 분석하였으며, 인터뷰와 설문조사를 통해 학생 평가활동의 타당성과 활용정도를 알아보았다. 연구 결과, 논의활동에서 증거를 형성하는 능력이 비교집단보다 실험집단이 통계적으로 유의미하게 높게 나타났으며, 실험집단 학생들이 비교집단 학생들보다 더 정확하고 충분한 증거를 제시하는 것으로 나타났다. 또한 실험집단 학생들은 평가활동을 통해 주장에 대한 증거가 적절한지, 증거가 충분한지, 제시된 증거 자료는 정확한지 대해 평가하며 지속적으로 평가결과를 피드백으로 활용하였음을 알 수 있었다. 학생들은 평가 결과가 대체적으로 타당하다고 인식하고 있으며, 평가 결과를 다음 활동에 반영하여 다양한 증거를 제시하는 능력이 향상되었다고 인식하고 있음을 알 수 있었다. 이를 통해 논의기반 탐구 과학수업에서 학생 평가활동이 학생들의 주장과 증거를 형성할 때 주장의 타당성과 정당성을 높이는 증거 형성에 효과적이라는 것을 알 수 있다.

Accuracy of c-KIT in lung cancer prognosis; a systematic review protocol" instead of c-KIT Expression in Lung Cancer Prognostic Evaluation - a Systematic Review Protocol

  • Roudi, Raheleh;Kalantari, Elham;Keshtkar, Abbas;Madjd, Zahra
    • Asian Pacific Journal of Cancer Prevention
    • /
    • 제17권2호
    • /
    • pp.863-866
    • /
    • 2016
  • Background: Extensive efforts have been made to investigate c-KIT expression in lung cancer specimens and its correlation with clinical outcomes, but the issue remains unresolved. Thus, this study will be conducted to clarify the prognostic value of c-KIT expression in lung cancer patients. Materials and Methods: We will search Pubmed, SCOPUS, and ISI web of sciences with no restriction of language. Studies with any design (except case reports or case series) evaluating correlations of c-KIT expression with survival or outcome in patients with lung cancer will be included. The outcome measures will include all types of survival indexes, including overall survival rate and disease free survival using Kaplan-Meier analysis and hazard ratios. Study selection and data extraction will be performed by two independent researchers. Quality assessment (assessment of risk of bias) and data synthesis will be implemented using Stata software version 11.1. Results: No ethical issues are predicted. These findings will be published in a peer-reviewed journal and presented at national and international conferences. Conclusions: This systematic review protocol is registered in the PROSPERO International Prospective Register of Systematic Reviews, registration number = CRD42015023391.

Accuracy and robustness of hysteresis loop analysis in the identification and monitoring of plastic stiffness for highly nonlinear pinching structures

  • Hamish Tomlinson;Geoffrey W. Rodgers;Chao Xu;Virginie Avot;Cong Zhou;J. Geoffrey Chase
    • Smart Structures and Systems
    • /
    • 제31권2호
    • /
    • pp.101-111
    • /
    • 2023
  • Structural health monitoring (SHM) covers a range of damage detection strategies for buildings. In real-time, SHM provides a basis for rapid decision making to optimise the speed and economic efficiency of post-event response. Previous work introduced an SHM method based on identifying structural nonlinear hysteretic parameters and their evolution from structural force-deformation hysteresis loops in real-time. This research extends and generalises this method to investigate the impact of a wide range of flag-shaped or pinching shape nonlinear hysteretic response and its impact on the SHM accuracy. A particular focus is plastic stiffness (Kp), where accurate identification of this parameter enables accurate identification of net and total plastic deformation and plastic energy dissipated, all of which are directly related to damage and infrequently assessed in SHM. A sensitivity study using a realistic seismic case study with known ground truth values investigates the impact of hysteresis loop shape, as well as added noise, on SHM accuracy using a suite of 20 ground motions from the PEER database. Monte Carlo analysis over 22,000 simulations with different hysteresis loops and added noise resulted in absolute percentage identification error (median, (IQR)) in Kp of 1.88% (0.79, 4.94)%. Errors were larger where five events (Earthquakes #1, 6, 9, 14) have very large errors over 100% for resulted Kp as an almost entirely linear response yielded only negligible plastic response, increasing identification error. The sensitivity analysis shows accuracy is reduces to within 3% when plastic drift is induced. This method shows clear potential to provide accurate, real-time metrics of non-linear stiffness and deformation to assist rapid damage assessment and decision making, utilising algorithms significantly simpler than previous non-linear structural model-based parameter identification SHM methods.

6 시그마와 총 오차 허용범위의 개발에 대한 연구 (A Study of Six Sigma and Total Error Allowable in Chematology Laboratory)

  • 장상우;김남용;최호성;김영환;추경복;정혜진;박병옥
    • 대한임상검사과학회지
    • /
    • 제37권2호
    • /
    • pp.65-70
    • /
    • 2005
  • Those specifications of the CLIA analytical tolerance limits are consistent with the performance goals in Six Sigma Quality Management. Six sigma analysis determines performance quality from bias and precision statistics. It also shows if the method meets the criteria for the six sigma performance. Performance standards calculates allowable total error from several different criteria. Six sigma means six standard deviations from the target value or mean value and about 3.4 failures per million opportunities for failure. Sigma Quality Level is an indicator of process centering and process variation total error allowable. Tolerance specification is replaced by a Total Error specification, which is a common form of a quality specification for a laboratory test. The CLIA criteria for acceptable performance in proficiency testing events are given in the form of an allowable total error, TEa. Thus there is a published list of TEa specifications for regulated analytes. In terms of TEa, Six Sigma Quality Management sets a precision goal of TEa/6 and an accuracy goal of 1.5 (TEa/6). This concept is based on the proficiency testing specification of target value +/-3s, TEa from reference intervals, biological variation, and peer group median mean surveys. We have found rules to calculate as a fraction of a reference interval and peer group median mean surveys. We studied to develop total error allowable from peer group survey results and CLIA 88 rules in US on 19 items TP, ALB, T.B, ALP, AST, ALT, CL, LD, K, Na, CRE, BUN, T.C, GLU, GGT, CA, phosphorus, UA, TG tests in chematology were follows. Sigma level versus TEa from peer group median mean CV of each item by group mean were assessed by process performance, fitting within six sigma tolerance limits were TP ($6.1{\delta}$/9.3%), ALB ($6.9{\delta}$/11.3%), T.B ($3.4{\delta}$/25.6%), ALP ($6.8{\delta}$/31.5%), AST ($4.5{\delta}$/16.8%), ALT ($1.6{\delta}$/19.3%), CL ($4.6{\delta}$/8.4%), LD ($11.5{\delta}$/20.07%), K ($2.5{\delta}$/0.39mmol/L), Na ($3.6{\delta}$/6.87mmol/L), CRE ($9.9{\delta}$/21.8%), BUN ($4.3{\delta}$/13.3%), UA ($5.9{\delta}$/11.5%), T.C ($2.2{\delta}$/10.7%), GLU ($4.8{\delta}$/10.2%), GGT ($7.5{\delta}$/27.3%), CA ($5.5{\delta}$/0.87mmol/L), IP ($8.5{\delta}$/13.17%), TG ($9.6{\delta}$/17.7%). Peer group survey median CV in Korean External Assessment greater than CLIA criteria were CL (8.45%/5%), BUN (13.3%/9%), CRE (21.8%/15%), T.B (25.6%/20%), and Na (6.87mmol/L/4mmol/L). Peer group survey median CV less than it were as TP (9.3%/10%), AST (16.8%/20%), ALT (19.3%/20%), K (0.39mmol/L/0.5mmol/L), UA (11.5%/17%), Ca (0.87mg/dL1mg/L), TG (17.7%/25%). TEa in 17 items were same one in 14 items with 82.35%. We found out the truth on increasing sigma level due to increased total error allowable, and were sure that the goal of setting total error allowable would affect the evaluation of sigma metrics in the process, if sustaining the same process.

  • PDF

MODFLOW or FEFLOW: A Case Study of Groundwater Model Selection for the Upper Waikato Catchment, New Zealand

  • Weir, Julian;Moore, Dr Catherine;Hadfield, John
    • 한국수자원학회:학술대회논문집
    • /
    • 한국수자원학회 2011년도 학술발표회
    • /
    • pp.14-14
    • /
    • 2011
  • Groundwater in the Waikatoregion is a valuable resource for agriculture, water supply, forestry and industries. The 434,000 ha study area comprises the upper Waikato River catchment from the outflow of Lake Taupo (New Zealand's largest lake) through to Lake Karapiro (a man-made hydro lake with high recreational value) (Figure 1). Water quality in the area is naturally high. However, there are indications that this quality is deteriorating as a result of land use intensification and deforestation. Compounding this concern for decision makers is the lag time between land use changes and the realisation of effects on groundwater and surface water quality. It is expected that the effects of land use changes have not yet fully manifested, and additional intensification may take decadesto fully develop, further compounding the deterioration. Consequently, Environment Waikato (EW) have proposed a programme of work to develop a groundwater model to assist managing water quality and appropriate policy development within the catchment. One of the most important and critical decisions of any modelling exercise is the choice of the modelling platform to be used. It must not inhibit future decision making and scenario exploration and needs to allow as accurate representation of reality as feasible. With this in mind, EW requested that two modelling platforms, MODFLOW/MT3DMS and FEFLOW, be assessed for their ability to deliver the long-term modelling objectives for this project. The two platforms were compared alongside various selection criteria including complexity of model set-up and development, computational burden, ease and accuracy of representing surface water-groundwater interactions, precision in predictive scenarios and ease with which the model input and output files could be interrogated. This latter criteria is essential for the thorough assessment of predictive uncertainty with third-party software, such as PEST. This paper will focus on the attributes of each modelling platform and the comparison of the two approaches against the key criteria in the selection process. Primarily due to the ease of handling and developing input files and interrogating output files, MODFLOW/MT3DMS was selected as the preferred platform. Other advantages and disadvantages of the two modelling platforms were somewhat balanced. A preliminary regional groundwater numerical model of the study area was subsequently constructed. The model simulates steady state groundwater and surface water flows using MODFLOW and transient contaminant transport with MT3DMS, focussing on nitrate nitrogen (as a conservative solute). Geological information for this project was provided by GNS Science. Professional peer review was completed by Dr. Vince Bidwell (of Lincoln Environmental).

  • PDF