• 제목/요약/키워드: assessors agreement

검색결과 4건 처리시간 0.017초

설진의 표준화를 위한 제언 : 설태 후박의 진단기준을 중심으로 (A Proposal for Standardization of Tongue Diagnosis Based on Diagnostic Criteria of Tongue Coating Thickness)

  • 손지희;김진성;박재우;류봉하
    • 대한한방내과학회지
    • /
    • 제33권1호
    • /
    • pp.1-13
    • /
    • 2012
  • Background : In oriental medicine, the status of the tongue is an important indicator to diagnose the condition of one's health, such as physiological and the clinicopathological changes of internal organs. A tongue diagnosis is not only convenient but also non-invasive, and therefore widely used in Oriental medicine. However, the tongue diagnosis is greatly affected by examination circumstances, patient's posture, and doctor's diagnosis criteria. Objectives : This study was designed to assure the necessity for standardization of tongue diagnosis based on diagnostic criteria of tongue coating thickness (TCT). Methods : Thirty tongue photographs were acquired and analyzed by digital tongue diagnosis system (DTDS) which measured the percentage of TCT on the tongue surface. Fifteen oriental medical doctors evaluated TCT in 30 photographs. Afterward, the 15 assessors were trained for diagnostic criteria of TCT and evaluated the photographs again. The intraclass correlation coefficient (ICC) was used to obtain the agreement rate among the 15 assessors and the agreement rate between assessors' TCT scores and DTDS values. Results : The agreement rate among the 15 assessors after training was higher than before training. The agreement rate between assessors' TCT scores and DTDS values after training was also higher than before training. Furthermore, the difference of the agreement rate between before and after training was significant (p<0.05). Conclusions : The standardization of diagnostic criteria of TCT increased the agreement rate among the assessors and the agreement rate between assessors' TCT scores and DTDS values. Therefore, the standardization of diagnostic criteria is expected to contribute to the objectification and quantification of the tongue diagnosis system.

우울증 변증도구의 신뢰도, 타당도 평가 (Reliability and Validity Analysis of the Instrument on Pattern Identifications for Depression)

  • 이헌수;강위창;정인철
    • 동의신경정신과학회지
    • /
    • 제26권4호
    • /
    • pp.407-416
    • /
    • 2015
  • Objectives: This study was performed to evaluate the reliability and validity of the instrument on pattern identifications for depression. Methods: Two assessors carried out an evaluation about the instrument on pattern identifications for depression, targeting 201 participants, who after taking the HAM-D score over 12 or under 7 twice. Results: Inter-assessor reliability was higher than intra-assessor reliability in a reliability analysis about classification of pattern identification evaluated by the instrument on pattern identifications for depression. Reliability of intra-assessor and inter-assessor showed a moderate to strong agreement when reliability analysis about classification score of the pattern identification had been performed. Reliability analysis to evaluate the validity of the instrument on pattern identifications for depression showed moderate agreement. Conclusions: The results reveal that reliability analysis of the instrument on pattern identifications for depression showed an over moderate agreement and validity analysis represented a positive correlation.

Building a text collection for Urdu information retrieval

  • Rasheed, Imran;Banka, Haider;Khan, Hamaid M.
    • ETRI Journal
    • /
    • 제43권5호
    • /
    • pp.856-868
    • /
    • 2021
  • Urdu is a widely spoken language in the Indian subcontinent with over 300 million speakers worldwide. However, linguistic advancements in Urdu are rare compared to those in other European and Asian languages. Therefore, by following Text Retrieval Conference standards, we attempted to construct an extensive text collection of 85 304 documents from diverse categories covering over 52 topics with relevance judgment sets at 100 pool depth. We also present several applications to demonstrate the effectiveness of our collection. Although this collection is primarily intended for text retrieval, it can also be used for named entity recognition, text summarization, and other linguistic applications with suitable modifications. Ours is the most extensive existing collection for the Urdu language, and it will be freely available for future research and academic education.

The Influence of SGRs on Self, Peer, and Instructor Evaluation in Higher Education

  • HONG, Seongyoun
    • Educational Technology International
    • /
    • 제9권1호
    • /
    • pp.97-114
    • /
    • 2008
  • This research has three purposes: The first purpose is to verify whether SGRs(Student-Generated Rubrics) are effective for learner achievement in higher education or not. The second one is to analyze the agreements between an instructor's evaluations and peer group assessments with SGRs in real classroom situation. The final purpose is to propose the possibility of students' more objective self-evaluation with the use of SGRs. It appears that rubrics are effective tools to improve learner achievement in adult education and to promote the agreement between the instructor's and peer's evaluations, even though learners do not develop SGRs. In addition, this research has demonstrated that most students are not very accurate self-assessors, and they often overestimate themselves. This study can be helpful for novice instructors, especially for those who try to assess their students more fairly, to develop the SGRs as an evaluation tool appropriate for their own situation, and to give more reliable feedback to students.