• Title/Summary/Keyword: assessors agreement

Search Result 4, Processing Time 0.021 seconds

A Proposal for Standardization of Tongue Diagnosis Based on Diagnostic Criteria of Tongue Coating Thickness (설진의 표준화를 위한 제언 : 설태 후박의 진단기준을 중심으로)

  • Son, Ji-Hee;Kim, Jin-Sung;Park, Jae-Woo;Ryu, Bong-Ha
    • The Journal of Internal Korean Medicine
    • /
    • v.33 no.1
    • /
    • pp.1-13
    • /
    • 2012
  • Background : In oriental medicine, the status of the tongue is an important indicator to diagnose the condition of one's health, such as physiological and the clinicopathological changes of internal organs. A tongue diagnosis is not only convenient but also non-invasive, and therefore widely used in Oriental medicine. However, the tongue diagnosis is greatly affected by examination circumstances, patient's posture, and doctor's diagnosis criteria. Objectives : This study was designed to assure the necessity for standardization of tongue diagnosis based on diagnostic criteria of tongue coating thickness (TCT). Methods : Thirty tongue photographs were acquired and analyzed by digital tongue diagnosis system (DTDS) which measured the percentage of TCT on the tongue surface. Fifteen oriental medical doctors evaluated TCT in 30 photographs. Afterward, the 15 assessors were trained for diagnostic criteria of TCT and evaluated the photographs again. The intraclass correlation coefficient (ICC) was used to obtain the agreement rate among the 15 assessors and the agreement rate between assessors' TCT scores and DTDS values. Results : The agreement rate among the 15 assessors after training was higher than before training. The agreement rate between assessors' TCT scores and DTDS values after training was also higher than before training. Furthermore, the difference of the agreement rate between before and after training was significant (p<0.05). Conclusions : The standardization of diagnostic criteria of TCT increased the agreement rate among the assessors and the agreement rate between assessors' TCT scores and DTDS values. Therefore, the standardization of diagnostic criteria is expected to contribute to the objectification and quantification of the tongue diagnosis system.

Reliability and Validity Analysis of the Instrument on Pattern Identifications for Depression (우울증 변증도구의 신뢰도, 타당도 평가)

  • Lee, Hun-Soo;Kang, Wee-Chang;Jung, In-Chul
    • Journal of Oriental Neuropsychiatry
    • /
    • v.26 no.4
    • /
    • pp.407-416
    • /
    • 2015
  • Objectives: This study was performed to evaluate the reliability and validity of the instrument on pattern identifications for depression. Methods: Two assessors carried out an evaluation about the instrument on pattern identifications for depression, targeting 201 participants, who after taking the HAM-D score over 12 or under 7 twice. Results: Inter-assessor reliability was higher than intra-assessor reliability in a reliability analysis about classification of pattern identification evaluated by the instrument on pattern identifications for depression. Reliability of intra-assessor and inter-assessor showed a moderate to strong agreement when reliability analysis about classification score of the pattern identification had been performed. Reliability analysis to evaluate the validity of the instrument on pattern identifications for depression showed moderate agreement. Conclusions: The results reveal that reliability analysis of the instrument on pattern identifications for depression showed an over moderate agreement and validity analysis represented a positive correlation.

Building a text collection for Urdu information retrieval

  • Rasheed, Imran;Banka, Haider;Khan, Hamaid M.
    • ETRI Journal
    • /
    • v.43 no.5
    • /
    • pp.856-868
    • /
    • 2021
  • Urdu is a widely spoken language in the Indian subcontinent with over 300 million speakers worldwide. However, linguistic advancements in Urdu are rare compared to those in other European and Asian languages. Therefore, by following Text Retrieval Conference standards, we attempted to construct an extensive text collection of 85 304 documents from diverse categories covering over 52 topics with relevance judgment sets at 100 pool depth. We also present several applications to demonstrate the effectiveness of our collection. Although this collection is primarily intended for text retrieval, it can also be used for named entity recognition, text summarization, and other linguistic applications with suitable modifications. Ours is the most extensive existing collection for the Urdu language, and it will be freely available for future research and academic education.

The Influence of SGRs on Self, Peer, and Instructor Evaluation in Higher Education

  • HONG, Seongyoun
    • Educational Technology International
    • /
    • v.9 no.1
    • /
    • pp.97-114
    • /
    • 2008
  • This research has three purposes: The first purpose is to verify whether SGRs(Student-Generated Rubrics) are effective for learner achievement in higher education or not. The second one is to analyze the agreements between an instructor's evaluations and peer group assessments with SGRs in real classroom situation. The final purpose is to propose the possibility of students' more objective self-evaluation with the use of SGRs. It appears that rubrics are effective tools to improve learner achievement in adult education and to promote the agreement between the instructor's and peer's evaluations, even though learners do not develop SGRs. In addition, this research has demonstrated that most students are not very accurate self-assessors, and they often overestimate themselves. This study can be helpful for novice instructors, especially for those who try to assess their students more fairly, to develop the SGRs as an evaluation tool appropriate for their own situation, and to give more reliable feedback to students.