The Journal of Korean Medicine Ophthalmology and Otolaryngology and Dermatology (한방안이비인후피부과학회지)

The Society of Korean Medicine Ophthalmology, Otolaryngology & Dermatology (대한한방안이비인후피부과학회)
권호 표지
DOI QR코드

DOI QR Code

Inter- and Intra-rater Reliability of Pattern Identification Using Nasal Endoscopy for Allergic Rhinitis

비내시경을 활용한 알레르기 비염에 대한 한의학적 변증 지표의 관찰자간, 관찰자내 신뢰도 연구

  • Kim, Kyu-Seok (Department of Ophthalmology, Otolaryngology and Dermatology, College of Korean Medicine, Kyung Hee University) ;
  • Yun, Young-Hee (Department of Ophthalmology, Otolaryngology and Dermatology, College of Korean Medicine, Kyung Hee University) ;
  • Park, Jeong-Su (Department of Preventive Medicine, College of Korean Medicine and Center for Clinical Research and Drug Development, Kyung Hee University) ;
  • Kim, Nam-Kwen (Department of Ophthalmology, Otolaryngology and Dermatology, College of Korean Medicine, Wonkwang University) ;
  • Kim, Kyung-Jun (Department of Ophthalmology, Otolaryngology and Dermatology, College of Korean Medicine, Gachon University) ;
  • Kim, Hee-Taek (Department of Ophthalmology, Otolaryngology and Dermatology, College of Korean Medicine, Semyung University) ;
  • Hong, Seung-Ug (Department of Ophthalmology, Otolaryngology and Dermatology, College of Korean Medicine, Dongguk University) ;
  • Jang, Bo-Hyeong (Department of Preventive Medicine, College of Korean Medicine and Center for Clinical Research and Drug Development, Kyung Hee University) ;
  • Yoon, Hwa-Jung (Department of Ophthalmology, Otolaryngology and Dermatology, College of Korean Medicine, Dong-Eui University) ;
  • Choi, In-Hwa (Department of Ophthalmology, Otolaryngology and Dermatology, College of Korean Medicine, Kyung Hee University) ;
  • Ko, Seong-Gyu (Department of Preventive Medicine, College of Korean Medicine and Center for Clinical Research and Drug Development, Kyung Hee University)
  • 김규석 (경희대학교 한의과대학 안이비인후피부과 교실) ;
  • 윤영희 (경희대학교 한의과대학 안이비인후피부과 교실) ;
  • 박정수 (경희대학교 한의과대학 예방의학교실, 경희대학교 한의학임상연구및의약품개발센터) ;
  • 김남권 (원광대학교 한의과대학 안이비인후피부과 교실) ;
  • 김경준 (가천대학교 한의과대학 안이비인후피부과 교실) ;
  • 김희택 (세명대학교 한의과대학 안이비인후피부과 교실) ;
  • 홍승욱 (동국대학교 한의과대학 안이비인후피부과 교실) ;
  • 장보형 (경희대학교 한의과대학 예방의학교실, 경희대학교 한의학임상연구및의약품개발센터) ;
  • 윤화정 (동의대학교 한의과대학 안이비인후피부과 교실) ;
  • 최인화 (경희대학교 한의과대학 안이비인후피부과 교실) ;
  • 고성규 (경희대학교 한의과대학 예방의학교실, 경희대학교 한의학임상연구및의약품개발센터)
  • Received : 2013.04.13
  • Accepted : 2013.05.09
  • Published : 2013.05.25
Download PDF
⟨ Previous Next ⟩

Abstract

Objectives : We performed a pilot study to investigate inter- and intra-rater reliability of pattern identification using nasal endoscopy for allergic rhinitis(AR). Methods : Eight experts of ophthalmology, otolaryngology and dermatology of Korean medicine evaluated 20 nasal endoscopy photograph cases of AR patients with pattern identification index using nasal endoscopy for AR including the nasal membrane color(pale / hyperemia), nasal membrane humidity(dryness / dampness), rhinorrhea(watery / yellow), and membrane edema (atrophic / edematous) on nasal endoscopy. Results : Intra-rater agreement(%) and Kappa coefficient was generally from 'moderate' to 'good'(% agreement: 73.13-90% / Kappa coefficient: 0.547-0.748). Inter-rater agreement(%) and Kappa coefficient was also from 'moderate' to 'good' (% agreement: 65-85% / Kappa: 0.475-0.778) except 'humidity(dryness / dampness)' item (% agreement: 55.98% / Kappa: 0.340). In findings of subgroup analysis according to affiliation of raters, Inter-rater agreement(%) and Kappa coefficient of raters in same affiliation was higher than inter-rater agreement(%) and Kappa coefficient of raters in different affiliation except 'dryness / dampness' item. Conclusions : It is necessary to improve objectivity and reproducibility of pattern identification using nasal endoscopy for allergic rhinitis(AR) through the development of detail-oriented criteria and enhanced training of clinicians with development of standard operating procedures(SOPs).

Keywords

References

  1. Okubo K, Kurono Y, Fujieda S, Ogino S, Uchio E, Odajima H, et al. Japanese Society of Allergology. Japanese guideline for allergic rhinitis. Allergol Int. 2011;60(2):171-89. https://doi.org/10.2332/allergolint.11-RAI-0334
  2. Ko SG, Shin YC. The Research on evaluation endpoint development for clinical trial of herbal medicinal products about atopic dermatitis and allergic rhinitis. Korean Food and Drug Administration report. 2008.
  3. Yang JH, Park JH, Han YS. Review in the view of Western and Oriental medicne on allergic rhinitis. J Jeahan Oriental Med Acad. 1999;4(1):436-48.
  4. Min YG, Choi JO, Kim LS. Clinical Otolaryngology for primary practice. 1st ed. Seoul:Iljogak. 2004.
  5. Yoon YH, Park JS, Kim KS, Kim NG, Kim KJ, Kim HT, et al. Study on the Development of Guideline for Assessing Anterior Nasal Cavity Using Nasal Endoscopy on Allergic Rhinitis Patients. Kor J Oreintal Preventive Med Soc. 2013;17(1) in print.
  6. Lee KS, Park DH, Kim GE, Bang JH, Kim JH, Choi JY, et al. A Systematic review from the journals under the Korean oriental medical society. J Korean Oriental Med. 2010;31(5):1-11.
  7. Gwet KL. Handbook of inter-rater reliability: The definitive guide to measuring the extent of agreement among multiple raters, advanced analytics. 3rd ed. LLC. 2012.
  8. Bousquet J, Khaltaev N, Cruz AA, Denburg J, Fokkens WJ, Togias A, et al. Allergic rhinitis and its impact on asthma (ARIA) 2008 update (in collaboration with the World Health Organization, GA2LEN and AllerGen). Allergy. 2008;63(suppl86):8-160. https://doi.org/10.1111/j.1398-9995.2007.01620.x
  9. Lee JS. Guideline of clinical trial on efficacy of herbal preparations. Bio Herbal Pharmacy report in Korean Food and Drug Administration. 2010.
  10. Seong TJ. Validity and reliability. 2nd ed. Seoul:Hakjisa. 2005:155-6.
  11. Altman DG. Practical statistics for medical research. London:Chapman and Hall Inc. 1991.

Cited by

  1. Assessment of Concordance Rate in Pattern Analysis between Pattern Diagnosis of KiFDA on Allergic Rhinitis in 2008 and Doctor of Korean Medicine vol.27, pp.1, 2014, https://doi.org/10.6114/jkood.2014.27.1.091
  2. Inter- and intra-rater reliability of a nasal endoscopy index for pattern identification in patients with allergic rhinitis vol.15, pp.3, 2015, https://doi.org/10.1007/s13596-015-0191-9
  3. 비내시경 소견의 알레르기비염 분류 도구와 중증도 평가도구의 상관성 연구 vol.28, pp.1, 2013, https://doi.org/10.6114/jkood.2015.28.1.109
  4. 알레르기 비염의 한의학적 관리를 위한 최신 지견 vol.29, pp.4, 2013, https://doi.org/10.6114/jkood.2016.29.4.095
  5. 비내시경 활용 비염 변증 지표의 평가자 간 신뢰도 연구 vol.30, pp.4, 2017, https://doi.org/10.6114/jkood.2017.30.4.097
  6. 한방안이비인후피부과학회지에 게재된 알레르기 비염과 관련된 임상 논문에 대한 고찰 vol.32, pp.1, 2013, https://doi.org/10.6114/jkood.2019.32.1.074
  7. 심층 학습을 활용한 가상 치아 이미지 생성 연구 -학습 횟수를 중심으로 vol.42, pp.1, 2013, https://doi.org/10.14347/kadt.2020.42.1.1