Browse > Article
http://dx.doi.org/10.14370/jewnr.2020.26.1.91

Inter-rater Reliability of Korean Triage and Acuity Scale (KTAS) among the Research Nurses and the Triage Nurses  

Yang, Jungeun (Department of Emergency Department, Konkuk University Medical Center)
Lee, Eunja (College of Nursing, Gachon University)
Publication Information
Journal of East-West Nursing Research / v.26, no.1, 2020 , pp. 91-99 More about this Journal
Abstract
Purpose: The study aims to assess the inter-rater reliability of the Korean Triage and Acuity Scale between the research nurses and the triage nurses. Methods: Interrater reliability was measured on 400 adult (≧15) and 400 pediatric (<15) patients who visited the emergency medical center from January 4 to June 30, 2018. Results: The study result showed that the inter-rater reliability of the Korean Triage and Acuity Scale was substantial, with κ=.73 (95% Confidence interval= .68-.78) and 77.0 percent agreement. The inter-rater of Pediatric Korean Triage and Acuity Scale was also substantial, with κ=.76 (95% Confidence interval= .71-.82) and 83.8 percent agreement. Conclusion: Although the inter-rater reliability of the Korean Triage and Acuity Scale was acceptable, the percent agreement was lower than the desirable level (<80.0%). It was confirmed that Pediatric Korean Triage and Acuity Scale had an acceptable level of inter-rater reliability and percent agreement for clinical use. Efforts should be made to improve the reliability in the future.
Keywords
Triage; Emergency Department; Reliability; Validity; Nurse;
Citations & Related Records
Times Cited By KSCI : 4  (Citation Analysis)
연도 인용수 순위
1 Haas B, Gomez D, Zagorski B, Stukel TA, Rubenfeld GD, Nathens AB. Survival of the fittest: the hidden cost of undertriage of major trauma. J Am Coll Surg. 2010;211(6):804-11. http://doi.org/10.1016/j.jamcollsurg.2010.08.014   DOI
2 Armstrong JH, Hammond J, Hirshberg A, Frykberg ER. Is overtriage associated with increased mortality? The evidence says "yes." Disaster Med Public Health Pre. 2008;2(1):4-5. http://doi.org/10.1097/DMP.0b013e31816476c0
3 Choi HJ, Ok JS, An SY. Evaluation of Validity of the Korean Triage and Acuity Scale. J Korean Acad Nurs. 2019;49(1):26-35. https://doi.org/10.4040/jkan.2019.49.1.26   DOI
4 Iserson KV, Moskop JC. Triage in medicine, part I: concept, history, and types. Ann Emerg Med. 2007;49(3):275-81. https://doi.org/10.1016/j.annemergmed.2006.05.019   DOI
5 Park CU, Kim HJ. Measurement of inter-rater reliability in systematic review. Hanyang Med Rev. 2015;35(1):44-9. https://doi.org/10.7599/hmr.2015.35.1.44   DOI
6 Worster A, Sardo A, Eva K, Fernandes CMB, Upadhye S. Triage Tool inter-rater reliability: a comparison of live versus paper case scenarios. J Emerg Nurs. 2007;33(4):319-23. https://doi.org/10.1016/j.jen.2006.12.016   DOI
7 Ying R, Sern W, Glen S, Khairil A, Jamil M, Wai W, et al. Comparison of the Emergency Severity Index versus the Patient Acuity Category Scale in an emergency setting. Int Emerg Nurs. 2018;41:13-8. https://doi.org/10.1016/j.ienj.2018.05.001   DOI
8 Bujang MA, Baharum N. Guidelines of the minimum sample size requirements for Cohen's Kappa. Epidemiol Biostat Public Health. 2017; 14(2):e122671-1-10. https://doi.org/10.2427/12267
9 The Korean Society of Emergency Medicine KTAS Committee. Korean Triage and Acuity Scale manual version 3. Paju: Koonja; 2019. pp.11-30.
10 Park JB, Lee J, Kim YJ, Lee JH. Reliability of Korean Triage and Acuity Scale : interrater agreement between two experienced nurses by real-time triage and analysis of influencing factors to disagreement of triage levels. J Korean Med Sci. 2019;34(28):1-7. https://doi.org/10.3346/jkms.2019.34.e189   DOI
11 Moon S, Lan J, Id S, Park K, Park C. Triage accuracy and causes of mistriage using the Korean Triage and Acuity Scale. PLoS One. 2019; 14(9):e0216972. https://doi.org/10.1371/journal.pone.0216972   DOI
12 Moon S, Shim JL. Triage Accuracy of pediatric patients using the Korean Triage and Acuity Scale in emergency departments. J Korea Acad Industr Coop Soc. 2018;19(11):626-34. https://doi.org/10.5762/KAIS.2018.19.11.626   DOI
13 Lee JH, Park YS, Park IC, Lee HS, Kim JH, Park JM, et al. Over-triage occurs when considering the patient's pain in Korean Triage and Acuity Scale (KTAS). PLoS One. 2019;14(5):e0216519. http://dx.plos.org/10.1371/journal.pone.0216519   DOI
14 Magalhães-Barbosa MC, Robaina JR, Prata-Barbosa A, Lopes CDS. Reliability of triage systems for paediatric emergency care: a systematic review. Emerg Med J. 2019;36(4):231-8. http://doi.org/10.1136/emermed-2018-207781   DOI
15 Peacock S, Patel S. Cultural influences on pain. Rev Pain. 2008;1(2):6-9. https://doi.org/10.1177/204946370800100203   DOI
16 Ministry of Health and Welfare. Enactment of the Korean emergency patients severity classification standard: article 2015-243 [Internet]. Sejong: Ministry of Health and Welfare; 2015 [cited 2020 March 04]. Available from: http://www.mohw.go.kr/react/jb/sjb0406vw.jsp?PAR_MENU_ID=03&MENU_ID=030406&CONT_SEQ=329273
17 Fernandes CM, Tanabe P, Gilboy N, Johnson LA, McNair RS, Rosenau AM, et al. Five-level triage: a report from the ACEP/ENA five-level triage task force. J Emerg Nurs. 2005;31(1):39-50. https://doi.org/10.1016/j.jen.2004.11.002   DOI
18 Park J, Lim T. Korean Triage and Acuity Scale (KTAS). J Korean Soc Emerg Med. 2017;28(6):547-51. https://doi.org/10.22470/pemj.2015.2.2.53
19 Mirhaghi A, Heydari A, Mazlom R, Ebrahimi M. The reliability of the Canadian triage and acuity scale: meta-analysis. N Am J Med Sci. 2015;7(7):299-305. http://doi.org/10.4103/1947-2714.161243   DOI
20 Zachariasse JM, van der Hagen V, Seiger N, Mackway-Jones K, van Veen M, Moll HA. Performance of triage systems in emergency care: a systematic review and meta-analysis. BMJ Open. 2019;9(5):e026471. http://doi.org/10.1136/bmjopen-2018-026471   DOI
21 Magalhaes-Barbosa MC, Robaina JR, Prata-Barbosa A, Lopes CDS. Validity of triage systems for paediatric emergency care: a systematic review. Emerg Med J. 2017;34(11):711-9. http://doi.org/10.1136/emermed-2016-206058   DOI
22 The Korean Society of Emergency Medicine. Reliability and validity verification study of the Korean Triage and Acuity Scale[Internet]. Sejong: Ministry of Health and Welfare; 2014 [cited 2020 March 4]. Available from: http://www.prism.go.kr/homepage/entire/retrieveEntireDetail.do?pageIndex=1&research_id=1351000-201400241&left-MenuLevel=160&cond_research_name=한국형+중증%.
23 Chang YC, Ng CJ, Wu CT, Chen LC, Chen JC, Hsu KH. Effectiveness of a five-level Paediatric Triage System: an analysis of resource utilisation in the emergency department in Taiwan. Emerg Med J. 2013;30(9):735-9. https://doi.org/10.1136/emermed-2012-201362   DOI
24 Bullard MJ, Chan T, Brayman C, Warren D. Revisions to the Canadian emergency department Triage and Acuity Scale (CTAS) Guidelines. CJEM. 2014;16(6):485-9. https://doi.org/10.1017/S148180350000350X   DOI
25 Takahashi T, Inoue N, Shimizu N, Terakawa T, Goldman RD. "Downtriage" for children with abnormal vital signs: evaluation of a new triage practice at a paediatric emergency department in Japan. Emerg Med J. 2016;33(8):533-7. http://doi.org/10.1136/emermed-2015-204968   DOI