The Journal of Korean Academy of Sensory Integration (대한감각통합치료학회지)

Korean Academy of Sensory Integration (대한감각통합치료학회)
권호 표지
DOI QR코드

DOI QR Code

A Study of Test-Retest Reliability and Interrater Reliability of the Sensory Processing Scale for Children (SPS-C)

아동감각처리척도(Sensory Processing Scale for Children; SPS-C)의 검사-재검사 신뢰도와 검사자간 신뢰도 연구

  • Kim, Kyeong-Mi (Dept. of Occupational Therapy, College of Health and Medical Affairs, Inje University) ;
  • Kim, Ga-Yeon (Dept. of Occupational Therapy, Bachelor and Master's Program, Graduate School, Inje University) ;
  • Lee, Seung-Jin (Dept. of Occupational Therapy, Bachelor and Master's Program, Graduate School, Inje University)
  • 김경미 (인제대학교 보건의료융합대학 작업치료학과) ;
  • 김가연 (인제대학교 대학원 작업치료학과) ;
  • 이승진 (인제대학교 대학원 작업치료학과)
  • Received : 2022.08.10
  • Accepted : 2022.09.23
  • Published : 2022.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

Objective : This study examined the test-retest reliability and interrater reliability of the Sensory Processing Scale for Children (SPS-C). Method : Senventy primary caregivers of children with sensory processing difficulties and 3 years old participated in the study. The subjects were recruited through child development centers, welfare centers, and acquaintances located in Seoul, Gyeonggi-do, Busan, and Gyeongsang-do. The test-retest reliability verification targeted 20 main caregivers of children with difficulty in sensory processing. Re-evaluation was performed within 7 to 14 days after the initial evaluation, and Pearson's correlation coefficient was used to confirm the relevance between the two time points, and the Intraclass correlation coefficient was used to confirm the degree of agreement. The interrater reliability verification was conducted with 18 primary caregivers and 18 subsidiary caregivers of children with sensory processing difficulties. Each caregiver evaluated the same child, and the Intraclass correlation coefficient was used to confirm the agreement between the two sets of caregivers. Results : The test-retest reliability was Pearson's correlation coefficient r=.914 and intraclass correlation coefficient ICC=.939, indicating a high level of relevance and agreement. The interrater reliability was an Intraclass correlation coefficient ICC=.727, which showed a moderate level of agreement, but the tactile area (ICC=.455) and proprioceptive area (ICC=.439) were not statistically significant and showed a low degree of agreement. Conclusion : Through this study, it was confirmed that the children's Sensory Processing Scale for Children (SPS-C) is a stable evaluation tool with test-retest reliability and interrater reliability verified, and it will be able to provide help in standardization studies for future clinical use.

목적 : 본 연구의 목적은 국내에서 개발된 아동감각처리척도(Sensory Processing Scale-Children; SPS-C)의 안정성 확립을 위해 감각처리에 어려움을 가진 만 3~5세 아동의 보호자를 대상으로 검사-재검사 신뢰도와 검사자간 신뢰도를 검증하는 것이다. 연구방법 : 본 연구의 대상자는 감각처리에 어려움을 가진 3~5세 아동 70명이었다. 검사-재검사 신뢰도 검증은 감각처리에 어려움을 가진 아동의 주 양육자 20명이 대상이었다. 초기평가 후 7~14일 내로 재평가를 실시하였고, 두 시점 간 관련성은 피어슨 상관계수를, 일치도는 급내상관계수를 사용하였다. 검사자 간 신뢰도 검증은 감각처리에 어려움을 가진 아동의 주 양육자, 부 양육자 각각 18명을 대상으로 하였다. 두 검사자 간의 일치도 확인은 급내상관계수를 사용하였다. 결과 : 검사-재검사 신뢰도는 피어슨 상관계수 r=.914, 급내상관계수 ICC=.939로 높은 수준의 관련성과 일치도를 나타냈다. 검사자간 신뢰도는 급내상관계수 ICC=.727로 좋은 일치도를 나타냈으나 촉각 영역(ICC=.455)과 고유감각 영역(ICC=.439)은 통계적으로 유의하지 않았지만, 보통의 일치도를 보였다. 결론 : 본 연구를 통해 아동감각처리척도(SPS-C)는 검사-재검사 신뢰도와 검사자간 신뢰도가 검증되어 안정성 있는 평가도구임을 확인하였으며, 추후 임상적 사용을 위한 표준화 연구에 도움을 제공할 수 있을 것이다.

Keywords

Acknowledgement

이 연구는 2021년도 대한감각통합치료학회 연구지원에 의해 이루어졌음.

References

  1. Almohalha, L., Santos, L. F., & Pfeifer, L. I. (2021). Cross-cultural adaptation and reliability of the Infant Sensory Profile2 for brazilian babies. Journal of Occupational Therapy, Schools, & Early Intervention, 15(1), 61-71. doi:10.1080/19411243.2021.1910607
  2. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: American Psychological Association.
  3. Benjamin, T. E., Crasta, J. E., Suresh, A. P. C., Alwinesh, M. J. T., Kanniappan, G., Padankatti, S. M., ... Russell, P. S. S. (2014). Sensory Profile Caregiver Questionnaire: A measure for sensory impairment among children with developmental disabilities in India. Indian Journal of Pediatrics, 81(2), 183-186. doi:10.1007/s12098-014-1603-4
  4. Brown, T., Morrison, I. C., & Stagnitti, K. (2010). The reliability of two sensory processing scales used with school-age children: Comparing the response consistency of mothers, fathers, and classroom teachers rating the same child. Journal of Occupational Therapy, Schools, & Early Intervention, 3(4), 331-347. doi:10.1080/19411243.2010.541775
  5. Case-Smith, J., & O'Brien, J. C. (2015). Occupational therapy for children and adolescents. St. Louis, Missouri: Elsevier.
  6. Cervera, P. S., Cerezuela, G. P., Andres, M. I. F., & Minguez, R. T. (2015). Sensory processing in children with autism spectrum disorder: Relationship with non-verbal IQ, autism severity and attention deficit/hyperactivity disorder symptomatology. Research in Developmental Disabilities, 45-46, 188-201. doi:10.1016./j.ridd.2015.07.031
  7. Cha, J., & Kim, Y. (1994). An analytical review of interrater reliability & agreement. Korean Management Review, 23, 75-102.
  8. Cho, K. S., & Choi, J. Y. (2003). A preliminary study on development of Korea version of the Behavior Assessment System for Children(BASC): Parent Rating Scale-Preschool(PRS-P). Korean Journal of Special Education, 38(1), 291-314.
  9. Crowe, T. K. (1989). Pediatric assessments: A survey of their use by occupational therapists in northwestern school systems. Occupational Therapy Journal of Research, 9(5), 273-286. doi:10.1177/153944928900900502
  10. Custers, J. W., Hoijtink, H., Van der Net, J., & Helders, P. J. (2000). Cultural differences in functional status measurement: Analyses of person fit according to the Rasch model. Quality of Life Research, 9(5), 571-578. https://doi.org/10.1023/A:1008949108089
  11. Dunn, W. (1997). The impact of sensory processing abilities on the daily lives of young children and their families: A conceptual model. Infants & Young Children, 9(4), 23-35. https://doi.org/10.1097/00001163-199704000-00005
  12. Dunn, W. (1999). Sensory Profile user's manual. San Antonio, TX: Psychological Corporation.
  13. Eeles, A. L., Spittle, A. J., Anderson, P. J., Brown, N., Lee, K. J., Boyd, R. N., ... Doyle, L. W. (2013). Assessments of sensory processing in infants: A systematic review. Developmental Medicine & Child Neurology, 55(4), 314-326. doi:10.1111/j.1469-8749.2012.04434
  14. Fleiss, J. L. (1986). The design and analysis of clinical experiments. NY: Wiley.
  15. Jeong, B. L., Yoo, E. Y., Jung, M. Y., & Chung, B. I. (2009). Adaptation of the Korean-translated version of the pediatric evaluation of disability inventory and cross-cultural research: Preliminary study. Journal of Korean Society of Occupational Therapy, 17(3), 121-132.
  16. Jin, M., Liu, A., Chen, Z., & Li, Z. (2013). Sequential testing of measurement errors in inter-rater reliability studies. Statistica Sinica, 23(4), 1743-1759. doi:10.5705/ss.2012.036s.
  17. Kerlinger, F. N. (1964). Foundations of behavioral research: Educational and psicological inquiry. Holt, NY: Rinehart and Winston.
  18. Ketelaar, M., Vermeer, A., & Helders, P. (1998). Functional motor abilities of children with cerebral palsy: A systematic literature review of assessment measures. Clinical Rehabilitation, 12(5), 369-380. doi:10.1191/026921598673571117
  19. Kielhofner, G. (2006). Developing and evaluating quantitative data collection instruments. In G. Kielhofner (Ed.), Research in occupational therapy: Methods of inquiry for enhancing practice (pp. 155-176). Philadelphia: F. A. Davis.
  20. Kim, K. M., & Shin, H. H. (2016). A study for construct validity and reliability of the Sensory Processing Scale for Children(SPS-C). Journal of Korean Academy of Sensory Integration, 14(2), 11-21. doi:10.18064/JKASI.2016.14.2.011
  21. Kim, K. M., Shin, H. H., & Kim, M. H. (2015). A preliminary study to development of an assessment to measure sensory processing of children, 'Sensory Processing Scale for Children (SPS-C)'. Journal of Korean Academy of Sensory Integration, 13(2), 31-41. doi:10.18064/JKASI.2015.13.2.031
  22. Kim, M. H., Shin, H. H., & Kim, K. M. (2015). Assessment tools of sensory processing for preschool-aged children: A systematic review. Journal of Korean Academy of Sensory Integration, 13(1), 1-12. doi:10.18064/JKASI.2015.13.1.001
  23. Ko, J. Y., & Kim, G. W. (2010). Test-retest, inter-rater, and intra-rater reliability of a pediatric balance scale in children with cerebral palsy. Journal of Korean Physical Therapy, 22(4), 43-48.
  24. Kong, K. A. (2017). Statistical methods: Reliability assessment and method comparison. Ewha Medical Journal, 40(1), 9-16. doi:10.12771/emj.2017.40.1.9
  25. Korean Society for Preventive Medicine. (2013). Preventive medicine and public health (2nd ed). Seoul: Gyechuk Munwhasa.
  26. Lee, S. H., Hong, C. R., & Park, H. Y. (2018). Current trend in use of occupational therapy assessment tool by pediatric occupational therapist. Journal of Korean Academy of Sensory Integration, 16(3), 23-33. doi:10.18064/JKASI.2018.16.3.023
  27. Lim, Y. J., Park, K. Y., & Yoo, E. Y. (2007). Pilot study to establish content validity of a Korean-translated version of a Sensory Profile. Journal of Korean Society of Occupational Therapy, 15(2), 25-42.
  28. Little, L. M., Freuler, A. C., Houser, M. B., Guckian, L., Carbine, K., David, F. J., ... Baranek, G. T. (2011). Psychometric validation of the Sensory Experiences Questionnaire. American Journal of Occupational Therapy, 65(2), 207-210. doi:10.5014/ajot.2011.00084
  29. Martin, R. P. (1988). Assessment of personality and behavior problems: Infancy through adolescence. NY: Guilford Press.
  30. McIntosh, D. N., Miller, L. J., Shyu, W., & Dunn, W. (1999). Development and validation of the Short Sensory Profile. In W. Dunn (Ed.), The sensory profile: Examiners manual. San Antonio, TX: Psychological Cooperation.
  31. Ohl, A., Butler, C., Carney, C., Jarmel, E., Palmieri, M., Pottheiser, D., ... Smith, T. (2012). Test-retest reliability of the Sensory Profile Caregiver Questionnaire. American Journal of Occupational Therapy, 66(4), 483-487. doi:10.5014/ajot.2012.003517
  32. Parham, L. D., Ecker, C., Miller Kuhaneck, H., Henry, D. A., & Glennon, T. J. (2007). Sensory Processing Measure (SPM) manual. Los Angeles, CA: Western Psychological Services.
  33. Portney, L. G., & Watkins, M. P. (2009). Foundations of clinical research: Applications to practice (3rd ed). Upper Saddle River, NJ: Prentice Hall Health.
  34. Rosner, B. (2006). Fundamentals of biostatistics (7th ed). Boston, MA: Duxbury Press.
  35. Shin, J. E., Kim, K. M., Chang, M. Y., & Hong, E. (2020). A pilot study for standardization of the Sensory Processing Scale for Children (SPS-C). Journal of Korean Academy of Sensory Integration, 18(2), 42-54. doi:10.18064/JKASI.2020.18.2.42
  36. Silva, L. M., & Schalock, M. (2012). Sense and Self-regulation Checklist, a measure of comorbid autism symptoms: Initial psychometric evidence. American Journal of Occupational Therapy, 66(2), 177-186. https://doi.org/10.5014/ajot.2012.001578
  37. Szklo, M., & Nieto, F. J. (2007). Epidemiology: Beyond the basics (2nd ed). MA: Jones & Bartlett Publishers.
  38. Yoo, S. Y. (2003). Translating and validating questionnaires for physical education research. Journal of Education, 22(1), 1-15.