• Safety and Health at Work
• /
• 제11권1호
• /
• pp.10-18
• /
• 2020

Background: The elevated risk of occupational infection such as tuberculosis among health workers in many countries raises the question of whether the quality of occupational health and safety (OHS) and infection prevention and control (IPC) can be improved by auditing. The objectives of this study were to measure (1) audited compliance of primary health-care facilities in South Africa with national standards for OHS and IPC, (2) change in compliance at reaudit three years after baseline, and (3) the inter-rater reliability of the audit. Methods: The study analyzed audits of 60 primary health-care facilities in the Western Cape Province of South Africa. Baseline external audits in the time period 2011-2012 were compared with follow-up internal audits in 2014-2015. Audits at 25 facilities that had both internal and external audits conducted in 2014/2015 were used to measure reliability. Results: At baseline, 25% of 60 facilities were "noncompliant" (audit score<50%), 48% "conditionally compliant" (score >50 < 80%), and only 27% "compliant" (score >80%). Overall, there was no significant improvement in compliance three years after baseline. Percentage agreement on specific items between internal and external audits ranged from 28% to 92% and kappa from -0.8 to 0.41 (poor to moderate). Conclusion: Low baseline compliance with OHS-IPC measures and lack of improvement over three years reflect the difficulties of quality improvement in these domains. Low inter-rater reliability of the audit instrument undermines the audit process. Evidence-based investment of effort is required if repeat auditing is to contribute to occupational risk reduction for health workers.

• Physical Therapy Rehabilitation Science
• /
• 제7권4호
• /
• pp.186-190
• /
• 2018

Objective: Deep neck flexor muscle endurance (DNFET) is important to cervical pain patients. However, there is no normative data of the DNFET hold time of Korean university students. The purpose of this study was to provide normative data and the reliability of the DNFET times of Korean university students and to compare the DNFET hold times between male and female subjects. Design: Cross-sectional study. Methods: The participants included 39 male and 39 female students with no cervical pain. Each DNFET was measured while the subjects kept their chin tucked in while in a supine (hook-lying) position and with the head lifted 2.5 cm off the bed. The DNFET was conducted on each subject twice and the mean values were obtained. After each measurement, the participants rested for 5 minutes. Inter-rater reliability was measured by intraclass correlation coefficient (ICC) by three separate evaluators. Results: The inter-rater reliability was good, showing an ICC (2,3) value = 0.785 (95% confidence interval, 0.370-0.942). The DNFET time scores for men and women were $25.14{\pm}9.96$ seconds and $15.23{\pm}6.10$ seconds, respectively, in which the time scores of the men were significantly longer compared to women (p<0.05). Conclusions: Asymptomatic men displayed higher DNFET scores than women. This study can help clinicians test cervical function of patients and set an interventional goal. These findings serve as a basis that insists Korean women to increase their amount of physical activity.

• 한국보육지원학회지
• /
• 제12권4호
• /
• pp.111-130
• /
• 2016

This study examined the reliability and validity evidence of the Korean version of Wechsler Primary & Preschool Scale for Intelligence(K-WPPSI-IV), which was standardized recently. Following the stratified sampling for Korean population in terms of region and maternal education level, 1,700 children aged 2.6~7.7 years were recruited for Korean norm development. The split-half reliability (N=1,700) was high(Fisher's z(.75-.89)) and test-retest reliability(N=100) was satisfactory ranging from .95 to .68. The inter-rater reliability(N=110) was very high(.96-1.0). Discriminant and convergent validities were revealed by correlational patterns among subtests and indices. Future studies are needed to extend both reliability and validity of K-WPPSI-IV by collecting data with a various sample group and a variety of instruments.

• 재활복지공학회논문지
• /
• 제10권1호
• /
• pp.37-45
• /
• 2016

이 연구의 목적은 래스터입체사진술이 적용된 ABW-mapper를 사용하여 얻은 관상면 상에서의 하지 정렬 측정에 대하여 측정자 내, 측정자 간, 측정-재측정 간 각각의 신뢰도와 타당도를 조사하고 평가하는 것이다. 열여덟 명의 대상자가 이 연구에 참여하였다. 일주일간격으로 두 번의 세션에 걸쳐서 두 사람의 측정자가 각각 ABW-mapper를 사용하여 기립자세에서의 S각(입체사진 각-래스터입체사진 촬영을 통해 측정한 관상면상의 하지 정렬 측정 각)을 측정하였고, 첫 번째 세션에서는 짧은 시간 간격으로 한 측정자가 같은 대상자에 대하여 두 번씩 측정하였다. Q각은 디지털카메라로 기립자세를 촬영한 사진에서 고니어미터로 측정하였다. HKA각은 컴퓨터 기반 디지털 방사선 영상사진 위에서 측정 소프트웨어를 사용하여 측정하였다. 급내상관계수(ICC)를 통해 신뢰도를 분석하였고, 피어슨 상관계수를 사용하여 타당도를 검사하였다. 그 결과, S각 측정은 매우 높은 측정자 내 (ICC=0.956~0.974), 측정자 간 (ICC=0.962) 검사-재검사 간 (ICC=0.945) 신뢰도를 나타냈으며, S각과 Q각, S각과 HKA각 사이에는 강한 음의 상관관계(각각 r=-0.739, -0.702)를 나타냈다. 따라서, ABW-mapper에 의한 래스터입체사진법을 통한 S각 측정은 관상면에서의 하지정렬의 측정에 대하여 Q각이나 HKA각 측정에 관련하여 예비적 또는 보완적 도구로 사용될 수 있을 것이라 생각된다.

• 기본간호학회지
• /
• 제13권3호
• /
• pp.510-519
• /
• 2006

Purpose: To develop and validate a scale suitable and efficient scale for use in clinical practice as to assess pain in premature infants. Method: Pain indicators identified by observation of preform infants. A cohort of preform infants was studied prospectively to determine the construct validity, inter-rater reliability, and internal consistency of the scale. The PIPS uses four indicators of pain: corrected gestational age, heart rate, oxygen saturation, behavioral state. The validation study included 45 premature infants with gestational age of 37 weeks or less. Results: The inter-rater reliability of the PIPS was acceptable, with Pearson correlations ranging from.720 to.970. Internal consistency was high: Cronbach's alpha coefficients ranged from.551 to.653. There was a strong correlation between the PIPS and PIPP scores (each researcher's r=.743, each indicator's r=.914). Although gestational age showed no association between these factors and the sum, the other variables were positively associated with the sum. Time needed to calculate PIPS scores is was less than Premature Infant Pain Profile (PIPP) scores(p<.000). Conclusion: The validation data suggest that the PIPS is appropriate and efficient for assessing pain in premature infants. Further studies are required about to determine appropriate interventions for each pain score on the PIPS.

• 한국간호교육학회지
• /
• 제22권4호
• /
• pp.549-558
• /
• 2016

Purpose: The purpose of this study was to develop and validate a Nursing Competency Scale in Simulation (NCSS) for nursing students. Methods: A preliminary version of the NCSS of 14 items was derived from the literature. A panel of seven experts reviewed the preliminary version for content validation and developed 15 items scale. A convenient sample of 195 nursing students completed the survey and two evaluators measured the performances of nine teams in a simulation scenario with NCSS. The data were analyzed using exploratory factor analysis, descriptive statistics, independent t-test and Cronbach's alpha. Intraclass correlation coefficient (ICC) was used in order to estimate the degree of inter-rater reliability. Results: An exploratory factor analysis demonstrated that two factor structures of the NCSS explained 51.1% of the total variance. Two factors were named psychosocial skills and cognitive and psychomotor skills. The mean scores of NCSS between third and 4th grade were significantly different providing support for its known-group validity. Cronbach's alpha was .90 and ranged from .79 to .88. The overall ICC for inter-rater agreement was 0.89 (95% CI 0.03 to 0.98). Conclusion: This scale shows preliminary evidence for validity and reliability. It could be a useful instrument for measuring learning outcome in simulation for nursing students' clinical competency.

• Safety and Health at Work
• /
• 제9권2호
• /
• pp.140-143
• /
• 2018

Background: The Occupational Safety and Health Monitoring and Assessment Tool (OSH-MAT) is a practical instrument that is currently used in the German woodworking and metalworking industries to monitor safety conditions at workplaces. The 12-item scoring system has three subscales rating technical, organizational, and personnel-related conditions in a company. Each item has a rating value ranging from 1 to 9, with higher values indicating higher standard of safety conditions. Methods: The reliability of this instrument was evaluated in a cross-sectional survey among 128 companies and its validity among 30,514 companies. The inter-rater reliability of the instrument was examined independently and simultaneously by two well-trained safety engineers. Agreement between the double ratings was quantified by the intraclass correlation coefficient and absolute agreement of the rating values. The content validity of the OSH-MAT was evaluated by quantifying the association between OSH-MAT values and 5-year average injury rates by Poisson regression analysis adjusted for the size of the companies and industrial sectors. The construct validity of OSH-MAT was examined by principle component factor analysis. Results: Our analysis indicated good to very good inter-rater reliability (intraclass correlation coefficient = 0.64-0.74) of OSH-MAT values with an absolute agreement of between 72% and 81%. Factor analysis identified three component subscales that met exactly the structure theory of this instrument. The Poisson regression analysis demonstrated a statistically significant exposure-response relationship between OSH-MAT values and the 5-year average injury rates. Conclusion: These analyses indicate that OSH-MAT is a valid and reliable instrument that can be used effectively to monitor safety conditions at workplaces.

• Pediatric Gastroenterology, Hepatology & Nutrition
• /
• 제26권2호
• /
• pp.88-98
• /
• 2023

Purpose: Children with inflammatory bowel disease (IBD) frequently undergo clinical assessments, involving triadic communication between clinician, parent, and child. During such encounters parents are traditionally the main communicator of information on their child's IBD, including subjective symptom reports. The level of agreement between children and their parents for IBD symptoms is poorly understood, and this study aimed to examine this factor. Methods: This was a cross-sectional study among children with IBD, and one parent. A validated paediatric IBD symptom report tool (IBDnow) enabled children and their parent to rate seven pain, well-being, and stool metrics, with dyads completing the tool concurrently. Results were assessed using: Individual agreement: proportion of identical symptom reports by each dyad (ideal score >0.7); Category agreement: percentage of identical reports for IBDnow metrics for the cohort; Inter-rater reliability: Gwet's AC1 coefficient with higher scores indicating better reliability (maximum=1). Results: Seventy-four parent/child dyads participated; child's mean age 12.2 years (standard deviation [SD] 2.9, range 6-16), mean time since diagnosis 2.8 years (SD 3), 54% female, 73% had Crohn's Disease. Mean individual agreement level was 0.6, with 27% of dyads agreeing on ≥6/7 IBDnow metrics. Category agreement was reported by 61% of dyads, 20% of parents overestimated, and 19% underestimated, their child's symptoms. Inter-rater reliability ranged from fair to good. Conclusion: These results should improve clinician awareness of how IBD symptom reports from parents may introduce bias. Children should be considered the most important source of symptom reports, and tools such as IBDnow utilised to enhance communication.

• Journal of health informatics and statistics
• /
• 제41권1호
• /
• pp.49-56
• /
• 2016

목적: 경동맥 내막-중막 두께와 경동맥 경화반의 존재유무는 죽상동맥경화증의 임상 전단계를 나타내는 지표로 널리 사용되고 있다. 경동맥 내막-중막 두께를 측정할 때의 측정자 의존성 때문에, 다기관 연구에서는 경동맥 내막-중막 두께와 경화반 측정의 기관간 신뢰도를 확인하는 것이 중요하다. 이 연구의 목적은 심뇌혈관 및 대사질환원인 연구센터에 속해 있는 세 임상기관 사이의 경동맥 내막-중막 두께와 경화반 측정의 측정자간 신뢰도를 평가하는 것이다. 방법: 심뇌혈관 질환 과거력이 없는 사람 20명이 2014-2015년 사이에 이 연구에 참여하였고(연령 37-64세), 미리 정해진 프로토콜에 따라 연구참여자의 좌, 우 경동맥을 세 임상기관에서 반복적으로 측정하였다. 총 경동맥의 원위부에서 측정한 경동맥 내막-중막 두께의 최대값과 평균값을 기록하였다. 경동맥에서의 경화반 존재유무는 측정자에 의해 확인되었다. 경동맥 내막-중막 두께와 경화반 존재유무의 신뢰도를 급내상관계수와 카파 통계량을 통해 각각 평가하였다. 결과: 계산된 급내상관계수는 최대 경동맥 내막-중막 두께를 평가하였을 때 0.647이었고 (95% CI: 0.487-0.779), 평균 경동맥 내막-중막 두께를 평가하였을 때 0.758 (95% CI: 0.632-0.854) 이었다. Bland Altman plot에서, 관측치의 대부분은 평균의 차이에서 ${\pm}1.96$ 표준편차 사이에 분포하였다. 각 기관 사이의 경화반 존재유무에 대한 카파 통계량은 0.304 (기관 1과 2), 0.507 (기관 1과 3), 0.606 (기관 2와 3)이었다. 전반적인 일치를 평가하는 Fleiss카파값은 0.445였다. 결론: 세 임상기관 사이의 경동맥 내막-중막 두께의 측정자간 신뢰도는 훌륭하였으며, 경화반 존재유무에 대한 신뢰도는 적정하였다.

• 한국콘텐츠학회:학술대회논문집
• /
• 한국콘텐츠학회 2019년도 춘계종합학술대회
• /
• pp.381-382
• /
• 2019

본 연구는 기능적 뻗기 검사의 측정자 간 신뢰도를 알아보기 위하여 실시하였다. 본 연구에 참가한 대상자는 총 46명(남 20명, 여 26명)이었고 기능적 뻗기 검사는 두 곳의 실험실에서 이루어졌고 측정자는 총 6명이었다. 같은 장소의 실험실에서 이루어진 검사의 측정자간 신뢰도는 높게 나타났으나 장소가 다른 곳에서 이루어진 검사의 측정자 간 신뢰도는 아주 낮게 나타났다. 따라서 기능적 뻗기 검사의 신뢰도를 확보하기 위하여서는 측정자들의 명확한 기준의 정리가 필요할 것으로 보인다.