• Pediatric Gastroenterology, Hepatology & Nutrition
• /
• v.26 no.2
• /
• pp.88-98
• /
• 2023

Purpose: Children with inflammatory bowel disease (IBD) frequently undergo clinical assessments, involving triadic communication between clinician, parent, and child. During such encounters parents are traditionally the main communicator of information on their child's IBD, including subjective symptom reports. The level of agreement between children and their parents for IBD symptoms is poorly understood, and this study aimed to examine this factor. Methods: This was a cross-sectional study among children with IBD, and one parent. A validated paediatric IBD symptom report tool (IBDnow) enabled children and their parent to rate seven pain, well-being, and stool metrics, with dyads completing the tool concurrently. Results were assessed using: Individual agreement: proportion of identical symptom reports by each dyad (ideal score >0.7); Category agreement: percentage of identical reports for IBDnow metrics for the cohort; Inter-rater reliability: Gwet's AC1 coefficient with higher scores indicating better reliability (maximum=1). Results: Seventy-four parent/child dyads participated; child's mean age 12.2 years (standard deviation [SD] 2.9, range 6-16), mean time since diagnosis 2.8 years (SD 3), 54% female, 73% had Crohn's Disease. Mean individual agreement level was 0.6, with 27% of dyads agreeing on ≥6/7 IBDnow metrics. Category agreement was reported by 61% of dyads, 20% of parents overestimated, and 19% underestimated, their child's symptoms. Inter-rater reliability ranged from fair to good. Conclusion: These results should improve clinician awareness of how IBD symptom reports from parents may introduce bias. Children should be considered the most important source of symptom reports, and tools such as IBDnow utilised to enhance communication.

• Journal of health informatics and statistics
• /
• v.41 no.1
• /
• pp.49-56
• /
• 2016

Objectives: Carotid intima-media thickness (CIMT) and the presence of carotid artery plaque are widely used as preclinical markers of atherosclerosis. Due to operator dependency in measuring CIMT, it is important to evaluate the reliability of measuring CIMT and plaque between centers in a multicenter study. The purpose of this study is to evaluate the inter-rater reliability of CIMT and plaque presence among three clinical centers of the Cardiovascular and Metabolic Disease Etiology Research Center (CMERC). Methods: Twenty people without known cardiovascular disease (age 37-64) were enrolled during 2014-2015, and their left and right carotid arteries were examined repeatedly with ultrasonography for CIMT measurements at three clinical centers according to a predetermined protocol. Maximum and mean values of CIMT at distal common carotid artery were recorded. Plaque presence at a carotid artery was checked by an operator. The reliability of CIMT and carotid plaque presence was assessed using an intraclass correlation coefficient (ICC) and kappa statistics, respectively. Results: Calculated ICC was 0.647 (95% CI: 0.487-0.779) for maximum CIMT, and 0.758 (95% CI: 0.632- 0.854) for mean CIMT. In Bland Altman plot, most observed values were distributed within mean difference ${\pm}1.96$ SD ranges. Kappa statistics of plaque presence between two centers were 0.304 (center 1 and 2), 0.507 (center 1 and 3), and 0.606 (center 2 and 3), respectively, while Fleiss kappa for overall agreement was 0.445. Conclusions: The inter-rater reliability of CIMT measurements among three clinical centers turned out to be high, and the agreement of measuring carotid plaque presence was fair.

• Therapeutic Science for Rehabilitation
• /
• v.8 no.4
• /
• pp.65-76
• /
• 2019

Objective : This study aimed to verify the validity and reliability of the Upper Extremity Performance Test for the Elderly (TEMPA) by modifying its items to exhibit cultural differences. Methods : This study included 171 healthy adults and older adults and 41 individuals with impaired upper extremity function. Content validity, discriminant validity, test-retest reliability, and inter-rater reliability were analyzed. Results : The following items, exhibiting cultural differences, were modified: "open a lock and take the top off a pillbox" and "write and affix a postage stamp." The discriminant validity results indicated that participants with normal upper extremity function performed better than those with impaired in the upper extremity function (p<.001). The test-retest reliability of the execution speed (intraclass correlation coefficient; ICC) was .71-.94, functional rating (kappa) was 1.0, and task analysis (ICC) was 1.0. The inter-rater reliability of the speed of execution was 1.0, functional rating was .79-1.0, and task analysis was .94-1.0. Conclusion : TEMPA has moderate to high level of reliability and is an assessment tool that can clearly distinguish individuals with upper extremity impairment from those without impairment.

• Physical Therapy Korea
• /
• v.18 no.3
• /
• pp.85-93
• /
• 2011

The purpose of this study was to establish the reliability and validity of the passive lumbar extension (PLE) test and prone instability test (PIT). Thirty-three subjects (14 males, 19 females) with lower back pain enrolled in the study and the subjects were divided into 2 groups (positive and negative instability groups) on the basis of radiographies of flexion and extension. Reliability was determined by the kappa coefficient and validity was examined using calculated sensitivity, specificity, and the likelihood ratio. The results showed that the reliability of the PLE test was higher than the PIT (intra-rater reliability: k=.86 and k=.81, interrater reliability: k=.65 and k=.62) and the validity of the PLE test was also higher than the PIT (sensitivity: 91% and 62%, specificity: 95% and 85% positive likelihood ratio: 20.00 and 4.10, negative likelihood ratio: .10 and .45). In conclusion, we think that the PLE test was a more reliable and valid method for lumbar instability than the PIT.

• The Journal of Korean Physical Therapy
• /
• v.21 no.1
• /
• pp.41-48
• /
• 2009

Purpose: The examine the Reliability and Validity of the modified Emory Functional Ambulation Profile (mEFAP), Tinetti. Gait (TG), Timed Up & Go Tes t (TUG), Comfortable Gait Speed (CGS), Berg Balance Scale (BBS) in assessing gait function and balance in elderly person. Methods: The 45 community-dwelling subjects were participated in this study. Reliability was determined by intra-class correlation coefficient (ICC$_{3,1}$), Bland and Altman method (Standard Error of Measurement (SEM), Smallest Real Difference (SRD)). Results: Validity was examined by correlation the mEFAP, TG, TUG, CGS, BBS. The intra-rater reliability were High (ICC$_{3,1}$ : mEFAP=0.95, TG=0.96, TUG=0.94, CGS=0.96, BBS=0.92) and Absolute reliability were excellent (SEM: mEFAP=1.90, TG=0.21, TUG=0.28 CGS=0.25, BBS=0.52), (SRD: mEFAP=5.26, TG=0.58, TUG=0.77, CGS=0.69, BBS=1.44). There were significant correlations between assessment tool (r=.0.58$\sim$0.78, p<0.01) indicating good validity. Our results provide strong evidence that the assessment tool has good reliability, validity for assessing elderly person undergoing rehabilitation. Conclusion: The gait assessment tool is a useful scale for measuring walking function and recovery in elderly person.

• Therapeutic Science for Rehabilitation
• /
• v.11 no.1
• /
• pp.69-85
• /
• 2022

Objective : This study aimed to develop a Comprehensive Oro-Facial Function Scale (COFFS) that can evaluate oro-facial function in patients with dysphagia. Methods : To verify the item composition and reliability of the COFFS, preliminary items were collected by selecting and analyzing four previous studies, and the Content Validity Ratio (CVR) was derived through a second survey of experts. Cronbach's 𝛼 was calculated for the internal validity of the evaluation items, and the test-retest reliability and inter-rater reliability were calculated using the internal classification coefficients (ICC). Results : The content validity ratio of all items was 0.67; in the case of Cronbach's 𝛼 value for each domain, 0.849 for communication domain, -0.224 for the oro-facial structure and shape, 0.831 for the ability to perform orofacial movements, and 0.946 for mastication and swallowing function. The test-retest reliability was 0.974 and the inter-rater reliability was 0.937, showing high reliability. Conclusion : In this study, the evaluation tool of COFFS was finally selected from 34 items in four areas and developed on a 3-5 point scale according to the evaluation items. In future studies, additional research is needed to prove its validity through correlation with other evaluation tools that measure oro-facial function.

• The Journal of Korean Physical Therapy
• /
• v.21 no.1
• /
• pp.9-17
• /
• 2009

Purpose: The purpose of this study was to determine reliability and validity of the Postural Assessment Scale for Stroke Patients (PASS) in chronic stroke patients. Methods: A total of 43 stroke patients, who had a stroke more than 6 months previously, participated in the study. Reliability was determined by the intra-class correlation coefficient (ICC$_{3,1}$), Bland and Altman method and Cronbach's alpha by internal consistency. Validity was examined by correlation the PASS scores to the Berg Balance Scale (BBS), Trunk Control Test (TCT), and Fugl-Meyer Balance (FM-B) score. Results: The intra-rater reliability and the Absolute reliability of the PASS was good ICC$_{3,1}$=0.97 (95%CI 0.95$\sim$0.99) and excellent SEM=1.01 respectively. Cronbach's alpha value for PASS was found to be 0.94. There were significant correlations between the PASS and BBS, TCT, FM-B (r=0.65－0.96, p<0.01). Conclusion: The PASS provide reliable and valid instrument of the postural control assessment for chronic stroke patients.

• Proceedings of the Korea Contents Association Conference
• /
• 2019.05a
• /
• pp.381-382
• /
• 2019

본 연구는 기능적 뻗기 검사의 측정자 간 신뢰도를 알아보기 위하여 실시하였다. 본 연구에 참가한 대상자는 총 46명(남 20명, 여 26명)이었고 기능적 뻗기 검사는 두 곳의 실험실에서 이루어졌고 측정자는 총 6명이었다. 같은 장소의 실험실에서 이루어진 검사의 측정자간 신뢰도는 높게 나타났으나 장소가 다른 곳에서 이루어진 검사의 측정자 간 신뢰도는 아주 낮게 나타났다. 따라서 기능적 뻗기 검사의 신뢰도를 확보하기 위하여서는 측정자들의 명확한 기준의 정리가 필요할 것으로 보인다.

• Journal of The Korean Association For Science Education
• /
• v.17 no.1
• /
• pp.65-73
• /
• 1997

The purpose of this study is to develop a valid and reliable instrument, applicable to high school Earth Science class experiment. In advance of developing items, I was selected 14 inquiry process skills and specified evaluative objectives for each of them to develop scales and criteria for them. I developed 28 evaluation items for 5 experiment subjects among those of high school Earth Science class. The first field trial was performed a sample of 5 high school students, and the second one using a sample of 25 high school students. The results are as follows. (1) The content validity and reliability(Cronbach $\alpha$) of the developed items were 82.7% and .86, respectively, the developed instrument in this study is considered valid and reliable. (2) The average difficulty index was .69 and the discrimination index was .30. (3) Answer sheets based on the reported results were rated 5 teachers and Inter-rater Reliabilitiy and Inter-rater Consistency were analyzed, its indices were .80 and .76, respectively. (4) The developed items show a low coefficient of .45 with TESIS, a set of paper-and-pencil test items developed by Lee, Hang-Ro(1991). That the experiment assessment is solely subject to the rater's viewpoint has been one of the major problems raised concerning the matter. This research, however, shows that a set of more specified scales and criteria for the evaluation will make it more valid, reliable and efficient.

• Asian Pacific Journal of Cancer Prevention
• /
• v.15 no.14
• /
• pp.5759-5765
• /
• 2014

Electrical impedance tomography (EIT) is a potential supplement for mammogram screening. This study aimed to evaluate and feasibility of EIT as opposed to mammography and to determine pain perception with both imaging methods. Women undergoing screening mammography at the Radiology Department of National University of Malaysia Medical Centre were randomly selected for EIT imaging. All women were requested to give a pain score after each imaging session. Two independent raters were chosen to define the image findings of EIT. A total of 164 women in the age range from 40 to 65-year-old participated and were divided into two groups; normal and abnormal. EIT sensitivity and specificity for rater 1 were 69.4% and 63.3, whereas for rater 2 they were 55.3% and 57.0% respectively. The reliability for each rater ranged between good to very good (p<0.05). Quantitative values of EIT showed there were significant differences in all values between groups (ANCOVA, p<0.05). Interestingly, EIT scored a median pain score of $1.51{\pm}0.75$ whereas mammography scored $4.15{\pm}0.87$ (Mann Whitney U test, p<0.05). From these quantitative values, EIT has the potential as a health discriminating index. Its ability to replace image findings from mammography needs further investigation.