• Title/Summary/Keyword: Intraclass Correlation Coefficient

Search Result 248, Processing Time 0.028 seconds

Agreement and Reliability between Clinically Available Software Programs in Measuring Volumes and Normative Percentiles of Segmented Brain Regions

  • Huijin Song;Seun Ah Lee;Sang Won Jo;Suk-Ki Chang;Yunji Lim;Yeong Seo Yoo;Jae Ho Kim;Seung Hong Choi;Chul-Ho Sohn
    • Korean Journal of Radiology
    • /
    • v.23 no.10
    • /
    • pp.959-975
    • /
    • 2022
  • Objective: To investigate the agreement and reliability of estimating the volumes and normative percentiles (N%) of segmented brain regions among NeuroQuant (NQ), DeepBrain (DB), and FreeSurfer (FS) software programs, focusing on the comparison between NQ and DB. Materials and Methods: Three-dimensional T1-weighted images of 145 participants (48 healthy participants, 50 patients with mild cognitive impairment, and 47 patients with Alzheimer's disease) from a single medical center (SMC) dataset and 130 participants from the Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset were included in this retrospective study. All images were analyzed with DB, NQ, and FS software to obtain volume estimates and N% of various segmented brain regions. We used Bland-Altman analysis, repeated measures ANOVA, reproducibility coefficient, effect size, and intraclass correlation coefficient (ICC) to evaluate inter-method agreement and reliability. Results: Among the three software programs, the Bland-Altman plot showed a substantial bias, the ICC showed a broad range of reliability (0.004-0.97), and repeated-measures ANOVA revealed significant mean volume differences in all brain regions. Similarly, the volume differences of the three software programs had large effect sizes in most regions (0.73-5.51). The effect size was largest in the pallidum in both datasets and smallest in the thalamus and cerebral white matter in the SMC and ADNI datasets, respectively. N% of NQ and DB showed an unacceptably broad Bland-Altman limit of agreement in all brain regions and a very wide range of ICC values (-0.142-0.844) in most brain regions. Conclusion: NQ and DB showed significant differences in the measured volume and N%, with limited agreement and reliability for most brain regions. Therefore, users should be aware of the lack of interchangeability between these software programs when they are applied in clinical practice.

Comparative Study between ZOOMit and Conventional Intravoxel Incoherent Motion MRI for Assessing Parotid Gland Abnormalities in Patients with Early- or Mid-Stage Sjögren's Syndrome

  • Qing-Qing Zhou;Wei Zhang;Yu-Sheng Yu;Hong-Yan Li;Liang Wei;Xue-Song Li;Zhen-Zhen He;Hong Zhang
    • Korean Journal of Radiology
    • /
    • v.23 no.4
    • /
    • pp.455-465
    • /
    • 2022
  • Objective: To compare the reproducibility and performance of quantitative metrics between ZOOMit and conventional intravoxel incoherent motion (IVIM) magnetic resonance imaging (MRI) in the diagnosis of early- and mid-stage Sjögren's syndrome (SS). Materials and Methods: Twenty-two patients (mean age ± standard deviation, 52.0 ± 10.8 years; male:female, 2:20) with early- or mid-stage SS and 20 healthy controls (46.9 ± 14.6 years; male:female, 7:13) were prospectively enrolled in our study. ZOOMit IVIM and conventional IVIM MRI were performed simultaneously in all individuals using a 3T scanner. Quantitative IVIM parameters - including tissue diffusivity (D), pseudodiffusion coefficient (D*), and perfusion fraction (f) - inter- and intra-observer reproducibility in measuring these parameters, and their ability to distinguish patients with SS from healthy individuals were assessed and compared between ZOOMit IVIM and conventional IVIM methods, appropriately. MR gland nodular grade (MRG) was also examined. Results: Inter- and intra-observer reproducibility was better with ZOOMit imaging than with conventional IVIM imaging (ZOOMit vs. conventional, intraclass correlation coefficient of 0.897-0.941 vs. 0.667-0.782 for inter-observer reproducibility and 0.891-0.968 vs. 0.814-0.853 for intra-observer reproducibility). Significant differences in ZOOMit f, ZOOMit D*, D*, conventional D*, and MRG between patients with SS and healthy individuals (all p < 0.05) were observed. ZOOMit D* outperformed conventional D* in diagnosing early- and mid-stage SS (area under receiver operating curve, 0.867 and 0.658, respectively; p = 0.002). The combination of ZOOMit D*, MRG, and ZOOMit f as a new diagnostic index for SS, increased diagnostic area under the curve to 0.961, which was higher than that of any single parameter (all p < 0.01). Conclusion: Considering its better reproducibility and performance, ZOOMit IVIM may be preferred over conventional IVIM MRI, and may subsequently improve the ability to diagnose early- and mid-stage SS.

Development and Validation of a Novel Generic Health-related Quality of Life Instrument With 20 Items (HINT-20)

  • Jo, Min-Woo;Lee, Hyeon-Jeong;Kim, Soo Young;Kim, Seon-Ha;Chang, Hyejung;Ahn, Jeonghoon;Ock, Minsu
    • Journal of Preventive Medicine and Public Health
    • /
    • v.50 no.1
    • /
    • pp.38-59
    • /
    • 2017
  • Objectives: Few attempts have been made to develop a generic health-related quality of life (HRQoL) instrument and to examine its validity and reliability in Korea. We aimed to do this in our present study. Methods: After a literature review of existing generic HRQoL instruments, a focus group discussion, in-depth interviews, and expert consultations, we selected 30 tentative items for a new HRQoL measure. These items were evaluated by assessing their ceiling effects, difficulty, and redundancy in the first survey. To validate the HRQoL instrument that was developed, known-groups validity and convergent/discriminant validity were evaluated and its test-retest reliability was examined in the second survey. Results: Of the 30 items originally assessed for the HRQoL instrument, four were excluded due to high ceiling effects and six were removed due to redundancy. We ultimately developed a HRQoL instrument with a reduced number of 20 items, known as the Health-related Quality of Life Instrument with 20 items (HINT-20), incorporating physical, mental, social, and positive health dimensions. The results of the HINT-20 for known-groups validity were poorer in women, the elderly, and those with a low income. For convergent/discriminant validity, the correlation coefficients of items (except vitality) in the physical health dimension with the physical component summary of the Short Form 36 version 2 (SF-36v2) were generally higher than the correlations of those items with the mental component summary of the SF-36v2, and vice versa. Regarding test-retest reliability, the intraclass correlation coefficient of the total HINT-20 score was 0.813 (p<0.001). Conclusions: A novel generic HRQoL instrument, the HINT-20, was developed for the Korean general population and showed acceptable validity and reliability.

Esophageal Air in Patients with Globus Pharyngeus (인두 이물감을 호소하는 환자에서 식도 내 공기에 대한 연구)

  • Shim, Ye Ji;Nam, Dongwoo;Kim, Bo Hae;Jin, Young Ju;Ryu, Yoon-Jong;Kim, Min-Su;Chung, Eun-Jae;Kwon, Seong Keun;Hah, J Hun;Kwon, Tack-Kyun
    • Journal of the Korean Society of Laryngology, Phoniatrics and Logopedics
    • /
    • v.26 no.2
    • /
    • pp.127-129
    • /
    • 2015
  • Background and Objectives : The etiology of globus pharyngeus remains uncertain. It has been known there is a relationship between the presence of air bubbles in esophagus and GERD symptoms. The aim of this study is to identify relationship between the globus symptom and the presence of air column in esophagus. Subjects and Methods : The study population consisted of 46 patients who underwent CT scan as part of evaluation for globus. Controls were chosen from the population consisted of patients with lymphadenopathy who underwent CT scan. The correlation between the presence of globus symptom and diameter, volume, and position of the air column was assessed using t-test. Reproducibility of diameter and volume of the esophageal air column was analyzed using intraclass correlation coefficient. Results : In study group, the mean volume of the air column was $769.56{\pm}983.08mm^3$, the mean diameter was $8.24{\pm}4.90mm$, the mean distance from the inferior border of posterior lamina of cricoid cartilage was $88.86{\pm}28.01mm$. In control group, $682.18{\pm}767.28mm^3$, $8.37{\pm}5.50mm$, $88.34{\pm}21.06mm$, respectively. There were no differences of diameter, volume and distance of the air column between the two groups. We failed to obtain acceptable reliability when we compare the diameter and the volume of the esophageal air column. Conclusion : There was no relationship between air column of esophagus and presence of globus symptom. And the measurement of diameter and volume of the esophageal air column change over time and it should be considered in a further study.

  • PDF

Surface Topographic Measurement Method for Assessing Lower Extremity Alignment: Examination on a novel clinical and research Tool (하지 정렬 평가를 위한 체표면 토포그래피를 이용한 측정법: 새로운 임상 및 연구 도구에 대한 검토)

  • Yim, Ji-Young;Yim, Hyun-Seung;Park, Dae-Sung;Lee, Na-Kyung;Lee, Na-Kyung
    • Journal of rehabilitation welfare engineering & assistive technology
    • /
    • v.10 no.1
    • /
    • pp.37-45
    • /
    • 2016
  • The purpose of this study was to assess the intra-rater, inter-rater and test-retest reliability and validity of frontal plane lower extremity alignment estimated from a rasterstereographic method using ABW-Mapper. Eighteen subjects participated in this study. The S angle (stereographic angle-frontal plane lower extremity alignment estimated from a rasterstereographic method) in standing was measured throughout the two sessions with one week interval by two different readers. In the first session, a reader measured S angle twice per subject with a short break in-between. The Q-angle (quadriceps angle) was measured using a standard goniometer from a photography taken through digital camera with the participant standing in the same position as in the S angle measurement. The HKA(hip-knee-ankle) angle was measured from a computer based digital radiograph with the computerized measurement software. Reliability was tested using intraclass correlation coefficients(ICC). Validity was tested using a Pearson's correlation coefficient. Excellent intra-rater(ICC=0.956~0.974), inter-rater(ICC=0.962), test-retest reliability (ICC=0.945) were demonstrated. There were strong negative correlations between S angle and Q-angle (r=-0.739), and between S angle and HKA angle (r=-0.702). Therefore, the S angle measured using a rasterstereographic mapper may be used to as a preliminary or supplementary tool to evaluate and study LE alignment in the frontal plane in relation to HKA angle or Q-angle.

Psychometric Properties of the Korean Version of Self-Efficacy for HIV Disease Management Skills (한국어판 HIV 감염인의 건강관리 자기효능감 도구의 타당도와 신뢰도)

  • Kim, Gwang Suk;Kim, Layoung;Shim, Mi-So;Baek, Seoyoung;Kim, Namhee;Park, Min Kyung;Lee, Youngjin
    • Journal of Korean Academy of Nursing
    • /
    • v.53 no.3
    • /
    • pp.295-308
    • /
    • 2023
  • Purpose: This study evaluated the validity and reliability of Shively and colleagues' self-efficacy for HIV disease management skills (HIV-SE) among Korean participants. Methods: The original HIV-SE questionnaire, comprising 34 items, was translated into Korean using a translation and back-translation process. To enhance clarity and eliminate redundancy, the author and expert committee engaged in multiple discussions and integrated two items with similar meanings into a single item. Further, four HIV nurse experts tested content validity. Survey data were collected from 227 individuals diagnosed with HIV from five Korean hospitals. Construct validity was verified through confirmatory factor analysis. Criterion validity was evaluated using Pearson's correlation coefficients with the new general self-efficacy scale. Internal consistency reliability and test-retest were examined for reliability. Results: The Korean version of HIV-SE (K-HIV-SE) comprises 33 items across six domains: "managing depression/mood," "managing medications," "managing symptoms," "communicating with a healthcare provider," "getting support/help," and "managing fatigue." The fitness of the modified model was acceptable (minimum value of the discrepancy function/degree of freedom = 2.49, root mean square error of approximation = .08, goodness-of-fit index = .76, adjusted goodness-of-fit index = .71, Tucker-Lewis index = .84, and comparative fit index = .86). The internal consistency reliability (Cronbach's α = .91) and test-retest reliability (intraclass correlation coefficient = .73) were good. The criterion validity of the K-HIV-SE was .59 (p < .001). Conclusion: This study suggests that the K-HIV-SE is useful for efficiently assessing self-efficacy for HIV disease management.

Reliability of a Questionnaire for Evaluation of Dry Mouth Symptoms (구강건조증 증상 평가를 위한 설문지의 신뢰도에 관한 연구)

  • Lee, Jeong-Yun;Lee, Young-Ok;Kho, Hong-Seop
    • Journal of Oral Medicine and Pain
    • /
    • v.30 no.4
    • /
    • pp.383-389
    • /
    • 2005
  • Xerostomia is defined as a subjective complaint of dry mouth that may be perceived when there is insufficient mucosal wetting. However, the diagnosis and treatment of xerostomia is not that simple because of the fact that the subjective awareness of dry mouth is not always correlated with a diminution in the flow of saliva and there is always a difference between individuals in salivary flow rates needed for normal oral function. In the present study, the aim was to develop a questionnaire to evaluate the dry mouth symptoms and to analyze its reliability and usability as a diagnostic and analytic tool for xerostomia. The questionnaire which consists of 6 Visual Analogue Scale(VAS) type questions to evaluate the subjective oral dryness and 4 questions to evaluate behavior to avoid oral dryness was developed and administered twice with 1 week's interval to the healthy 88 young adults without dry mouth symptoms(44 males and 44 females; mean age was $25.6{\pm}3.1$ years in male and $24.3{\pm}2.1$ years in female). The results were as follows. 1 The intraclass correlation coefficients of 6 questions to evaluate the subjective oral dryness were as significantly high as 0.767 for the degree of oral dryness at other times of the day, 0.850 for the amount of saliva in the mouth, and 0.791 for the degree of effect on daily life due to oral dryness and as high as 0.563 for the degree of oral dryness at night or on awakening, 0.674 for the degree of oral dryness during eating, and 0.641 for the degree of difficulty in swallowing foods. 2. Cronbach's alpha value of 6 questions was 0.982. It can be concluded that the series of questions to evaluate the subjective oral dryness has high internal consistency. 3. Cohen's kappa values of 4 questions to evaluate behavior to relieve oral dryness were as significantly high as 0.850 for the frequency of keeping a glass of water at the bedside and as high as 0.506 the frequency of awakening during sleeping due to oral dryness, 0.419 for the frequency of sipping liquids to aid in eating dry foods, and 0.407 for the frequency of using a candy or chewing gum due to oral dryness. From the results, it can be concluded that the questionnaire consisting of 6 VAS type questions to evaluate the subjective oral dryness and 4 questions to evaluate behavior to relieve oral dryness has reliability of good to excellent level, and that the series of 6 VAS type questions has significantly high internal consistency to evaluate the subjective oral dryness.

Cross-cultural Adaptation and Psychometric Evaluation of the Korean Version of the A-ONE (한국판 일상생활활동중심 작업기반 신경행동평가(A-ONE)의 개발 및 평가)

  • Kang, Jaewon;Park, Hae Yean;Kim, Jung-Ran;Park, Ji-Hyuk
    • Therapeutic Science for Rehabilitation
    • /
    • v.10 no.2
    • /
    • pp.109-128
    • /
    • 2021
  • Objective : The purpose of this study was to develop a Korean version of the Activities of Daily Living (ADL)-focused Occupation-Based Neurobehavioral Evaluation (A-ONE) through cross-cultural adaptation and examine its validity and reliability. Methods : This study translated the A-ONE into Korean and performed cross-cultural adaptation for the Korean population. After the development of the Korean version of the A-ONE, cross-cultural and concurrent validities were analyzed. Internal consistency, test-retest reliability, and inter-rater reliability were also evaluated. Results : We adapted three items to the Korean culture. The Korean version of the A-ONE showed high cross-cultural validity with a content validity index (I-CVI) >0.9. It correlated with the Functional Independence Measure (FIM) (r=0.52-0.77, p<0.001), except for communication. Cronbach's α was 0.58-0.93 for the functional independence scale (FI) and 0.42-0.93 for the neurobehavioral specific impairment subscale (NBSIS). Intraclass correlation coefficients (ICCs) indicated high test-retest and inter-rater reliability for FI (ICC=0.79-1.00 and 0.75-1.00, respectively) and NBSIS (ICC=0.74-1.00 and 0.72-1.00, respectively). Conclusion : The Korean version of the A-ONE is well adapted to the Korean culture and has good validity and reliability. It is recommended to evaluate ADL performance skills and neurobehavioral impairments simultaneously in Korea.

The Closure Stage of Cranial Sutures in Correlation with Age (증령적 변화로서의 두개골 봉합의 유합 상태)

  • Ahn, Hyoung-Joon;Sin, Kyoung-Jin;Kwon, Jeong-Seung;Do, Hyung-Joo;Choi, Jong-Hoon;Kim, Chong-Youl
    • Journal of Oral Medicine and Pain
    • /
    • v.26 no.4
    • /
    • pp.377-393
    • /
    • 2001
  • In order to study the closure stage of cranial sutures and its correlations with age, the ectocranial closure stage of coronal suture, sagittal suture, and lambdoidal suture of 67 skulls was measured. Among the skulls kept at the department of anatomy, college of medicine, Yonsei University, the ones with ages identified were used for this study. These measurements of suture closure were conducted by 4 examiners independently. The sutures were further divided by Frederic's method into 16 suture parts. The closure stages were classified by five stages of Broca-Ribbe. The following results were obtained: 1. The inter-observer reliability among 4 examiners showed high intraclass correlation coefficient of over 0.75(mean : 0.856) in all suture parts. Therefore, the determination of closure stage wasn't influenced by the subjective view of each examiner. 2. In all suture parts, the closure stage increased proportionally with age.(p<0.01) In terms of each suture part, the S2 part of sagittal suture showed the highest correlation(68.1%) while the L1-R part of lambdoidal suture showed the lowest correlation(51.3%). In addition, in terms of suture types, the correlation with age decreased in the order of sagittal suture(60.0%), coronal suture(57.7%), and lambdoidal suture (55.7%). In general, the average value of suture closure stages had 57.8% correlation with age(p<0.01). 3. The most frequent suture closure stage according to age group was '0' for ages below 30, '0' and '1' for ages within the 30's, '1' and '2' for ages within the 40's, and '2' for ages within the 50's. With older age groups, the frequency of '3' and '4' increased, and the suture closure stage increased proportionally with age. 4. The mean age by closure stage of each suture were within the 40's for the closure stage of '1', within the 50's for the closure stage of '2', and from 50's through 60's for the closure stage of '3'. The standard deviation was over 10 for all closure stages. In addition, at the same suture closure stage, the mean age according to the coronal suture was higher than the ages according to the sagittal suture or lambdoidal suture. Especially, C1-R, C1-L, C2-R, and C2-L parts showed the highest age when at the same suture closure stage. 5. The values appropriate for age estimations using suture closure stages of 16 suture parts were calculated, and a calculator for age estimation ($R^2=0.6944$, p<0.01) by ectocranial suture closure stage for Koreans is presented. From the above results, the method of using the closure stage of sutures of the skull to estimate age can be useful in individual identification of forensic science. Further extensive and accurate research using larger samples would be worthy of study.

  • PDF

Agreement of Manual Muscle Testing and Test-Retest Reliability of Hand Held Dynamometer for the Posterior Gluteus Medius Muscle for Patients With Low Back Pain (요통 환자를 대상으로 후중둔근 도수근력검사의 일치도 및 휴대용 근력계 측정 방법의 신뢰도 검사)

  • Park, Kyue-Nam;Kim, Hyun-Sook;Choi, Houng-Sik;Lee, Won-Hwee;Ha, Sung-Min;Kim, Su-Jung
    • Physical Therapy Korea
    • /
    • v.18 no.3
    • /
    • pp.67-75
    • /
    • 2011
  • The purpose of this study was to assess the agreement of manual muscle testing (MMT) and test-retest reliability of a hand held dynamometer for the posterior gluteus medius muscle, with and without lumbar stabilization, using a pressure biofeedback unit for patients with low back pain. The pressure biofeedback unit was used to minimize the substitute motion of the lumbopelvic region during hip abduction in patients lying on their side. Fifteen patients with low back pain participated in this study. A tester determined the MMT grades of the posterior gluteus medius with and without the pressure biofeedback unit. Active hip abduction range of motion with an inclinometer and the strength of their posterior gluteus medius using a hand held dynamometer were measured with and without the pressure biofeedback unit in the MMT position. The agreement of the grade of muscle strength in the MMT, and intra-rater reliability of both the active hip abduction range of motion and the strength of posterior gluteus medius were analyzed using the weighted kappa and intraclass correlation coefficient (ICC), respectively. The agreement of MMT with the pressure biofeedback unit (weighted kappa=.92) was higher than the MMT (weighted kappa=.34)(p<.05). The inclinometer with pressure biofeedback unit measurement of the active hip abduction range of motion had an excellent intra-rater reliability (ICC=.90). Also, the hand held dynamometer with pressure biofeedback unit measure of strength of the posterior gluteus medius had a good intra-rater reliability (ICC=.85). Therefore, the test for muscle strength with pressure biofeedback unit will be a reliable method for the determination of the MMT grades or amount of posterior gluteus medius muscle strength and the measurement of the range of motion for hip abduction in patients with low back pain.