• Title/Summary/Keyword: ICCs

Search Result 94, Processing Time 0.023 seconds

Reliability and Validity of a Life Course Passive Smoke Exposure Questionnaire in an Australian Cohort From Childhood to Adulthood

  • Ezegbe, Chigozie;Magnussen, Costan G.;Neil, Amanda Louise;Buscot, Marie-Jeanne;Dwyer, Terence;Venn, Alison;Gall, Seana
    • Journal of Preventive Medicine and Public Health
    • /
    • 제54권2호
    • /
    • pp.153-159
    • /
    • 2021
  • Objectives: Life course exposure to passive smoke may predict health, but there are few validated measures. We tested the reliability and validity of a retrospective life course passive smoking questionnaire. Methods: Participants from the third follow-up of the Childhood Determinants of Adult Health study (2014-2019, ages 36-49 years) retrospectively reported mother/father/other household member smoking when living at home during childhood, including duration (years) and smoking location (never/sometimes/always inside house). The severity of exposure index (SEI; sum of mother/father/other years smoked multiplied by smoking location), cumulative years of exposure (CYE; sum of mother/father/other years), and total household smokers (THS) were derived. The reliability of retrospective passive smoking reports was examined with intraclass correlation coefficients (ICCs) using household smoking reported 34 years earlier in 1985 by participants when aged 7-15 years. Construct validity was examined by correlating retrospective passive smoking with participants' smoking in adulthood and lung function in childhood and adulthood. Results: Among 2082 participants (mean±standard deviation [SD], 45.0±2.5 years; 55.2% females), THS ranged from 0 to 5 (mean±SD, 0.9±1.0), CYE ranged from 0 to 106 (mean±SD, 10.5±13.9), and SEI ranged from 0 to 318 (mean±SD, 24.4±36.0). Retrospective measures showed moderate agreement with total household smokers reported in childhood (ICC, 0.58 to 0.62). The retrospective measures were weakly but significantly (p<0.05) correlated with participants' smoking (r=0.13 to 0.15) and lung function (r= -0.05 to -0.06). Conclusions: The retrospective passive smoking questionnaire showed reasonable reliability and validity. This measure may be useful for epidemiological studies.

The Reliability and Validity of the Digital Goniometer and Smart Phone to Determine Trunk Active Range of Motion in Stroke Patients

  • Park, Hee-yong;Hwang, Ui-jae;Kwon, Oh-yun
    • 한국전문물리치료학회지
    • /
    • 제29권3호
    • /
    • pp.225-234
    • /
    • 2022
  • Background: Trunk movements are an important factor in activities of daily living; however, these movements can be impaired by stroke. It is difficult to quantify and measure the active range of motion (AROM) of the trunk in patients with stroke. Objects: To determine the reliability and validity of measurements using a digital goniometer (DG) and smart phone (SP) applications for trunk rotation and lateral flexion in stroke patients. Methods: This is an observational study, in which twenty participants were clinically diagnosed with stroke. Trunk rotation and lateral flexion AROM were assessed using the DG and SP applications (Compass and Clinometer). Intrarater reliability was determined using intraclass correlation coefficients (ICCs) with 95% confidence intervals. Pearson correlation coefficient was used to determine the validity of the DG and SP in AROM measurement. The level of agreement between the two instruments was shown by Bland-Altman plot and 95% limit of agreement (LoA) was calculated. Results: The intrarater reliability (rotation with DG: 0.96-0.98, SP: 0.98; lateral flexion with DG: 0.97-0.98, SP: 0.96) was excellent. A strong and significant correlation was found between DG and SP (rotation hemiplegic side: r = 0.95; non-hemiplegic side: r = 0.90; lateral flexion hemiplegic side: r = 0.88; non-hemiplegic side: r = 0.78). The level of agreement between the two instruments was rotation (hemiplegic side: 23.02° [LoA 17.41°, -5.61°]; non-hemiplegic side: 31.68° [LoA 23.87°, -7.81°]) and lateral flexion (hemiplegic side: 20.94° [LoA 17.48°, -3.46°]; non-hemiplegic side: 27.12° [LoA 18.44°, -8.68°]). Conclusion: Both DG and SP applications can be used as reliable methods for measuring trunk rotation and lateral flexion in patients with stroke. Although, considering the level of clinical agreement, DG and SP could not be used interchangeably for measurements.

근전도 전자 망치를 이용한 깊은힘줄반사의 측정자 간 신뢰도 (Inter-Rater Reliability of the Deep Tendon Reflex by using EMG Electric Reflex Hammer)

  • 이정우;서태화
    • 대한통합의학회지
    • /
    • 제10권4호
    • /
    • pp.137-143
    • /
    • 2022
  • Purpose : The purpose of this study was to evaluate the reliability analysis of the deep tendon reflex by using electromyography (EMG). Methods : The study was tested on 30 volunteers who are women in their 20s. Using an electronic reflective hammer of EMG, deep tendon reflex was measured on all subjects with the participation of three trained physical therapists as raters. First, the subjects were comfortably seated on a table with their knees bent at 90 °. The three raters tapped the electric hammer at intervals of 10 seconds to avoid habituation until a total of 10 compound muscle action potential records were collected. Intraclass correlation coefficients (ICCs) were calculated to assess the inter-rater reliability of the deep tendon reflex with the use of EMG. The items of analysis included amplitude (mV), latency (ms), duration (ms), and area (mV × ms) of the compound evoked potentials. Results : Based on the average records of 10 compound muscle action potential, excellent reliability (ICC: .912) was achieved in terms of area, and there was good reliability in terms of latency (ICC: .795) and duration (ICC: .800). In the shortest latency of the compound muscle action potential, good reliability was achieved in terms of amplitude (ICC: .865), duration (ICC: .781), and area (ICC: .832). In the amplitude of peak-to-peak of compound muscle action potential, excellent reliability was recorded in terms of amplitude (ICC: .924), and good reliability was recorded in terms of duration (ICC: .801) and area (ICC: .874). Conclusion : The findings in this study indicate that electromyography via an electric hammer is a reliable method of assessing and measuring deep tendon reflexes. Especially, it may be an excellent gauge in the area of average values of the compound muscle action potentials and the amplitude of peak-to-peak of compound muscle action potentials.

Three-Dimensional Evaluation of Skeletal Stability following Surgery-First Orthognathic Approach: Validation of a Simple and Effective Method

  • Nabil M. Mansour;Mohamed E. Abdelshaheed;Ahmed H. El-Sabbagh;Ahmed M. Bahaa El-Din;Young Chul Kim;Jong-Woo Choi
    • Archives of Plastic Surgery
    • /
    • 제50권3호
    • /
    • pp.254-263
    • /
    • 2023
  • Background The three-dimensional (3D) evaluation of skeletal stability after orthognathic surgery is a time-consuming and complex procedure. The complexity increases further when evaluating the surgery-first orthognathic approach (SFOA). Herein, we propose and validate a simple time-saving method of 3D analysis using a single software, demonstrating high accuracy and repeatability. Methods This retrospective cohort study included 12 patients with skeletal class 3 malocclusion who underwent bimaxillary surgery without any presurgical orthodontics. Computed tomography (CT)/cone-beam CT images of each patient were obtained at three different time points (preoperation [T0], immediately postoperation [T1], and 1 year after surgery [T2]) and reconstructed into 3D images. After automatic surface-based alignment of the three models based on the anterior cranial base, five easily located anatomical landmarks were defined to each model. A set of angular and linear measurements were automatically calculated and used to define the amount of movement (T1-T0) and the amount of relapse (T2-T1). To evaluate the reproducibility, two independent observers processed all the cases, One of them repeated the steps after 2 weeks to assess intraobserver variability. Intraclass correlation coefficients (ICCs) were calculated at a 95% confidence interval. Time required for evaluating each case was recorded. Results Both the intra- and interobserver variability showed high ICC values (more than 0.95) with low measurement variations (mean linear variations: 0.18 mm; mean angular variations: 0.25 degree). Time needed for the evaluation process ranged from 3 to 5 minutes. Conclusion This approach is time-saving, semiautomatic, and easy to learn and can be used to effectively evaluate stability after SFOA.

Reliability and Validity Inquiry for Tele-assessment Based on Video Conferencing

  • Suha Lee;Changho Song
    • Physical Therapy Rehabilitation Science
    • /
    • 제12권2호
    • /
    • pp.105-114
    • /
    • 2023
  • Objective: The study examined the validity and reliability of tele-assessment of cervical range of motion (ROM) through video conferencing. Design: A cross-sectional study Methods: The study included 22 healthy adults as subjects and 10 physical therapists as evaluators. The subjects underwent both face-to-face and tele-assessment of cervical ROM. The CROM (Cervical Range of Motion) device was used for reference measurements in the face-to-face assessment. The evaluators assessed the subjects' ROM through visual inspection (VI) and using a Universal Goniometer (UG) in the tele-assessment. Results: The results showed a significant correlation between the face-to-face and tele-assessment measurements for all ROM contents. The correlation coefficients ranged from r=0.54 to 0.71 (p<0.05), indicating concurrent validity. In terms of inter-rater reliability, the ICC values for both VI and UG assessments in the tele-assessment were high, with ICCs of 0.93 and 0.92, respectively. Additionally, the study investigated the usability of the tele-assessment method and environment. The satisfaction of the participants and evaluators was assessed using the Telehealth Usability Questionnaire (TUQ), which evaluates perceptions, usability, and satisfaction with telehealth services. Conclusions: In conclusion, tele-assessment of cervical range of motion using video conferencing was valid and reliable. Also, investigated participant and evaluator satisfaction and opinions, providing insights into the clinical value of tele-assessment. It is important to note that the study was conducted only healthy adults, and further research may be needed to validate the tele-assessment method in populations with cervical dysfunction or neck pain. These findings support the potential effectiveness of telerehabilitation services in assessing and managing musculoskeletal disorders.

The Factor Analysis of Information and Communication Technology Literacy for Primary School Students in South Korea

  • SUNG, Eunmo;JIN, Sung-Hee
    • Educational Technology International
    • /
    • 제16권2호
    • /
    • pp.231-247
    • /
    • 2015
  • The purpose of this study was to identify the factors of ICT literacy in the primary school students in South Korea and to examine the gender and city size difference on the factor of ICT literacy. To accomplish this goal, we have analyzed the data of Korea Youth Competency Measurement and International Comparative Study I: ICCS 2016 which is nationally collected from the primary school students, currently on the 5 ~ 6th grades in South Korea. 1,188 samples were used in the study excluding missing samples. The participants were 584 5th grad and 604 6th grad students, 620 males (52.2%) and 568 females (47.8%). The mean age was 13.49 years (SD=.52). The result of the study reveals the four factors of ICT literacy through cross-validating exploratory factor analysis and confirmative factor analysis; pleasure of using ICT, perceived usefulness of using ICT, learning ability with using ICT, and operating ability of ICT. This study found that the leaner differ in gender on learning ability with using ICT and pleasure of using ICT. The female students were significantly larger than male students on learning ability with using ICT. However, the male students were significantly larger than male students on pleasure of using ICT. This study found that the leaner differ in city size on the factors of ICT literacy excluding pleasure of using ICT. The students living in the big size city were significantly larger than the students living in the middle and small. That is, over all, female students were more learning with ICT, male students were more interesting about ICT, and the students living in the big size city were more ICT use for learning. Based on the results, some strategies were suggested on the proper use of the factors of ICT in education.

RELIABILITY and VALIDITY of DUAL PROBE-FIXING FRAME for REHABILITATIVE ULTRASOUND IMAGING for EXERCISES with VISUAL FEEDBACK

  • Na-eun Byeon;Jang-hoon Shin;Wan-hee Lee
    • Physical Therapy Rehabilitation Science
    • /
    • 제12권3호
    • /
    • pp.259-267
    • /
    • 2023
  • Objective: Rehabilitative ultrasound imaging is a safe and noninvasive technique for evaluating muscle thickness. A dual probe-fixing frame (DPF) can provide visual feedback during exercises targeting specific muscles. The purpose of this research was to verify the reliability and validity of the DPF for dual-probe ultrasound (DPU)-based visual feedback exercises, allowing users to use both hands freely. Design: This cross-sectional study used repeated measures to compare muscle thickness measurements obtained using the handheld device and DPF with DPU. Methods: Twenty healthy adults participated in the study. Measurements were taken over two sessions, with a two-day interval between the sessions. The thicknesses of the rectus abdominis (RA) and transverse abdominis (TrA) muscles were measured using DPU. The DPF with DPU developed by the research team, was used along with a laptop-based muscle viewer. Bland-Altman analysis and intraclass correlation coefficients (ICCs) calculations were used in statistical analyses to evaluate agreement and reliability, respectively. Results: The results of the Bland-Altman analysis showed small average differences between the handheld and DPF methods for both RA and TrA muscle thicknesses. Inter-rater reliability analysis showed high ICC values for DPF measurements of both RA (0.908-0.912) and TrA (0.892-741) muscle thicknesses. Intra-rater reliability analysis also showed good ICC values for measurements taken by a single examiner over two days. Conclusion: The findings of this study demonstrate that the DPF provides reliable and valid measurements of muscle thickness during visual feedback exercises using the DPU.

Clinically Available Software for Automatic Brain Volumetry: Comparisons of Volume Measurements and Validation of Intermethod Reliability

  • Ji Young Lee;Se Won Oh;Mi Sun Chung;Ji Eun Park;Yeonsil Moon;Hong Jun Jeon;Won-Jin Moon
    • Korean Journal of Radiology
    • /
    • 제22권3호
    • /
    • pp.405-414
    • /
    • 2021
  • Objective: To compare two clinically available MR volumetry software, NeuroQuant® (NQ) and Inbrain® (IB), and examine the inter-method reliabilities and differences between them. Materials and Methods: This study included 172 subjects (age range, 55-88 years; mean age, 71.2 years), comprising 45 normal healthy subjects, 85 patients with mild cognitive impairment, and 42 patients with Alzheimer's disease. Magnetic resonance imaging scans were analyzed with IB and NQ. Mean differences were compared with the paired t test. Inter-method reliability was evaluated with Pearson's correlation coefficients and intraclass correlation coefficients (ICCs). Effect sizes were also obtained to document the standardized mean differences. Results: The paired t test showed significant volume differences in most regions except for the amygdala between the two methods. Nevertheless, inter-method measurements between IB and NQ showed good to excellent reliability (0.72 < r < 0.96, 0.83 < ICC < 0.98) except for the pallidum, which showed poor reliability (left: r = 0.03, ICC = 0.06; right: r = -0.05, ICC = -0.09). For the measurements of effect size, volume differences were large in most regions (0.05 < r < 6.15). The effect size was the largest in the pallidum and smallest in the cerebellum. Conclusion: Comparisons between IB and NQ showed significantly different volume measurements with large effect sizes. However, they showed good to excellent inter-method reliability in volumetric measurements for all brain regions, with the exception of the pallidum. Clinicians using these commercial software should take into consideration that different volume measurements could be obtained depending on the software used.

Clinical Validation of a Deep Learning-Based Hybrid (Greulich-Pyle and Modified Tanner-Whitehouse) Method for Bone Age Assessment

  • Kyu-Chong Lee;Kee-Hyoung Lee;Chang Ho Kang;Kyung-Sik Ahn;Lindsey Yoojin Chung;Jae-Joon Lee;Suk Joo Hong;Baek Hyun Kim;Euddeum Shim
    • Korean Journal of Radiology
    • /
    • 제22권12호
    • /
    • pp.2017-2025
    • /
    • 2021
  • Objective: To evaluate the accuracy and clinical efficacy of a hybrid Greulich-Pyle (GP) and modified Tanner-Whitehouse (TW) artificial intelligence (AI) model for bone age assessment. Materials and Methods: A deep learning-based model was trained on an open dataset of multiple ethnicities. A total of 102 hand radiographs (51 male and 51 female; mean age ± standard deviation = 10.95 ± 2.37 years) from a single institution were selected for external validation. Three human experts performed bone age assessments based on the GP atlas to develop a reference standard. Two study radiologists performed bone age assessments with and without AI model assistance in two separate sessions, for which the reading time was recorded. The performance of the AI software was assessed by comparing the mean absolute difference between the AI-calculated bone age and the reference standard. The reading time was compared between reading with and without AI using a paired t test. Furthermore, the reliability between the two study radiologists' bone age assessments was assessed using intraclass correlation coefficients (ICCs), and the results were compared between reading with and without AI. Results: The bone ages assessed by the experts and the AI model were not significantly different (11.39 ± 2.74 years and 11.35 ± 2.76 years, respectively, p = 0.31). The mean absolute difference was 0.39 years (95% confidence interval, 0.33-0.45 years) between the automated AI assessment and the reference standard. The mean reading time of the two study radiologists was reduced from 54.29 to 35.37 seconds with AI model assistance (p < 0.001). The ICC of the two study radiologists slightly increased with AI model assistance (from 0.945 to 0.990). Conclusion: The proposed AI model was accurate for assessing bone age. Furthermore, this model appeared to enhance the clinical efficacy by reducing the reading time and improving the inter-observer reliability.

Use of autonomous maximal smile to evaluate dental and gingival exposure

  • Wang, Shuai;Lin, Hengzhe;Yang, Yan;Zhao, Xin;Mei, Li;Zheng, Wei;Li, Yu;Zhao, Zhihe
    • 대한치과교정학회지
    • /
    • 제48권3호
    • /
    • pp.182-188
    • /
    • 2018
  • Objective: This study was performed to validate the autonomous maximal smile (AMS) as a new reference for evaluating dental and gingival exposure. Methods: Digital video clips of 100 volunteers showing posed smiles and AMS at different verbal directives were recorded for evaluation a total of three times at 1-week intervals. Lip-teeth relationship width (LTRW) and buccal corridor width (BCW) were measured. LTRW represented the vertical distance between the inferior border of the upper vermilion and the edge of the maxillary central incisors. Intraclass correlation coefficients (ICCs) for reproducibility, and the m-value (minimum number of repeated measurements required for an ICC level over 0.75), were calculated. Results: LTRW and BCW of the AMS were 1.41 and 2.04 mm, respectively, greater than those of the posed smile (p < 0.05), indicating significantly larger dental and gingival exposure in the AMS. The reproducibility of the AMS (0.74 to 0.77) was excellent, and higher than that of the posed smile (0.62 to 0.65), which had fair-to-good reproducibility. Moreover, the m-value of the AMS (0.88 to 1.05) was lower than that of the posed smile (1.59 to 1.85). Conclusions: Compared to the posed smile, the AMS shows significantly larger LTRW and BCW, with significantly higher reproducibility. The AMS might serve as an adjunctive reference, in addition to the posed smile, in orthodontic and other dentomaxillofacial treatments.