• Title/Summary/Keyword: Intraclass Correlation Coefficient

Search Result 245, Processing Time 0.023 seconds

Reliability and responsiveness of Equivital Lifemonitor and photoplethysmography based wristwatch for the assessment of physiological parameters during a simulated fatigue task

  • Anwer, Shahnawaz;Li, Heng;Umer, Waleed;Antwi-Afari, Maxwell Fordjour;Wong, Arnold YL
    • International conference on construction engineering and project management
    • /
    • 2020.12a
    • /
    • pp.257-264
    • /
    • 2020
  • Objective: To investigate test-retest reliability and responsiveness of Equivital Lifemonitor and photoplethysmography based wristwatch tools in assessing physiological parameters during a simulated fatigue task. Methods: Ten university students (Mean age, 30.6 ± 1.7 years) participated in this pilot study. Participants were asked to perform a 30-minute of a simulated fatigue task in an experimental setup in a lab. The physiological parameters (e.g., heart rate, heart rate variability, respiratory rate, electrodermal activity, and skin temperature) were measured at baseline and immediately after the fatigue task. An intraclass correlation coefficient (ICC2,1) was used to evaluate the test-retest reliability of each tool in assessing physiological measures. In addition, the responsiveness of each tool to measure changes from baseline to posttest was calculated using a standardized response mean. Results: The Equivital Lifemonitor has shown good to excellent test-retest reliability for the assessment of heart rate (ICC, 0.97), heart rate variability (ICC, 0.86), respiratory rate (ICC, 0.77), and local skin temperature (ICC, 0.76). However, photoplethysmography based wristwatch showed moderate to good test-retest reliability for the assessment of heart rate (ICC, 0.71), heart rate variability (ICC, 0.73), electrodermal activity (ICC, 0.80), and skin temperature (ICC, 0.72). A large standardized response mean (>0.8) indicates that both tools can capture the changes in heart rate, heart rate variability, respiratory rate, skin temperature, and electrodermal activity after a 30-minute of fatigue task. Conclusions: The Equivital Lifemonitor and photoplethysmography based wristwatch devices are reliable in measuring physiological parameters after the fatigue task. Additionally, both devices can capture the fatigue response after a simulated construction task. Future field studies with a larger sample should investigate the sensitivity and validity of these tools in measuring physiological parameters for fatigue assessment at construction sites.

  • PDF

Utility of Noncontrast Magnetic Resonance Angiography for Aneurysm Follow-Up and Detection of Endoleaks after Endovascular Aortic Repair

  • Hiroshi Kawada;Satoshi Goshima;Kota Sakurai;Yoshifumi Noda;Kimihiro Kajita;Yukichi Tanahashi;Nobuyuki Kawai;Narihiro Ishida;Katsuya Shimabukuro;Kiyoshi Doi;Masayuki Matsuo
    • Korean Journal of Radiology
    • /
    • v.22 no.4
    • /
    • pp.513-524
    • /
    • 2021
  • Objective: To assess the noncontrast two-dimensional single-shot balanced turbo-field-echo magnetic resonance angiography (b-TFE MRA) features of the abdominal aortic aneurysm (AAA) status following endovascular aneurysm repair (EVAR) and evaluate to detect endoleaks (ELs). Materials and Methods: We examined four aortic stent-grafts in a phantom study to assess the degree of metallic artifacts. We enrolled 46 EVAR-treated patients with AAA and/or common iliac artery aneurysm who underwent both computed tomography angiography (CTA) and b-TFE MRA after EVAR. Vascular measurements on CTA and b-TFE MRA were compared, and signal intensity ratios (SIRs) of the aneurysmal sac were correlated with the size changes in the AAA after EVAR (AAA prognoses). Furthermore, we examined six feasible b-TFE MRA features for the assessment of ELs. Results: There were robust intermodality (r = 0.92-0.99) correlations and interobserver (intraclass correlation coefficient = 0.97-0.99) agreement. No significant differences were noted between SIRs and aneurysm prognoses. Moreover, "mottled high-intensity" and "creeping high-intensity with the low-band rim" were recognized as significant imaging findings suspicious for the presence of ELs (p < 0.001), whereas "no signal black spot" and "layered high-intensity area" were determined as significant for the absence of ELs (p < 0.03). Based on the two positive features, sensitivity, specificity, and accuracy for the detection of ELs were 77.3%, 91.7%, and 84.8%, respectively. Furthermore, the k values (0.40-0.88) displayed moderate-to-almost perfect agreement. Conclusion: Noncontrast MRA could be a promising imaging modality for ascertaining patient follow-up after EVAR.

Right Ventricular Mass Quantification Using Cardiac CT and a Semiautomatic Three-Dimensional Hybrid Segmentation Approach: A Pilot Study

  • Hyun Woo Goo
    • Korean Journal of Radiology
    • /
    • v.22 no.6
    • /
    • pp.901-911
    • /
    • 2021
  • Objective: To evaluate the technical applicability of a semiautomatic three-dimensional (3D) hybrid CT segmentation method for the quantification of right ventricular mass in patients with cardiovascular disease. Materials and Methods: Cardiac CT (270 cardiac phases) was used to quantify right ventricular mass using a semiautomatic 3D hybrid segmentation method in 195 patients with cardiovascular disease. Data from 270 cardiac phases were divided into subgroups based on the extent of the segmentation error (no error; ≤ 10% error; > 10% error [technical failure]), defined as discontinuous areas in the right ventricular myocardium. The reproducibility of the right ventricular mass quantification was assessed. In patients with no error or < 10% error, the right ventricular mass was compared and correlated between paired end-systolic and end-diastolic data. The error rate and right ventricular mass were compared based on right ventricular hypertrophy groups. Results: The quantification of right ventricular mass was technically applicable in 96.3% (260/270) of CT data, with no error in 54.4% (147/270) and ≤ 10% error in 41.9% (113/270) of cases. Technical failure was observed in 3.7% (10/270) of cases. The reproducibility of the quantification was high (intraclass correlation coefficient = 0.999, p < 0.001). The indexed mass was significantly greater at end-systole than at end-diastole (45.9 ± 22.1 g/m2 vs. 39.7 ± 20.2 g/m2, p < 0.001), and paired values were highly correlated (r = 0.96, p < 0.001). Fewer errors were observed in severe right ventricular hypertrophy and at the end-systolic phase. The indexed right ventricular mass was significantly higher in severe right ventricular hypertrophy (p < 0.02), except in the comparison of the end-diastolic data between no hypertrophy and mild hypertrophy groups (p > 0.1). Conclusion: CT quantification of right ventricular mass using a semiautomatic 3D hybrid segmentation is technically applicable with high reproducibility in most patients with cardiovascular disease.

Ultrafast Dynamic Contrast-Enhanced Breast MRI: Lesion Conspicuity and Size Assessment according to Background Parenchymal Enhancement

  • Soo-Yeon Kim;Nariya Cho;Yunhee Choi;Sung Ui Shin;Eun Sil Kim;Su Hyun Lee;Jung Min Chang;Woo Kyung Moon
    • Korean Journal of Radiology
    • /
    • v.21 no.5
    • /
    • pp.561-571
    • /
    • 2020
  • Objective: To evaluate the clinical utility of ultrafast dynamic contrast-enhanced (DCE)-MRI compared to conventional DCE-MRI by studying lesion conspicuity and size according to the level of background parenchymal enhancement (BPE). Materials and Methods: This study included 360 women (median age, 54 years; range, 26-82 years) with 361 who had undergone breast MRI, including both ultrafast and conventional DCE-MRI before surgery, between January and December 2017. Conspicuity was evaluated using a five-point score. Size was measured as the single maximal diameter. The Wilcoxon signed-rank test was used to compare median conspicuity score. To identify factors associated with conspicuity, multivariable logistic regression was performed. Absolute agreement between size at MRI and histopathologic examination was assessed using the intraclass correlation coefficient (ICC). Results: The median conspicuity scores were 5 at both scans, but the interquartile ranges were significantly different (5-5 at ultrafast vs. 4-5 at conventional, p < 0.001). Premenopausal status (odds ratio [OR] = 2.2, p = 0.048), non-mass enhancement (OR = 4.1, p = 0.001), moderate to marked BPE (OR = 7.5, p < 0.001), and shorter time to enhancement (OR = 0.9, p = 0.043) were independently associated with better conspicuity at ultrafast scans. Tumor size agreement between MRI and histopathologic examination was similar for both scans (ICC = 0.66 for ultrafast vs. 0.63 for conventional). Conclusion: Ultrafast DCE-MRI could improve lesion conspicuity compared to conventional DCE-MRI, especially in women with premenopausal status, non-mass enhancement, moderate to marked BPE or short time to enhancement.

Generation of virtual mandibular first molar teeth and accuracy analysis using deep convolutional generative adversarial network (심층 합성곱 생성적 적대 신경망을 활용한 하악 제1대구치 가상 치아 생성 및 정확도 분석)

  • Eun-Jeong Bae;Sun-Young Ihm
    • Journal of Technologic Dentistry
    • /
    • v.46 no.2
    • /
    • pp.36-41
    • /
    • 2024
  • Purpose: This study aimed to generate virtual mandibular left first molar teeth using deep convolutional generative adversarial networks (DCGANs) and analyze their matching accuracy with actual tooth morphology to propose a new paradigm for using medical data. Methods: Occlusal surface images of the mandibular left first molar scanned using a dental model scanner were analyzed using DCGANs. Overall, 100 training sets comprising 50 original and 50 background-removed images were created, thus generating 1,000 virtual teeth. These virtual teeth were classified based on the number of cusps and occlusal surface ratio, and subsequently, were analyzed for consistency by expert dental technicians over three rounds of examination. Statistical analysis was conducted using IBM SPSS Statistics ver. 23.0 (IBM), including intraclass correlation coefficient for intrarater reliability, one-way ANOVA, and Tukey's post-hoc analysis. Results: Virtual mandibular left first molars exhibited high consistency in the occlusal surface ratio but varied in other criteria. Moreover, consistency was the highest in the occlusal buccal lingual criteria at 91.9%, whereas discrepancies were observed most in the occusal buccal cusp criteria at 85.5%. Significant differences were observed among all groups (p<0.05). Conclusion: Based on the classification of the virtually generated left mandibular first molar according to several criteria, DCGANs can generate virtual data highly similar to real data. Thus, subsequent research in the dental field, including the development of improved neural network structures, is necessary.

Assessment of Questionnaire of Physical Activity at Workplace Based on the Social Cognitive Theory (PAWPQ-SCT): A Psychometric Study in Iranian Gas Refinery Workers

  • Kamel Ghobadi;AhmadAli Eslami;Asiyeh Pirzadeh;Seyed Mohammad Mazloomi;Fatemeh Hosseini
    • Safety and Health at Work
    • /
    • v.14 no.4
    • /
    • pp.358-367
    • /
    • 2023
  • Background: This study aimed to develop and assess the psychometric features of the Physical Activity at Workplace Questionnaire (PAWPQ) based on the Social Cognitive Theory (SCT) to evaluate employees' physical activity (PA) behaviors at the workplace. Methods: This psychometric cross-sectional study was conducted on 455 employees working in one of the gas refineries in Iran. The participants were selected using the proportional stratified sampling method in 2019. The data collection tools were a demographic information questionnaire, the short form of the International Physical Activity Questionnaire (IPAQ), and a questionnaire developed based on the SCT, whose psychometric features were confirmed in terms of validity and reliability. Data were analyzed using SPSS22 and AMOS20 software. Results: The first version of PAWPQ-SCT had 74 items. After evaluating content and face validity, nine items were removed. The results of the content validity index (0.98), content validity ratio (0.86), and impact score (3.62) were acceptable for the whole instrument. In exploratory factor analysis, after removing seven items-58-item final version of the scale-six factors could explain 73.54% of the total variance. The results of structural equation modeling showed the acceptable fit of the model into the data (RMSEA = 0.052, CFI = 0.917, NFI = 0.878, TLI = 0.905, IFI = 0.917, CMIN/DF = 2.818). Cronbach's alpha coefficient and Intraclass Correlation were 0.90 and 0.86, respectively. Conclusion: This study confirmed that the psychometric features of the 58-item final version of PAWPQSCT constructs were acceptable in a sample of Iranian employees. This questionnaire can be used as a valid and reliable tool to evaluate Iranian employees' PA behaviors and develop effective educational interventions for workers and managers.

Surgeon's Experience and Accuracy of Preoperative Digital Templating in Primary Total Hip Arthroplasty

  • Maria Surroca;Silvia Miguela;Agusti Bartra-Ylla;Jorge H. Nunez;Francesc Angles-Crespo
    • Hip & pelvis
    • /
    • v.36 no.2
    • /
    • pp.129-134
    • /
    • 2024
  • Purpose: Preoperative planning has become essential in performance of total hip arthroplasty (THA). However, data regarding the effect of the planner's experience on the accuracy of digital preoperative planning is limited. The objective of this study was to assess the accuracy of digital templating in THA based on the surgeon's experience. Materials and Methods: A retrospective study was conducted. An analysis of 98 anteroposterior pelvic radiographs, which were individually templated by four surgeons (two hip surgeons and two orthopaedic residents) using TraumaCad® digital planning, was performed. A comparison of preoperatively planned sizes with implanted sizes was performed to evaluate the accuracy of predicting component size. The results of preoperative planning performed by hip surgeons and orthopaedic residents were compared for testing of the planner's experience. Results: Femoral stem was precisely predicted in 32.4% of cases, acetabular component in 40.3%, and femoral offset in 76.7%. Prediction of cup size showed greater accuracy than femoral size among all observers. No differences in any variable were observed among the four groups (acetabular cup P=0.07, femoral stem P=0.82, femoral offset P=0.06). All measurements showed good reliability (intraclass correlation coefficient [ICC] acetabular cup: 0.76, ICC femoral stem: 0.79). Conclusion: The results of this study might suggest that even though a surgeon's experience supports improved precision during the planning stage, it should not be restricted only to surgeons with a high level of experience. We consider preoperative planning an essential part of the surgery, which should be included in training for orthopaedics residents.

The Reliability and Validity of a Portable Hand-held Spirometer for the Measurement of Various Lung Functions in Healthy Adults

  • Merve Nur Uygun;Jun-Min Ann;Byeong-Hyeon Woo;Hyeon-Myeong Park;Ha-Im Kim;Dae-Sung Park;In-Beom Jeong
    • Physical Therapy Rehabilitation Science
    • /
    • v.13 no.2
    • /
    • pp.179-186
    • /
    • 2024
  • Objective: This study aims to assess the reliability and validity of the new hand-held spirometer as a potential substitute for traditional pulmonary function testing (PFT) devices. Design: Cross-sectional study. Methods: In this study, thirty healthy adults underwent spirometry using both the new hand-held spirometer and the MIR spirometer, which is a standard PFT device. Parameters including peak expiratory flow (PEF), forced expiratory volume in one second (FEV1), and forced vital capacity (FVC) were measured and analyzed for validity and reliability. Inter-rater reliability and validity were evaluated through 95% limits of agreement (LOA) and intraclass correlation coefficients (ICC). Statistical analyses, including the Bland-Altman plots and the ICC, were utilized to assess agreement between the two devices. Results: The new hand-held spirometer exhibited a good agreement with intra-class coefficient (ICC [2,1]) ranging 0.762 to 0.956 and 95% LOA of -1.94 to 1.80 when compared with MIR. The test-retest reliability of the hand-held spirometer analyzed using - ICC [2,1] demonstrated a good level of consistency (ICC [2,1] =0.849-0.934). Conclusions: In conclusion, the study aimed to assess the potential of the new hand-held spirometer as a viable alternative to traditional PFT devices, with a specific focus on its reliability and validity in spirometric measurements. The new hand-held spirometer exhibited good test-retest reliability across all measured variables, suggesting its potential as a valid and reliable tool for simultaneous PFT measurements.

Variability of Transrectal Shear Wave Elastography in a Phantom Model (팬텀연구에서 경직장 전단파탄성초음파의 가변성)

  • Jihyun Lee;Seong Kuk Yoon;Jin Han Cho;Hee Jin Kwon;Dong Won Kim;Jun Woo Lee
    • Journal of the Korean Society of Radiology
    • /
    • v.84 no.5
    • /
    • pp.1110-1122
    • /
    • 2023
  • Purpose This study aimed to assess the variability of transrectal shear wave elastography (SWE) using a designed phantom. Materials and Methods In a phantom, the SWE values were examined by two radiologists using agarose and emulsion silicone of different sizes (1, 2, and 3 cm) and shapes (round, cubic) at three depths (1, 2, and 3 cm), two region of interest (ROI) and locations (central, peripheral) using two ultrasound machines (A, B from different vendors). Variability was evaluated using the coefficient of variation (CV). Results The CVs decreased with increasing phantom size. Significant changes in SWE values included; agarose phantom at 3 cm depth (p < 0.001; machine A), 1 cm depth (p = 0.01; machine B), emulsion silicone at 2 cm depth (p = 0.047, p = 0.020; both machines). The CVs increased with increasing depth. Significant changes in SWE values included; 1 cm agarose (p = 0.037, p = 0.021; both machines) and 2 cm agarose phantom (p = 0.047; machine A). Significant differences in SWE values were observed between the shapes for emulsion silicone phantom (p = 0.032; machines A) and between ROI locations on machine B (p ≤ 0.001). The SWE values differed significantly between the two machines (p < 0.05). The intra-/inter-operator agreements were excellent (intraclass correlation coefficient > 0.9). Conclusion The phantom size, depth, and different machines affected the variability of transrectal SWE.

Inter-Rater Reliability of Carotid Intima-Media Thickness Measurements in a Multicenter Cohort Study (다기관 코호트 연구에서 경동맥 내막-중막 두께 측정의 측정자간 신뢰도 평가)

  • Lee, Jung Hyun;Choi, Dong Phil;Shim, Jee-Seon;Kim, Dae Jung;Park, Sung-Ha;Kim, Hyeon Chang
    • Journal of health informatics and statistics
    • /
    • v.41 no.1
    • /
    • pp.49-56
    • /
    • 2016
  • Objectives: Carotid intima-media thickness (CIMT) and the presence of carotid artery plaque are widely used as preclinical markers of atherosclerosis. Due to operator dependency in measuring CIMT, it is important to evaluate the reliability of measuring CIMT and plaque between centers in a multicenter study. The purpose of this study is to evaluate the inter-rater reliability of CIMT and plaque presence among three clinical centers of the Cardiovascular and Metabolic Disease Etiology Research Center (CMERC). Methods: Twenty people without known cardiovascular disease (age 37-64) were enrolled during 2014-2015, and their left and right carotid arteries were examined repeatedly with ultrasonography for CIMT measurements at three clinical centers according to a predetermined protocol. Maximum and mean values of CIMT at distal common carotid artery were recorded. Plaque presence at a carotid artery was checked by an operator. The reliability of CIMT and carotid plaque presence was assessed using an intraclass correlation coefficient (ICC) and kappa statistics, respectively. Results: Calculated ICC was 0.647 (95% CI: 0.487-0.779) for maximum CIMT, and 0.758 (95% CI: 0.632- 0.854) for mean CIMT. In Bland Altman plot, most observed values were distributed within mean difference ${\pm}1.96$ SD ranges. Kappa statistics of plaque presence between two centers were 0.304 (center 1 and 2), 0.507 (center 1 and 3), and 0.606 (center 2 and 3), respectively, while Fleiss kappa for overall agreement was 0.445. Conclusions: The inter-rater reliability of CIMT measurements among three clinical centers turned out to be high, and the agreement of measuring carotid plaque presence was fair.