• Title/Summary/Keyword: Accuracy and Agreement of Diagnosis

Search Result 68, Processing Time 0.032 seconds

MR diagnosis of cranial neuritis focusing on facial neuritis: Performance of contrast-enhanced 3D-FLAIR technique

  • Lee, Ho Kyu;Koh, Myeong Ju;Kim, Seung Hyoung;Oh, Jung-Hwan
    • Journal of Medicine and Life Science
    • /
    • v.16 no.1
    • /
    • pp.1-5
    • /
    • 2019
  • Our purpose was to evaluate usefulness of the contrast-enhanced 3 dimensional fluid attenuated inversion recovery (3D-FLAIR) technique of half brain volume to diagnose the patients with facial neuritis based on segment-based analysis. We assessed retrospectively 17 consecutive patients who underwent brain MR imaging at 3 tesla for facial neuritis: 11 patients with idiopathic facial neuritis and 6 with herpes zoster oticus. Contrast enhanced 3D-FLAIR sequences of the half brain volume were analyzed and 3D T1-weighted sequence of the full brain volume were used as the base-line exam. Enhancement of the facial nerve was determined in each segment of 5 facial nerve segments by two radiologists. Sensitivity, specificity and accuracy of enhancement of each segment were assessed. The authors experienced a prompt fuzzy CSF enhancement in the fundus of the internal auditory canal in patients with enhancement of the canalicular segment. Interobserver agreement of CE 3D-FLAIR was excellent(${\kappa}$-value 0.885). Sensitivity, specificity, and accuracy of each segment are 1.0, 0.823, 0.912 in the canalicular segment; 0.118, 1.0, 0.559 in the labyrinthine segment; 0.823, 0.294, 0.559 in the anterior genu; 0.823, 0.529, 0.676 in the tympanic segment; 0.823, 0.235, 0.529 in the mastoid segment, respectively. In addition, those of prompt fuzzy enhancement were 0.647, 1.0, and 0.824, respectively. Incidence of prompt fuzzy enhancement with enhancement of the canalicular segment was 11 sites(55%): 6 (54.5%) in idiopathic facial neuritis and 5 (83.3%) in herpes zoster. Enhancement of the canalicular segment and prompt fuzzy enhancement on CE 3D-FLAIR was significantly correlated with occurrence of facial neuritis (p<0.001). CE 3D-FLAIR technique of the half brain volume is useful to evaluate the patients with facial neuritis as an adjunct sequence in addition to contrast-enhanced 3D T1-weighted sequence. On segment-based analysis, contrast enhancement of the canalicular segment is the most reliable. Prompt fuzzy enhancement is seen in not only herpes zoster, but in idiopathic facial neuritis.

Cold-Heat and Excess-Deficiency Pattern Identification Based on Questionnaire, Pulse, and Tongue in Cancer Patients: A Feasibility Study (암 환자 대상 설문지, 맥진기, 설진기 결과를 활용한 한열허실변증에 대한 예비 연구)

  • Choi, Yujin;Kim, Soo-Dam;Kwon, Ojin;Park, Hyo-Ju;Kim, JiHye;Choi, Woosu;Ko, Myung-Hyun;Ha, Su-Jeung;Song, Si-Yeon;Park, So-Jung;Yoo, Hwa-Seung;Jeong, Mi-Kyung
    • The Journal of Korean Medicine
    • /
    • v.42 no.1
    • /
    • pp.1-11
    • /
    • 2021
  • Objectives: This pilot study aimed to evaluate the agreement between traditional face-to-face Korean medicine (KM) pattern identification and non-face-to-face KM pattern identification using the data from related questionnaires, tongue image, and pulse features in patients with cancer. Methods: From January to June 2020, 16 participants with a cancer diagnosis were recruited at the one Korean medicine hospital. Three experienced Korean medicine doctors independently diagnosed the participants whether they belong to the cold pattern or not, heat pattern or not, deficiency pattern or not, and excess pattern or not. Another researcher collected KM pattern related data using questionnaires including Cold-Heat Pattern Identification (CHPI), tongue image analysis system, and pulse analyzer. Collected KM pattern related data without participants' identifier was provided for the three Korean medicine doctors in random order, and non-face-to-face KM pattern identification was carried out. The kappa value between face-to-face and non-face-to-face pattern identification was calculated. Results: From the face-to-face pattern identification, there were 13/3 cold/non-cold pattern, 4/12 heat/non-heat pattern, 14/2 deficiency/non-deficiency pattern, and 0/16 excess/non-excess pattern participants. In cold/non-cold pattern, kappa value was 0.455 (sensitivity: 0.85, specificity: 0.67, accuracy: 0.81). In heat/non-heat pattern, the kappa value was 0.429 (sensitivity: 0.75, specificity: 0.72, accuracy: 0.75). The kappa value of deficiency/non-deficiency and excess/non-excess pattern was not calculated because of the few participants of non-deficiency, and excess pattern. Conclusions: The agreement between traditional face-to-face pattern identification and non-face-to-face pattern identification seems to be moderate. The non-face-to-face pattern identification using questionnaires, tongue, and pulse features may feasible for the large clinical study.

The Efficacy of Rapid Antigen Tests for Detection of Seasonal Influenza Virus (계절 인플루엔자 진단에서 신속항원검사의 유용성)

  • Lee, Jun Yeol;Lee, Sol;Kim, Han Sung;Kim, Kwang Nam
    • Pediatric Infection and Vaccine
    • /
    • v.24 no.1
    • /
    • pp.31-36
    • /
    • 2017
  • Purpose: This study aimed to examine the accuracy of rapid influenza diagnostic tests (RIDT) in children with an influenza-like illness and to evaluate factors associated with greater accuracy. Methods: Pediatric patients, who visited Hallym University Sacred Heart Hospital with an influenza-like illness between June 2011 and May 2016, were enrolled in this study. We tested 798 samples using a real-time polymerase chain reaction (PCR) for respiratory viruses and compared the results with rapid influenza tests. Results: In comparison with the results of the multiplex PCR, the positive agreement rates of RIDT for influenza A and B virus were 75.7% and 60.0%, respectively. The performance of RIDT varied according to days after fever onset. The positive agreement rates of RIDT for influenza A and B tests, performed within 4 days of fever onset, were 77.6% and 73.2%, but the rates for tests performed more than 5 days after fever onset were 66.7% and 21.4%, respectively. Conclusions: The RIDT is a quick and simple aid to diagnosis, but is less sensitive than the labeled sensitivity. Moreover, test performance varied according to days after fever onset. Test specimens for RIDT should be collected as soon as possible after the onset of symptoms (less than 4 days).

Unenhanced Breast MRI With Diffusion-Weighted Imaging for Breast Cancer Detection: Effects of Training on Performance and Agreement of Subspecialty Radiologists

  • Yeon Soo Kim;Su Hyun Lee;Soo-Yeon Kim;Eun Sil Kim;Ah Reum Park;Jung Min Chang;Vivian Youngjean Park;Jung Hyun Yoon;Bong Joo Kang;Bo La Yun;Tae Hee Kim;Eun Sook Ko;A Jung Chu;Jin You Kim;Inyoung Youn;Eun Young Chae;Woo Jung Choi;Hee Jeong Kim;Soo Hee Kang;Su Min Ha;Woo Kyung Moon
    • Korean Journal of Radiology
    • /
    • v.25 no.1
    • /
    • pp.11-23
    • /
    • 2024
  • Objective: To investigate whether reader training improves the performance and agreement of radiologists in interpreting unenhanced breast magnetic resonance imaging (MRI) scans using diffusion-weighted imaging (DWI). Materials and Methods: A study of 96 breasts (35 cancers, 24 benign, and 37 negative) in 48 asymptomatic women was performed between June 2019 and October 2020. High-resolution DWI with b-values of 0, 800, and 1200 sec/mm2 was performed using a 3.0-T system. Sixteen breast radiologists independently reviewed the DWI, apparent diffusion coefficient maps, and T1-weighted MRI scans and recorded the Breast Imaging Reporting and Data System (BI-RADS) category for each breast. After a 2-h training session and a 5-month washout period, they re-evaluated the BI-RADS categories. A BI-RADS category of 4 (lesions with at least two suspicious criteria) or 5 (more than two suspicious criteria) was considered positive. The per-breast diagnostic performance of each reader was compared between the first and second reviews. Inter-reader agreement was evaluated using a multi-rater κ analysis and intraclass correlation coefficient (ICC). Results: Before training, the mean sensitivity, specificity, and accuracy of the 16 readers were 70.7% (95% confidence interval [CI]: 59.4-79.9), 90.8% (95% CI: 85.6-94.2), and 83.5% (95% CI: 78.6-87.4), respectively. After training, significant improvements in specificity (95.2%; 95% CI: 90.8-97.5; P = 0.001) and accuracy (85.9%; 95% CI: 80.9-89.8; P = 0.01) were observed, but no difference in sensitivity (69.8%; 95% CI: 58.1-79.4; P = 0.58) was observed. Regarding inter-reader agreement, the κ values were 0.57 (95% CI: 0.52-0.63) before training and 0.68 (95% CI: 0.62-0.74) after training, with a difference of 0.11 (95% CI: 0.02-0.18; P = 0.01). The ICC was 0.73 (95% CI: 0.69-0.74) before training and 0.79 (95% CI: 0.76-0.80) after training (P = 0.002). Conclusion: Brief reader training improved the performance and agreement of interpretations by breast radiologists using unenhanced MRI with DWI.

A Study on the Reliability and Validity test of the QSCC II + (Revised Questionnaire for the Sasang Constitution Classification) (개정(改定)된 사상체질분류검사지(四象體質分類檢査紙)II의 신뢰도(信賴度)와 타당도(妥當度)에 대한 연구(硏究))

  • Choi, Kyung-Ju;Choi, Yang-Sik;Cha, Jae-Hoon;Hwang, Min-Woo;Lee, Soo-Kyung;Go, Byeong-Hui;Song, Il-Byung
    • Journal of Sasang Constitutional Medicine
    • /
    • v.18 no.1
    • /
    • pp.62-74
    • /
    • 2006
  • 1. Objectives This is a statistical study on the Reliability and Validity of the Revised Questionnaire for the Sasang Constitution classification(QSCC II +). 2. Methods To analyze the reliability; we gathered the results of the QSCC II + of 266 people. Each person took the questionnaire three times, and the interval of the examinations were about one year. With the results, we used stratified analysis to check up the consistency rate of three examinations, and analyzed the tendency of agreement by crosstabs to get the kappa value. For the validity, we gathered the results of the QSCC II + of 587 people who were Taeumin, Soyangin, Soeumin. They took the questionnaire once, and SCM specialists strictly examined to diagnose their Sasang constitutions. We compare their results of the QSCC II + to the diagnostic result of their Sasang constitutions, and analyzed by crosstabs to get the rate of accuracy of the QSCC II +, and the kappa value for the measure of agreements. 3. Results and Conclusions The expected rate to get the same results was 54.5% in Soyangin, 68.1% in Taeumin, 65.7% in Soeumin, and kappa value was $0.311{\sim}0.414$, which means the reliability of the QSCC II + is analytically significant. The accuracy of the results of QSCC II +, compared to the diagnosis of the SCM specialists, was 58.4%, but increased up to 60.8%, and validity also became moderately good(K=0.412) by age limitation. Because in the 70's results of the QSCC II + isn't likely to agree to the diagnosis of the SCM specialists.

  • PDF

Diagnosis of Unruptured Intracranial Aneurysms Using Proton-Density Magnetic Resonance Angiography: A Comparison With High-Resolution Time-of-Flight Magnetic Resonance Angiography

  • Pae Sun Suh;Seung Chai Jung;Hye Hyeon Moon;Yun Hwa Roh;Yunsun Song;Minjae Kim;Jungbok Lee;Keum Mi Choi
    • Korean Journal of Radiology
    • /
    • v.25 no.6
    • /
    • pp.575-588
    • /
    • 2024
  • Objective: Differentiating intracranial aneurysms from normal variants using CT angiography (CTA) or MR angiography (MRA) poses significant challenges. This study aimed to evaluate the efficacy of proton-density MRA (PD-MRA) compared to high-resolution time-of-flight MRA (HR-MRA) in diagnosing aneurysms among patients with indeterminate findings on conventional CTA or MRA. Materials and Methods: In this retrospective analysis, we included patients who underwent both PD-MRA and HR-MRA from August 2020 to July 2022 to assess lesions deemed indeterminate on prior conventional CTA or MRA examinations. Three experienced neuroradiologists independently reviewed the lesions using HR-MRA and PD-MRA with reconstructed voxel sizes of 0.253 mm3 or 0.23 mm3, respectively. A neurointerventionist established the gold standard with digital subtraction angiography. We compared the performance of HR-MRA, PD-MRA (0.253-mm3 voxel), and PD-MRA (0.23-mm3 voxel) in diagnosing aneurysms, both per lesion and per patient. The Fleiss kappa statistic was used to calculate inter-reader agreement. Results: The study involved 109 patients (average age 57.4 ± 11.0 years; male:female ratio, 11:98) with 141 indeterminate lesions. Of these, 78 lesions (55.3%) in 69 patients were confirmed as aneurysms by the reference standard. PD-MRA (0.253-mm3 voxel) exhibited significantly higher per-lesion diagnostic performance compared to HR-MRA across all three readers: sensitivity ranged from 87.2%-91.0% versus 66.7%-70.5%; specificity from 93.7%-96.8% versus 58.7%-68.3%; and accuracy from 90.8%-92.9% versus 63.8%-69.5% (P ≤ 0.003). Furthermore, PD-MRA (0.253-mm3 voxel) demonstrated significantly superior per-patient specificity and accuracy compared to HR-MRA across all evaluators (P ≤ 0.013). The diagnostic accuracy of PD-MRA (0.23-mm3 voxel) surpassed that of HR-MRA and was comparable to PD-MRA (0.253-mm3 voxel). The kappa values for inter-reader agreements were significantly higher in PD-MRA (0.820-0.938) than in HR-MRA (0.447-0.510). Conclusion: PD-MRA outperformed HR-MRA in diagnostic accuracy and demonstrated almost perfect inter-reader consistency in identifying intracranial aneurysms among patients with lesions initially indeterminate on CTA or MRA.

Comparison of Face-to-Face Interview Questionnaires and Medical Records Data for Smoking Habits in Lung Cancer Patients (폐암 환자들의 일대일 설문조사와 의무기록의 흡연 습관 비교)

  • Lee, Eui-Cheol;Ryu, Jeong-Seon;Kim, Hyun-Jung;Cho, Jae-Hwa;Kwak, Seoung-Min;Lee, Hong-Lyeol
    • Tuberculosis and Respiratory Diseases
    • /
    • v.62 no.1
    • /
    • pp.27-32
    • /
    • 2007
  • Background: This study evaluated the accuracy of smoking habit from the data obtained from the medical records of lung cancer patients against the data obtained form face-to-face interview questionnaires Methods: The smoking habits of 225 lung cancer patients were categorized into never smoked, ex-smoker and current smoker in face-to-face interview questionnaire and medical record taken at the time of admission for a diagnosis. The overall agreement between two sources was evaluated. The factors affecting the disagreement between two sources and the level of data omission of the smoking habits in medical records were analyzed suing multiple logistic regression. Results: The smoking habit between two sources showed moderate overall agreement(Kappa $({\kappa})=0.60$). The lowest agreement was observed in the ex-smokers(${\kappa}=0.49$). Multivariate analysis revealed an age of 65 or older to be a statistically significant factor associated with the increasing disagreement risk compared with those 64 or younger (OR 3.02; 95% CI 1.58-5.80). The omission rate of smoking habits in the medical records was 18.2%. Adenocarcinoma was shown to be a statistically significant factor of associated with an increasing omission rate compared with squamous cell carcinoma (OR 3.00; 95% CI 1.19-7.59). Conclusion: The smoking habits obtained from medical record moderately reflect their true behavior. However, the smoking habit data from medical record should be used with caution when being used in a clinical study or cohort study of lung cancer.

An Evaluation of the Accuracy of Mini-Wright Peak Flow Meter (mini-Wright Peak Flow Meter에 의한 PEFR 측정의 정확도)

  • Koh, Young-Il;Choi, In-Seon;Na, Hyun-Ju;Park, Seok-Chae;Jang, An-Soo
    • Tuberculosis and Respiratory Diseases
    • /
    • v.44 no.2
    • /
    • pp.298-308
    • /
    • 1997
  • Background : Portable devices for measuring peak expiratory flow(PEF) are now of proved value in the diagnosis and management of asthma and many lightweight PEF meters have become available. However, it is necessary to determine whether peak expiratory flow rate(PEFR) measurements measured with peak flowmeters is accurate and reproducible for clinical application. The aim of the present study is to define accuracy, agreement, and precision of mini-Wright peak flow meter(MPFM) against standard pneumotachygraph. Methods : The lung function tests by standard pneumotachygraph and PEFR measurement by MPFM were performed in a random order for 2 hours in 22 normal and 17 asthmatic subjects and also were performed for 3 successive days in 22 normals. Results : The PEFR measured with MPFM was significantly related to the PEFR and $FEV_1$ measured with standard pneumotachygraph in normal and asthmatics(for PEFR, r = 0.92 ; p < 0.001 ; for $FEV_1$, r = 0.78 ; p < 0.001). The accuracy of MPFM was within 100(limits of accuracy recommeded by NAEP) in all the subjects or 22 normal, mean difference from standard pneumotachygraph being 16.5L/min(percentage of difference being 2.90%) or 10.6L/min(percentage of difference being 1.75%), respectively. According to the method proposed by Bland and Altman, the 95% limits of the distribution of differences between MPFM and standard pneumotachygraph after correction of PEFR using our regression equation were +38.2 and -71.5L/min in all the subjects or 20.49~+9.49L/min in 22 normal and was similar to the intraindividual agreements for 3 successive days in normal. There was no statistically significant difference of PEFR measured with MPFM and standard pneumotachygraph among three days(p > 0.05) and the coefficient of variation($2.4{\pm}1.2%$) of PEFR measured with MPFM was significantly lower than that($5.2{\pm}3.5%$) with standard pneumotachygraph in normal (p < 0.05). Conclusion : This results suggest that the MPFM was as accurate and reproducible as standard pneumotachygraph for monitoring of PEFR in the asthmatic subjects.

  • PDF

Accuracy of the Registered Cause of Death in a County and its Related Factors (일개 군 사망신고자료에 기재된 사인의 정확성과 관련요인)

  • Shin, Hee-Young;Shin, Jun-Ho;Nam, Hae-Sung;Ryu, So-Yeon;Im, Jeong-Soo;Rhee, Jung-Ae;Chung, Eun-Kyung
    • Journal of Preventive Medicine and Public Health
    • /
    • v.35 no.2
    • /
    • pp.153-159
    • /
    • 2002
  • Objectives : To evaluate the accuracy of the registered cause of death in a county and its related factors. Methods : The data used in this study was based on 504 cases, in a county of Chonnam province, registered between January and December 1998. Study subjects consisted of 388 of the 504 cases, and their causes of death were established by an interview survey of the next of kin or neighbor and medical record surveys. We compared the registered cause of death with the confirmed cause of death, determined by surveys and medical records, and evaluated the factors associated with the accuracy of the registered cause of death. Results : 62.6% of the deaths were concordant with 19 Chapters classification of cause of death. external causes of mortality, endocrine, nutritional and metabolic diseases, neoplasms and diseases of the circulatory system showed the good agreement between the registered cause of death and the confirmed cause of death. The factors relating to the accuracy of the registered cause of death were the doctors' diagnosis for the cause of death (adjusted Odds Ratio: 2.67, 95% Confidence Interval: 1.21-5.89) and the grade of the public officials in charge of the death registry (adjusted Odds Ratio: 0.30, 95% CI=0.12-0.78). Conclusions : The accuracy of the registered cause of death was not high. It could be improved by using the doctors' diagnosis for death and improving the job specification for public officials who deal with death registration.

The Accuracy of Barr, Blethyn and Leech Scoring Systems on Plain Abdominal Radiographs in Childhood Constipation (소아에서 단순 복부 X-선 사진으로 변비를 진단하는데 있어 Barr, Blethyn과 Leech 점수체계의 정확도)

  • Moon, Ji-Young;Moon, Kyung-Rye
    • Pediatric Gastroenterology, Hepatology & Nutrition
    • /
    • v.10 no.1
    • /
    • pp.44-50
    • /
    • 2007
  • Purpose: The role of plain, abdominal radiography in childhood constipation has not been fully evaluated. The aim of this study was to determine the accuracy and reliability of scoring systems assessing a fecal load on plain, abdominal radiographs in children with functional constipation. Methods: Plain, abdominal radiographs from 38 constipated children and 39 control children were examined by four independent inspectors, pediatric residents. Four inspectors independently scored the radiographs according to three different scoring systems Barr, Blethyn, and Leech. No clinical information about the patients was available to the inspectors. Each abdominal radiograph was evaluated on two separate occasions, one week apart. Kappa coefficients were calculated as indicators of inter-and intra-inspector variability, coefficients <0.20, 0.21~0.40, 0.40~0.60, 0.61~0.80 and 0.81~1.00 were considered to indicate poor, fair, moderate, good, and very good agreement, respectively. Results: The Leech score showed the highest reproducibility: the inter-inspector agreement was uniformly very good on two separate occasions (${\kappa}$ values of 0.88, 0.91, 0.92, 0.86 in the first time and 0.81, 0.88, 0.89, 0.84 in the second time). Agreement using the Barr score was good (${\kappa}$ values of 0.66, 0.67, 0.69, 0.66 in the first time and 0.68, 0.65, 0.71, 0.68 in the second time). However, agreement for the Blethyn score was the lowest of the three scoring systems. The Leech scoring system had the highest sensitivity and specificity compared to the Barr scoring system for the diagnosis of functional constipation by plain, abdominal radiographs. Conclusion: The Leech score appeared to be a more accurate and reliable method because of its high sensitivity and specificity for evaluating the fecal load on plain, abdominal radiographs in children with functional constipation. Therefore, the Leech scoring system was found to be the most useful for assessment for the degree of constipation on plain, abdominal radiographs in children.

  • PDF