• 제목/요약/키워드: Cohen's Kappa

검색결과 94건 처리시간 0.028초

Digital Tomosynthesis versus Conventional Radiography for Evaluating Osteonecrosis of the Femoral Head

  • Yun Hwa Roh;Seunghun Lee;Jeong Ah Ryu;Yeo Ju Kim;Yeesuk Kim;Jiyoon Bae
    • Korean Journal of Radiology
    • /
    • 제22권12호
    • /
    • pp.2026-2033
    • /
    • 2021
  • Objective: The aim of this study was to compare the diagnostic performances of digital tomosynthesis (DTS) and conventional radiography in detecting osteonecrosis of the femoral head (ONFH) using computed tomography (CT), as the reference standard and evaluate the diagnostic reproducibility of DTS. Materials and Methods: Forty-five patients (24 male and 21 female; age range, 25-77 years) with clinically suspected ONFH underwent anteroposterior radiography, DTS, and CT. Two musculoskeletal radiologists independently evaluated the presence and type of ONFH. The diagnostic performance of radiography and DTS in detecting the presence of ONFH and determining the types of ONFH were evaluated. The interobserver and intraobserver reliabilities of each imaging modality were analyzed using Cohen's kappa. Results: DTS had higher sensitivity (89.4%-100% vs. 74.5%-76.6%) and specificity (97.3%-100% vs. 78.4%-83.8%) for ONFH detection than radiography. DTS showed higher performance than radiography in identifying the subtypes of ONFH with statistical significance in one reader (type 1, 100% vs. 30.8%, p = 0.004; type II, 97.1% vs. 73.5%, p = 0.008). The interobserver agreement was excellent for DTS and moderate for radiography (kappa of 0.86 vs. 0.57, respectively). The intraobserver agreement for DTS was higher than that of radiography (kappa of 0.96 vs. 0.69, respectively). Conclusion: DTS showed higher diagnostic performance and reproducibility than radiography in detecting ONFH. DTS may be used as a first-line diagnostic modality instead of radiography for patients suspected of having ONFH.

대학 아이덴티티(University Identity) 디자인 요인 비교분석에 관한 연구: 한국과 중국 중심으로 (Comparative Analysis of University Identity Design Factors: Focusing on Korea and China)

  • 조옥룡;김병대
    • 한국콘텐츠학회논문지
    • /
    • 제22권3호
    • /
    • pp.390-400
    • /
    • 2022
  • 대학 아이덴티티(University Identity)는 대학의 정체성 확립과 하나의 고유한 이미지를 통합하여 학교가 지향하는 핵심 가치를 효과적으로 전달이 가능하다. 따라서 대다수의 대학은 대학 아이덴티티를 새롭게 정의하거나 문화상품을 내놓는 등 적극적인 홍보 전략을 펼치고 있다. 최근 기존의 광고나 홈페이지는 물론 인스타 그램, 유튜브, 페이스북등의 SNS로 대학브랜드를 지속적으로 노출하며 차별화하고 있다. 본 연구는 '2021 QS World University Rankings'에서 '2021 QS ASIA University Rankings'의 한국과 중국의 상위 각 80개 대학 아이덴티티를 분석하여 디자인의 형태, 색상 수, 영어 표현에서 차이가 확인 된다. 그리고 한국과 중국 대학의 시각화된 대학 아이덴티티 디자인의 계량화와 교차분석을 통한 양국의 시각적 표현 차이분석과 데이터의 정확성을 확보하기 위해 'Cohen's Kappa' 일치성 분석을 하였다. 연구결과 창의적이고 불규칙형태를 나타내며 파랑색, 빨강색, 초록색의 사용이 많으며 대부분 2가지 이내 색상의 사용을 볼 수 있다. 또한 대학 아이덴티티 디자인은 워드마크와 추상적 형식의 표현이 확인된다. 본 연구는 향후 대학의 국제화, 차별화된 대학 아이덴티티 디자인을 창출하기 위한 효과적인 기초자료로 시사점을 제시할 수 있다.

Deep learning for the classification of cervical maturation degree and pubertal growth spurts: A pilot study

  • Mohammad-Rahimi, Hossein;Motamadian, Saeed Reza;Nadimi, Mohadeseh;Hassanzadeh-Samani, Sahel;Minabi, Mohammad A. S.;Mahmoudinia, Erfan;Lee, Victor Y.;Rohban, Mohammad Hossein
    • 대한치과교정학회지
    • /
    • 제52권2호
    • /
    • pp.112-122
    • /
    • 2022
  • Objective: This study aimed to present and evaluate a new deep learning model for determining cervical vertebral maturation (CVM) degree and growth spurts by analyzing lateral cephalometric radiographs. Methods: The study sample included 890 cephalograms. The images were classified into six cervical stages independently by two orthodontists. The images were also categorized into three degrees on the basis of the growth spurt: pre-pubertal, growth spurt, and post-pubertal. Subsequently, the samples were fed to a transfer learning model implemented using the Python programming language and PyTorch library. In the last step, the test set of cephalograms was randomly coded and provided to two new orthodontists in order to compare their diagnosis to the artificial intelligence (AI) model's performance using weighted kappa and Cohen's kappa statistical analyses. Results: The model's validation and test accuracy for the six-class CVM diagnosis were 62.63% and 61.62%, respectively. Moreover, the model's validation and test accuracy for the three-class classification were 75.76% and 82.83%, respectively. Furthermore, substantial agreements were observed between the two orthodontists as well as one of them and the AI model. Conclusions: The newly developed AI model had reasonable accuracy in detecting the CVM stage and high reliability in detecting the pubertal stage. However, its accuracy was still less than that of human observers. With further improvements in data quality, this model should be able to provide practical assistance to practicing dentists in the future.

Nutrition Evaluation Screening Tool: An Easy to Use Screening Tool for Hospitalised Children

  • Dokal, Kitt;Asmar, Nadia;Shergill-Bonner, Rita;Mutalib, Mohamed
    • Pediatric Gastroenterology, Hepatology & Nutrition
    • /
    • 제24권1호
    • /
    • pp.90-99
    • /
    • 2021
  • Purpose: Nutrition screening is vital to ensure patients are appropriately managed in hospital. In paediatrics there is currently no universally accepted nutrition screening tool. The Nutrition Evaluation Screening Tool (NEST) was developed as an easy to use and practical screening tool for hospitalised children. We aim to evaluate compliance of the NEST and assess agreement of the NEST with the already validated nutrition screening tools, Screening Tool for Risk on Nutritional Status and Growth (STRONGkids), Screening Tool for the Assessment of Malnutrition in Paediatrics (STAMP) and the Subjective Global Nutritional Assessment (SGNA) tool. Methods: Retrospective review of 102 patient episodes at the Evelina London Children's Hospital. Electronic records were used to assess NEST compliance and to complete the nutrition tools for each patient episode. Cohen's kappa was used to determine the level of agreement between each nutrition tool. Results: There was moderate agreement between the NEST and the two screening tools, STRONGkids (κ=0.472) and STAMP (κ=0.416) for patients on initial screening at admission. 87.2% of patient episodes were NEST compliant within 24 hours of admission to hospital. Conclusion: The moderate agreement between these two already validated screening tools enhances the NEST's validity as a paediatric screening tool. The NEST had the strongest correlation with the SGNA tool compared to other screening tools. The NEST is user friendly screening tool for hospitalised children.

Reliability of the scapular dyskinesis test yes-no classification in asymptomatic individuals between students and expert physical therapists

  • Lawrence S. Ramiscal;Lori A. Bolgla;Chad E. Cook;John S. Magel;Stephen A. Parada;Raymond Chong
    • Clinics in Shoulder and Elbow
    • /
    • 제25권4호
    • /
    • pp.321-327
    • /
    • 2022
  • Background: Scapular dyskinesis is considered a risk factor for the shoulder pain that may warrant screening for prevention. Clinicians of all experience screen scapular dyskinesis using the scapular dyskinesis test yes-no classification (Y-N), yet its reliability in asymptomatic individuals is unknown. We aimed to establish Y-N's intra- and inter-reliability between students and expert physical therapists. Methods: We utilized a cross-sectional design using consecutive asymptomatic subjects. Six students and two experts rated 100 subjects using the Y-N. Cohen's kappa (κ) and Krippendorff's alpha (K-α) were calculated to determine intra- and inter-rater reliability. Results: Intra- and inter-rater values for experts were κ=0.92 (95% confidence interval [CI], 0.91-0.93) and 0.85 (95% CI, 0.84-0.87) respectively; students were κ=0.77 (95% CI, 0.75-0.78) and K-α=0.63 (95% CI, 0.58-0.67). Conclusions: The Y-N is reliable in detecting scapular dyskinesis in asymptomatic individuals regardless of experience.

Assessment of Posterior Globe Flattening: Two-Dimensional versus Three-Dimensional T2-Weighted Imaging

  • Ann, Jun Hyung;Kim, Eung Yeop
    • Investigative Magnetic Resonance Imaging
    • /
    • 제19권3호
    • /
    • pp.178-185
    • /
    • 2015
  • Purpose: To compare the frequency of posterior globe flattening between two-dimensional T2-weighted imaging (2D T2WI) and three-dimensional (3D T2WI). Materials and Methods: Sixty-nine patients (31 female; mean age, 44.4 years) who had undergone both 5-mm axial T2WI and sagittal 3D 1-mm isovoxel T2WI of the whole brain for evaluation of various diseases (headache [n = 30], large hemorrhage [n = 19], large tumor or leptomeningeal tumor spread [n = 15], large infarct [n = 3], and bacterial meningitis [n = 2]) were used in this study. Two radiologists independently reviewed both sets of images at separate sessions. Axial T2WI and multi-planar imaging of 3D T2WI were visually assessed for the presence of globe flattening. The optic nerve sheath diameter (ONSD) was measured at a location 4 mm posterior to each globe on oblique coronal imaging reformatted from 3D T2WI. Results: There were significantly more globes showing posterior flattening on 3D T2WI (105/138 [76.1%]) than on 2D T2WI (27/138 [19.6%], P = 0.001). Inter-observer agreement was excellent for both 2D T2WI and 3D T2WI (Cohen's kappa = 0.928 and 0.962, respectively). Intra-class correlation coefficient for the ONSD was almost perfect (Cohen's kappa = 0.839). The globes with posterior flattening had significantly larger ONSD than those without on both 2D and 3D T2WI (P < 0.001; $6.14mm{\pm}0.44$ vs. $5.74mm{\pm}0.44$ on 2D T2WI; $5.90mm{\pm}0.47$ vs. $5.56mm{\pm}0.34$ on 3D T2WI). Optic nerve protrusion was significantly more frequent on reformatted 1-mm 3D T2WI than on 5-mm 2D T2WI (8 out of 138 globes on 3D T2WI versus one on 2D T2WI; P = 0.018). Conclusion: Posterior globe flattening is more frequently observed on 3D T2WI than on 2D T2WI in patients suspected of having increased intracranial pressure. The globes with posterior flattening have significantly larger ONSD than those without.

심도자 검사 환자를 위한 구체적 감각 정보의 개발 (Development of Concrete Sensory Information for Patients Undergoing Cardiac Catheterization)

  • 김조자;김화순
    • 대한간호학회지
    • /
    • 제27권2호
    • /
    • pp.433-443
    • /
    • 1997
  • Cardiac catheterization is a diagnostic procedure which is intrusive and anxiety provoking. Patient education and information offer have been suggested as effective nursing interventions to reduce patients' anxiety and stress. Main objectives of this study are : 1) to develop concrete objective information for patients undergoing cardiac catheterization : 2) to analyze the types of information included in the newly developed concrete objective information. The subjects of this study are 11 patients who were admitted to the CCU of a general hospital in Seoul. The subjects were provided with preparatory information about cardiac catheterization by using interview and a booklet. After the procedure, the subjects were asked to describe additional information which they suggest to be added into the booklet and the physical sensations felt during the procedure. The results of the study are summarized as follows : Most subjects were satisfied with the preparatory information that was provided by interview and the booklet before the procedure. But patients suggested several problems related to the content of the booklet. First, they reported difficulty to differentiate the terms -coronary angio gram and cardiac catheterization. Also, some patients expressed that they feared after reading the information about the incision of inguinal area. Subjects responded that the information about the direct process of the test did not reduce their anxiety and the information was not detail enough. Next, most subjects would want to know about the monitor and the sound from monitor. They said that they could not hear instructions from doctor or nurse during the procedure due to tension. Considering above response results, the need for more effective way to provide information, like visual and auditory information through video tape for giving information is suggested. Sensations related to the procedure were the smell coming from sterilization of inguinal area, stinging pain in groin when the doctor inserts a needle into artery, and the sensation of pressure and moving of vessels surrounding neck when the catheter was inserted and visualized on fluoroscopy. Besides, subject reported hot sensation and burning feeling in face and chest area, and nausea when dye is injected by hand. In the analysis of information content, there was 79% agreement on the actual units of analysis that were coded. In the analysis of type of information, procedural information was 60.4%. Concrete objective information was 28.1%. and other information was 11.5%. Agreement of the coders in categorizing the units of information was determined by using Cohen's kappa which corrects for chance agreement. Cohen's kappa was .84.

  • PDF

맥진기 판독의 신뢰도 및 파형의 재현성 연구 (Study on Reliability of Interpretation and Reproducibility of a Pulse Analyser)

  • 박승찬;이지혜;이혜윤;조민경;김도형;김소연;최준용;한창우;박성하;홍진우;이인;권정남
    • 대한한방내과학회지
    • /
    • 제34권3호
    • /
    • pp.231-239
    • /
    • 2013
  • Objectives : This study was performed to evaluate inter-rater and intra-rater reliability of interpretation and reproducibility of a pulse analyser (MAXMAC27-Plus). Methods : 38 of 40 volunteers completed the pulse analysis consecutively. Three Korean medical doctors who had at least 2 years of clinical experience interpreted the pulse waves for 3 aspects of size, depth and shape, then inter-rater reliability and crude agreement was obtained. Reinterpretation was done 2 weeks later and intra-rater reliability and crude agreement was obtained. Intra-rater reliability and crude agreement between 1st and 2nd measurement was calculated. Cohen's weighted kappa for size, Cohen's kappa for depth and shape were used as statistical analysis. Results : Inter-rater reliability of size, depth and shape among 3 raters was 0.598, 0.604, and 0.312, respectively, showing moderate to substantial agreement. Average intra-rater reliability between 1st and 2nd interpretation of size, depth and shape was 0.806, 0.705, and 0.638, respectively, showing substantial to almost perfect agreement. However, intra-rater reliability between consecutive measurements of size, depth and shape was 0.221, 0.121, and 0.194, respectively, which showed only poor to fair agreement. Conclusions : Intra-rater and inter-rater reliability of one pulse wave showed relatively high concordance. Training by a clinical expert may effect better concordance among raters. Test-retest reliability showed poor agreement. Improvement of measurement technique and device performance will be needed.

급성기 뇌경색 환자에 있어 변증형별 유의한 임상지표의 분석 (Analysis of Clinical Indicators related to Pattern-Identification in Acute Cerebral Infarction Patient)

  • 이은찬;현상호;곽승혁;우수경;박주영;정우상;문상관;조기호;박성욱;고창남
    • 대한중풍순환신경학회지
    • /
    • 제13권1호
    • /
    • pp.33-42
    • /
    • 2012
  • Object : The aim of this study was to assess the clinical indicators related to Pattern-Identification(PI) in acute cerebral infarction patients. Methods : We studied hospitalized patients within 30days after ictus, who admitted at Korean Medicine Center of Kyung-Hee University from January 2010 to October 2012.(n=290) Two Traditional Korean Medicine(TKM) physicians evaluated the patients independently and diagnosed PI. Inter-rater reliability was measured using simple percentage agreement and the Cohen's kappa(κ) coefficient. To assess the clinical indicators closely related to each PI, we analysed average score of each indicator in each group. Results : Simple percentage agreement of PI between raters was 64.83% and Cohen's kappa(κ) coefficient was 0.526(95% CI: 0.451-0.600). Inter-rater reliability level was fair to good. We analysed the clinical indicators in each group. Significant indicators for Fire-Heat Pattern(FHP) were reddened complexion and strong pulse power, and meaningful indicators for FHP were halitosis and thick tongue fur. Significant indicator for Dampness-Phlegm Pattern(DPP) was overweight and there was no meaningful indicator. Significant indicator for Yin-Deficiency Pattern(YDP) was dry tongue fur and meaningful indicator for YDP was thirst. There was no significant indicator for Qi-Deficiency Pattern(QDP) and pale complexion and faint low voice were meaningful indicators for QDP. Conclusions : This study reveals the significant and meaningful clinical indicators related to each Pattern-Identification in acute cerebral infarction patients. It will contribute to standardization of Korean Medical Diagnosis and Treatment in acute cerebral infarction patients.

  • PDF

초기 간암 선별 검사로서 단축 자기공명영상 검사의 진단능: 고식적 역동학적 자기공명영상검사와의 비교 (Diagnostic Performance of Simulated Abbreviated MRI for Early-Stage Hepatocellular Carcinoma Screening: A Comparison to Conventional Dynamic Contrast-Enhanced MRI)

  • 임은솔;김성모;신상수;허숙희;이종은;정용연
    • 대한영상의학회지
    • /
    • 제82권5호
    • /
    • pp.1218-1230
    • /
    • 2021
  • 목적 고위험 환자에서 초기 간암 선별 검사로써 단축 자기공명영상 검사의 환자별 진단능을 기존의 고식적 간 자기공명영상검사와 비교하고자 한다. 대상과 방법 간암 고위험군에서 간 자기공명영상 검사를 시행 받은 총 201명의 환자에 대해 연구를 시행하였다. 단축 자기공명영상 검사 군의 프로토콜은 T2 강조영상, 담도기 T1 강조영상, 확산강조영상 등으로 구성되며, 두 명의 영상의학과 의사가 각각의 환자에 대해 후향적으로 단축 자기공명영상검사 군 및 고식적 자기공명영상검사 군, 두 군의 영상을 독립적으로 평가하였다. 두 연구자 간 일관성은 Cohen's kappa 값을 이용하여 비교하였다. 복합적인 참조표준을 이용하여 두 군에서 각각 진단능을 평가하여 비교하였다. 결과 79 명의 환자에서 총 93개의 간암이 발견되었다. 두 연구자 간 일관성은 두 군에서 모두 매우 양호하였다(κ = 0.839, 0.948). 단축 자기공명영상검사 군에서 민감도 및 음성예측도는 각각 94.9% 및 96.4%였으며, 이는 고식적 자기공명영상검사 군과 큰 차이를 보이지 않았다(96.2%, 97.5%). 결론 단축 자기공명영상검사는 고식적 자기공명영상검사에 비교하여 임상적으로 허용 가능한 민감도와 음성예측도를 갖는다. 따라서 간암 고위험군 환자에서 간암 선별검사로써 새로운 대안이 될 수 있을 것이다.