• Journal of the Korean Data and Information Science Society
• /
• v.23 no.1
• /
• pp.25-37
• /
• 2012

Many statistics, such as Cohen's (1960) ${\kappa}$, Scott's (1955) ${\pi}$, and Park and Park's (2007) H have been proposed as measures of agreement to represent inter-rater reliability. This study compared bias, SE, MSE, and CV of the measures of agreement with nominal and ordinal categories in the balanced marginal distributions, and those with nominal categories in the two paradoxical situations. As a result, in all cases, AC1and Hhad smaller SE and CV.

• Journal of the Economic Geographical Society of Korea
• /
• v.16 no.3
• /
• pp.458-471
• /
• 2013

This paper addresses the limitation of a map comparison metric entitled Figure of Merit through employing a simple land change model. The metric was originally designed to overcome limitations of other existing statistics, such as Kappa, when assessing predictive accuracy of land change models. A series of comparisons between null and predicted outcomes at multiple resolutions as well as a multi-resolution Figure of Merit analysis techniques of validation are compared for spatially segregated calibration and validation datasets. The Figure of Merit at the null resolution in this paper was 57%, although future research must be done to determine if this was simply a coincidence. A Figure of Merit greater than 50% would seem to represent a "Resolution of Merit" in that the Figure of Merit at that resolution becomes greater than the error. Thus, these two metrics should be used in tandem to assess predictive accuracy of a land change model.

• Journal of health informatics and statistics
• /
• v.41 no.1
• /
• pp.49-56
• /
• 2016

Objectives: Carotid intima-media thickness (CIMT) and the presence of carotid artery plaque are widely used as preclinical markers of atherosclerosis. Due to operator dependency in measuring CIMT, it is important to evaluate the reliability of measuring CIMT and plaque between centers in a multicenter study. The purpose of this study is to evaluate the inter-rater reliability of CIMT and plaque presence among three clinical centers of the Cardiovascular and Metabolic Disease Etiology Research Center (CMERC). Methods: Twenty people without known cardiovascular disease (age 37-64) were enrolled during 2014-2015, and their left and right carotid arteries were examined repeatedly with ultrasonography for CIMT measurements at three clinical centers according to a predetermined protocol. Maximum and mean values of CIMT at distal common carotid artery were recorded. Plaque presence at a carotid artery was checked by an operator. The reliability of CIMT and carotid plaque presence was assessed using an intraclass correlation coefficient (ICC) and kappa statistics, respectively. Results: Calculated ICC was 0.647 (95% CI: 0.487-0.779) for maximum CIMT, and 0.758 (95% CI: 0.632- 0.854) for mean CIMT. In Bland Altman plot, most observed values were distributed within mean difference ${\pm}1.96$ SD ranges. Kappa statistics of plaque presence between two centers were 0.304 (center 1 and 2), 0.507 (center 1 and 3), and 0.606 (center 2 and 3), respectively, while Fleiss kappa for overall agreement was 0.445. Conclusions: The inter-rater reliability of CIMT measurements among three clinical centers turned out to be high, and the agreement of measuring carotid plaque presence was fair.

• Journal of Digital Convergence
• /
• v.14 no.2
• /
• pp.519-527
• /
• 2016

This research aims at investigating the measures of agreement between BMI classification standard and that of 9-point contour drawing rating scale(CDRS), verifying their usefulness for the application to the filed, examining university students' substantial understanding of their bodies, and offering correct information regarding the distorted recognition of their bodies. In order to examine the measures of agreement between the classification standard of BMI and that of CDRS, and the women university students' recognition of their body images depending on BMI, Cross tabulation was carried out, and ${\chi}^2$, Spearman rank correlation coefficient and kappa statistics were calculated. As the analysis results, the classification standards of CDRS and BMI judged by general female college students showed statistically the correlation was high with ${\rho}=.719$(p<.001) and an average level of confirmity with ${\kappa}=.506$(p<.001). Based on these results, regarding body shape, sizes and shapes according to racial characteristics need to be controlled later.

• Journal of the korean academy of Pediatric Dentistry
• /
• v.46 no.1
• /
• pp.48-56
• /
• 2019

The objective of this study was to examine measuring agreement between middle phalanx of the third finger and cervical vertebrae analysis for assessing skeletal maturity according to body mass index percentile. A retrospective chart view was used to select patients with body mass index data, hand - wrist radiographs and lateral cephalograms of same day. The patients were divided into 4 groups by body mass index percentile. The hand - wrist radiographs were analyzed using modified middle phalanx of the third finger method and the lateral cephalograms were categorized according to cervical vertebral maturation stage. The degree of agreement between the 2 methods of analyzing skeletal maturation was measured by calculating weighted kappa statistic according to body mass index percentile group. There was a good agreement between the 2 methods in the entire body mass index percentile group. According to the body mass index percentile group, the agreement was found to be different, and the pattern was different between boys and girls. Pediatric dentist should consider sex and weight status when evaluating growing children and adolescents because it can affect the agreement of 2 method of analyzing skeletal maturation.

• Journal of Nutrition and Health
• /
• v.53 no.3
• /
• pp.319-328
• /
• 2020

Purpose: This study was conducted to evaluate the validity of the Gene-Health application in terms of estimating energy and macronutrients. Methods: The subjects were 98 health adults participating in a weight-control intervention study. They recorded their diets in the Gene-Health application, took photographs before and after every meal on the same day, and uploaded them to the Gene-Health application. The amounts of foods and drinks consumed were estimated based on the photographs by trained experts, and the nutrient intakes were calculated using the CAN-Pro 5.0 program, which was named 'Photo Estimation'. The energy and macronutrients estimated from the Gene-Health application were compared with those from a Photo Estimation. The mean differences in energy and macronutrient intakes between the two methods were compared using paired t-test. Results: The mean energy intakes of Gene-Health and Photo Estimation were 1,937.0 kcal and 1,928.3 kcal, respectively. There were no significant differences in intakes of energy, carbohydrate, fat, and energy from fat (%) between two methods. The protein intake and energy from protein (%) of the Gene-Health were higher than those from the Photo Estimation. The energy from carbohydrate (%) for the Photo Estimation was higher than that of the Gene-Health. The Pearson correlation coefficients, weighted Kappa coefficients, and adjacent agreements for energy and macronutrient intakes between the two methods ranged from 0.382 to 0.607, 0.588 to 0.649, and 79.6% to 86.7%, respectively. Conclusion: The Gene-Health application shows acceptable validity as a dietary intake assessment tool for energy and macronutrients. Further studies with female subjects and various age groups will be needed.

• Korean Journal of Clinical Laboratory Science
• /
• v.55 no.1
• /
• pp.45-51
• /
• 2023

Canine parvovirus type 2 (CPV-2) and canine coronavirus (CCoV) are major pathogens that can induce gastroenteritis in dogs. They are highly contagious and have a high morbidity rate. There are no specific treatments available for them to date. Therefore, rapid and accurate diagnosis becomes essential. The rapid diagnostic test (RDT) for animals can be used widely in the field because it is fast and easy to use for diagnosis. Thus, this study aimed to clinically evaluate and confirm the clinical utility of CPV-2/CCoV RDT. The parameters evaluated included the limit of detection (LoD), cross-reactivity, interference, sensitivity, specificity, negative likelihood ratio (NLR), and kappa value. The results revealed that the LoD values for CPV-2 and CCoV were 9.7×10 50% tissue culture infectious dose (TCID₅₀)/mL and 2.5×10² TCID₅₀/mL, respectively. There was no cross-reactivity with nine pathogens or interference by interfering materials. The RDT showed a sensitivity of 90.0%, a specificity of 100.0%, NLR of 0.1, and a kappa value of 0.90 for diagnosing both viruses. In conclusion, CPV-2/CCoV RDT is useful as a screening test because of its high sensitivity, specificity, kappa value, and low NLR.

• Journal of Biomedical Engineering Research
• /
• v.25 no.1
• /
• pp.11-19
• /
• 2004

Stage 1 sleep provides important information regarding interpretation of nocturnal polysomnography, particularly sleep onset. It is a short transition period from wakeful consciousness to sleep. Lack of prominent sleep events characterizing stage 1 sleep is a major obstacle in automatic sleep stage scoring. In this study, we attempted to utilize simultaneous EEC and EOG processing and analyses to detect stage 1 sleep automatically. Relative powers of the alpha waves and the theta waves were calculated from spectral estimation. Either the relative power of alpha waves less than 50％ or the relative power of theta waves more than 23％ was regarded as stage 1 sleep. SEM (slow eye movement) was defined as the duration of both eye movement ranging from 1.5 to 4 seconds and regarded also as stage 1 sleep. If one of these three criteria was met, the epoch was regarded as stage 1 sleep. Results f ere compared to the manual rating results done by two polysomnography experts. Total of 169 epochs was analyzed. Agreement rate for stage 1 sleep between automatic detection and manual scoring was 79.3％ and Cohen's Kappa was 0.586 (p＜0.01). A significant portion (32％) of automatically detected stage 1 sleep included SEM. Generally, digitally-scored sleep s1aging shows the accuracy up to 70％. Considering potential difficulties in stage 1 sleep scoring, the accuracy of 79.3％ in this study seems to be robust enough. Simultaneous analysis of EOG provides differential value to the present study from previous oneswhich mainly depended on EEG analysis. The issue of close relationship between SEM and stage 1 sleep raised by Kinnariet at. remains to be a valid one in this study.