• Title/Summary/Keyword: Kappa statistics

Search Result 103, Processing Time 0.023 seconds

Level of Agreement and Factors Associated With Discrepancies Between Nationwide Medical History Questionnaires and Hospital Claims Data

  • Kim, Yeon-Yong;Park, Jong Heon;Kang, Hee-Jin;Lee, Eun Joo;Ha, Seongjun;Shin, Soon-Ae
    • Journal of Preventive Medicine and Public Health
    • /
    • v.50 no.5
    • /
    • pp.294-302
    • /
    • 2017
  • Objectives: The objectives of this study were to investigate the agreement between medical history questionnaire data and claims data and to identify the factors that were associated with discrepancies between these data types. Methods: Data from self-reported questionnaires that assessed an individual's history of hypertension, diabetes mellitus, dyslipidemia, stroke, heart disease, and pulmonary tuberculosis were collected from a general health screening database for 2014. Data for these diseases were collected from a healthcare utilization claims database between 2009 and 2014. Overall agreement, sensitivity, specificity, and kappa values were calculated. Multiple logistic regression analysis was performed to identify factors associated with discrepancies and was adjusted for age, gender, insurance type, insurance contribution, residential area, and comorbidities. Results: Agreement was highest between questionnaire data and claims data based on primary codes up to 1 year before the completion of self-reported questionnaires and was lowest for claims data based on primary and secondary codes up to 5 years before the completion of self-reported questionnaires. When comparing data based on primary codes up to 1 year before the completion of selfreported questionnaires, the overall agreement, sensitivity, specificity, and kappa values ranged from 93.2 to 98.8%, 26.2 to 84.3%, 95.7 to 99.6%, and 0.09 to 0.78, respectively. Agreement was excellent for hypertension and diabetes, fair to good for stroke and heart disease, and poor for pulmonary tuberculosis and dyslipidemia. Women, younger individuals, and employed individuals were most likely to under-report disease. Conclusions: Detailed patient characteristics that had an impact on information bias were identified through the differing levels of agreement.

A Study on Wildlife Habitat Suitability Modeling for Goral (Nemorhaedus caudatus raddeanus) in Seoraksan National Park (설악산 산양을 대상으로 한 야생동물 서식지 적합성 모형에 관한 연구)

  • Seo, Chang Wan;Choi, Tae Young;Choi, Yun Soo;Kim, Dong Young
    • Journal of the Korean Society of Environmental Restoration Technology
    • /
    • v.11 no.3
    • /
    • pp.28-38
    • /
    • 2008
  • The purpose of this study are to compare existing presence-absence predictive models and to predict suitable habitat for Goral (Nemorhaedus caudatus raddeanus) that is an endangered and protected species in Seoraksan national park using the best model among existing predictive models. The methods of this study are as follows. First, 375 location data and 9 environmental data layers were implemented to build a model. Secondly, 4 existing presence-absence models : Generalized Linear Model (GLM), Generalized Addictive Model (GAM), Classification and Regression Tree (CART), and Artificial Neural Network (ANN) were tested to predict the Goal habitat. Thirdly, ROC (Receiver Operating Characteristic) and Kappa statistics were used to calculate a model performance. Lastly, we verified models and created habitat suitability maps. The ROC AUC (Area Under the Curve) and Kappa values were 0.697/0.266 (GLM), 0.729/0.313 (GAM), 0.776/0.453 (CART), and 0.858/0.559 (ANN). Therefore, ANN was selected as the best model among 4 models. The models showed that elevation, slope, and distance to stream were the significant factors for Goal habitat. The ratio of predicted area of ANN using a threshold was 31.29%, but the area decreased when human effect was considered. We need to investigate the difference of various models to build a suitable wildlife habitat model under a given condition.

The Measures of Agreement between the Classification Standard of BMI and that of CDRS in Women university students (여자대학생의 BMI와 신체상평정척도(CDRS) 분류기준에 대한 일치도 검정)

  • Nam, Duck-Hyun
    • Journal of Digital Convergence
    • /
    • v.14 no.2
    • /
    • pp.519-527
    • /
    • 2016
  • This research aims at investigating the measures of agreement between BMI classification standard and that of 9-point contour drawing rating scale(CDRS), verifying their usefulness for the application to the filed, examining university students' substantial understanding of their bodies, and offering correct information regarding the distorted recognition of their bodies. In order to examine the measures of agreement between the classification standard of BMI and that of CDRS, and the women university students' recognition of their body images depending on BMI, Cross tabulation was carried out, and ${\chi}^2$, Spearman rank correlation coefficient and kappa statistics were calculated. As the analysis results, the classification standards of CDRS and BMI judged by general female college students showed statistically the correlation was high with ${\rho}=.719$(p<.001) and an average level of confirmity with ${\kappa}=.506$(p<.001). Based on these results, regarding body shape, sizes and shapes according to racial characteristics need to be controlled later.

Maximum diameter versus volumetric assessment for the response evaluation of vestibular schwannomas receiving stereotactic radiotherapy

  • Choi, Youngmin;Kim, Sungmin;Kwak, Dong-Won;Lee, Hyung-Sik;Kang, Myung-Koo;Lee, Dong-Kun;Hur, Won-Joo
    • Radiation Oncology Journal
    • /
    • v.36 no.2
    • /
    • pp.114-121
    • /
    • 2018
  • Purpose: To explore the feasibility of maximum diameter as a response assessment method for vestibular schwannomas (VS) after stereotactic radiosurgery or fractionated stereotactic radiotherapy (RT), we analyzed the concordance of RT responses between maximum diameters and volumetric measurements. Materials and Methods: Forty-two patients receiving curative stereotactic radiosurgery or fractionated stereotactic RT for VS were analyzed retrospectively. Twelve patients were excluded: 4 did not receive follow-up magnetic resonance imaging (MRI) scans and 8 had initial MRI scans with a slice thickness >3 mm. The maximum diameter, tumor volume (TV), and enhanced tumor volume (ETV) were measured in each MRI study. The percent change after RT was evaluated according to the measurement methods and their concordances were calculated with the Pearson correlation. The response classifications were determined by the assessment modalities, and their agreement was analyzed with Cohen kappa statistics. Results: Median follow-up was 31.0 months (range, 3.5 to 86.5 months), and 90 follow-up MRI studies were analyzed. The percent change of maximum diameter correlated strongly with TV and ETV (r(p) = 0.85, 0.63, p = 0.000, respectively). Concordance of responses between the Response Evaluation Criteria in Solid Tumors (RECIST) using the maximum diameters and either TV or ETV were moderate (kappa = 0.58; 95% confidence interval, 0.32-0.85) or fair (kappa = 0.32; 95% confidence interval, 0.05-0.59), respectively. Conclusions: The percent changes in maximum diameter and the responses in RECIST were significantly concordant with those in the volumetric measurements. Therefore, the maximum diameters can be used for the response evaluation of VS following stereotactic RT.

Significance of Hormone Receptor Status in Comparison of 18F -FDG-PET/CT and 99mTc-MDP Bone Scintigraphy for Evaluating Bone Metastases in Patients with Breast Cancer: Single Center Experience

  • Teke, Fatma;Teke, Memik;Inal, Ali;Kaplan, Muhammed Ali;Kucukoner, Mehmet;Aksu, Ramazan;Urakci, Zuhat;Tasdemir, Bekir;Isikdogan, Abdurrahman
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.16 no.1
    • /
    • pp.387-391
    • /
    • 2015
  • Background: Fluorine-18 deoxyglucose positron emission tomography computed tomography (18F-FDG-PET/CT) and bone scintigraphy (BS) are widely used for the detection of bone involvement. The optimal imaging modality for the detection of bone metastases in hormone receptor positive (+) and negative (-) groups of breast cancer remains ambiguous. Materials and Methods: Sixty-two patients with breast cancer, who had undergone both 18F-FDG-PET/CT and BS, being eventually diagnosed as having bone metastases, were enrolled in this study. Results: 18F-FDG-PET/CT had higher sensitivity and specificity than BS. Our data showed that 18F-FDGPET/CT had a sensitivity of 93.4% and a specificity of 99.4%, whiel for BS they were 84.5%, and 89.6% in the diagnosis of bone metastases. ${\kappa}$ statistics were calculated for 18F-FDGPET/CT and BS. The ${\kappa}$-value was 0.65 between 18F-FDG-PET/CT and BS in all patients. On the other hand, the ${\kappa}$-values were 0.70 in the hormone receptor (+) group, and 0.51 in hormone receptor (-) group. The ${\kappa}$-values suggested excellent agreement between all patient and hormone receptor (+) groups, while the ${\kappa}$-values suggested good agreement in the hormone receptor (-) group. Conclusions: The sensitivity and specificity for 18F-FDG-PET/CT were higher than BS in the screening of metastatic bone lesions in all patients. Similarly 18F-FDG-PET/CT had higher sensitivity and specificity in hormone receptor (+) and (-) groups.

Correspondence of Elementary School Students Anticipated Vocations, Perceived Competencies, and Interests (초등학생의 직업기대와 능력지각 및 흥미 일치도 분석)

  • Seo, Ji-Yoon;Kim, Mi-Kyoung;Song, Soo-Yong
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.14 no.1
    • /
    • pp.184-193
    • /
    • 2013
  • This study examined a correspondence of children's anticipated vocations, perceived competencies, and interests. For the purpose, this study asked 659 primary school students what activities they liked, those they thought they were good at, and what job they expected when they grew up. The responses were coded into RIASEC Holland codes and agreement across the three questions was examined using kappa statistics. Results indicated that there was a correspondence of children's anticipated vocations, perceived competencies, and interests. When broken down into separate examinations by gender, males and females had significant kappas for agreement between vocation and competence. And the correspondence of competence and interest was significant for males too. We couldn't examine females' case because they didn't answer C-type of Holland. Examinations of the results by grade demonstrated that 5th-grade and 6th-grade had significant kappas for agreement between vocation and competence. However the correspondence of vocation and interest was significant for 5th-grade. the correspondence of competence and interest was significant for 5th-grade too. We couldn't examine 6th-grade's case because they didn't answer C-type of Holland. The result obtained from this study indicate that there is a correspondence of children's anticipated vocations, perceived competencies, and interests. Such a result means that children, 5th-grade and 6th-grade, can consider their competencies and interests with their vocations. The findings are especially relevant for counselors and teachers working with children.

A modified Lee-Carter model based on the projection of the skewness of the mortality (왜도 예측을 이용한 Lee-Carter모형의 사망률 예측)

  • Lee, Hangsuck;Baek, Changryong;Kim, Jihyeon
    • The Korean Journal of Applied Statistics
    • /
    • v.29 no.1
    • /
    • pp.41-59
    • /
    • 2016
  • There have been continuous improvements in human life expectancy. Life expectancy is as a key factor in an aging population and can wreak severe damage on the financial integrity of pension providers. Hence, the projection of the accurate future mortality is a critical point to prevent possible losses to pension providers. However, improvements in future mortality would be overestimated by a typical mortality projection method using the Lee-Carter model since it underestimates the mortality index ${\kappa}_t$. This paper suggests a mortality projection based on the projection of the skewness of the mortality versus the typical mortality projection of the Lee-Carter model based on the projection of the mortality index, ${\kappa}_t$. The paper shows how to indirectly estimate future t trend with the skewness of the mortality and compares the results under each estimation method of the mortality index, ${\kappa}_t$. The analysis of the results shows that mortality projection based on the skewness presents less improved mortality at an elderly ages than the original projection.

Use of beta-P distribution for modeling hydrologic events

  • Murshed, Md. Sharwar;Seo, Yun Am;Park, Jeong-Soo;Lee, Youngsaeng
    • Communications for Statistical Applications and Methods
    • /
    • v.25 no.1
    • /
    • pp.15-27
    • /
    • 2018
  • Parametric method of flood frequency analysis involves fitting of a probability distribution to observed flood data. When record length at a given site is relatively shorter and hard to apply the asymptotic theory, an alternative distribution to the generalized extreme value (GEV) distribution is often used. In this study, we consider the beta-P distribution (BPD) as an alternative to the GEV and other well-known distributions for modeling extreme events of small or moderate samples as well as highly skewed or heavy tailed data. The L-moments ratio diagram shows that special cases of the BPD include the generalized logistic, three-parameter log-normal, and GEV distributions. To estimate the parameters in the distribution, the method of moments, L-moments, and maximum likelihood estimation methods are considered. A Monte-Carlo study is then conducted to compare these three estimation methods. Our result suggests that the L-moments estimator works better than the other estimators for this model of small or moderate samples. Two applications to the annual maximum stream flow of Colorado and the rainfall data from cloud seeding experiments in Southern Florida are reported to show the usefulness of the BPD for modeling hydrologic events. In these examples, BPD turns out to work better than $beta-{\kappa}$, Gumbel, and GEV distributions.

Reliability and Validity of the Korean Version of ISAAC Questionnaire (한국판 국제 소아천식 및 알레르기 질환 연구 설문지의 신뢰도 및 타당도 연구)

  • Choi, Seong-Woo;Ju, Yeong-Su;Kim, Dae-Sung;Kim, Jae-Yong;Kwon, Ho-Jang;Kang, Dae-Hee;Lee, Sang-Il;Cho, Soo-Hun
    • Journal of Preventive Medicine and Public Health
    • /
    • v.31 no.3 s.62
    • /
    • pp.361-371
    • /
    • 1998
  • Recent increases of asthma and allergies in childhood made the need for a standardized approach to international and regional comparisons of their prevalence and severity. To address these issues, 'International Study of Asthma and Allergies in Childhood (ISAAC)' is currently underway. In Korea, 'Nationwide Study of Asthma and Allergies in Korean Children' began in 1995 according to ISAAC protocol. ISAAC written and video questionnaires were used in this survey, but their reliability and validity were not evaluated properly yet. In this study, our aim was to evaluate the reliability and validity of two kinds of questionnaires and their usefulness in international and regional comparisons. The test and retest of two questionniares were completed by male(n=110) and female(n=111) middle school students with two and three weeks interval each. Kappa(or weighted kappa) were calculated from each questions and validity coefficients were estimated from those statistics. In Korean version of written questionnaire, the questions for allergic rhinitis, atopic dermatitis, allergic conjunctivitis, and food allergy proved to have high kappa values (or weighted kappa values) and validity coefficients and they can be used in further studies without any correction. But some questions about asthma(especially nocturnal cough, wheezing in exercise, and severe asthma) and drug allergy need to be revised for better under-standing to study subjects. Video questionnaire has the same degree of reliability and validity when compared to written questionnaire and this is the unexpected result. Accordingly, it also need to be revised to overcome the racial and cultural differences of the study subjects. In conclusion, the Korean version of written and video questionnaires may be considered to be useful methods in international and regional comparisons of asthma and allergic diseases in childhood after correction of some questions.

  • PDF

Reliability of a Questionnaire for Women's Reproductive History (여성의 출산력과 초경 및 폐경 연령에 대한 설문지의 신뢰도)

  • Ko, Kwang-Pil;Park, Sue-Kyung;Kim, Yeon-Ju;Bae, Ji-Suk;Jun, Jae-Kwan;Gwack, Jin;Yoo, Keun-Young
    • Journal of Preventive Medicine and Public Health
    • /
    • v.41 no.3
    • /
    • pp.181-185
    • /
    • 2008
  • Objectives : This study was performed to evaluate the reproducibility of a questionnaire concerned with reproductive history and to ascertain which characteristics of the subjects (age, the visit-revisit intervals, education and chronic disease) are associated with good reliability in the Korean Multi-Center Cancer Cohort (KMCC) study. Materials and Methods: A total of 19,688 participants were enrolled between 1993 and 2004. Among them, we selected 386 participants who were aged 40 or more and who re-visited within 8 years after the first visit. Reliability was measured by the percent agreement according to error range for the continuous variables and the percent agreement and kappa statistics for the categorical variables. Results : The pregnancy histories were reliable (kappa=0.67) and the reasons for being menopausal among the postmenopausal women were also reliable (kappa=0.92). The percent agreement of the breast-feeding history was high (96.1%), although the kappa statistic was low. For the continuous variables, when the error range of one variable was considered to be reliable, the percent agreement of the age at menarche and the age at the first full term pregnancy was good (69.4% and 83.6%), whereas that of the age at menopause was low (51.5%). The factors associated with high reliability were a younger age, the presence of chronic disease and a short visit-revisit time interval. Conclusions : The agreements for parity, the reasons for menopause, and the breastfeeding history in the reproductive history questionnaire used in the KMCC were relatively good. The questionnaire for the menarche age and the menopausal age might have lower reliability due to the difference between Korean age and American age. To obtain reliable information, more attention should be given to the items in questionnaire-based surveys, and especially for surveying old-aged women.