• Title/Summary/Keyword: Agreement index

Search Result 514, Processing Time 0.025 seconds

Should Cut-Off Values of the Risk of Malignancy Index be Changed for Evaluation of Adnexal Masses in Asian and Pacific Populations?

  • Yavuzcan, Ali;Caglar, Mete;Ozgu, Emre;Ustun, Yusuf;Dilbaz, Serdar;Ozdemir, Ismail;Yildiz, Elif;Gungor, Tayfun;Kumru, Selahattin
    • Asian Pacific Journal of Cancer Prevention
    • /
    • v.14 no.9
    • /
    • pp.5455-5459
    • /
    • 2013
  • Background: The risk of malignancy index (RMI) for the evaluation of adnexal masses is a sensitive tool in certain populations. The best cut off value for RMI 1, 2 and 3 is 200. The cut off value of RMI-4 to differentiate benign from malignant lesions is 450. Our aim was to evaluate the efficiency of four different malignancy indexes (RMI1-4) in a homogeneous population. Materials and Methods: We evaluated a total of 153 non-pregnant women with adnexal masses who did not have a history of malignancy and who were above 18 years of age. Results: A cut-off value of 250 for RMI-1 provided 95.9% inter-observer agreement, yielding 95.9% specificity, 93.5% negative predictive value, 75.0% sensitivity and 82.8% positive predictive value. A cut-off value of 250 for RMI-1 showed high performance in preoperative diagnosis of invasive malignant lesions than cut-off value of 200 in our population. A cut-off value of 350 for RMI-2 provided 94.5% inter-observed agreement, yielding 94.2% specificity, 93.4% negative predictive value, 75.0% sensitivity and 77.4% positive predictive value. RMI-2 showed the higher performance when the cut-off value was set at 350 in our population. A cut-off value of 250 provided 95.2% inter-observer agreement, yielding 95.0% specificity, 93.2% negative predictive value, 75.0% sensitivity, and 88.0% positive predictive value. RMI-3 showed the highest performance to diagnose malignant adnexal masses when the cut-off value was set at 250. In our study, RMI-4 showed similar statistical performance when the cut-off value was set at 400 [(Kappa: 0.684/p=0.000), yielding 93.8% inter-observer agreement, 93.4% specificity, 93.4% negative predictive value, 75.0% sensitivity, and 75.0% negative predictive value]. Conclusions: We showed successful utilization of RMIs in preoperative differentiation of benign from malignant masses. Many studies conducted in Asian and Pacific countries have reported different cut-off values as was the case in our study. We think that it is difficult to determine universally accepted cut-off values for RMIs for common use around the globe.

Comparison of Calibrations using Modified SWAT Auto-calibration Tool with Various Efficiency Criteria (다양한 검증 지수를 이용한 SWAT 자동 보정 비교 평가)

  • Kang, Hyun-Woo;Ryu, Ji-Chul;Kim, Nam-Won;Kim, Seong-Joon;Engel, Bernard A.;Lim, Kyoung-Jae
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2011.05a
    • /
    • pp.19-19
    • /
    • 2011
  • The appraisals of hydrology model behavior for flow and water quality are generally performed through comparison of simulated data with observed ones. To perform appraisal of hydrology model, some criteria are often used, such as coefficient of determination ($R^2$), Nash and Sutcliffe model efficiency coefficient (NSE), index of agreement (d), modified forms of NSE and d, and relative efficiency criteria NSE and d. These criteria are used not only for hydrology model estimations also for various comparisons of two data sets; This NSE has been often used for SWAT calibration. However, it has been known that the NSE value has some limitations in evaluating hydrology at watersheds under monsoon climate because this statistic is largely affected by higher values in the data set. To overcome these limitations, the SWAT auto-calibration module was enhanced with K-means clustering and direct runoff/baseflow modules. However the NSE is still being used in this module to evaluate model performance. Therefore, the SWAT Auto-calibration module was modified to incorporate alternative efficiency criteria into the SWAT K-means/direct runoff-baseflow auto-calibration module. It is expected that this enhanced SWAT auto-calibration module will provide better calibration capability of SWAT model for all flow regime.

  • PDF

Agreement between Smoking Self-report and Urine Cotinine among Adolescents (청소년 흡연 자가보고와 요코티닌 검사간의 일치도)

  • Park, No-Rai;Ham, Jin-Kyung;Jeong, Ihn-Sook
    • Journal of Preventive Medicine and Public Health
    • /
    • v.37 no.2
    • /
    • pp.127-132
    • /
    • 2004
  • Objectives : Cotinine, the major metabolite of nicotine, is a useful marker of exposure to tobacco smoke and self-reporting of smoking status is thought not to be reliable. This study aimed to evaluate the agreement between the smoking self-report among adolescents and the urinary cotinine test. Methods : The study subjects were 1226 middle and high school students in Hanam city, who were selected by stratified random sampling. The self-report about smoking behavior was compared with urine cotinine value measured with PBM $AccuSign^{\circledR}fi$ Nicotine(Princeton BioMeditech Corporation, USA). The percentage agreement, kappa and 95% confidence interval(CI) were calculated. Results : The overall percentage agreement was 88.6%, and those for boys, girls, middle school, general school and vocational school students were 87.3%, 90.1%, 93.7%, 85,5%, 90.7%, and 78.4%, respectively. The overall kappa index was 0.46(95% CI=0.39-0.54)for overall, .and those for boys, girls, middle school, general school and vocational school students were 0.56(95% CI=0.48-0.65), 0.20(95% CI=0.07-0.32), 0.21(95% CI=0.09-0.34), 0.55(95% CI=0.47-0.64), 0.42(95% CI=0.33-0.52), and 0.48(95% CI=0.36-0.60), respectively. Conclusion : The percentage agreement was relatively high but the kappa values very low for girls, and middle school students. Though the prevalence bias can be influenced by these results, the self-report was not a sufficient tool for the evaluation of adolescents' smoking status, especially in girls or middle school students.

A Study on the Trade Structure between Korea and RCEP Participating Countries (한국과 RCEP 참여국가와의 무역구조에 관한 연구)

  • Kim, Min-Soo
    • The Journal of Industrial Distribution & Business
    • /
    • v.9 no.1
    • /
    • pp.89-97
    • /
    • 2018
  • Purpose - The Regional Comprehensive Economic Partnership (RCEP) among 16 countries including South Korea, the largest free trade agreement in the Asia-Pacific region, will be concluded next year. The participating countries decided to pursue a comprehensive and high -quality agreement, while ensuring flexibility considering development level of each country. In this study, trade structures between nations from 2005 through 2016 were examined to see the impact that this agreement will have on Korea and to come up with effective countermeasures. Research design, data, and methodology - The method of analysis includes the analysis of the trade matrix, which is useful for identifying the dependency of the individual countries on the market in the region and the reciprocal dependency of the member countries on the market, and the index of intensity of trade, which is useful for figuring out the share of trade between the parties in total trade. Results - The results showed that first, the international trade coefficients of Vietnam and Philippines are higher than those of China and Japan. Secondly, the international inducement coefficients between China and Japan were high, and that between Indonesia and Burma were low, indicating that Korea's exports did not have much effect on export increase of these countries. Third, as a result of analyzing Korea's trade intensity, it was found that export intensity and import intensity were greater than 1 in Vietnam and Philippines, which shows that there is a high degree of relational bond with these countries. India and Laos countries still have a low level of relational bond, which indicates that there is room for improvement in economic relations when the agreement is concluded. After the signing of the agreement in the future, more diverse industrial structures should be continuously studied. Conclusions - The analysis of trade matrix, trade structure, trade inducement coefficient and trade intensity between Korea and RCEP participating countries shows that the majority of the countries have the high level of economic relationship with Korea. Korea should drive a harder bargain when negotiating the terms of the RCEP, in comparison with the level of the existing FTA agreement excluding Japan.

Interrater Reliability in the Content Analysis of Preparatory Information for Mechanically Ventilated Patients (인공호흡기 사용 환자들에게 제공된 예비적 정보에 대한 내용분석의 측정자간 신뢰도)

  • Kim Hwa-Soon
    • Journal of Korean Academy of Fundamentals of Nursing
    • /
    • v.5 no.2
    • /
    • pp.269-279
    • /
    • 1998
  • In nursing research that the data is collected through clinical observation, analysis of clinical recording or coding of interpersonal interaction in clinical areas, testing and reporting interrater reliability is very important to assure reliable results. Procedures for interrater reliability in these studies should follow two steps. The first step is to determine unitizing reliability, which is defined as consistency in the identification of same data elements in the record by two or more raters reviewing the same record. Unitizing reliability have been rarely reported in previous studies. Unitizing reliability should be tested before progressing to the next step as precondition. Next step is to determine interpretive reliability. Cohen's kappa is a preferable method of calculating the extent of agreement between observer or judges because it provides beyond-chance agreement. Despite its usefulness, kappa can sometimes present paradoxical conclusions and can be difficult to interpret. These difficulties result from the feature of kappa which is affected in complex ways by the presence of bias between observers and by true prevalence of certain categories. Therefore, percentage agreement should be reported with kappa for adequate interpretation of kappa. The presence of bias should be assessed using the bias index and the effect of prevalence should be assessed using the prevalence index. Researchers have been reported only global reliability reflecting the extent to which coders can consistently use the whole coding system across all categories. Category-by-category reliability also need to be reported to inform the possibility that some categories are harder to use than others.

  • PDF

Reliability of Scapular Downward Rotation Measurement in Subjects With Scapular Downward Rotation Syndrome

  • Choi, Woo-Jeong;Lee, Ji-Hyun;Jeong, Hyo-Jung;Yoon, Tae-Lim;Cynn, Heon-Seock
    • Physical Therapy Korea
    • /
    • v.21 no.3
    • /
    • pp.73-79
    • /
    • 2014
  • The purposes of the current study were to (1) estimate the inter-rater agreement for visual assessment of scapular downward rotation (SDR), (2) develop the scapular downward rotation index (SDRI) as a method to measure SDR objectively and quantitatively, and (3) analyze the intra- and inter-rater reliability of the SDRI. Twenty subjects with scapular downward rotation syndrome (SDRS) were recruited for this study. The visual assessment and the measurement for the SDRI were conducted by two examiners in two sessions each. The SDRI [$(a-b){\div}a{\times}100$] is calculated with the measurement of two linear distances: One is a perpendicular distance from the root of the scapular spine to the thoracic mid-line (a), and the other is a perpendicular distance from the inferior angle of the scapula to the thoracic mid-line (b). Cohen's kappa coefficient was calculated to estimate the inter-rater agreement for visual assessment. Intra-class correlation coefficients (ICCs) with a 95% confidence interval (CI), the standard error of measurement, and minimal detectable differences were calculated to assess intra- and inter-rater reliability of SDR measurement using the SDRI. The results indicated that the kappa coefficient of inter-rater agreement for visual assessment was fair (${\kappa}=.21$). The intra-rater reliability of SDR measurement using the SDRI was excellent for examiner 1 (ICC=.92, 95% CI=.78~.97) and good for examiner 2 (ICC=.82, 95% CI=.55~.93). The inter-rater reliability was moderate (ICC=.73, 95% CI=.32~.89). These findings showed that SDR measurement using the SDRI for subjects with SDRS may be considered reliable and better than the visual assessment.

The Calculation of Physical Properties of Amino Acids Using Molecular Modeling Techniques (II)

  • Lee, Myung-Jae;Kim, Ui-Rak
    • Bulletin of the Korean Chemical Society
    • /
    • v.25 no.7
    • /
    • pp.1046-1050
    • /
    • 2004
  • Six physical properties (enthalpy, density, decomposition temperature, solubility in water, pKa values, and hydronium potential) were examined by molecular modeling techniques. The molecular connectivity index, Wiener distance index, and Ad hoc descriptor are employed as structural parameters to encode information about branching, size, cyclization, unsaturation, heteroatom content, and polarizability. This paper examines the correlation of the molecular modeling techniques parameters and the physicochemical properties of amino acids. As a results, calculated values were in agreement with experimental data in the above six physical properties of amino acids and the molecular connectivity index was superior to the other indices in fitting the calculated data.

DETECTION OF DUST LOADED AIRMASS IN SEAWIFS IMAGERY: AN EMPIRICAL DUST INDEX IN COMPARISON WITH MODEL-PREDICTED DUST DISTRIBUTION OVER THE PACIFIC IN APRIL,1998

  • Fukushima, H.;Schmidt, M.;Sohn, B.J.;Toratani, M.;Uno, I.
    • Proceedings of the KSRS Conference
    • /
    • 1999.11a
    • /
    • pp.89-94
    • /
    • 1999
  • The paper first proposes an empirical algorithm for detecting dust-loaded airmass observed by Sea Wide Field-of-view Scanner (SeaWiFS). The proposed dust index formula is based on the curvature of the spectral reflectance estimated from the SeaWiFS band 4 (510 nm band) through band 8 (865 nm band) data, assuming "clear ocean water" reflectance. Evaluation of the algorithm is made over several typical Asian dust images including the ones over the Pacific in April, 1998, when a major dust event was reported. The study analyzes the performance and the characteristics of the algorithm by comparing the satellite-derived dust index images with contemporaneous columnar concentration of dust particles predicted by a numerical dust transport model. The comparison reveals several small-scale differences although their dust distribution patterns show good agreement generally.

  • PDF

Flame Structure of Fuel-rich $CH_4/O_2/N_2$ Premixed Flame with Oxygen Enrichment (과농 조건에서 산소부화된 $CH_4/O_2/N_2$ 예혼합화염의 화염구조)

  • Lee, Ki-Yong;Kwon, Young-Suk
    • Journal of the Korean Society of Combustion
    • /
    • v.8 no.2
    • /
    • pp.1-6
    • /
    • 2003
  • Numerical simulations are conducted at atmospheric pressure in order to understand the effect of the oxygen enrichment level on structure of $CH_4/O_2/N_2$ premixed flames. Under several equivalence ratios the flame speeds are calculated and compared with those obtained from the experiments, the results of which are in good agreement. The effects of the oxygen enrichment are investigated on flames under fuel-rich conditions. As the oxygen enrichment level is increased from 0.21 to 1, the flame speed and the temperature are increased. The emission index of $CO_2$ is decreased in cases of flames for fuel rich mixtures, so the efficiency of combustion may be decreased. The maximum emission index of NO is obtained for 0.6 of the oxygen enrichment level.

  • PDF

An Evolutionary Approach to Inferring Decision Rules from Stock Price Index Predictions of Experts

  • Kim, Myoung-Jong
    • Management Science and Financial Engineering
    • /
    • v.15 no.2
    • /
    • pp.101-118
    • /
    • 2009
  • In quantitative contexts, data mining is widely applied to the prediction of stock prices from financial time-series. However, few studies have examined the potential of data mining for shedding light on the qualitative problem-solving knowledge of experts who make stock price predictions. This paper presents a GA-based data mining approach to characterizing the qualitative knowledge of such experts, based on their observed predictions. This study is the first of its kind in the GA literature. The results indicate that this approach generates rules with higher accuracy and greater coverage than inductive learning methods or neural networks. They also indicate considerable agreement between the GA method and expert problem-solving approaches. Therefore, the proposed method offers a suitable tool for eliciting and representing expert decision rules, and thus constitutes an effective means of predicting the stock price index.