• Title/Summary/Keyword: Accuracy test

Search Result 4,817, Processing Time 0.03 seconds

The Use of Confidence Interval of Measures of Diagnostic Accuracy (진단검사 정확도 평가지표의 신뢰구간)

  • Oh, Tae-Ho;Pak, Son-Il
    • Journal of Veterinary Clinics
    • /
    • v.32 no.4
    • /
    • pp.319-323
    • /
    • 2015
  • The performance of diagnostic test accuracy is usually summarized by a variety of statistics such as sensitivity, specificity, predictive value, likelihood ratio, and kappa. These indices are most commonly presented when evaluations of competing diagnostic tests are reported, and it is of utmost importance to compare the accuracies of diagnostic tests to decide on the best available test for certain medical disorder. However, it is important to emphasize that specific point values of these indices are merely estimates. If parameter estimates are reported without a measure of uncertainty (precision), knowledgeable readers cannot know the range within which the true values of the indices are likely to lie. Therefore, when evaluations of diagnostic accuracy are reported the precision of estimates should be stated in parallel. To reflect the precision of any estimate of a diagnostic performance characteristic or of the difference between performance characteristics, the computation of confidential interval (CI), an indicator of precision, is widely used in medical literatures in that CIs are more informative to interpret test results than the simple point estimates. The majority of peer-reviewed journals usually require CIs to be specified for descriptive estimates, whereas domestic veterinary journals seem less vigilant on this issues. This paper describes how to calculate the indices and associated CIs using practical examples when assessing diagnostic test performance.

Comparison of Machine Learning-Based Radioisotope Identifiers for Plastic Scintillation Detector

  • Jeon, Byoungil;Kim, Jongyul;Yu, Yonggyun;Moon, Myungkook
    • Journal of Radiation Protection and Research
    • /
    • v.46 no.4
    • /
    • pp.204-212
    • /
    • 2021
  • Background: Identification of radioisotopes for plastic scintillation detectors is challenging because their spectra have poor energy resolutions and lack photo peaks. To overcome this weakness, many researchers have conducted radioisotope identification studies using machine learning algorithms; however, the effect of data normalization on radioisotope identification has not been addressed yet. Furthermore, studies on machine learning-based radioisotope identifiers for plastic scintillation detectors are limited. Materials and Methods: In this study, machine learning-based radioisotope identifiers were implemented, and their performances according to data normalization methods were compared. Eight classes of radioisotopes consisting of combinations of 22Na, 60Co, and 137Cs, and the background, were defined. The training set was generated by the random sampling technique based on probabilistic density functions acquired by experiments and simulations, and test set was acquired by experiments. Support vector machine (SVM), artificial neural network (ANN), and convolutional neural network (CNN) were implemented as radioisotope identifiers with six data normalization methods, and trained using the generated training set. Results and Discussion: The implemented identifiers were evaluated by test sets acquired by experiments with and without gain shifts to confirm the robustness of the identifiers against the gain shift effect. Among the three machine learning-based radioisotope identifiers, prediction accuracy followed the order SVM > ANN > CNN, while the training time followed the order SVM > ANN > CNN. Conclusion: The prediction accuracy for the combined test sets was highest with the SVM. The CNN exhibited a minimum variation in prediction accuracy for each class, even though it had the lowest prediction accuracy for the combined test sets among three identifiers. The SVM exhibited the highest prediction accuracy for the combined test sets, and its training time was the shortest among three identifiers.

The Effect of Earnings Quality on Financial Analysts' Dividend Forecast Accuracy: Evidence from Korea

  • NAM, Hye-Jeong
    • The Journal of Asian Finance, Economics and Business
    • /
    • v.6 no.4
    • /
    • pp.91-98
    • /
    • 2019
  • Dividend policy is an important business decision and is considered a channel to communicate a firm's performance to shareholders. Given the empirical findings that earnings quality significantly affects financial analysts' forecasting activities, it is predicted that higher earnings quality would positively influence forecast accuracy. Specifically, it is expected that financial analysts would forecast dividends more accurately for firms with higher earning quality. Unlike the research on financial analysts' earnings forecasts was heavily conducted, there is little study about financial analysts' dividend forecasts. This paper examines the effect of earnings quality on financial analysts' dividend forecast accuracy. We use a sample of South Korean firms for the period of 2011-2015 for multivariate regression. Earnings quality is measured by accruals quality and performance-adjusted discretionary accruals followed by prior studies. We first compare the accuracy between dividend forecasts and earnings forecasts using t-test and Wilcoxon singed-rank test. It is confirmed that financial analysts' dividend forecasts are more accurate than earnings forecasts in Korea. We find that financial analysts' dividend forecasts are more accurate for firms with higher earnings quality. We also find that the result is still valid after controlling for the accuracy of financial analysts' earnings forecasts. This confirms that earnings quality positively affects financial analysts' dividend forecasts.

Development of accuracy enhancement system for boron meters using multisensitive detector for reactor safety

  • Sung, Si Hyeong;Kim, Hee Reyoung
    • Nuclear Engineering and Technology
    • /
    • v.52 no.3
    • /
    • pp.538-543
    • /
    • 2020
  • Boric acid is used as a coolant for pressurized-water reactors, and the degree of burnup is controlled by the concentration of boric acid. Therefore, accurate measurement of the concentration of boric acid is an important factor in reactor safety. An improved system was proposed for the accurate determination of boron concentration. A new boron-concentration measurement technique, called multisensitive detection, was developed to improve the measurement accuracy of boron meters. In previous studies, laboratory-scale experiments were performed based on different sensitivity detectors, confirming a 65% better accuracy than conventional single-detector boron meters. Based on these experimental results, an experimental system simulating the coolant-circulation environment in the reactor was constructed; accuracy analysis of the boron meter with a multisensitivity detector was performed at the actual coolant pressure and temperature. In this study, the boron concentration conversion equation was derived from the calibration test, and the accuracy of the boron concentration conversion equation was examined through a repeatability test. Through the experiment, it was confirmed that the accuracy was up to 87.5% higher than the conventional single-detector boron meter.

A Study on the Marginal Fit of Dental Prosthesis According to the W/P Ratio of Investment (매몰재의 혼수비가 치관 보철물 변연의 적합성에 미치는 영향에 관한 연구)

  • Hwang, Kyung-Sook
    • Journal of Technologic Dentistry
    • /
    • v.18 no.1
    • /
    • pp.67-72
    • /
    • 1996
  • This test is verifying for influence of W/P ratio of investment upon dental prosthesis Firstly we made 40 MOD die and divide 4 groups, each group take 0.2 different w/p ratio grade such as 0.35, 0.37, 0.39 and 0.41. The method of data analysis applied were by ANOVA, Tukey test and Mann-Whiney and Kruskal Wallis test. The finding of this study were as follows : 1. The 0.37 w/p ratio group showed most accurte margin due to $15.8{\mu}m$ gap between margin and die which keep up with manufacture's instruction and 0.35 w/p ratio group was followed as second accuracy group o 새 $48.3{\mu}m$ gap between margin and die, 0.39 w/p ratio group showed $101{\mu}m$ gap and 0.41 w/p ratio group showed $129.8{\mu}m$ gap. 2. As to the relationship of the margin accuracy between 4 different grade of w/p ratio groups, each group was statistically significant(P<0.01). Also the all groups were statistically significant except between 0.35 and 0.37 groups between 0.39 and 0.41 groups, and between 0.35 and 0.39 groups. 3. A consequence of Mann-Whitney & Kruskal-Wallis test for marginal accuracy between 4 different grade of w/p ratio was statistically significant as same as above ANOVA test result. Also Tukey test for verifying similarity from each group showed same as above.

  • PDF

The Effect of Education Program on Primiparas로 Knowledge, Confidence and Accuracy of Behavior in Newborn Care (신생아 돌보기 교육 프로그램이 초산모의 신생아 돌보기 지식, 자신감, 행동 정확도에 미치는 효과)

  • 서영미
    • Journal of Korean Academy of Nursing
    • /
    • v.28 no.4
    • /
    • pp.1060-1074
    • /
    • 1998
  • This study was to find whether the educational program contributed to the increase of knowledge, confidence, and accuracy of behavior in newborn care of the primiparas. The educational program consistes of individual lectures, demostrations, discussion, and practice of newborn care. Also two telephone counseling with the subjects after they are discharged from hospital. This study is a quasi-experimental design using non-equivalent control group pretest-posttest design. Data collection was done from July 21 to Oct 4 in 1997. The subjects were selected from 2 general hospitals and 1 university hosipital in C city, Subjects were 44 primiparas(control group 22, experimental group 22). they were tested on knowledge, confidence, and accuracy of behavior in newborn care. A pretest was done 2-3 days after vaginal delivary(5-6 days after c-sec delivary). A posttest was done 21-28 day(vaginal delivary, c-sec delivary) after delivary. The instruments used for this study were knowledge scale about newbon care developed by the reserarcher, Pharis' confidence scale modified by the researcher and accuracy of behavior scale developed by the reserarcher. Primiparas' knowledge and confidence was tested by questionnaire and Primiparas' accuracy of behavior was tested by structured observational method. Analysis of data was done by using of χ²- test, t -test, paired t -test. The results of this study are summarized as follows : 1) Knowledge of the experimental group was significant higher than the control group(t=-4.94, P=.000). 2) Confidence of the experimental group was significant higher than the control group(t=-.262, P=.012). 3) Accuracy of behavior of the experimental group was significant higher than the control group (t=-.969, P=.000). In conclusion, the newborn care education along with intensive telephon counseling shows a significant promotion of newbon care in primiparas. Thus this program can be recommended as an intervention model for the newborn and primiparas.

  • PDF

A Study on the Map Accuracy Assessment of Positioning Data Using Statistical Approach Analysis (오차분석을 이용한 지도 위치정확도 평가기법에 관한 연구)

  • Cho, Bong-Whan;Lee, Yong-Woong;Choi, Sun-Yong
    • Journal of Korean Society for Geospatial Information Science
    • /
    • v.5 no.1 s.9
    • /
    • pp.71-80
    • /
    • 1997
  • This paper suggests a Map Accuracy Standards by analyzing U.S. National Map Accuracy Standards, by considering korean terrain feature and statistical error theory for paper and digital maps on the scale of 1:50,000. Map accuracy standards require horizontal accuracy to be reported as a circular error with 90% confidence level through Linear Error Probable(LEP) theory and Circular Error Probable(CEP) theory. In order to verify the proposed methodology for positioning accuracy testing, several kinds of test point were selected and tested. These test points were extracted at the centers of roads and bridges, the comers of the independent building, the edges of geographical botany, and the tops of mountains. The positioning accuracy assessment was peformed by comparing the positions of test points in digital maps generated three different sources with those acquired by high accurate GPS surveying. The digital maps were produced from aerial photographs and SPOT satellite image using analytical plotter and 1:50,000 paper map.

  • PDF

A Study on the Land Cover Classification and Cross Validation of AI-based Aerial Photograph

  • Lee, Seong-Hyeok;Myeong, Soojeong;Yoon, Donghyeon;Lee, Moung-Jin
    • Korean Journal of Remote Sensing
    • /
    • v.38 no.4
    • /
    • pp.395-409
    • /
    • 2022
  • The purpose of this study is to evaluate the classification performance and applicability when land cover datasets constructed for AI training are cross validation to other areas. For study areas, Gyeongsang-do and Jeolla-do in South Korea were selected as cross validation areas, and training datasets were obtained from AI-Hub. The obtained datasets were applied to the U-Net algorithm, a semantic segmentation algorithm, for each region, and the accuracy was evaluated by applying them to the same and other test areas. There was a difference of about 13-15% in overall classification accuracy between the same and other areas. For rice field, fields and buildings, higher accuracy was shown in the Jeolla-do test areas. For roads, higher accuracy was shown in the Gyeongsang-do test areas. In terms of the difference in accuracy by weight, the result of applying the weights of Gyeongsang-do showed high accuracy for forests, while that of applying the weights of Jeolla-do showed high accuracy for dry fields. The result of land cover classification, it was found that there is a difference in classification performance of existing datasets depending on area. When constructing land cover map for AI training, it is expected that higher quality datasets can be constructed by reflecting the characteristics of various areas. This study is highly scalable from two perspectives. First, it is to apply satellite images to AI study and to the field of land cover. Second, it is expanded based on satellite images and it is possible to use a large scale area and difficult to access.

Diagnostic Accordance Rate and Accuracy Between Cytological and Histological Test in Lung Disease (폐질환에 있어 세포검사와 조직검사의 진단 일치율 및 정확도에 대한 조사 연구)

  • Kim, Sung-Chul;Ro, Joung-Whan;Kim, Tai-Jeon
    • Korean Journal of Clinical Laboratory Science
    • /
    • v.41 no.4
    • /
    • pp.189-195
    • /
    • 2009
  • Lung cancer is a type of cancer with high mortality; its 5-year survival rate is at a low 14%. Related cytological tests include sputum, bronchial brushing, bronchial washing and fine needle aspiration cytology test etc. From the test specimens in which sputum, bronchial brushing, bronchial washing, and fine needle aspiration cytology were performed, the sensitivity, specificity and accuracy between cytology test and histology test. In the sputum test, sensitivity was 27.71% and specificity was 98.02%, and the bronchial brushing test showed sensitivity of 93.33% and a specificity of 91.3%. The bronchial washing test was a sensitivity of 53.7% and its specificity was 98.9%, and the fine needle aspiration cytology test showed sensitivity and specificity were 88.46% and 72.97%, respectively. In the specimens diagnosed as normal at the sputum test, malignant diagnosis was found in 21 specimens of bronchial brushing, 30 cases of bronchial washings and 37 cases of fine needle aspiration cytology specimens. In the specimens diagnosed as normal at the bronchial washing test, malignant diagnosis was found in 5 specimens of sputum, 7 specimens of bronchial brushin and 1 cases of fine needle aspiration cytology. One specimens found to be normal in fine needle aspiration cytology turned out to maligant in sputum test. The result of this research shows that, in diagnosis lung cancer, a test method of high sensitivity and specificity should be pursued. However, depending on the location and malignancy of the illness, diagnosis may not be obtained in some cases. Therefore, we conclude that the cytological tests performed for lung cancer testing such as sputum, bronchial brushing, bronchial washing, and fine needle aspiration cytology should be carried out in a mutually complementary manner.

  • PDF

High-Accuracy Coastdown Test Method by Distance-Time Measurement: II. Development of a Short Distance Method and its Evaluation (거리·시간 측정에 의한 고정도 타행시험법: II. 단거리 방법의 개발 및 시험)

  • Hur, N.G.;Ahn, I.K.;Petrushov, V.A.
    • Transactions of the Korean Society of Automotive Engineers
    • /
    • v.3 no.3
    • /
    • pp.1-8
    • /
    • 1995
  • In the companion paper of the present paper, a coast down test method to determine the resistance forces on running vehicle based on the distance-time measurement was explained along with the suggestions to improve its accuracy and testing methodology. In the present paper some of the suggestions discussed previously are implemented and actually road tested to see the applicability of the improved method(short distance method) in the field. From the results. it is shown that the short distance method which requires only 600m long proving ground road gives at least comparable results on the accuracy compared to the original S-t method which requires 2000m. It is hoped that the present method be further refiend to give more accurate results.

  • PDF