• Title/Summary/Keyword: Diagnostic validation

Search Result 168, Processing Time 0.02 seconds

Development of On-Line Diagnostic Expert System : Heuristics and Influence Diagrams (현장진단 전문가 시스템의 개발 : 휴리스틱과 인플루언스 다이아그램)

  • Kim, Young-Jin
    • Journal of Korean Institute of Industrial Engineers
    • /
    • v.23 no.1
    • /
    • pp.95-113
    • /
    • 1997
  • This paper outlines a framework for a diagnosis of a complex system with uncertain information. Sensor validation ploys a vital role in the ability of the overall system to correctly determine the state of a system monitored by imperfect sensors. Here, emphases are put on the heuristic technology and post-processor for reasoning. Heuristic Sensor Validation (HSV) exploits deeper knowledge about parameter interaction within the plant to cull sensor faults from the data stream. Finally the modified probability distributions and validated data are used as input to the reasoning scheme which is the runtime version of the influence diagram. The output of the influence diagram is a diagnostic mapping from the symptoms or sensor readings to a determination of likely failure modes. Once likely failure modes are identified, a detailed diagnostic knowledge base suggests corrective actions to improve performance. This framework for a diagnostic expert system with sensor validation and reasoning under uncertainty applies in $HEATXPRT^{TM}$ a data-driven on-line expert system for diagnosing heat rate degradation problems in fossil power plants [1].

  • PDF

Diagnostic In Spline Regression Model With Heteroscedasticity

  • Lee, In-Suk;Jung, Won-Tae;Jeong, Hye-Jeong
    • Journal of the Korean Data and Information Science Society
    • /
    • v.6 no.1
    • /
    • pp.63-71
    • /
    • 1995
  • We have consider the study of local influence for smoothing parameter estimates in spline regression model with heteroscedasticity. Practically, generalized cross-validation does not work well in the presence of heteroscedasticity. Thus we have proposed the local influence measure for generalized cross-validation estimates when errors are heteroscedastic. And we have examined effects of diagnostic by above measures through Hyperinflation data.

  • PDF

Development of On-Line Diagnostic Expert System Algorithmic Sensor Validation (진단 전문가시스템의 개발 : 연산적 센서검증)

  • 김영진
    • Transactions of the Korean Society of Mechanical Engineers
    • /
    • v.18 no.2
    • /
    • pp.323-338
    • /
    • 1994
  • This paper outlines a framework for performing intelligent sensor validation for a diagnostic expert system while reasoning under uncertainty. The emphasis is on the algorithmic preprocess technique. A companion paper focusses on heuristic post-processing. Sensor validation plays a vital role in the ability of the overall system to correctly detemine the state of a plant monitored by imperfect sensors. Especially, several theoretical developments were made in understanding uncertain sensory data in statistical aspect. Uncertain information in sensory values is represented through probability assignments on three discrete states, "high", "normal", and "low", and additional sensor confidence measures in Algorithmic Sv.Upper and lower warning limits are generated from the historical learning sets, which represents the borderlines for heat rate degradation generated in the Algorithmic SV initiates a historic data base for better reference in future use. All the information generated in the Algorithmic SV initiate a session to differentiate the sensor fault from the process fault and to make an inference on the system performance. This framework for a diagnostic expert system with sensor validation and reasonig under uncertainty applies in HEATXPRT$^{TM}$, a data-driven on-line expert system for diagnosing heat rate degradation problems in fossil power plants.

Consistency check algorithm for validation and re-diagnosis to improve the accuracy of abnormality diagnosis in nuclear power plants

  • Kim, Geunhee;Kim, Jae Min;Shin, Ji Hyeon;Lee, Seung Jun
    • Nuclear Engineering and Technology
    • /
    • v.54 no.10
    • /
    • pp.3620-3630
    • /
    • 2022
  • The diagnosis of abnormalities in a nuclear power plant is essential to maintain power plant safety. When an abnormal event occurs, the operator diagnoses the event and selects the appropriate abnormal operating procedures and sub-procedures to implement the necessary measures. To support this, abnormality diagnosis systems using data-driven methods such as artificial neural networks and convolutional neural networks have been developed. However, data-driven models cannot always guarantee an accurate diagnosis because they cannot simulate all possible abnormal events. Therefore, abnormality diagnosis systems should be able to detect their own potential misdiagnosis. This paper proposes a rulebased diagnostic validation algorithm using a previously developed two-stage diagnosis model in abnormal situations. We analyzed the diagnostic results of the sub-procedure stage when the first diagnostic results were inaccurate and derived a rule to filter the inconsistent sub-procedure diagnostic results, which may be inaccurate diagnoses. In a case study, two abnormality diagnosis models were built using gated recurrent units and long short-term memory cells, and consistency checks on the diagnostic results from both models were performed to detect any inconsistencies. Based on this, a re-diagnosis was performed to select the label of the second-best value in the first diagnosis, after which the diagnosis accuracy increased. That is, the model proposed in this study made it possible to detect diagnostic failures by the developed consistency check of the sub-procedure diagnostic results. The consistency check process has the advantage that the operator can review the results and increase the diagnosis success rate by performing additional re-diagnoses. The developed model is expected to have increased applicability as an operator support system in terms of selecting the appropriate AOPs and sub-procedures with re-diagnosis, thereby further increasing abnormal event diagnostic accuracy.

Validation Data Augmentation for Improving the Grading Accuracy of Diabetic Macular Edema using Deep Learning (딥러닝을 이용한 당뇨성황반부종 등급 분류의 정확도 개선을 위한 검증 데이터 증강 기법)

  • Lee, Tae Soo
    • Journal of Biomedical Engineering Research
    • /
    • v.40 no.2
    • /
    • pp.48-54
    • /
    • 2019
  • This paper proposed a method of validation data augmentation for improving the grading accuracy of diabetic macular edema (DME) using deep learning. The data augmentation technique is basically applied in order to secure diversity of data by transforming one image to several images through random translation, rotation, scaling and reflection in preparation of input data of the deep neural network (DNN). In this paper, we apply this technique in the validation process of the trained DNN, and improve the grading accuracy by combining the classification results of the augmented images. To verify the effectiveness, 1,200 retinal images of Messidor dataset was divided into training and validation data at the ratio 7:3. By applying random augmentation to 359 validation data, $1.61{\pm}0.55%$ accuracy improvement was achieved in the case of six times augmentation (N=6). This simple method has shown that the accuracy can be improved in the N range from 2 to 6 with the correlation coefficient of 0.5667. Therefore, it is expected to help improve the diagnostic accuracy of DME with the grading information provided by the proposed DNN.

Key Principles of Clinical Validation, Device Approval, and Insurance Coverage Decisions of Artificial Intelligence

  • Seong Ho Park;Jaesoon Choi;Jeong-Sik Byeon
    • Korean Journal of Radiology
    • /
    • v.22 no.3
    • /
    • pp.442-453
    • /
    • 2021
  • Artificial intelligence (AI) will likely affect various fields of medicine. This article aims to explain the fundamental principles of clinical validation, device approval, and insurance coverage decisions of AI algorithms for medical diagnosis and prediction. Discrimination accuracy of AI algorithms is often evaluated with the Dice similarity coefficient, sensitivity, specificity, and traditional or free-response receiver operating characteristic curves. Calibration accuracy should also be assessed, especially for algorithms that provide probabilities to users. As current AI algorithms have limited generalizability to real-world practice, clinical validation of AI should put it to proper external testing and assisting roles. External testing could adopt diagnostic case-control or diagnostic cohort designs. A diagnostic case-control study evaluates the technical validity/accuracy of AI while the latter tests the clinical validity/accuracy of AI in samples representing target patients in real-world clinical scenarios. Ultimate clinical validation of AI requires evaluations of its impact on patient outcomes, referred to as clinical utility, and for which randomized clinical trials are ideal. Device approval of AI is typically granted with proof of technical validity/accuracy and thus does not intend to directly indicate if AI is beneficial for patient care or if it improves patient outcomes. Neither can it categorically address the issue of limited generalizability of AI. After achieving device approval, it is up to medical professionals to determine if the approved AI algorithms are beneficial for real-world patient care. Insurance coverage decisions generally require a demonstration of clinical utility that the use of AI has improved patient outcomes.

Development and Validation of S.T.E.P+ Diagnostic Tool: Assessing Organizational Competence for Self-management in Daycare Centers (어린이집 자율관리를 위한 조직역량 진단도구(S.T.E.P+)의 개발 및 타당화)

  • Jeong-Won Kang;So-Young Park;Won-Seon Lee;Yoe-Jeong Lim
    • Korean Journal of Childcare and Education
    • /
    • v.20 no.2
    • /
    • pp.105-126
    • /
    • 2024
  • Objective: The study aimed to develop and validate a tool for assessing daycare center organizational competence and for autonomously managing childcare quality. Methods: Through literature review and expert reviews, items were derived and validated using the Content Validity Index. Data from a survey involving 216 directors and 509 teachers were analyzed using SPSS and AMOS to assess reliability and conduct confirmatory factor analysis. Results: Results revealed a 36-item diagnostic tool across four subcategories: shared values (6 items), training abilities (18 items), environmental support (6 items), and organizational promotion (6 items). A diagnostic tool named S.T.E.P+ was developed, named after the first letters of the four subfactors. Skewness and kurtosis were within normality assumptions. Good fit indices (CFI, TLI) and low SRMR and RMSEA values indicated a satisfactory model fit. Cronbach's α values showed high reliability for all factors. The tool enables autonomous diagnosis of childcare quality. Conclusion/Implications: This tool can effectively autonomously diagnose whether a daycare center is providing quality childcare.

Development and Validation of Generalized Linear Regression Models to Predict Vessel Enhancement on Coronary CT Angiography

  • Masuda, Takanori;Nakaura, Takeshi;Funama, Yoshinori;Sato, Tomoyasu;Higaki, Toru;Kiguchi, Masao;Matsumoto, Yoriaki;Yamashita, Yukari;Imada, Naoyuki;Awai, Kazuo
    • Korean Journal of Radiology
    • /
    • v.19 no.6
    • /
    • pp.1021-1030
    • /
    • 2018
  • Objective: We evaluated the effect of various patient characteristics and time-density curve (TDC)-factors on the test bolus-affected vessel enhancement on coronary computed tomography angiography (CCTA). We also assessed the value of generalized linear regression models (GLMs) for predicting enhancement on CCTA. Materials and Methods: We performed univariate and multivariate regression analysis to evaluate the effect of patient characteristics and to compare contrast enhancement per gram of iodine on test bolus (${\Delta}HUTEST$) and CCTA (${\Delta}HUCCTA$). We developed GLMs to predict ${\Delta}HUCCTA$. GLMs including independent variables were validated with 6-fold cross-validation using the correlation coefficient and Bland-Altman analysis. Results: In multivariate analysis, only total body weight (TBW) and ${\Delta}HUTEST$ maintained their independent predictive value (p < 0.001). In validation analysis, the highest correlation coefficient between ${\Delta}HUCCTA$ and the prediction values was seen in the GLM (r = 0.75), followed by TDC (r = 0.69) and TBW (r = 0.62). The lowest Bland-Altman limit of agreement was observed with GLM-3 (mean difference, $-0.0{\pm}5.1$ Hounsfield units/grams of iodine [HU/gI]; 95% confidence interval [CI], -10.1, 10.1), followed by ${\Delta}HUCCTA$ ($-0.0{\pm}5.9HU/gI$; 95% CI, -11.9, 11.9) and TBW ($1.1{\pm}6.2HU/gI$; 95% CI, -11.2, 13.4). Conclusion: We demonstrated that the patient's TBW and ${\Delta}HUTEST$ significantly affected contrast enhancement on CCTA images and that the combined use of clinical information and test bolus results is useful for predicting aortic enhancement.

COMPUTATIONAL INTELLIGENCE IN NUCLEAR ENGINEERING

  • UHRIG ROBERT E.;HINES J. WESLEY
    • Nuclear Engineering and Technology
    • /
    • v.37 no.2
    • /
    • pp.127-138
    • /
    • 2005
  • Approaches to several recent issues in the operation of nuclear power plants using computational intelligence are discussed. These issues include 1) noise analysis techniques, 2) on-line monitoring and sensor validation, 3) regularization of ill-posed surveillance and diagnostic measurements, 4) transient identification, 5) artificial intelligence-based core monitoring and diagnostic system, 6) continuous efficiency improvement of nuclear power plants, and 7) autonomous anticipatory control and intelligent-agents. Several changes to the focus of Computational Intelligence in Nuclear Engineering have occurred in the past few years. With earlier activities focusing on the development of condition monitoring and diagnostic techniques for current nuclear power plants, recent activities have focused on the implementation of those methods and the development of methods for next generation plants and space reactors. These advanced techniques are expected to become increasingly important as current generation nuclear power plants have their licenses extended to 60 years and next generation reactors are being designed to operate for extended fuel cycles (up to 25 years), with less operator oversight, and especially for nuclear plants operating in severe environments such as space or ice-bound locations.

Comparative Analysis of Diagnostic Prediction Algorithm Performance for Blood Cancer Factor Validation and Classification (혈액암 인자 유효성 검증과 분류를 위한 진단 예측 알고리즘 성능 비교 분석)

  • Jeong, Jae-Seung;Ju, Hyunsu;Cho, Chi-Hyun
    • Journal of Korea Multimedia Society
    • /
    • v.25 no.10
    • /
    • pp.1512-1523
    • /
    • 2022
  • Artificial intelligence application in digital health care has been increasing with its development of artificial intelligence. The convergence of the healthcare industry and information and communication technology makes the diagnosis of diseases more simple and comprehensible. From the perspective of medical services, its practice as an initial test and a reference indicator may become widely applicable. Therefore, analyzing the factors that are the basis for existing diagnosis protocols also helps suggest directions using artificial intelligence beyond previous regression and statistical analyses. This paper conducts essential diagnostic prediction learning based on the analysis of blood cancer factors reported previously. Blood cancer diagnosis predictions based on artificial intelligence contribute to successfully achieve more than 90% accuracy and validation of blood cancer factors as an alternative auxiliary approach.