• Title/Summary/Keyword: data validation

Search Result 3,346, Processing Time 0.037 seconds

SVM Load Forecasting using Cross-Validation (교차검증을 이용한 SVM 전력수요예측)

  • Jo, Nam-Hoon
    • The Transactions of the Korean Institute of Electrical Engineers A
    • /
    • v.55 no.11
    • /
    • pp.485-491
    • /
    • 2006
  • In this paper, we study the problem of model selection for Support Vector Machine(SVM) predictor for short-term load forecasting. The model selection amounts to tuning SVM parameters, such as the cost coefficient C and kernel parameters and so on, in order to maximize the prediction performance of SVM. We propose that Cross-Validation method can be used as a model selection algorithm for SVM-based load forecasting technique. Through the various experiments on several data sets, we found that the difference between the prediction error of SVM using Cross-Validation and that of ideal SVM is less than 5%. This shows that SVM parameters for load forecasting can be efficiently tuned by using Cross-Validation.

Development and Validation of a Prediction Model: Application to Digestive Cancer Research (예측모형의 구축과 검증: 소화기암연구 사례를 중심으로)

  • Yonghan Kwon;Kyunghwa Han
    • Journal of Digestive Cancer Research
    • /
    • v.11 no.3
    • /
    • pp.157-164
    • /
    • 2023
  • Prediction is a significant topic in clinical research. The development and validation of a prediction model has been increasingly published in clinical research. In this review, we investigated analytical methods and validation schemes for a clinical prediction model used in digestive cancer research. Deep learning and logistic regression, with split-sample validation as an internal or external validation, were the most commonly used methods. Furthermore, we briefly introduced and summarized the advantages and disadvantages of each method. Finally, we discussed several points to consider when conducting prediction model studies.

A Study on the Statistical Model Validation using Response-adaptive Experimental Design (반응적응 시험설계법을 이용하는 통계적 해석모델 검증 기법 연구)

  • Jung, Byung Chang;Huh, Young-Chul;Moon, Seok-Jun;Kim, Young Joong
    • Proceedings of the Korean Society for Noise and Vibration Engineering Conference
    • /
    • 2014.10a
    • /
    • pp.347-349
    • /
    • 2014
  • Model verification and validation (V&V) is a current research topic to build computational models with high predictive capability by addressing the general concepts, processes and statistical techniques. The hypothesis test for validity check is one of the model validation techniques and gives a guideline to evaluate the validity of a computational model when limited experimental data only exist due to restricted test resources (e.g., time and budget). The hypothesis test for validity check mainly employ Type I error, the risk of rejecting the valid computational model, for the validity evaluation since quantification of Type II error is not feasible for model validation. However, Type II error, the risk of accepting invalid computational model, should be importantly considered for an engineered products having high risk on predicted results. This paper proposes a technique named as the response-adaptive experimental design to reduce Type II error by adaptively designing experimental conditions for the validation experiment. A tire tread block problem and a numerical example are employed to show the effectiveness of the response-adaptive experimental design for the validity evaluation.

  • PDF

Robust Cross Validation Score

  • Park, Dong-Ryeon
    • Communications for Statistical Applications and Methods
    • /
    • v.12 no.2
    • /
    • pp.413-423
    • /
    • 2005
  • Consider the problem of estimating the underlying regression function from a set of noisy data which is contaminated by a long tailed error distribution. There exist several robust smoothing techniques and these are turned out to be very useful to reduce the influence of outlying observations. However, no matter what kind of robust smoother we use, we should choose the smoothing parameter and relatively less attention has been made for the robust bandwidth selection method. In this paper, we adopt the idea of robust location parameter estimation technique and propose the robust cross validation score functions.

A Proposal for Certificate Status Validation Using the Call Processing of PCS (PCS의 호처리를 이용한 인증서 상태검증 모델 제안)

  • Lee Young-Sook;Won Dong-Ho;Lee Young-Gyo
    • The Journal of the Korea Contents Association
    • /
    • v.5 no.1
    • /
    • pp.45-53
    • /
    • 2005
  • With the rapid progress of research to offer a convenience of mobile communication, the mobile users can use not only the services of voice call but also the variety services of data communication using Internet. These include Internet Searching, Internet Shopping and Internet banking and Internet stock exchange and electronic payment and so on, based on PKI. Also, the need of data communication between the mobile users has been increased. As it is possible for mobile users to do user authentication, key distribution, encryption, decryption and so on, it is needed the certificate status validation between the mobile users. However due to the PCS(Personal Communication System) had been only designed and implemented for voice call between the mobile users, it is not easy to apply data communication between the mobile users on PKI. Therefore the study of for the data communication between the mobile users in PCS is a few. It is for the data transfer between the mobile users to communicate using call processing of PCS. So, we propose how to process the certificate status validation during call processing for data communication between the mobile users in the PCS.

  • PDF

The Cross-validation of Satellite OMI and OMPS Total Ozone with Pandora Measurement (지상 Pandora와 위성 OMI와 OMPS 오존관측 자료의 상호검증 방법에 대한 분석 연구)

  • Baek, Kanghyun;Kim, Jae-Hwan;Kim, Jhoon
    • Korean Journal of Remote Sensing
    • /
    • v.36 no.3
    • /
    • pp.461-474
    • /
    • 2020
  • Korea launched Geostationary Environmental Monitoring Satellite (GEMS), a UV/visible spectrometer that measure pollution gases on 18 February 2020. Because satellite retrieval is an ill-posed inverse solving process, the validation with ground-based measurements or other satellite measurements is essential to obtain reliable products. For this purpose, satellite-based OMI and OMPS total column ozone (TCO), and ground-based Pandora TCO in Busan and Seoul were selected for future GEMS validation. First of all, the goal of this study is to validate the ground ozone data using characteristics that satellite data provide coherent ozone measurements on a global basis, although satellite data have a larger error than the ground-based measurements. In the cross validation between Pandora and OMI TCO, we have found abnormal deviation in ozone time series from Pandora #29 observed in Seoul. This shows that it is possible to perform inverse validation of ground data using satellite data. Then OMPS TCO was compared with verified Pandora TCO. Both data shows a correlation coefficient of 0.97, an RMSE of less than 2 DU and the OMPS-Pandora relative mean difference of >4%. The result also shows the OMPS-Pandora relative mean difference with SZA, TCO, cross-track position and season have insignificant dependence on those variables.In addition, we showed that appropriate thresholds depending on the spatial resolution of each satellite sensor are required to eliminate the impact of the cloud on Pandora TCO.

On validation of fully coupled behavior of porous media using centrifuge test results

  • Tasiopoulou, Panagiota;Taiebat, Mahdi;Tafazzoli, Nima;Jeremic, Boris
    • Coupled systems mechanics
    • /
    • v.4 no.1
    • /
    • pp.37-65
    • /
    • 2015
  • Modeling and simulation of mechanical response of infrastructure object, solids and structures, relies on the use of computational models to foretell the state of a physical system under conditions for which such computational model has not been validated. Verification and Validation (V&V) procedures are the primary means of assessing accuracy, building confidence and credibility in modeling and computational simulations of behavior of those infrastructure objects. Validation is the process of determining a degree to which a model is an accurate representation of the real world from the perspective of the intended uses of the model. It is mainly a physics issue and provides evidence that the correct model is solved (Oberkampf et al. 2002). Our primary interest is in modeling and simulating behavior of porous particulate media that is fully saturated with pore fluid, including cyclic mobility and liquefaction. Fully saturated soils undergoing dynamic shaking fall in this category. Verification modeling and simulation of fully saturated porous soils is addressed in more detail by (Tasiopoulou et al. 2014), and in this paper we address validation. A set of centrifuge experiments is used for this purpose. Discussion is provided assessing the effects of scaling laws on centrifuge experiments and their influence on the validation. Available validation test are reviewed in view of first and second order phenomena and their importance to validation. For example, dynamics behavior of the system, following the dynamic time, and dissipation of the pore fluid pressures, following diffusion time, are not happening in the same time scale and those discrepancies are discussed. Laboratory tests, performed on soil that is used in centrifuge experiments, were used to calibrate material models that are then used in a validation process. Number of physical and numerical examples are used for validation and to illustrate presented discussion. In particular, it is shown that for the most part, numerical prediction of behavior, using laboratory test data to calibrate soil material model, prior to centrifuge experiments, can be validated using scaled tests. There are, of course, discrepancies, sources of which are analyzed and discussed.

Design of weighted federated learning framework based on local model validation

  • Kim, Jung-Jun;Kang, Jeon Seong;Chung, Hyun-Joon;Park, Byung-Hoon
    • Journal of the Korea Society of Computer and Information
    • /
    • v.27 no.11
    • /
    • pp.13-18
    • /
    • 2022
  • In this paper, we proposed VW-FedAVG(Validation based Weighted FedAVG) which updates the global model by weighting according to performance verification from the models of each device participating in the training. The first method is designed to validate each local client model through validation dataset before updating the global model with a server side validation structure. The second is a client-side validation structure, which is designed in such a way that the validation data set is evenly distributed to each client and the global model is after validation. MNIST, CIFAR-10 is used, and the IID, Non-IID distribution for image classification obtained higher accuracy than previous studies.

ACTIVITIES OF CALIBRATION AND VALIDATION FOR THE KOMPSAT-2 MSC DATA

  • Lee Dong-Han;Lee Sun-Gu;Seo Doo-Chun;Song Jeong-Heon;Shih Jae-Min;Kim Yongseung;Lim Hyo-Suk;Paik Hong-Yul
    • Proceedings of the KSRS Conference
    • /
    • 2005.10a
    • /
    • pp.620-623
    • /
    • 2005
  • KARI has prepared Calibration and Validation activities for the KOMPSAT-2 (KOrea Multi-Purpose SATellite-2) MSC data that will be launched at the end of this year. Firstly, we divided the Cal/Val activities of it to four parts, Spatial, Spectral, Radiometric and Geometric, and defmed the detailed Cal/Val items from them. Secondly, Cal/Val targets have been defined and manufactured for the role of them. Thirdly, we have made the plan and the procedure for the Cal/Val items, developed the codes for them, studied more detailed method to do them, and trained the Cal/Val activities using the foreign satellite image data by ourselves. KARI has been now setting up the KOMPSAT-2 LEOP plan with the Cal/Val activities, and probably will finish the EOP Cal/Val activities for the KOMPSAT-2 MSC data by the next April or May.

  • PDF

Validation Study of Gridded Product of Surface Wind/Wind-stress derived by Satellite Scatterometer Data in the Western North Pacific using Kuroshio Extension Observatory Buoy

  • Kutsuwada, Kunio;Morimoto, Naoki;Koyama, Makoto
    • Proceedings of the KSRS Conference
    • /
    • v.1
    • /
    • pp.394-397
    • /
    • 2006
  • Gridded products of surface wind/wind-stress over the world ocean have been constructed by using satellite scatterometer as the Japanese Ocean Flux data sets with Use of Remote-sensing Observation (J-OFURO) data. Our previous validation study in the tropical Pacific using TAO/Triton and NDBC buoys revealed high reliability of our products. In this study, the Kuroshio Extension Observatory (KEO) buoy data are used for validation of other gridded wind-stress products including the NCEP-1 and 2 in the western North Pacific region where there have been few in-situ data. Results reveal that our J-OFURO product has almost zero mean difference and smallest root-mean-square (RMS) difference, while the NCEP-1 and 2 ones significantly positive biases and relatively high RMS difference. Intercomparison between the J-OFURO and NCEP products in a wide region of the North Pacific covered by the westerly winds exhibits that the NCEPs have larger magnitudes in the wind stress than the J-OFURO's, suggesting overestimation of the NCEPs.

  • PDF