• The Korean Journal of Applied Statistics
• /
• v.32 no.2
• /
• pp.291-300
• /
• 2019

This study investigates the characteristics of evaluation measures for classification models on a binary response variable in order to evaluate their suitability for use. Six measures are considered: Accuracy, Sensitivity, Specificity, Precision, F-measure, and the Heidke's skill score (HSS). Evaluation measures are reformulated using x(ratio of actually 1), y(ratio predicted by 1), z(ratio of both actual and predicted by 1) from the confusion matrix. We suggest two necessary conditions to assess the suitability of the evaluation measures. The first condition is that the measure function is constant for x and y in the case of a random model. The second condition is that the measure function is increasing for z and decreasing for x and y. Since only HSS satisfies the two conditions, that is always appropriate as an evaluation measure for the classification model on the binary response variable, and the other measures should be used within a limited range.

• Atmosphere
• /
• v.28 no.4
• /
• pp.479-490
• /
• 2018

This study assesses the prediction skill of regional scale model for the mean temperature anomaly over South Korea produced by Pusan National University Coupled General Circulation Model (PNU CGCM)-Weather Research and Forecasting (WRF) chain. The initial and boundary conditions of WRF are derived from PNU CGCM. The hindcast period is 11 years from 2007 to 2017. The model's prediction skill of mean temperature anomaly is evaluated in terms of the temporal correlation coefficient (TCC), root mean square error (RMSE) and skill scores which are Heidke skill score (HSS), hit rate (HR), false alarm rate (FAR). The predictions of WRF and PNU CGCM are overall similar to observation (OBS). However, TCC of WRF with OBS is higher than that of PNU CGCM and the variation of mean temperature is more comparable to OBS than that of PNU CGCM. The prediction skill of WRF is higher in March and April but lower in October to December. HSS is as high as above 0.25 and HR (FAR) is as high (low) as above (below) 0.35 in 2-month lead time. According to the spatial distribution of HSS, predictability is not concentrated in a specific region but homogeneously spread throughout the whole region of South Korea.

• Journal of the Korean earth science society
• /
• v.28 no.2
• /
• pp.214-226
• /
• 2007

Because precipitation is influenced by various atmospheric variables, it is highly nonlinear. Although precipitation predicted by a dynamic model can be corrected by using a nonlinear Artificial Neural Network, this approach has limits such as choices of the initial weight, local minima and the number of neurons, etc. In the present paper, we correct simulated precipitation by using a multiple linear regression (MLR) method, which is simple and widely used. First of all, Ensemble hindcast is conducted by the PNU/CME Coupled General Circulation Model (CGCM) (Park and Ahn, 2004) for the period from April to August in 1979-2005. MLR is applied to precipitation simulated by PNU/CME CGCM for the months of June (lead 2), July (lead 3), August (lead 4) and seasonal mean JJA (from June to August) of the Northeast Asian region including the Korean Peninsula $(110^{\circ}-145^{\circ}E,\;25-55^{\circ}N)$. We build the MLR model using a linear relationship between observed precipitation and the hindcasted results from the PNU/CME CGCM. The predictor variables selected from CGCM are precipitation, 500 hPa vertical velocity, 200 hPa divergence, surface air temperature and others. After performing a leave-oneout cross validation, the results are compared with the PNU/CME CGCM's. The results including Heidke skill scores demonstrate that the MLR corrected results have better forecasts than the direct CGCM result for rainfall.

• Proceedings of the KSRS Conference
• /
• 2007.10a
• /
• pp.294-297
• /
• 2007

Steam and advection fogs are frequently observed in the Yellow Sea located between Korea and China during the periods of March-April and June-July respectively. This study uses the remote sensing (RS) data for monitoring sea fog. Meteorological data obtained from the Ieodo Ocean Research Station provided an informative synopsis for the occurrence of steam and advection fogs through a ground truth. The RS data used in this study was GOES-9, MTSAT-1R images and QuikSCAT wind data. A dual channel difference (DCD) approach using IR and near-IR channel of GOES-9 and MTSAT-1R satellites was applied to estimate the extension of the sea fog. For the days examined, it was found that not only the DCD but also the texture-related measurement and the weak wind condition are required to separate the sea fog from the low cloud. The QuikSCAT wind is used to provide a weak wind area less than threshold under stable condition of the surface wind around a fog event. The Laplacian computation for a measurement of the homogeneity was designed. A new combined method of DCD, QuikSCAT wind speed and Laplacian was applied in the twelve cases with GOES-9 and MTSAT-1R. The threshold values for DCD, QuikSCAT wind speed and Laplacian are -2.0 K, 8 m $s^{-1}$ and 0.1, respectively. The validation methods such as Heidke skill score, probability of detection, probability of false detection, true skill score and odds ratio show that the new combined method improves the detection of sea fog rather than DCD method.

• Korean Journal of Agricultural and Forest Meteorology
• /
• v.24 no.4
• /
• pp.218-233
• /
• 2022

The long-term (1986~2020) predictability of the number of days of heat and cold damages for each growth stage of soybean is evaluated using the daily maximum and minimum temperature (Tmax and Tmin) data produced by Pusan National University Coupled General Circulation Model (PNU CGCM)-Weather Research and Forecasting (WRF). The Predictability evaluation methods for the number of days of damages are Normalized Standard Deviations (NSD), Root Mean Square Error (RMSE), Hit Rate (HR), and Heidke Skill Score (HSS). First, we verified the simulation performance of the Tmax and Tmin, which are the variables that define the heat and cold damages of soybean. As a result, although there are some differences depending on the month starting with initial conditions from January (01RUN) to May (05RUN), the result after a systematic bias correction by the Variance Scaling method is similar to the observation compared to the bias-uncorrected one. The simulation performance for correction Tmax and Tmin from March to October is overall high in the results (ENS) averaged by applying the Simple Composite Method (SCM) from 01RUN to 05RUN. In addition, the model well simulates the regional patterns and characteristics of the number of days of heat and cold damages by according to the growth stages of soybean, compared with observations. In ENS, HR and HSS for heat damage (cold damage) of soybean have ranged from 0.45~0.75, 0.02~0.10 (0.49~0.76, -0.04~0.11) during each growth stage. In conclusion, 01RUN~05RUN and ENS of PNU CGCM-WRF Chain have the reasonable performance to predict heat and cold damages for each growth stage of soybean in South Korea.

• Korean Journal of Remote Sensing
• /
• v.24 no.1
• /
• pp.1-16
• /
• 2008

Steam and advection fogs are frequently observed in the Yellow Sea from March to July except for May. This study uses remote sensing (RS) data for the monitoring of sea fog. Meteorological data obtained from the Ieodo Ocean Research Station provided a valuable information for the occurrence of steam and advection fogs as a ground truth. The RS data used in this study were GOES-9, MTSAT-1R images and QuikSCAT wind data. A dual channel difference (DCD) approach using IR and shortwave IR channel of GOES-9 and MTSAT-1R satellites was applied to detect sea fog. The results showed that DCD, texture-related measurement and the weak wind condition are required to separate the sea fog from the low cloud. The QuikSCAT wind data was used to provide the wind speed criteria for a fog event. The laplacian computation was designed for a measurement of the homogeneity. A new combined method, which includes DCD, QuikSCAT wind speed and laplacian computation, was applied to the twelve cases with GOES-9 and MTSAT-1R. The threshold values for DCD, QuikSCAT wind speed and laplacian are -2.0 K, $8m\;s^{-1}$ and 0.1, respectively. The validation results showed that the new combined method slightly improves the detection of sea fog compared to DCD method: improvements of the new combined method are $5{\sim}6%$ increases in the Heidke skill score, 10% decreases in the probability of false detection, and $30{\sim}40%$ increases in the odd ratio.