• Title/Summary/Keyword: RMSE (Root Mean Square Error)

Search Result 655, Processing Time 0.028 seconds

Validation of Satellite Scatterometer Sea-Surface Wind Vectors (MetOp-A/B ASCAT) in the Korean Coastal Region (한반도 연안해역에서 인공위성 산란계(MetOp-A/B ASCAT) 해상풍 검증)

  • Kwak, Byeong-Dae;Park, Kyung-Ae;Woo, Hye-Jin;Kim, Hee-Young;Hong, Sung-Eun;Sohn, Eun-Ha
    • Journal of the Korean earth science society
    • /
    • v.42 no.5
    • /
    • pp.536-555
    • /
    • 2021
  • Sea-surface wind is an important variable in ocean-atmosphere interactions, leading to the changes in ocean surface currents and circulation, mixed layers, and heat flux. With the development of satellite technology, sea-surface winds data retrieved from scatterometer observation data have been used for various purposes. In a complex marine environment such as the Korean Peninsula coast, scatterometer-observed sea-surface wind is an important factor for analyzing ocean and atmospheric phenomena. Therefore, the validation results of wind accuracy can be used for diverse applications. In this study, the sea-surface winds derived from ASCAT (Advanced SCATterometer) mounted on MetOp-A/B (METeorological Operational Satellite-A/B) were validated compared to in-situ wind measurements at 16 marine buoy stations around the Korean Peninsula from January to December 2020. The buoy winds measured at a height of 4-5 m from the sea surface were converted to 10-m neutral winds using the LKB (Liu-Katsaros-Businger) model. The matchup procedure produced 5,544 and 10,051 collocation points for MetOp-A and MetOp-B, respectively. The root mean square errors (RMSE) were 1.36 and 1.28 m s-1, and bias errors amounted to 0.44 and 0.65 m s-1 for MetOp-A and MetOp-B, respectively. The wind directions of both scatterometers exhibited negative biases of -8.03° and -6.97° and RMSE values of 32.46° and 36.06° for MetOp-A and MetOp-B, respectively. These errors were likely associated with the stratification and dynamics of the marine-atmospheric boundary layer. In the seas around the Korean Peninsula, the sea-surface winds of the ASCAT tended to be more overestimated than the in-situ wind speeds, particularly at weak wind speeds. In addition, the closer the distance from the coast, the more the amplification of error. The present results could contribute to the development of a prediction model as improved input data and the understanding of air-sea interaction and impact of typhoons in the coastal regions around the Korean Peninsula.

Study on the Concentration Estimation Equation of Nitrogen Dioxide using Hyperspectral Sensor (초분광센서를 활용한 이산화질소 농도 추정식에 관한 연구)

  • Jeon, Eui-Ik;Park, Jin-Woo;Lim, Seong-Ha;Kim, Dong-Woo;Yu, Jae-Jin;Son, Seung-Woo;Jeon, Hyung-Jin;Yoon, Jeong-Ho
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.20 no.6
    • /
    • pp.19-25
    • /
    • 2019
  • The CleanSYS(Clean SYStem) is operated to monitor air pollutants emitted from specific industrial complexes in Korea. So the industrial complexes without the system are directly monitored by the control officers. For efficient monitoring, studies using various sensors have been conducted to monitor air pollutants emitted from industrial complex. In this study, hyperspectral sensors were used to model and verify the equations for estimating the concentration of $NO_2$(nitrogen dioxide) in air pollutants emitted. For development of the equations, spectral radiance were observed for $NO_2$ at various concentrations with different SZA(Solar Zenith Angle), VZA(Viewing Zenith Angle), and RAA(Relative Azimuth Angle). From the observed spectral radiance, the calculated value of the difference between the values of the specific wavelengths was taken as an absorption depth, and the equations were developed using the relationship between the depth and the $NO_2$ concentration. The spectral radiance mixed gas of $NO_2$ and $SO_2$(sulfur dioxide) was used to verify the equations. As a result, the $R^2$(coefficient of determination) and RMSE(Root Mean Square Error) were different from 0.71~0.88 and 72~23 ppm according to the form of the equation, and $R^2$ of the exponential form was the highest among the equations. Depending on the type of the equations, the accuracy of the estimated concentration with varying concentrations is not constant. However, if the equations are advanced in the future, hyperspectral sensors can be used to monitor the $NO_2$ emitted from the industrial complex.

Predicting Crime Risky Area Using Machine Learning (머신러닝기반 범죄발생 위험지역 예측)

  • HEO, Sun-Young;KIM, Ju-Young;MOON, Tae-Heon
    • Journal of the Korean Association of Geographic Information Studies
    • /
    • v.21 no.4
    • /
    • pp.64-80
    • /
    • 2018
  • In Korea, citizens can only know general information about crime. Thus it is difficult to know how much they are exposed to crime. If the police can predict the crime risky area, it will be possible to cope with the crime efficiently even though insufficient police and enforcement resources. However, there is no prediction system in Korea and the related researches are very much poor. From these backgrounds, the final goal of this study is to develop an automated crime prediction system. However, for the first step, we build a big data set which consists of local real crime information and urban physical or non-physical data. Then, we developed a crime prediction model through machine learning method. Finally, we assumed several possible scenarios and calculated the probability of crime and visualized the results in a map so as to increase the people's understanding. Among the factors affecting the crime occurrence revealed in previous and case studies, data was processed in the form of a big data for machine learning: real crime information, weather information (temperature, rainfall, wind speed, humidity, sunshine, insolation, snowfall, cloud cover) and local information (average building coverage, average floor area ratio, average building height, number of buildings, average appraised land value, average area of residential building, average number of ground floor). Among the supervised machine learning algorithms, the decision tree model, the random forest model, and the SVM model, which are known to be powerful and accurate in various fields were utilized to construct crime prevention model. As a result, decision tree model with the lowest RMSE was selected as an optimal prediction model. Based on this model, several scenarios were set for theft and violence cases which are the most frequent in the case city J, and the probability of crime was estimated by $250{\times}250m$ grid. As a result, we could find that the high crime risky area is occurring in three patterns in case city J. The probability of crime was divided into three classes and visualized in map by $250{\times}250m$ grid. Finally, we could develop a crime prediction model using machine learning algorithm and visualized the crime risky areas in a map which can recalculate the model and visualize the result simultaneously as time and urban conditions change.

Evaluation of stream flow and water quality changes of Yeongsan river basin by inter-basin water transfer using SWAT (SWAT을 이용한 유역간 물이동량에 따른 영산강유역의 하천 유량 및 수질 변동 분석)

  • Kim, Yong Won;Lee, Ji Wan;Woo, So Young;Kim, Seong Joon
    • Journal of Korea Water Resources Association
    • /
    • v.53 no.12
    • /
    • pp.1081-1095
    • /
    • 2020
  • This study is to evaluate stream flow and water quality changes of Yeongsan river basin (3,371.4 km2) by inter-basin water transfer (IBWT) from Juam dam of Seomjin river basin using SWAT (Soil and Water Assessment Tool). The SWAT was established using inlet function for IBWT between donor and receiving basins. The SWAT was calibrated and validated with 14 years (2005 ~ 2018) data of 1 stream (MR) and 2 multi-functional weir (SCW, JSW) water level gauging stations, and 3 water quality stations (GJ2, NJ, and HP) including data of IBWT and effluent from wastewater treatment plants of Yeongsan river basin. For streamflow and weir inflows (MR, SCW, and JSW), the coefficient of determination (R2), Nash-Sutcliffe efficiency (NSE), root mean square error (RMSE), and percent bias (PBIAS) were 0.69 ~ 0.81, 0.61 ~ 0.70, 1.34 ~ 2.60 mm/day, and -8.3% ~ +7.6% respectively. In case of water quality, the R2 of SS, T-N, and T-P were 0.69 ~ 0.81, 0.61 ~ 0.70, and 0.54 ~ 0.63 respectively. The Yeongsan river basin average streamflow was 12.0 m3/sec and the average SS, T-N, and T-P were 110.5 mg/L, 4.4 mg/L, 0.18 mg/L respectively. Under the 130% scenario of IBWT amount, the streamflow, SS increased to 12.94 m3/sec (+7.8%), 111.26 mg/L (+0.7%) and the T-N, T-P decreased to 4.17 mg/L (-5.2%), 0.165 mg/L (-8.3%) respectively. Under the 70% scenario of IBWT amount, the streamflow, SS decreased to 11.07 m3/sec (-7.8%), 109.74 mg/L (-0.7%) and the T-N, T-P increased to 4.68 mg/L (+6.4%), 0.199 mg/L (+10.6%) respectively.

Physical Offset of UAVs Calibration Method for Multi-sensor Fusion (다중 센서 융합을 위한 무인항공기 물리 오프셋 검보정 방법)

  • Kim, Cheolwook;Lim, Pyeong-chae;Chi, Junhwa;Kim, Taejung;Rhee, Sooahm
    • Korean Journal of Remote Sensing
    • /
    • v.38 no.6_1
    • /
    • pp.1125-1139
    • /
    • 2022
  • In an unmanned aerial vehicles (UAVs) system, a physical offset can be existed between the global positioning system/inertial measurement unit (GPS/IMU) sensor and the observation sensor such as a hyperspectral sensor, and a lidar sensor. As a result of the physical offset, a misalignment between each image can be occurred along with a flight direction. In particular, in a case of multi-sensor system, an observation sensor has to be replaced regularly to equip another observation sensor, and then, a high cost should be paid to acquire a calibration parameter. In this study, we establish a precise sensor model equation to apply for a multiple sensor in common and propose an independent physical offset estimation method. The proposed method consists of 3 steps. Firstly, we define an appropriate rotation matrix for our system, and an initial sensor model equation for direct-georeferencing. Next, an observation equation for the physical offset estimation is established by extracting a corresponding point between a ground control point and the observed data from a sensor. Finally, the physical offset is estimated based on the observed data, and the precise sensor model equation is established by applying the estimated parameters to the initial sensor model equation. 4 region's datasets(Jeon-ju, Incheon, Alaska, Norway) with a different latitude, longitude were compared to analyze the effects of the calibration parameter. We confirmed that a misalignment between images were adjusted after applying for the physical offset in the sensor model equation. An absolute position accuracy was analyzed in the Incheon dataset, compared to a ground control point. For the hyperspectral image, root mean square error (RMSE) for X, Y direction was calculated for 0.12 m, and for the point cloud, RMSE was calculated for 0.03 m. Furthermore, a relative position accuracy for a specific point between the adjusted point cloud and the hyperspectral images were also analyzed for 0.07 m, so we confirmed that a precise data mapping is available for an observation without a ground control point through the proposed estimation method, and we also confirmed a possibility of multi-sensor fusion. From this study, we expect that a flexible multi-sensor platform system can be operated through the independent parameter estimation method with an economic cost saving.

Performance evaluation of hyperspectral bathymetry method for morphological mapping in a large river confluence (초분광수심법 기반 대하천 합류부 하상측정 성능 평가)

  • Kim, Dongsu;Seo, Youngcheol;You, Hojun;Gwon, Yeonghwa
    • Journal of Korea Water Resources Association
    • /
    • v.56 no.3
    • /
    • pp.195-210
    • /
    • 2023
  • Additional deposition and erosion in large rivers in South Korea have continued to occur toward morphological stabilization after massive dredging through the four major river restoration project, subsequently requiring precise bathymetry monitoring. Hyperspectral bathymetry method has increasingly been highlighted as an alternative way to estimate bathymetry with high spatial resolution in shallow depth for replacing classical intrusive direct measurement techniques. This study introduced the conventional Optimal Band Ratio Analysis (OBRA) of hyperspectral bathymetry method, and evaluated the performance in a domestic large river in normal turbid and flow condition. Maximum measurable depth was estimated by applying correlation coefficient and root mean square error (RMSE) produced during OBRA with cascadedly applying cut-off depth, where the consequent hyperspectral bathymetry map excluded the region over the derived maximum measurable depth. Also non-linearity was considered in building relation between optimal band and depth. We applied the method to the Nakdong and Hwang River confluence as a large river case and obtained the following features. First, the hyperspectal method showed acceptable performance in morphological mapping for shallow regions, where the maximum measurable depth was 2.5 m and 1.25 m in the Nakdong and Hwang river, respectively. Second, RMSE was more feasible to derive the maximum measurable depth rather than the conventional correlation coefficient whereby considering various scenario of excluding range of in situ depths for OBRA. Third, highly turbid region in Hwang River did not allow hyperspectral bathymetry mapping compared with the case of adjacent Nakdong River, where maximum measurable depth was down to half in Hwang River.

Validation of Extreme Rainfall Estimation in an Urban Area derived from Satellite Data : A Case Study on the Heavy Rainfall Event in July, 2011 (위성 자료를 이용한 도시지역 극치강우 모니터링: 2011년 7월 집중호우를 중심으로)

  • Yoon, Sun-Kwon;Park, Kyung-Won;Kim, Jong Pil;Jung, Il-Won
    • Journal of Korea Water Resources Association
    • /
    • v.47 no.4
    • /
    • pp.371-384
    • /
    • 2014
  • This study developed a new algorithm of extreme rainfall extraction based on the Communication, Ocean and Meteorological Satellite (COMS) and the Tropical Rainfall Measurement Mission (TRMM) Satellite image data and evaluated its applicability for the heavy rainfall event in July-2011 in Seoul, South Korea. The power-series-regression-based Z-R relationship was employed for taking into account for empirical relationships between TRMM/PR, TRMM/VIRS, COMS, and Automatic Weather System(AWS) at each elevation. The estimated Z-R relationship ($Z=303R^{0.72}$) agreed well with observation from AWS (correlation coefficient=0.57). The estimated 10-minute rainfall intensities from the COMS satellite using the Z-R relationship generated underestimated rainfall intensities. For a small rainfall event the Z-R relationship tended to overestimated rainfall intensities. However, the overall patterns of estimated rainfall were very comparable with the observed data. The correlation coefficients and the Root Mean Square Error (RMSE) of 10-minute rainfall series from COMS and AWS gave 0.517, and 3.146, respectively. In addition, the averaged error value of the spatial correlation matrix ranged from -0.530 to -0.228, indicating negative correlation. To reduce the error by extreme rainfall estimation using satellite datasets it is required to take into more extreme factors and improve the algorithm through further study. This study showed the potential utility of multi-geostationary satellite data for building up sub-daily rainfall and establishing the real-time flood alert system in ungauged watersheds.

How to improve the accuracy of recommendation systems: Combining ratings and review texts sentiment scores (평점과 리뷰 텍스트 감성분석을 결합한 추천시스템 향상 방안 연구)

  • Hyun, Jiyeon;Ryu, Sangyi;Lee, Sang-Yong Tom
    • Journal of Intelligence and Information Systems
    • /
    • v.25 no.1
    • /
    • pp.219-239
    • /
    • 2019
  • As the importance of providing customized services to individuals becomes important, researches on personalized recommendation systems are constantly being carried out. Collaborative filtering is one of the most popular systems in academia and industry. However, there exists limitation in a sense that recommendations were mostly based on quantitative information such as users' ratings, which made the accuracy be lowered. To solve these problems, many studies have been actively attempted to improve the performance of the recommendation system by using other information besides the quantitative information. Good examples are the usages of the sentiment analysis on customer review text data. Nevertheless, the existing research has not directly combined the results of the sentiment analysis and quantitative rating scores in the recommendation system. Therefore, this study aims to reflect the sentiments shown in the reviews into the rating scores. In other words, we propose a new algorithm that can directly convert the user 's own review into the empirically quantitative information and reflect it directly to the recommendation system. To do this, we needed to quantify users' reviews, which were originally qualitative information. In this study, sentiment score was calculated through sentiment analysis technique of text mining. The data was targeted for movie review. Based on the data, a domain specific sentiment dictionary is constructed for the movie reviews. Regression analysis was used as a method to construct sentiment dictionary. Each positive / negative dictionary was constructed using Lasso regression, Ridge regression, and ElasticNet methods. Based on this constructed sentiment dictionary, the accuracy was verified through confusion matrix. The accuracy of the Lasso based dictionary was 70%, the accuracy of the Ridge based dictionary was 79%, and that of the ElasticNet (${\alpha}=0.3$) was 83%. Therefore, in this study, the sentiment score of the review is calculated based on the dictionary of the ElasticNet method. It was combined with a rating to create a new rating. In this paper, we show that the collaborative filtering that reflects sentiment scores of user review is superior to the traditional method that only considers the existing rating. In order to show that the proposed algorithm is based on memory-based user collaboration filtering, item-based collaborative filtering and model based matrix factorization SVD, and SVD ++. Based on the above algorithm, the mean absolute error (MAE) and the root mean square error (RMSE) are calculated to evaluate the recommendation system with a score that combines sentiment scores with a system that only considers scores. When the evaluation index was MAE, it was improved by 0.059 for UBCF, 0.0862 for IBCF, 0.1012 for SVD and 0.188 for SVD ++. When the evaluation index is RMSE, UBCF is 0.0431, IBCF is 0.0882, SVD is 0.1103, and SVD ++ is 0.1756. As a result, it can be seen that the prediction performance of the evaluation point reflecting the sentiment score proposed in this paper is superior to that of the conventional evaluation method. In other words, in this paper, it is confirmed that the collaborative filtering that reflects the sentiment score of the user review shows superior accuracy as compared with the conventional type of collaborative filtering that only considers the quantitative score. We then attempted paired t-test validation to ensure that the proposed model was a better approach and concluded that the proposed model is better. In this study, to overcome limitations of previous researches that judge user's sentiment only by quantitative rating score, the review was numerically calculated and a user's opinion was more refined and considered into the recommendation system to improve the accuracy. The findings of this study have managerial implications to recommendation system developers who need to consider both quantitative information and qualitative information it is expect. The way of constructing the combined system in this paper might be directly used by the developers.

Validation of Sea Surface Wind Speeds from Satellite Altimeters and Relation to Sea State Bias - Focus on Wind Measurements at Ieodo, Marado, Oeyeondo Stations (인공위성 고도계 해상풍 검증과 해상상태편차와의 관련성 - 이어도, 마라도, 외연도 해상풍 관측치를 중심으로 -)

  • Choi, Do-Young;Woo, Hye-Jin;Park, Kyung-Ae;Byun, Do-Seong;Lee, Eunil
    • Journal of the Korean earth science society
    • /
    • v.39 no.2
    • /
    • pp.139-153
    • /
    • 2018
  • The sea surface wind field has long been obtained from satellite scatterometers or passive microwave radiometers. However, the importance of satellite altimeter-derived wind speed has seldom been addressed because of the outstanding capability of the scatterometers. Satellite altimeter requires the accurate wind speed data, measured simultaneously with sea surface height observations, to enhance the accuracy of sea surface height through the correction of sea state bias. This study validates the wind speeds from the satellite altimeters (GFO, Jason-1, Envisat, Jason-2, Cryosat-2, SARAL) and analyzes characteristics of errors. In total, 1504 matchup points were produced using the wind speed data of Ieodo Ocean Research Station (IORS) and of Korea Meteorological Administration (KMA) buoys at Marado and Oeyeondo stations for 10 years from December 2007 to May 2016. The altimeter wind speed showed a root mean square error (RMSE) of about $1.59m\;s^{-1}$ and a negative bias of $-0.35m\;s^{-1}$ with respect to the in-situ wind speed. Altimeter wind speeds showed characteristic biases that they were higher (lower) than in-situ wind speeds at low (high) wind speed ranges. Some tendency was found that the difference between the maximum and minimum value gradually increased with distance from the buoy stations. For the improvement of the accuracy of altimeter wind speed, an equation for correction was derived based on the characteristics of errors. In addition, the significance of altimeter wind speed on the estimation of sea surface height was addressed by presenting the effect of the corrected wind speeds on the sea state bias values of Jason-1.

A Quantification Method for the Cold Pool Effect on Nocturnal Temperature in a Closed Catchment (폐쇄집수역의 냉기호 모의를 통한 일 최저기온 분포 추정)

  • Kim, Soo-Ock;Yun, Jin-I.
    • Korean Journal of Agricultural and Forest Meteorology
    • /
    • v.13 no.4
    • /
    • pp.176-184
    • /
    • 2011
  • Cold air on sloping surfaces flows down to the valley bottom in mountainous terrain at calm and clear nights. Based on the assumption that the cold air flow may be the same as the water flow, current models estimate temperature drop by regarding the cold air accumulation at a given location as the water-like free drainage. At a closed catchment whose outlet is blocked by man-made obstacles such as banks and roads, however, the water-like free drainage assumption is no longer valid because the cold air accumulates from the bottom first. We developed an empirical model to estimate quantitatively the effect of cold pool on nocturnal temperature in a closed catchment. In our model, a closed catchment is treated like a "vessel", and a digital elevation model (DEM) was used to calculate the maximum capacity of the cold pool formed in a closed catchment. We introduce a topographical variable named "shape factor", which is the ratio of the cold air accumulation potential across the whole catchment area to the maximum capacity of the cold pool to describe the relative size of temperature drop at a wider range of catchment shapes. The shape factor is then used to simulate the density profile of cold pool formed in a given catchment based on a hypsometric equation. The cold lake module was incorporated with the existing model (i.e., Chung et al., 2006), generating a new model and predicting distribution of minimum temperature over closed catchments. We applied this model to Akyang valley (i.e., a typical closed catchment of 53 $km^2$ area) in the southern skirt of Mt. Jiri National Park where 12 automated weather stations (AWS) are operational. The performance of the model was evaluated based on the feasibility of delineating the temperature pattern accurately at cold pool forming at night. Overall, the model's ability of simulating the spatial pattern of lower temperature were improved especially at the valley bottom, showing a similar pattern of the estimated temperature with that of thermal images obtained across the valley at dawn (0520 to 0600 local standard time) of 17 May 2011. Error in temperature estimation, calculated with the root mean square error using the 10 low-lying AWSs, was substantially decreased from $1.30^{\circ}C$ with the existing model to $0.71^{\circ}C$ with the new model. These results suggest the feasibility of the new method in predicting the site-specific freeze and frost warning at a closed catchment.