• Title/Summary/Keyword: retrieval bias

Search Result 57, Processing Time 0.023 seconds

Quantitative precipitation estimation of X-band radar using empirical relationship (경험적 관계식을 이용한 X밴드 레이더의 정량적 강우 추정)

  • Song, Jae In;Lim, Sanghun;Cho, Yo Han;Jeong, Hyeon Gyo
    • Journal of Korea Water Resources Association
    • /
    • v.55 no.9
    • /
    • pp.679-686
    • /
    • 2022
  • As the occurrences of flash floods have increased due to climate change, faster and more accurate precipitation observation using X-band radar has become important. Therefore, the Ministry of Environment installed two dual-pol X-band radars at Samcheok and Uljin. The radar data used in this study were obtained from two different elevation angles and composed to reduce the shielding effect. To obtain quantitative rainfall, quality control (QC), KDP retrieval, and Hybrid Surface Rainfall (HSR) methods were sequentially applied. To improve the accuracy of the quantitative precipitation estimation (QPE) of the X-band radar, we retrieved parameters for the relationship between rainfall rate and specific differential phase, which is commonly called the R-KDP relationship; hence, an empirical approach was developed using multiple rain gauges for those two radars. The newly suggested relationship, R = 27.4K0.81DP, slightly increased the correlation coefficient by 1% more than the relationship suggested by the previous study. The root mean square error significantly decreased from 3.88 mm/hr to 3.68 mm/hr, and the bias of the estimated precipitation also decreased from -1.72 mm/hr to -0.92 mm/hr for overall cases, showing the improvement of the new method.

Retrieval of High Resolution Surface Net Radiation for Urban Area Using Satellite and CFD Model Data Fusion (위성 및 CFD모델 자료의 융합을 통한 도시지역에서의 고해상도 지표 순복사 산출)

  • Kim, Honghee;Lee, Darae;Choi, Sungwon;Jin, Donghyun;Her, Morang;Kim, Jajin;Hong, Jinkyu;Hong, Je-Woo;Lee, Keunmin;Han, Kyung-Soo
    • Korean Journal of Remote Sensing
    • /
    • v.34 no.2_1
    • /
    • pp.295-300
    • /
    • 2018
  • Net radiation is the total amount of radiation energy used as a heat flux for the Earth's energy cycle, and net radiation from the surface is an important factor in areas such as hydrology, climate, meteorological studies and agriculture. It is very important to monitoring the net radiation through remote sensing to be able to understand the trend of heat island and urbanization phenomenon. However, net radiation estimation using only remote sensing data is generally causes difference in accuracy depending on cloud. Therefore, in this paper, we retrieved and monitored high resolution surface net radiation at 1 hour interval in Eunpyeong New Town where urbanization using Communication, Ocean and Meteorological Satellite (COMS), Landsat-8 satellite and Computational Fluid Dynamics (CFD) model data reflecting the difference in building height. We compared the observed and estimated net radiation at the flux tower. As a result, estimated net radiation was similar trend to the observed net radiation as a whole and it had the accuracy of RMSE $54.29Wm^{-2}$ and Bias $27.42Wm^{-2}$. In addition, the calculated net radiation showed well the meteorological conditions such as precipitation, and showed the characteristics of net radiation for the vegetation and artificial area in the spatial distribution.

The Effect of Bilateral Eye Movements on Face Recognition in Patients with Schizophrenia (양측성 안구운동이 조현병 환자의 얼굴 재인에 미치는 영향)

  • Lee, Na-Hyun;Kim, Ji-Woong;Im, Woo-Young;Lee, Sang-Min;Lim, Sanghyun;Kwon, Hyukchan;Kim, Min-Young;Kim, Kiwoong;Kim, Seung-Jun
    • Korean Journal of Psychosomatic Medicine
    • /
    • v.24 no.1
    • /
    • pp.102-108
    • /
    • 2016
  • Objectives : The deficit of recognition memory has been found as one of the common neurocognitive impairments in patients with schizophrenia. In addition, they were reported to fail to enhance the memory about emotional stimuli. Previous studies have shown that bilateral eye movements enhance the memory retrieval. Therefore, this study was conducted in order to investigate the memory enhancement of bilaterally alternating eye movements in schizophrenic patients. Methods : Twenty one patients with schizophrenia participated in this study. The participants learned faces (angry or neutral faces), and then performed a recognition memory task in relation to the faces after bilateral eye movements and central fixation. Recognition accuracy, response bias, and mean response time to hits were compared and analysed. Two-way repeated measure analysis of variance was performed for statistical analysis. Results : There was a significant effect of bilateral eye movements condition in mean response time(F=5.812, p<0.05) and response bias(F=10.366, p<0.01). Statistically significant interaction effects were not observed between eye movement condition and face emotion type. Conclusions : Irrespective of the emotional difference of facial stimuli, recognition memory processing was more enhanced after bilateral eye movements in patients with schizophrenia. Further study will be needed to investigate the underlying neural mechanism of bilateral eye movements-induced memory enhancement in patients with schizophrenia.

Retrieval of Oceanic Skin Sea Surface Temperature using Infrared Sea Surface Temperature Autonomous Radiometer (ISAR) Radiance Measurements (적외선 라디오미터 관측 자료를 활용한 해양 피층 수온 산출)

  • Kim, Hee-Young;Park, Kyung-Ae
    • Journal of the Korean earth science society
    • /
    • v.41 no.6
    • /
    • pp.617-629
    • /
    • 2020
  • Sea surface temperature (SST), which plays an important role in climate change and global environmental change, can be divided into skin sea surface temperature (SSST) observed by satellite infrared sensors and the bulk temperature of sea water (BSST) measured by instruments. As sea surface temperature products distributed by many overseas institutions represent temperatures at different depths, it is essential to understand the relationship between the SSST and the BSST. In this study, we constructed an observation system of infrared radiometer onboard a marine research vessel for the first time in Korea to measure the SSST. The calibration coefficients were prepared by performing the calibration procedure of the radiometer device in the laboratory prior to the shipborne observation. A series of processes were applied to calculate the temperature of the layer of radiance emitted from the sea surface as well as that from the sky. The differences in skin-bulk temperatures were investigated quantitatively and the characteristics of the vertical structure of temperatures in the upper ocean were understood through comparison with Himawari-8 geostationary satellite SSTs. Comparison of the skin-bulk temperature differences illustrated overall differences of about 0.76℃ at Jangmok port in the southern coast and the offshore region of the eastern coast of the Korean Peninsula from 21 April to May 6, 2020. In addition, the root-mean-square error of the skin-bulk temperature differences showed daily variation from 0.6℃ to 0.9℃, with the largest difference of 0.83-0.89℃ at 1-3 KST during the daytime and the smallest difference of 0.59℃ at 15 KST. The bias also revealed clear diurnal variation at a range of 0.47-0.75℃. The difference between the observed skin sea surface temperature and the satellite sea surface temperature showed a mean square error of approximately 0.74℃ and a bias of 0.37℃. The analysis of this study confirmed the difference in the skin-bulk temperatures according to the observation depth. This suggests that further ocean shipborne infrared radiometer observations should be carried out continuously in the offshore regions to understand diurnal variation as well as seasonal variations of the skin-bulk SSTs and their relations to potential causes.

Validation of GCOM-W1/AMSR2 Sea Surface Temperature and Error Characteristics in the Northwest Pacific (북서태평양 GCOM-W1/AMSR2 해수면온도 검증 및 오차 특성)

  • Kim, Hee-Young;Park, Kyung-Ae;Woo, Hye-Jin
    • Korean Journal of Remote Sensing
    • /
    • v.32 no.6
    • /
    • pp.721-732
    • /
    • 2016
  • The accuracy and error characteristics of microwave Sea Surface Temperature (SST) measurements in the Northwest Pacific were analyzed by utilizing 162,264 collocated matchup data between GCOM-W1/AMSR2 data and oceanic in-situ temperature measurements from July 2012 to August 2016. The AMSR2 SST measurements had a Root-Mean-Square (RMS) error of about $0.63^{\circ}C$ and a bias error of about $0.05^{\circ}C$. The SST differences between AMSR2 and in-situ measurements were caused by various factors, such as wind speed, SST, distance from the coast, and the thermal front. The AMSR2 SST data showed an error due to the diurnal effect, which was much higher than the in-situ temperature measurements at low wind speed (<6 m/s) during the daytime. In addition, the RMS error tended to be large in the winter because the emissivity of the sea surface was increased by high wind speeds and it could induce positive deviation in the SST retrieval. Low sensitivity at colder temperature and land contamination also affected an increase in the error of AMSR2 SST. An analysis of the effect of the thermal front on satellite SST error indicated that SST error increased as the magnitude of the spatial gradient of the SST increased and the distance from the front decreased. The purpose of this study was to provide a basis for further research applying microwave SST in the Northwest Pacific. In addition, the results suggested that analyzing the errors related to the environmental factors in the study area must precede any further analysis in order to obtain more accurate satellite SST measurements.

Conditional Generative Adversarial Network based Collaborative Filtering Recommendation System (Conditional Generative Adversarial Network(CGAN) 기반 협업 필터링 추천 시스템)

  • Kang, Soyi;Shin, Kyung-shik
    • Journal of Intelligence and Information Systems
    • /
    • v.27 no.3
    • /
    • pp.157-173
    • /
    • 2021
  • With the development of information technology, the amount of available information increases daily. However, having access to so much information makes it difficult for users to easily find the information they seek. Users want a visualized system that reduces information retrieval and learning time, saving them from personally reading and judging all available information. As a result, recommendation systems are an increasingly important technologies that are essential to the business. Collaborative filtering is used in various fields with excellent performance because recommendations are made based on similar user interests and preferences. However, limitations do exist. Sparsity occurs when user-item preference information is insufficient, and is the main limitation of collaborative filtering. The evaluation value of the user item matrix may be distorted by the data depending on the popularity of the product, or there may be new users who have not yet evaluated the value. The lack of historical data to identify consumer preferences is referred to as data sparsity, and various methods have been studied to address these problems. However, most attempts to solve the sparsity problem are not optimal because they can only be applied when additional data such as users' personal information, social networks, or characteristics of items are included. Another problem is that real-world score data are mostly biased to high scores, resulting in severe imbalances. One cause of this imbalance distribution is the purchasing bias, in which only users with high product ratings purchase products, so those with low ratings are less likely to purchase products and thus do not leave negative product reviews. Due to these characteristics, unlike most users' actual preferences, reviews by users who purchase products are more likely to be positive. Therefore, the actual rating data is over-learned in many classes with high incidence due to its biased characteristics, distorting the market. Applying collaborative filtering to these imbalanced data leads to poor recommendation performance due to excessive learning of biased classes. Traditional oversampling techniques to address this problem are likely to cause overfitting because they repeat the same data, which acts as noise in learning, reducing recommendation performance. In addition, pre-processing methods for most existing data imbalance problems are designed and used for binary classes. Binary class imbalance techniques are difficult to apply to multi-class problems because they cannot model multi-class problems, such as objects at cross-class boundaries or objects overlapping multiple classes. To solve this problem, research has been conducted to convert and apply multi-class problems to binary class problems. However, simplification of multi-class problems can cause potential classification errors when combined with the results of classifiers learned from other sub-problems, resulting in loss of important information about relationships beyond the selected items. Therefore, it is necessary to develop more effective methods to address multi-class imbalance problems. We propose a collaborative filtering model using CGAN to generate realistic virtual data to populate the empty user-item matrix. Conditional vector y identify distributions for minority classes and generate data reflecting their characteristics. Collaborative filtering then maximizes the performance of the recommendation system via hyperparameter tuning. This process should improve the accuracy of the model by addressing the sparsity problem of collaborative filtering implementations while mitigating data imbalances arising from real data. Our model has superior recommendation performance over existing oversampling techniques and existing real-world data with data sparsity. SMOTE, Borderline SMOTE, SVM-SMOTE, ADASYN, and GAN were used as comparative models and we demonstrate the highest prediction accuracy on the RMSE and MAE evaluation scales. Through this study, oversampling based on deep learning will be able to further refine the performance of recommendation systems using actual data and be used to build business recommendation systems.

Gap-Filling of Sentinel-2 NDVI Using Sentinel-1 Radar Vegetation Indices and AutoML (Sentinel-1 레이더 식생지수와 AutoML을 이용한 Sentinel-2 NDVI 결측화소 복원)

  • Youjeong Youn;Jonggu Kang;Seoyeon Kim;Yemin Jeong;Soyeon Choi;Yungyo Im;Youngmin Seo;Myoungsoo Won;Junghwa Chun;Kyungmin Kim;Keunchang Jang;Joongbin Lim;Yangwon Lee
    • Korean Journal of Remote Sensing
    • /
    • v.39 no.6_1
    • /
    • pp.1341-1352
    • /
    • 2023
  • The normalized difference vegetation index (NDVI) derived from satellite images is a crucial tool to monitor forests and agriculture for broad areas because the periodic acquisition of the data is ensured. However, optical sensor-based vegetation indices(VI) are not accessible in some areas covered by clouds. This paper presented a synthetic aperture radar (SAR) based approach to retrieval of the optical sensor-based NDVI using machine learning. SAR system can observe the land surface day and night in all weather conditions. Radar vegetation indices (RVI) from the Sentinel-1 vertical-vertical (VV) and vertical-horizontal (VH) polarizations, surface elevation, and air temperature are used as the input features for an automated machine learning (AutoML) model to conduct the gap-filling of the Sentinel-2 NDVI. The mean bias error (MAE) was 7.214E-05, and the correlation coefficient (CC) was 0.878, demonstrating the feasibility of the proposed method. This approach can be applied to gap-free nationwide NDVI construction using Sentinel-1 and Sentinel-2 images for environmental monitoring and resource management.