• Title/Summary/Keyword: Meteorological Big Data

Search Result 76, Processing Time 0.032 seconds

Renewable Energy Generation Prediction Model using Meteorological Big Data (기상 빅데이터를 활용한 신재생 에너지 발전량 예측 모형 연구)

  • Mi-Young Kang
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.18 no.1
    • /
    • pp.39-44
    • /
    • 2023
  • Renewable energy such as solar and wind power is a resource that is sensitive to weather conditions and environmental changes. Since the amount of power generated by a facility can vary depending on the installation location and structure, it is important to accurately predict the amount of power generation. Using meteorological data, a data preprocessing process based on principal component analysis was conducted to monitor the relationship between features that affect energy production prediction. In addition, in this study, the prediction was tested by reconstructing the dataset according to the sensitivity and applying it to the machine learning model. Using the proposed model, the performance of energy production prediction using random forest regression was confirmed by predicting energy production according to the meteorological environment for new and renewable energy, and comparing it with the actual production value at that time.

A Missing Value Replacement Method for Agricultural Meteorological Data Using Bayesian Spatio-Temporal Model (농업기상 결측치 보정을 위한 통계적 시공간모형)

  • Park, Dain;Yoon, Sanghoo
    • Journal of Environmental Science International
    • /
    • v.27 no.7
    • /
    • pp.499-507
    • /
    • 2018
  • Agricultural meteorological information is an important resource that affects farmers' income, food security, and agricultural conditions. Thus, such data are used in various fields that are responsible for planning, enforcing, and evaluating agricultural policies. The meteorological information obtained from automatic weather observation systems operated by rural development agencies contains missing values owing to temporary mechanical or communication deficiencies. It is known that missing values lead to reduction in the reliability and validity of the model. In this study, the hierarchical Bayesian spatio-temporal model suggests replacements for missing values because the meteorological information includes spatio-temporal correlation. The prior distribution is very important in the Bayesian approach. However, we found a problem where the spatial decay parameter was not converged through the trace plot. A suitable spatial decay parameter, estimated on the bias of root-mean-square error (RMSE), which was determined to be the difference between the predicted and observed values. The latitude, longitude, and altitude were considered as covariates. The estimated spatial decay parameters were 0.041 and 0.039, for the spatio-temporal model with latitude and longitude and for latitude, longitude, and altitude, respectively. The posterior distributions were stable after the spatial decay parameter was fixed. root mean square error (RMSE), mean absolute error (MAE), mean absolute percentage error (MAPE), and bias were calculated for model validation. Finally, the missing values were generated using the independent Gaussian process model.

Development of Examination Model of Weather Factors on Garlic Yield Using Big Data Analysis (빅데이터 분석을 활용한 마늘 생산에 미치는 날씨 요인에 관한 영향 조사 모형 개발)

  • Kim, Shinkon
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.19 no.5
    • /
    • pp.480-488
    • /
    • 2018
  • The development of information and communication technology has been carried out actively in the field of agriculture to generate valuable information from large amounts of data and apply big data technology to utilize it. Crops and their varieties are determined by the influence of the natural environment such as temperature, precipitation, and sunshine hours. This paper derives the climatic factors affecting the production of crops using the garlic growth process and daily meteorological variables. A prediction model was also developed for the production of garlic per unit area. A big data analysis technique considering the growth stage of garlic was used. In the exploratory data analysis process, various agricultural production data, such as the production volume, wholesale market load, and growth data were provided from the National Statistical Office, the Rural Development Administration, and Korea Rural Economic Institute. Various meteorological data, such as AWS, ASOS, and special status data, were collected and utilized from the Korea Meteorological Agency. The correlation analysis process was designed by comparing the prediction power of the models and fitness of models derived from the variable selection, candidate model derivation, model diagnosis, and scenario prediction. Numerous weather factor variables were selected as descriptive variables by factor analysis to reduce the dimensions. Using this method, it was possible to effectively control the multicollinearity and low degree of freedom that can occur in regression analysis and improve the fitness and predictive power of regression analysis.

A Study on the Development of Flight Prediction Model and Rules for Military Aircraft Using Data Mining Techniques (데이터 마이닝 기법을 활용한 군용 항공기 비행 예측모형 및 비행규칙 도출 연구)

  • Yu, Kyoung Yul;Moon, Young Joo;Jeong, Dae Yul
    • The Journal of Information Systems
    • /
    • v.31 no.3
    • /
    • pp.177-195
    • /
    • 2022
  • Purpose This paper aims to prepare a full operational readiness by establishing an optimal flight plan considering the weather conditions in order to effectively perform the mission and operation of military aircraft. This paper suggests a flight prediction model and rules by analyzing the correlation between flight implementation and cancellation according to weather conditions by using big data collected from historical flight information of military aircraft supplied by Korean manufacturers and meteorological information from the Korea Meteorological Administration. In addition, by deriving flight rules according to weather information, it was possible to discover an efficient flight schedule establishment method in consideration of weather information. Design/methodology/approach This study is an analytic study using data mining techniques based on flight historical data of 44,558 flights of military aircraft accumulated by the Republic of Korea Air Force for a total of 36 months from January 2013 to December 2015 and meteorological information provided by the Korea Meteorological Administration. Four steps were taken to develop optimal flight prediction models and to derive rules for flight implementation and cancellation. First, a total of 10 independent variables and one dependent variable were used to develop the optimal model for flight implementation according to weather condition. Second, optimal flight prediction models were derived using algorithms such as logistics regression, Adaboost, KNN, Random forest and LightGBM, which are data mining techniques. Third, we collected the opinions of military aircraft pilots who have more than 25 years experience and evaluated importance level about independent variables using Python heatmap to develop flight implementation and cancellation rules according to weather conditions. Finally, the decision tree model was constructed, and the flight rules were derived to see how the weather conditions at each airport affect the implementation and cancellation of the flight. Findings Based on historical flight information of military aircraft and weather information of flight zone. We developed flight prediction model using data mining techniques. As a result of optimal flight prediction model development for each airbase, it was confirmed that the LightGBM algorithm had the best prediction rate in terms of recall rate. Each flight rules were checked according to the weather condition, and it was confirmed that precipitation, humidity, and the total cloud had a significant effect on flight cancellation. Whereas, the effect of visibility was found to be relatively insignificant. When a flight schedule was established, the rules will provide some insight to decide flight training more systematically and effectively.

Developing a Solution to Improve Road Safety Using Multiple Deep Learning Techniques

  • Humberto, Villalta;Min gi, Lee;Yoon Hee, Jo;Kwang Sik, Kim
    • International Journal of Internet, Broadcasting and Communication
    • /
    • v.15 no.1
    • /
    • pp.85-96
    • /
    • 2023
  • The number of traffic accidents caused by wet or icy road surface conditions is on the rise every year. Car crashes in such bad road conditions can increase fatalities and serious injuries. Historical data (from the year 2016 to the year 2020) on weather-related traffic accidents show that the fatality rates are fairly high in Korea. This requires accurate prediction and identification of hazardous road conditions. In this study, a forecasting model is developed to predict the chances of traffic accidents that can occur on roads affected by weather and road surface conditions. Multiple deep learning algorithms taking into account AlexNet and 2D-CNN are employed. Data on orthophoto images, automatic weather systems, automated synoptic observing systems, and road surfaces are used for training and testing purposes. The orthophotos images are pre-processed before using them as input data for the modeling process. The procedure involves image segmentation techniques as well as the Z-Curve index. Results indicate that there is an acceptable performance of prediction such as 65% for dry, 46% for moist, and 33% for wet road conditions. The overall accuracy of the model is 53%. The findings of the study may contribute to developing comprehensive measures for enhancing road safety.

Constructing Efficient Regional Hazardous Weather Prediction Models through Big Data Analysis

  • Lee, Jaedong;Lee, Jee-Hyong
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.16 no.1
    • /
    • pp.1-12
    • /
    • 2016
  • In this paper, we propose an approach that efficiently builds regional hazardous weather prediction models based on past weather data. Doing so requires finding the proper weather attributes that strongly affect hazardous weather for each region, and that requires a large number of experiments to build and test models with different attribute combinations for each kind of hazardous weather in each region. Using our proposed method, we reduce the number of experiments needed to find the correct weather attributes. Compared to the traditional method, our method decreases the number of experiments by about 45%, and the average prediction accuracy for all hazardous weather conditions and regions is 79.61%, which can help forecasters predict hazardous weather. The Korea Meteorological Administration currently uses the prediction models given in this paper.

Modelling of a Base Big Data Analysis Using R Method for Selection of Suitable Vertical Farm Sites: Focusing on the Analysis of Pollutants

  • Huh, Jun-Ho;Seo, Kyungryong
    • Journal of Korea Multimedia Society
    • /
    • v.19 no.12
    • /
    • pp.1970-1980
    • /
    • 2016
  • The problem of food deficiency is a major discouragement to many low-income developing countries. Most of these countries experience constant danger of hunger, malnutrition and diseases as they are unable to maintain their food supplies mainly due to lack of arable lands and modern crop, livestock and fishery production technologies. In addition, the pollutants resulting from the secondary industries are becoming another serious issue in their food problems. The pollutants mixed in the sands blowing from the mainland China and the toxic waters flowing in the farm land form the industrialized zones are some of the examples. The Vertical Farm, or Plant Factory, proposed in this study could be the best alternative food production system for them. Vertical farm is an efficient food production system that yields relatively a large volume of food materials without environmental risks. The system does not require a large open space and manpower and can minimize the possibility of infiltration of pollutants. This research describes a basic model of the system focusing on determining the optimal sites for it based on the meteorological data concentrating on the atmospheric pollutants. The types and volume of pollutants are analyzed and identified through the big data obtained, followed by visualization of analysis results and their comparisons for better understanding.

Applying a big data analysis to evaluate the suitability of shelter locations for the evacuation of residents in case of radiological emergencies

  • Jin Sik Choi;Jae Wook Kim;Han Young Joo;Joo Hyun Moon
    • Nuclear Engineering and Technology
    • /
    • v.55 no.1
    • /
    • pp.261-269
    • /
    • 2023
  • During a nuclear power plant (NPP) accident, radioactive material may be released into the surrounding environment in the form of a radioactive plume. The behavior of the radioactive plume is influenced by meteorological factors such as wind direction and speed. If the residents are evacuated to a shelter in the direction of the flow of the radioactive plume, the radiation exposure of the residents may increase, contrary to the purpose of the evacuation. To avoid such an undesirable outcome, this paper applies a big data analysis to evaluate the suitability of the shelter locations near 5 NPPs in the Republic of Korea in terms of the seasonal wind direction frequency in those areas. To this end, the wind data measured around the NPPs from 2016 to 2020 were analyzed to derive the seasonal wind direction frequency using a big data analysis. These analyses results were then used to determine how many shelters around NPPs locate in areas with prevailing wind direction per season. Then, suggestions were made on the direction for residents not to evacuate, if possible, that is, the prevailing seasonal wind directions for 5 NPPs, depending on the season in which the accident occurs.

Developing and Evaluating Damage Information Classifier of High Impact Weather by Using News Big Data (재해기상 언론기사 빅데이터를 활용한 피해정보 자동 분류기 개발)

  • Su-Ji, Cho;Ki-Kwang Lee
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.46 no.3
    • /
    • pp.7-14
    • /
    • 2023
  • Recently, the importance of impact-based forecasting has increased along with the socio-economic impact of severe weather have emerged. As news articles contain unconstructed information closely related to the people's life, this study developed and evaluated a binary classification algorithm about snowfall damage information by using media articles text mining. We collected news articles during 2009 to 2021 which containing 'heavy snow' in its body context and labelled whether each article correspond to specific damage fields such as car accident. To develop a classifier, we proposed a probability-based classifier based on the ratio of the two conditional probabilities, which is defined as I/O Ratio in this study. During the construction process, we also adopted the n-gram approach to consider contextual meaning of each keyword. The accuracy of the classifier was 75%, supporting the possibility of application of news big data to the impact-based forecasting. We expect the performance of the classifier will be improve in the further research as the various training data is accumulated. The result of this study can be readily expanded by applying the same methodology to other disasters in the future. Furthermore, the result of this study can reduce social and economic damage of high impact weather by supporting the establishment of an integrated meteorological decision support system.

Big Data Study about the Effects of Weather Factors on Food Poisoning Incidence (기상요인과 식중독 발병의 연관성에 대한 빅 데이터 분석)

  • Park, Ji-Ae;Kim, Jang-Mook;Lee, Ho-Sung;Lee, He-Jin
    • Journal of Digital Convergence
    • /
    • v.14 no.3
    • /
    • pp.319-327
    • /
    • 2016
  • This research attempts an analysis that fuses the big data concerning weather variation and health care from January 1, 2011 to December 31, 2014; it gives the weather factor as to what kind of influence there is for the incidence of food poisoning, and also endeavors to be helpful regarding national health prevention. By using R, the Logistic and Lasso Logistic Regression were analyzed. The main factor germ generating the food poisoning was classified and the incidence was confirmed for the germ of bacteria and virus. According to the result of the analysis of Logistic Regression, we found that the incidence of bacterial food poisoning was affected by the following influences: the average temperature, amount of sunshine deviation, and deviation of temperature. Furthermore, the weather factors, having an effect on the incidence of viral food poisoning, were: the minimum vapor pressure, amount of sunshine deviation and deviation of temperature. This study confirmed the correlation of meteorological factors and incidence of food poisoning. It was also found out that even if the incidence from two causes were influenced by the same weather factor, the incidence might be oppositely affected by the characteristic of the germs.