• Title/Summary/Keyword: Energy Big Data

Search Result 255, Processing Time 0.038 seconds

Dynamic Data Migration in Hybrid Main Memories for In-Memory Big Data Storage

  • Mai, Hai Thanh;Park, Kyoung Hyun;Lee, Hun Soon;Kim, Chang Soo;Lee, Miyoung;Hur, Sung Jin
    • ETRI Journal
    • /
    • v.36 no.6
    • /
    • pp.988-998
    • /
    • 2014
  • For memory-based big data storage, using hybrid memories consisting of both dynamic random-access memory (DRAM) and non-volatile random-access memories (NVRAMs) is a promising approach. DRAM supports low access time but consumes much energy, whereas NVRAMs have high access time but do not need energy to retain data. In this paper, we propose a new data migration method that can dynamically move data pages into the most appropriate memories to exploit their strengths and alleviate their weaknesses. We predict the access frequency values of the data pages and then measure comprehensively the gains and costs of each placement choice based on these predicted values. Next, we compute the potential benefits of all choices for each candidate page to make page migration decisions. Extensive experiments show that our method improves over the existing ones the access response time by as much as a factor of four, with similar rates of energy consumption.

Study on Enhancement of Data Processing Algorithm in SaaS Cloud Infrastructure to Monitor Wind Turbine Condition (풍력발전기 상태 감시를 위한 SaaS 클라우드 인프라 내 데이터 처리 알고리즘 개선 연구)

  • Lee, Gwang-Se;Choi, Jungchul;Kang, Minsang;Park, Sail;Lee, JinJae
    • New & Renewable Energy
    • /
    • v.16 no.1
    • /
    • pp.25-30
    • /
    • 2020
  • In this study, an SW for the analysis of the wind-turbine vibration characteristics was developed as an application of SaaS cloud infrastructure. A measurement system for power-performance, mechanical load, and gearbox vibration as type-test class was installed at a target MW-class wind turbine, and structural meta and raw data were then acquired into the cloud. Data processing algorithms were developed to provide cloud data to the SW. To operate the SW continuously, raw data was downloaded consistently based on the algorithms. During the SW test, an intermittent long time-delay occurred due to the communication load associated with frequent access to the cloud. To solve this, a compression service for the target raw data was developed in the cloud and more stable data processing was confirmed. Using the compression service, stable big data processing of wind turbines, including gearbox vibration analysis, is expected.

Detection of Abnormal Ship Operation using a Big Data Platform based on Hadoop and Spark (하둡 및 스파크 기반 빅데이터 플랫폼을 이용한 선박 운항 효율 이상 상태 분석)

  • Lee, Taehyeon;Yu, Eun-seop;Park, Kaemyoung;Yu, Seongsang;Park, Jinpyo;Mun, Duhwan
    • Journal of the Korean Society of Manufacturing Process Engineers
    • /
    • v.18 no.6
    • /
    • pp.82-90
    • /
    • 2019
  • To reduce emissions of marine pollutants, regulations are being tightened around the world. In the shipbuilding and shipping industries, various countermeasures are being put forward. As there are limits to applying countermeasures to ships already in operation, however, it is necessary for these vessels to use energy efficiently. The sensors installed on ships typically gather a very large amount of data, and thus a big data platform is needed to manage and analyze the data. In this paper, we build a big data analysis platform based on Hadoop and Spark, and we present a method to detect abnormal ship operation using the platform. We also utilize real ship operation data to discuss the data analysis experiment.

Applying a big data analysis to evaluate the suitability of shelter locations for the evacuation of residents in case of radiological emergencies

  • Jin Sik Choi;Jae Wook Kim;Han Young Joo;Joo Hyun Moon
    • Nuclear Engineering and Technology
    • /
    • v.55 no.1
    • /
    • pp.261-269
    • /
    • 2023
  • During a nuclear power plant (NPP) accident, radioactive material may be released into the surrounding environment in the form of a radioactive plume. The behavior of the radioactive plume is influenced by meteorological factors such as wind direction and speed. If the residents are evacuated to a shelter in the direction of the flow of the radioactive plume, the radiation exposure of the residents may increase, contrary to the purpose of the evacuation. To avoid such an undesirable outcome, this paper applies a big data analysis to evaluate the suitability of the shelter locations near 5 NPPs in the Republic of Korea in terms of the seasonal wind direction frequency in those areas. To this end, the wind data measured around the NPPs from 2016 to 2020 were analyzed to derive the seasonal wind direction frequency using a big data analysis. These analyses results were then used to determine how many shelters around NPPs locate in areas with prevailing wind direction per season. Then, suggestions were made on the direction for residents not to evacuate, if possible, that is, the prevailing seasonal wind directions for 5 NPPs, depending on the season in which the accident occurs.

A new model and testing verification for evaluating the carbon efficiency of server

  • Liang Guo;Yue Wang;Yixing Zhang;Caihong Zhou;Kexin Xu;Shaopeng Wang
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.17 no.10
    • /
    • pp.2682-2700
    • /
    • 2023
  • To cope with the risks of climate change and promote the realization of carbon peaking and carbon neutrality, this paper first comprehensively considers the policy background, technical trends and carbon reduction paths of energy conservation and emission reduction in data center server industry. Second, we propose a computing power carbon efficiency of data center server, and constructs the carbon emission per performance of server (CEPS) model. According to the model, this paper selects the mainstream data center servers for testing. The result shows that with the improvement of server performance, the total carbon emissions are rising. However, the speed of performance improvement is faster than that of carbon emission, hence the relative carbon emission per unit computing power shows a continuous decreasing trend. Moreover, there are some differences between different products, and it is calculated that the carbon emission per unit performance is 20-60KG when the service life of the server is five years.

Energy Big Data Pre-processing System for Energy New Industries (에너지신산업을 위한 에너지 빅데이터 전처리 시스템)

  • Yang, Soo-Young;Kim, Yo-Han;Kim, Sang-Hyun;Kim, Won-Jung
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.16 no.5
    • /
    • pp.851-858
    • /
    • 2021
  • Due to the increase in renewable energy and distributed resources, not only traditional data but also various energy-related data are being generated in the new energy industry. In other words, there are various renewable energy facilities and power generation data, system operation data, metering and rate-related data, as well as weather and energy efficiency data necessary for new services and analysis. Energy big data processing technology can systematically analyze and diagnose data generated in the first half of the power production and consumption infrastructure, including distributed resources, systems, and AMI. Through this, it will be a technology that supports the creation of new businesses in convergence between the ICT industry and the energy industry. To this end, research on the data analysis system, such as itemized characteristic analysis of the collected data, correlation sampling, categorization of each feature, and element definition, is needed. In addition, research on data purification technology for data loss and abnormal state processing should be conducted. In addition, it is necessary to develop and structure NIFI, Spark, and HDFS systems so that energy data can be stored and managed in real time. In this study, the overall energy data processing technology and system for various power transactions as described above were proposed.

SNS Big-data Analysis and Implication of the Marine and Fisheries Sector (해양수산 SNS 빅데이터 분석 결과 및 시사점)

  • Park, Kwangseo;Lee, Jeongmin;Lee, Sunryang
    • Journal of the Korean Society for Marine Environment & Energy
    • /
    • v.20 no.2
    • /
    • pp.117-125
    • /
    • 2017
  • SNS Big-data Analysis means to find potential value from big data which has produced by the social media. In this paper, SNS Big-data has been analysed to find Korean concerns by using 24 key words from the marine and fisheries sector. Among 24 key words, seafood, shipping and Dokdo Island are the most mentioned ones. Some key words such as ocean policies and marine security that have less concerns have bess mentioned less. Also, key words that are led by government are mostly mentioned by news media, but key words that are led by private sector and have intimate relationship with people's lives are mostly mentioned by Blogs and Twitters. Therefore, reflecting close national concerns by SNS Big-data Analysis and especially resolving negative factors are the most significant part of the policy establishment. Also, differentiated promotion methods need to be prepared because the frequency of key words mentioned from each type of media are different.

Big Data Analysis of Public Acceptance of Nuclear Power in Korea

  • Roh, Seungkook
    • Nuclear Engineering and Technology
    • /
    • v.49 no.4
    • /
    • pp.850-854
    • /
    • 2017
  • Public acceptance of nuclear power is important for the government, the major stakeholder of the industry, because consensus is required to drive actions. It is therefore no coincidence that the governments of nations operating nuclear reactors are endeavoring to enhance public acceptance of nuclear power, as better acceptance allows stable power generation and peaceful processing of nuclear wastes produced from nuclear reactors. Past research, however, has been limited to epistemological measurements using methods such as the Likert scale. In this research, we propose big data analysis as an attractive alternative and attempt to identify the attitudes of the public on nuclear power. Specifically, we used common big data analyses to analyze consumer opinions via SNS (Social Networking Services), using keyword analysis and opinion analysis. The keyword analysis identified the attitudes of the public toward nuclear power. The public felt positive toward nuclear power when Korea successfully exported nuclear reactors to the United Arab Emirates. With the Fukushima accident in 2011 and certain supplier scandals in 2012, however, the image of nuclear power was degraded and the negative image continues. It is recommended that the government focus on developing useful businesses and use cases of nuclear power in order to improve public acceptance.

A Study on Production Prediction Model using a Energy Big Data based on Machine Learning (에너지 빅데이터를 활용한 머신러닝 기반의 생산 예측 모형 연구)

  • Kang, Mi-Young;Kim, Suk
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2022.10a
    • /
    • pp.453-456
    • /
    • 2022
  • The role of the power grid is to ensure stable power supply. It is necessary to take various measures to prepare for unstable situations without notice. After identifying the relationship between features through exploratory data analysis using weather data, a machine learning based energy production prediction model is modeled. In this study, the prediction reliability was increased by extracting the features that affect energy production prediction using principal component analysis and then applying it to the machine learning model. By using the proposed model to predict the production energy for a specific period and compare it with the actual production value at that time, the performance of the energy production prediction applying the principal component analysis was confirmed.

  • PDF

Estimation of ship operational efficiency from AIS data using big data technology

  • Kim, Seong-Hoon;Roh, Myung-Il;Oh, Min-Jae;Park, Sung-Woo;Kim, In-Il
    • International Journal of Naval Architecture and Ocean Engineering
    • /
    • v.12 no.1
    • /
    • pp.440-454
    • /
    • 2020
  • To prevent pollution from ships, the Energy Efficiency Design Index (EEDI) is a mandatory guideline for all new ships. The Ship Energy Efficiency Management Plan (SEEMP) has also been applied by MARPOL to all existing ships. SEEMP provides the Energy Efficiency Operational Indicator (EEOI) for monitoring the operational efficiency of a ship. By monitoring the EEOI, the shipowner or operator can establish strategic plans, such as routing, hull cleaning, decommissioning, new building, etc. The key parameter in calculating EEOI is Fuel Oil Consumption (FOC). It can be measured on board while a ship is operating. This means that only the shipowner or operator can calculate the EEOI of their own ships. If the EEOI can be calculated without the actual FOC, however, then the other stakeholders, such as the shipbuilding company and Class, or others who don't have the measured FOC, can check how efficiently their ships are operating compared to other ships. In this study, we propose a method to estimate the EEOI without requiring the actual FOC. The Automatic Identification System (AIS) data, ship static data, and environment data that can be publicly obtained are used to calculate the EEOI. Since the public data are of large capacity, big data technologies, specifically Hadoop and Spark, are used. We verify the proposed method using actual data, and the result shows that the proposed method can estimate EEOI from public data without actual FOC.