• 제목/요약/키워드: Energy Big Data

검색결과 256건 처리시간 0.02초

하둡기반 빅데이터 시스템을 이용한 스마트그리드 전력데이터 분석 (Analyzing Smart Grid Energy Data using Hadoop Based Big Data System)

  • 조영탁;이원진;이인규;온병원;최중인
    • 전기학회논문지P
    • /
    • 제64권2호
    • /
    • pp.85-91
    • /
    • 2015
  • With the increasing popularity of Smart Grid infrastructure, it is much easier to collect energy usage data using AMI (Advanced Measuring Instrument) from residential housing, buildings and factories. Several researches have been done to improve an energy efficiency by analyzing the collected energy usage data. However, it is not easy to store and analyze the energy data using a traditional relational database management system since the data size grows exponentially with an increasing popularity of Smart grid infrastructure. In this paper, we are proposing a Hadoop based Big data system to store and analyze energy usage data. Based on our limited experiments, Hadoop based energy data analysis is three times faster than that of a relational database management system based approach with the current system.

블록체인 네트워크를 이용한 소규모 분산전력 거래플랫폼의 정산소요시간에 관한 연구 (A Study on the Accounts Balancing Time of Small Distributed Power Trading Platform Using Block Chain Network)

  • 김영곤;허걸;최중인;위재우
    • 에너지공학
    • /
    • 제27권4호
    • /
    • pp.86-91
    • /
    • 2018
  • 이 논문은 블록체인[1] 기술을 활용한 소규모 분산전력자원 거래 플랫폼에서의 정산소요시간에 대한 고찰이다. 먼저 연구에 적용한 "AMI 인프라를 활용한 국민 VPP 에너지 관리 시스템 (AI 기반의 에너지 거래 플랫폼)"을 소개한 후, 테스트베드 환경 내 IoT 전력 빅데이터[2] 분석으로 인증된 프로슈머의 발전(감축)량에 근거하여 지급되는 블록체인 암호화폐 코인의 정산과정 그리고 소요시간에 대하여 알아본다. 더불어 기존 람다 아키텍처에 MapD[3]를 적용한 GPU Fast 빅데이터 전력 빅데이터 분석 시스템 구성을 제시 한다.

태양광 패널 일사량에 기반한 대표연도 데이터 비교 평가 (Comparative Assessment of Typical Year Dataset based on POA Irradiance)

  • 윤창열;김보영;김창기;김현구;강용혁;김용일
    • 신재생에너지
    • /
    • 제20권1호
    • /
    • pp.102-109
    • /
    • 2024
  • The Typical Meteorological Year (TMY) dataset compiles 12 months of data that best represent long-term climate patterns, focusing on global horizontal irradiance and other weather-related variables. However, the irradiance measured on the plane of the array (POA) shows certain distinct distribution characteristics compared with the irradiance in the TMY dataset, and this may introduce some biases. Our research recalculated POA irradiance using both the Isotropic and DIRINT models, generating an updated dataset that was tailored to POA characteristics. Our analysis showed a 28% change in the selection of typical meteorological months, an 8% increase in average irradiance, and a 40% reduction in the range of irradiance values, thus indicating a significant shift in irradiance distribution patterns. This research aims to inform stakeholders about accurate use of TMY datasets in potential decision-making. These findings underscore the necessity of creating a typical dataset by using the time series of POA irradiance, which represents the orientation in which PV panels will be deployed.

스마트공장을 위한 빅데이터 애널리틱스 플랫폼 아키텍쳐 개발 (Developing a Big Data Analytics Platform Architecture for Smart Factory)

  • 신승준;우정엽;서원철
    • 한국멀티미디어학회논문지
    • /
    • 제19권8호
    • /
    • pp.1516-1529
    • /
    • 2016
  • While global manufacturing is becoming more competitive due to variety of customer demand, increase in production cost and uncertainty in resource availability, the future ability of manufacturing industries depends upon the implementation of Smart Factory. With the convergence of new information and communication technology, Smart Factory enables manufacturers to respond quickly to customer demand and minimize resource usage while maximizing productivity performance. This paper presents the development of a big data analytics platform architecture for Smart Factory. As this platform represents a conceptual software structure needed to implement data-driven decision-making mechanism in shop floors, it enables the creation and use of diagnosis, prediction and optimization models through the use of data analytics and big data. The completion of implementing the platform will help manufacturers: 1) acquire an advanced technology towards manufacturing intelligence, 2) implement a cost-effective analytics environment through the use of standardized data interfaces and open-source solutions, 3) obtain a technical reference for time-efficiently implementing an analytics modeling environment, and 4) eventually improve productivity performance in manufacturing systems. This paper also presents a technical architecture for big data infrastructure, which we are implementing, and a case study to demonstrate energy-predictive analytics in a machine tool system.

DTG Big Data Analysis for Fuel Consumption Estimation

  • Cho, Wonhee;Choi, Eunmi
    • Journal of Information Processing Systems
    • /
    • 제13권2호
    • /
    • pp.285-304
    • /
    • 2017
  • Big data information and pattern analysis have applications in many industrial sectors. To reduce energy consumption effectively, the eco-driving method that reduces the fuel consumption of vehicles has recently come under scrutiny. Using big data on commercial vehicles obtained from digital tachographs (DTGs), it is possible not only to aid traffic safety but also improve eco-driving. In this study, we estimate fuel consumption efficiency by processing and analyzing DTG big data for commercial vehicles using parallel processing with the MapReduce mechanism. Compared to the conventional measurement of fuel consumption using the On-Board Diagnostics II (OBD-II) device, in this paper, we use actual DTG data and OBD-II fuel consumption data to identify meaningful relationships to calculate fuel efficiency rates. Based on the driving pattern extracted from DTG data, estimating fuel consumption is possible by analyzing driving patterns obtained only from DTG big data.

Self-organization Scheme of WSNs with Mobile Sensors and Mobile Multiple Sinks for Big Data Computing

  • Shin, Ahreum;Ryoo, Intae;Kim, Seokhoon
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • 제14권3호
    • /
    • pp.943-961
    • /
    • 2020
  • With the advent of IoT technology and Big Data computing, the importance of WSNs (Wireless Sensor Networks) has been on the rise. For energy-efficient and collection-efficient delivery of any sensed data, lots of novel wireless medium access control (MAC) protocols have been proposed and these MAC schemes are the basis of many IoT systems that leads the upcoming fourth industrial revolution. WSNs play a very important role in collecting Big Data from various IoT sensors. Also, due to the limited amount of battery driving the sensors, energy-saving MAC technologies have been recently studied. In addition, as new IoT technologies for Big Data computing emerge to meet different needs, both sensors and sinks need to be mobile. To guarantee stability of WSNs with dynamic topologies as well as frequent physical changes, the existing MAC schemes must be tuned for better adapting to the new WSN environment which includes energy-efficiency and collection-efficiency of sensors, coverage of WSNs and data collecting methods of sinks. To address these issues, in this paper, a self-organization scheme for mobile sensor networks with mobile multiple sinks has been proposed and verified to adapt both mobile sensors and multiple sinks to 3-dimensional group management MAC protocol. Performance evaluations show that the proposed scheme outperforms the previous schemes in terms of the various usage cases. Therefore, the proposed self-organization scheme might be adaptable for various computing and networking environments with big data.

블록체인 네트워크를 이용한 빅데이터 분석 기반 생산·소비량 인증 전력 거래 시스템에 관한 연구 (A Study on the Production and Consumption Authentication Power Trading System based on Big Data Analysis using Blockchain Network)

  • 김영곤;허걸;최중인
    • 에너지공학
    • /
    • 제28권4호
    • /
    • pp.76-81
    • /
    • 2019
  • 이 논문은 에너지 클라우드 참여 프로슈머의 신뢰성 있는 생산 및 소비량 인증에 기반 한 개인 간 거래, 클라우드 간 거래, 그리고 소규모 분산전력 중개시장 참여 등의 다양한 에너지 프로슈머 비즈니스 모델에 필요한 생산·소비량 인증 기반 전력 거래 시스템에 관한 고찰이다. 이 시스템은 에너지 거래에 있어 가장 중요한 파라미터로 간주할 수 있는 거래 정산의 신뢰성을 확보하기 위한 것으로써 에너지 프로슈머로부터 수집되는 발전·소비 빅데이터 분석에 의한 인증 기반 블록체인 스마트 컨트랙트 체결을 위한 것이다. 이를 위하여 IoT AMI로부터 수집 된 빅데이터 분석 시스템과 AMI 와 연계 구성된 프라이빗 블록체인 네트워크를 적용한 생산량 인증 시스템 구성을 소개하고 블록체인 스마트 컨트랙트를 활용한 전력 거래 매칭 방식을 제안한다. 마지막으로 에너지 클러스터 거래 시스템 및 비즈니스모델을 알아본다.

공학교육 빅 데이터 분석 도구 개발 연구 (Research on the Development of Big Data Analysis Tools for Engineering Education)

  • 김윤영;김재희
    • 공학교육연구
    • /
    • 제26권4호
    • /
    • pp.22-35
    • /
    • 2023
  • As information and communication technology has developed remarkably, it has become possible to analyze various types of large-volume data generated at a speed close to real time, and based on this, reliable value creation has become possible. Such big data analysis is becoming an important means of supporting decision-making based on scientific figures. The purpose of this study is to develop a big data analysis tool that can analyze large amounts of data generated through engineering education. The tasks of this study are as follows. First, a database is designed to store the information of entries in the National Creative Capstone Design Contest. Second, the pre-processing process is checked for analysis with big data analysis tools. Finally, analyze the data using the developed big data analysis tool. In this study, 1,784 works submitted to the National Creative Comprehensive Design Contest from 2014 to 2019 were analyzed. As a result of selecting the top 10 words through topic analysis, 'robot' ranked first from 2014 to 2019, and energy, drones, ultrasound, solar energy, and IoT appeared with high frequency. This result seems to reflect the current core topics and technology trends of the 4th Industrial Revolution. In addition, it seems that due to the nature of the Capstone Design Contest, students majoring in electrical/electronic, computer/information and communication engineering, mechanical engineering, and chemical/new materials engineering who can submit complete products for problem solving were selected. The significance of this study is that the results of this study can be used in the field of engineering education as basic data for the development of educational contents and teaching methods that reflect industry and technology trends. Furthermore, it is expected that the results of big data analysis related to engineering education can be used as a means of preparing preemptive countermeasures in establishing education policies that reflect social changes.

기후 자료 분석을 통한 장기 기후변동성이 태양광 발전량에 미치는 영향 연구 (Assessing the Impact of Long-Term Climate Variability on Solar Power Generation through Climate Data Analysis)

  • 김창기;김현구;김진영
    • 신재생에너지
    • /
    • 제19권4호
    • /
    • pp.98-107
    • /
    • 2023
  • A study was conducted to analyze data from 1981 to 2020 for understanding the impact of climate on solar energy generation. A significant increase of 104.6 kWhm-2 was observed in the annual cumulative solar radiation over this period. Notably, the distribution of solar radiation shifted, with the solar radiation in Busan rising from the seventh place in 1981 to the second place in 2020 in South Korea. This study also examined the correlation between long-term temperature trends and solar radiation. Areas with the highest solar radiation in 2020, such as Busan, Gwangju, Daegu, and Jinju, exhibited strong positive correlations, suggesting that increased solar radiation contributed to higher temperatures. Conversely, regions like Seosan and Mokpo showed lower temperature increases due to factors such as reduced cloud cover. To evaluate the impact on solar energy production, simulations were conducted using climate data from both years. The results revealed that relying solely on historical data for solar energy predictions could lead to overestimations in some areas, including Seosan or Jinju, and underestimations in others such as Busan. Hence, considering long-term climate variability is vital for accurate solar energy forecasting and ensuring the economic feasibility of solar projects.

Big Data Strategies for Government, Society and Policy-Making

  • LEE, Jung Wan
    • The Journal of Asian Finance, Economics and Business
    • /
    • 제7권7호
    • /
    • pp.475-487
    • /
    • 2020
  • The paper aims to facilitate a discussion around how big data technologies and data from citizens can be used to help public administration, society, and policy-making to improve community's lives. This paper discusses opportunities and challenges of big data strategies for government, society, and policy-making. It employs the presentation of numerous practical examples from different parts of the world, where public-service delivery has seen transformation and where initiatives have been taken forward that have revolutionized the way governments at different levels engage with the citizens, and how governments and civil society have adopted evidence-driven policy-making through innovative and efficient use of big data analytics. The examples include the governments of the United States, China, the United Kingdom, and India, and different levels of government agencies in the public services of fraud detection, financial market analysis, healthcare and public health, government oversight, education, crime fighting, environmental protection, energy exploration, agriculture, weather forecasting, and ecosystem management. The examples also include smart cities in Korea, China, Japan, India, Canada, Singapore, the United Kingdom, and the European Union. This paper makes some recommendations about how big data strategies transform the government and public services to become more citizen-centric, responsive, accountable and transparent.