The Journal of the Korea institute of electronic communication sciences (한국전자통신학회논문지)

Korea Institute of Electronic Communication Science (한국전자통신학회)
권호 표지
DOI QR코드

DOI QR Code

Energy Big Data Pre-processing System for Energy New Industries

에너지신산업을 위한 에너지 빅데이터 전처리 시스템

  • 양수영 (부산대학교 사물인터넷연구센터) ;
  • 김요한 ((주)엘시스 기업부설연구소) ;
  • 김상현 ((주)아이웍스) ;
  • 김원중 (순천대학교 컴퓨터공학과)
  • Received : 2021.08.23
  • Accepted : 2021.10.17
  • Published : 2021.10.31
Download PDF
⟨ Previous Next ⟩

Abstract

Due to the increase in renewable energy and distributed resources, not only traditional data but also various energy-related data are being generated in the new energy industry. In other words, there are various renewable energy facilities and power generation data, system operation data, metering and rate-related data, as well as weather and energy efficiency data necessary for new services and analysis. Energy big data processing technology can systematically analyze and diagnose data generated in the first half of the power production and consumption infrastructure, including distributed resources, systems, and AMI. Through this, it will be a technology that supports the creation of new businesses in convergence between the ICT industry and the energy industry. To this end, research on the data analysis system, such as itemized characteristic analysis of the collected data, correlation sampling, categorization of each feature, and element definition, is needed. In addition, research on data purification technology for data loss and abnormal state processing should be conducted. In addition, it is necessary to develop and structure NIFI, Spark, and HDFS systems so that energy data can be stored and managed in real time. In this study, the overall energy data processing technology and system for various power transactions as described above were proposed.

재생에너지 및 분산자원의 증가로 에너지신산업에서는 전통적인 데이터뿐만 아니라 다양한 에너지 관련 데이터들이 생성되고 있다. 즉 다양한 재생에너지 설비와 발전 데이터, 계통 운영 데이터, 계량 및 요금 관련 데이터뿐만 아니라 새로운 서비스와 분석을 위해 필요한 기상 및 에너지 효율화 데이터 등이 있다. 에너지 빅데이터 처리 기술은 분산자원, 계통, AMI(: Advanced Metering Infrastructure)를 포함한 전력 생산·소비 인프라의 전반기에서 발생하는 데이터를 체계적으로 분석 ·진단할 수 있다. 이를 통해 ICT(: Information and Communications Technology)산업과 에너지 산업 간 융복합의 새로운 비즈니스 창출을 지원하는 기술이 될 수 있을 것이다. 이를 위해서 수집된 데이터의 항목별 특성 분석 및 연관관계 표본 추출과 각 특징들의 범주화 및 요소 정의 등 데이터 분석 시스템에 대한 연구가 필요하다. 또한 데이터의 손실 및 이상 상태 처리를 위한 데이터 정제 기술에 대한 연구가 이루어져야 한다. 그리고 에너지 데이터를 실시간으로 저장 및 관리할 수 있도록 Apache NIFI, Spark, HDFS(: Hadoop Distributed File System)에 대한 개발 및 구축이 필요하다. 본 연구에서는 위와 같은 다양한 전력거래를 위한 전반적인 에너지 데이터 처리 기술과 시스템를 제안하였다.

Keywords

Acknowledgement

이 논문은 2021년 순천대학교 교연비 사업에 의하여 연구되었음.

References

  1. W. Lee, I. Lee, B. On and J. Choi, "A Study on the Big Data System for Smart Grid Power Data Analysis," Communications of the Korean Institute of Information Scientists and Engineers, vol. 32, no. 9, 2014, pp. 35-41.
  2. J. Lim and J. Kim, "A Study on the Use of Big Data in the Energy Sector," Korea Energy Economics Institute, Report, 2014. 9.
  3. M. Kil, G. Kim, Y. Moon, and W. Lee, "A Study on the Use of Big Data in the Power Industry and the Latest Trend Analysis," Korea information processing society review, vol. 22, no. 4, 2015, pp. 13-21.
  4. W. Lee, I. Lee, B. On, and J. Choi, "A Study on the Utilization of Big Data in the Power Industry," Yonsei University Graduate School of Information, Master's thesis, 2016. 12.
  5. J. Choi, "A Study on Strategies for Responding to Climate Change Using Core Technologies of the 4th Industrial Revolution-focusing on Big Data-," Korea Legislation Research Institute, Report, 2017. 12.
  6. H. Lee, S. Lee, J. Kom and J. Choi, "Development of power energy services based on Big Data," Korea journal of geothermal energy, vol. 11, no. 2, 2015, pp. 20-31.
  7. J. Choi and W. Lee, "Energy ICT convergence with Big Data services," J. of the Korean Data & Information Science Society, vol. 5, no. 2, 2015, pp. 1141-1154.
  8. H. Lee, S. Lee, J. Kom, and J. Choi, "Development of power energy services based on Big Data," Korea journal of geothermal energy, vol. 11, no. 2, 2015, pp. 20-31.
  9. J. Kang and J. You, "Time-series Big Data analytics software on IoT streaming data," Korea Information Processing Association 2018 Spring Conference, 2018, pp. 52-53.
  10. K. Jang and S. Bae, "Design for Haddop-based Platform to Improve Io T-based Big Data Processing Efficiency," J. of Chosun Natural Science, vol. 13, no. 3, 2020, pp. 114-119. https://doi.org/10.13160/RICNS.2020.13.3.114
  11. S. Yang, Y. Kim, W. Lee and W. Kim, "The Power Brokerage Trading System for Efficient Management of Small-Scale Distributed Energy-Resources," J. of the Korea Institute of Electronic Communication Sciences, vol. 16, no. 4, 2021, pp. 735-742. https://doi.org/10.13067/JKIECS.2021.16.4.735
  12. B. Lee, K. Kim, and N. Choi, "Power Interruption Cost Calculation based on Value-based Methodology," J. of the Korea Institute of Electronic Communication Sciences, vol.16, no. 2, 2021, pp. 293-300. https://doi.org/10.13067/JKIECS.2021.16.2.293
  13. J. Choi and H. Choi, "Prediction of Wind Power Generation for Calculation of ESS Capacity using Multi-Layer Perceptron," J. of the Korea Institute of Electronic Communication Sciences, vol. 16, no. 2, 2021, pp. 319-328.. https://doi.org/10.13067/JKIECS.2021.16.2.319