• Title/Summary/Keyword: Big data platform

Search Result 503, Processing Time 0.028 seconds

Real-time IoT Big Data Analysis Platform Requirements (실시간 IoT Big Data 분석 플랫폼 요건)

  • Kang, Sun-Kyoung;Lee, Hyun-Chang;Shin, Seong-Yoon
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2017.05a
    • /
    • pp.165-166
    • /
    • 2017
  • It is demanding to receive information of data in real time anywhere and analyze it with meaningful data. Research on the platform for such analysis is actively underway. In this paper, we try to find out what are important factors in solving the problems of collecting and analyzing IoT data in real time. How much better than existing data collection methods and analytical methods can be the basis for judging the value of the data. It is important to accurately collect and store data more quickly and quickly from many sensors in real time in real time, and analytical methods that can derive values from the stored data. Therefore, an important requirement of the analysis platform in the IoT environment is to process large amount of data in real time and to centralize and manage it.

  • PDF

Clustering of Smart Meter Big Data Based on KNIME Analytic Platform (KNIME 분석 플랫폼 기반 스마트 미터 빅 데이터 클러스터링)

  • Kim, Yong-Gil;Moon, Kyung-Il
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.20 no.2
    • /
    • pp.13-20
    • /
    • 2020
  • One of the major issues surrounding big data is the availability of massive time-based or telemetry data. Now, the appearance of low cost capture and storage devices has become possible to get very detailed time data to be used for further analysis. Thus, we can use these time data to get more knowledge about the underlying system or to predict future events with higher accuracy. In particular, it is very important to define custom tailored contract offers for many households and businesses having smart meter records and predict the future electricity usage to protect the electricity companies from power shortage or power surplus. It is required to identify a few groups with common electricity behavior to make it worth the creation of customized contract offers. This study suggests big data transformation as a side effect and clustering technique to understand the electricity usage pattern by using the open data related to smart meter and KNIME which is an open source platform for data analytics, providing a user-friendly graphical workbench for the entire analysis process. While the big data components are not open source, they are also available for a trial if required. After importing, cleaning and transforming the smart meter big data, it is possible to interpret each meter data in terms of electricity usage behavior through a dynamic time warping method.

Research on Big Data Integration Method

  • Kim, Jee-Hyun;Cho, Young-Im
    • Journal of the Korea Society of Computer and Information
    • /
    • v.22 no.1
    • /
    • pp.49-56
    • /
    • 2017
  • In this paper we propose the approach for big data integration so as to analyze, visualize and predict the future of the trend of the market, and that is to get the integration data model using the R language which is the future of the statistics and the Hadoop which is a parallel processing for the data. As four approaching methods using R and Hadoop, ff package in R, R and Streaming as Hadoop utility, and Rhipe and RHadoop as R and Hadoop interface packages are used, and the strength and weakness of four methods are described and analyzed, so Rhipe and RHadoop are proposed as a complete set of data integration model. The integration of R, which is popular for processing statistical algorithm and Hadoop contains Distributed File System and resource management platform and can implement the MapReduce programming model gives us a new environment where in R code can be written and deployed in Hadoop without any data movement. This model allows us to predictive analysis with high performance and deep understand over the big data.

Housework and Care in the Era of the 4th Industrial Revolution through Big Data: Changes in the Aspects of Household Service based on the Platform (빅데이터로 살펴본 4차 산업혁명 시대의 가사노동과 돌봄: 플랫폼을 통한 가사서비스 양상 변화)

  • Lee, hyunah;Kwon, Soonbum
    • Journal of Family Resource Management and Policy Review
    • /
    • v.27 no.1
    • /
    • pp.13-24
    • /
    • 2023
  • The 4th industrial revolution came deep into family life and changed the way of housework and care. The change in the family caused by the technological change of the 4th industrial revolution is remarkable in terms of socialization of housework. In this study, the socialization of housework, which is accelerating in the era of the 4th industrial revolution, was examined focusing on the change in the aspect of "household service" through the "platform". Since 2015, when technological changes in the 4th industrial revolution began to decline, related newspaper articles were extracted for daily and economic newspapers nationwide and analyzed big data. The results of big data analysis show that the platform economy using the 4th industrial revolution technology is rapidly spreading the socialization of housework not only at the business level but also at the public policy level. It has been confirmed that support for household services through the platform is growing into a new business area of companies, and at the public policy level, it is being treated as an important policy task in supporting work-family balance or responding to infectious diseases. This study is meaningful in that it provided an opportunity to reflect on the roles and tasks of the family, market, and state for housework and care in the future through changes in housework and care caused by the 4th industrial revolution technology.

Collection and Analysis of Electricity Consumption Data in POSTECH Campus (포스텍 캠퍼스의 전력 사용 데이터 수집 및 분석)

  • Ryu, Do-Hyeon;Kim, Kwang-Jae;Ko, YoungMyoung;Kim, Young-Jin;Song, Minseok
    • Journal of Korean Society for Quality Management
    • /
    • v.50 no.3
    • /
    • pp.617-634
    • /
    • 2022
  • Purpose: This paper introduces Pohang University of Science Technology (POSTECH) advanced metering infrastructure (AMI) and Open Innovation Big Data Center (OIBC) platform and analysis results of electricity consumption data collected via the AMI in POSTECH campus. Methods: We installed 248 sensors in seven buildings at POSTECH for the AMI and collected electricity consumption data from the buildings. To identify the amounts and trends of electricity consumption of the seven buildings, electricity consumption data collected from March to June 2019 were analyzed. In addition, this study compared the differences between the amounts and trends of electricity consumption of the seven buildings before and after the COVID-19 outbreak by using electricity consumption data collected from March to June 2019 and 2020. Results: Users can monitor, visualize, and download electricity consumption data collected via the AMI on the OIBC platform. The analysis results show that the seven buildings consume different amounts of electricity and have different consumption trends. In addition, the amounts of most buildings were significantly reduced after the COVID-19 outbreak. Conclusion: POSTECH AMI and OIBC platform can be a good reference for other universities that prepare their own microgrid. The analysis results provides a proof that POSTECH needs to establish customized strategies on reducing electricity for each building. Such results would be useful for energy-efficient operation and preparation of unusual energy consumptions due to unexpected situations like the COVID-19 pandemic.

Metaverse Platform Design for Strengthening Gender Sensitivity of MZ Generation

  • Kim, Sea Woo;Na, Eun Gyung
    • International journal of advanced smart convergence
    • /
    • v.11 no.3
    • /
    • pp.79-84
    • /
    • 2022
  • Due to a series of online sex crimes cases and online class conversions caused by the spread of the coronavirus, alternatives to sex education in schools are urgently required. As a result of this study, the metaverse sex education platform was designed. Using this platform, learners are expected to cultivate correct adult awareness and digital citizenship. Within the metaverse platform, learners can participate more actively in learning. Instead of exposing one's name and face in a place dealing with sensitive gender issues, one can participate in education through his or her decorated avatar and participate in education much more actively than face-to-face education and express one's opinion through chat. In addition, education by level can be received regardless of time and place, which can have the effect of bridging the educational gap between urban and rural areas. In this paper, we propose a new sex education platform without time and space constraints by utilizing metaverse.

Convergence-Information Strategy between Big Data and Wearable Computing (빅데이터와 웨어러블 컴퓨팅의 융합정보화 전략)

  • Lee, Tae-Gyu;Shin, Seong-Yoon;Lee, Hyun-Chang
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2014.05a
    • /
    • pp.218-220
    • /
    • 2014
  • Data economy era is rapidly approaching where big data plays the pivotal role of creating new values and solving various problems. This paper aims at designing Korea's new strategic direction of informatization in the big data age. For this purpose, paradigm shift of our society and the new role of IT together with the discussion on open platform and big data focused on its potentials and new possibilities are analyzed, which leads to the conclusion that big data will be a main engine for creating new values. Based on the results of the analysis, three kinds of strategic direction is designed. The first direction is on national vision making and 'data analysis-based creative nation' is suggested. The second direction is on catalyst making and 'smart government utilizing the power of big data' is proposed in details. The third direction is on sustainable leading mechanism and 'collaborative governance between stakeholders' is suggested.

  • PDF

Building an Analytical Platform of Big Data for Quality Inspection in the Dairy Industry: A Machine Learning Approach (유제품 산업의 품질검사를 위한 빅데이터 플랫폼 개발: 머신러닝 접근법)

  • Hwang, Hyunseok;Lee, Sangil;Kim, Sunghyun;Lee, Sangwon
    • Journal of Intelligence and Information Systems
    • /
    • v.24 no.1
    • /
    • pp.125-140
    • /
    • 2018
  • As one of the processes in the manufacturing industry, quality inspection inspects the intermediate products or final products to separate the good-quality goods that meet the quality management standard and the defective goods that do not. The manual inspection of quality in a mass production system may result in low consistency and efficiency. Therefore, the quality inspection of mass-produced products involves automatic checking and classifying by the machines in many processes. Although there are many preceding studies on improving or optimizing the process using the data generated in the production process, there have been many constraints with regard to actual implementation due to the technical limitations of processing a large volume of data in real time. The recent research studies on big data have improved the data processing technology and enabled collecting, processing, and analyzing process data in real time. This paper aims to propose the process and details of applying big data for quality inspection and examine the applicability of the proposed method to the dairy industry. We review the previous studies and propose a big data analysis procedure that is applicable to the manufacturing sector. To assess the feasibility of the proposed method, we applied two methods to one of the quality inspection processes in the dairy industry: convolutional neural network and random forest. We collected, processed, and analyzed the images of caps and straws in real time, and then determined whether the products were defective or not. The result confirmed that there was a drastic increase in classification accuracy compared to the quality inspection performed in the past.

Data Analysis Platform Construct of Fault Prediction and Diagnosis of RCP(Reactor Coolant Pump) (원자로 냉각재 펌프 고장예측진단을 위한 데이터 분석 플랫폼 구축)

  • Kim, Ju Sik;Jo, Sung Han;Jeoung, Rae Hyuck;Cho, Eun Ju;Na, Young Kyun;You, Ki Hyun
    • Journal of Information Technology Services
    • /
    • v.20 no.3
    • /
    • pp.1-12
    • /
    • 2021
  • Reactor Coolant Pump (RCP) is core part of nuclear power plant to provide the forced circulation of reactor coolant for the removal of core heat. Properly monitoring vibration of RCP is a key activity of a successful predictive maintenance and can lead to a decrease in failure, optimization of machine performance, and a reduction of repair and maintenance costs. Here, we developed real-time RCP Vibration Analysis System (VAS) that web based platform using NoSQL DB (Mongo DB) to handle vibration data of RCP. In this paper, we explain how to implement digital signal process of vibration data from time domain to frequency domain using Fast Fourier transform and how to design NoSQL DB structure, how to implement web service using Java spring framework, JavaScript, High-Chart. We have implement various plot according to standard of the American Society of Mechanical Engineers (ASME) and it can show on web browser based on HTML 5. This data analysis platform shows a upgraded method to real-time analyze vibration data and easily uses without specialist. Furthermore to get better precision we have plan apply to additional machine learning technology.

A Study on Prediction of Traffic Volume Using Road Management Big Data

  • Sung, Hongki;Chong, Kyusoo
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.33 no.6
    • /
    • pp.589-594
    • /
    • 2015
  • In reflection of road expansion and increasing use rates, interest has blossomed in predicting driving environment. In addition, a gigantic scale of big data is applied to almost every area around the world. Recently, technology development is being promoted in the area of road traffic particularly for traffic information service and analysis system in utilization of big data. This study examines actual cases of road management systems and road information analysis technologies, home and abroad. Based on the result, the limitations of existing technologies and road management systems are analyzed. In this study, a development direction and expected effort of the prediction of road information are presented. This study also examines regression analysis about relationship between guide name and traffic volume. According to the development of driving environment prediction platform, it will be possible to serve more reliable road information and also it will make safe and smart road infrastructures.