• Title/Summary/Keyword: 시계열 데이터 분석

Search Result 740, Processing Time 0.031 seconds

Real-time PM10 Concentration Prediction LSTM Model based on IoT Streaming Sensor data (IoT 스트리밍 센서 데이터에 기반한 실시간 PM10 농도 예측 LSTM 모델)

  • Kim, Sam-Keun;Oh, Tack-Il
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.19 no.11
    • /
    • pp.310-318
    • /
    • 2018
  • Recently, the importance of big data analysis is increasing as a large amount of data is generated by various devices connected to the Internet with the advent of Internet of Things (IoT). Especially, it is necessary to analyze various large-scale IoT streaming sensor data generated in real time and provide various services through new meaningful prediction. This paper proposes a real-time indoor PM10 concentration prediction LSTM model based on streaming data generated from IoT sensor using AWS. We also construct a real-time indoor PM10 concentration prediction service based on the proposed model. Data used in the paper is streaming data collected from the PM10 IoT sensor for 24 hours. This time series data is converted into sequence data consisting of 30 consecutive values from time series data for use as input data of LSTM. The LSTM model is learned through a sliding window process of moving to the immediately adjacent dataset. In order to improve the performance of the model, incremental learning method is applied to the streaming data collected every 24 hours. The linear regression and recurrent neural networks (RNN) models are compared to evaluate the performance of LSTM model. Experimental results show that the proposed LSTM prediction model has 700% improvement over linear regression and 140% improvement over RNN model for its performance level.

Construction of integrated DB for domestic water-cycle system and short-term prediction model (생활용수 물순환 계통 통합 DB 및 단기예측모형 구축)

  • Seungyeon Lee;Sangeun Lee
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2023.05a
    • /
    • pp.362-362
    • /
    • 2023
  • 한정된 수자원의 이용 및 관리로 매년 물 부족과 물 배분 의사결정 문제가 발생하고 있다. 50년간(1965~2014년) 수자원의 총량은 약 1.2배 증가한 반면 인구수 약 1.8배, 생·공·농업용수의 수요는 약 5배가 증가(국회입법조사처, 2018) 했을 뿐 아니라, 기후변화의 영향으로 인한 강수량의 변화와 지역별 편차가 커져 지속가능한 물관리 필요성이 증대되고 있다. 따라서 효율적인 물관리를 위해서는 관리부처가 분절되어 있는 물순환 계통의 데이터를 통합하는 것이 우선시되어야 하고 이를 통해 물순환 모니터링/평가/예측 기술을 개발할 수 있다. 본 연구에서는 생활용수 물순환 계통 통합 DB를 정의 및 구축하였다. 도시의 관점에서 물순환 시스템을 순차적으로 물 유입(수원~취수장)/전달(정수장~급수지역)/유출(하(폐)수처리장~방류구)의 개념으로 설정하고 DB정의서를 마련하였다. 연구대상지는 가뭄이 장기화가 되고 있는 전라남도중 물순환 계통이 비교적 단순한 네트워크로 형성되어 있는 함평군 도시지역으로 선정하였다. 연구 기간은 총 5년(2017년 1월 1일~2021년 12월 31일)이고 일 단위 실계측자료 위주의 원자료를 구축하였다. 이를 이상치 탐지, 제거, 대체의 과정을 거쳐 품질 보정하고 정제된 시계열 자료에 대한 특성 분석을 하였다. 그 결과, 물순환 계통 내 주요 지점 간의 상관관계 및 지연시간을 통한 물흐름의 시계열적 특성을 파악할 수 있었으며 모형의 적합도를 판단하는 데 활용되는 통계량과 유의미하지 않은 잔차의 자기상관성을 볼 때 물 유입-전달-유출의 단기 예측을 위한 ARIMA(Auto-regressive Integrated Moving Average) 모형의 구축도 가능할 것으로 판단되었다. 다만 여름철 발생하는 방류량의 첨두값을 설명하기 위해서는 강우에 의한 불명수 발생으로 증가하는 방류량을 묘사할 수있어야 하므로 향후에는 물순환계통 외 해당 지역의 불명수(강우 효과)도 하수 방류량의 주요 입력 요인으로 추가 검토할 필요가 있다.

  • PDF

Correlation Analyses of the Temperature Time Series Data from the Heat Box for Energy Modeling in the Automobile Drying Process (자동차 건조 공정 에너지 예측 모형을 위한 공조기 온도 시계열 데이터의 상관관계 분석)

  • Lee, Chang-Yong;Song, Gensoo;Kim, Jinho
    • Journal of Korean Society of Industrial and Systems Engineering
    • /
    • v.37 no.2
    • /
    • pp.27-34
    • /
    • 2014
  • In this paper, we investigate the statistical correlation of the time series for temperature measured at the heat box in the automobile drying process. We show, in terms of the sample variance, that a significant non-linear correlation exists in the time series that consist of absolute temperature changes. To investigate further the non-linear correlation, we utilize the volatility, an important concept in the financial market, and induce volatility time series from absolute temperature changes. We analyze the time series of volatilities in terms of the de-trended fluctuation analysis (DFA), a method especially suitable for testing the long-range correlation of non-stationary data, from the correlation perspective. We uncover that the volatility exhibits a long-range correlation regardless of the window size. We also analyze the cross correlation between two (inlet and outlet) volatility time series to characterize any correlation between the two, and disclose the dependence of the correlation strength on the time lag. These results can contribute as important factors to the modeling of forecasting and management of the heat box's temperature.

Strategies for the Integrated Water Management System based on GIS (GIS 기반의 물통합관리시스템 구축 방안)

  • Seo, dong-jo;Song, dong-ha;Lee, sang-jin
    • Proceedings of the Korea Contents Association Conference
    • /
    • 2009.05a
    • /
    • pp.463-466
    • /
    • 2009
  • Some strategies for the integrated water management system based on GIS was suggested for the comprehensive and systematic management on the watershed. Contents of database and thematic layers for the related elements with GIS was indicated to estimate the quantity of total pollution loads and to simulate the water quality. Also, functions for the information providing was suggested on the connection with spatial data and attribute data, the search for collected data, the analysis for time series, and the visual presentations. Finally, it was suggested to integrate the existing systems and database structures, and to construct of data warehouse.

  • PDF

RIMS data time a series analysis a city railroad a use efficiency improve (RIMS 데이터 시계열 분석을 통한 도시철도 운용효율 향상)

  • Lee, Do-Sun;Chun, Houng-Jun;Park, Soo-Choong
    • Proceedings of the KSR Conference
    • /
    • 2008.06a
    • /
    • pp.1308-1314
    • /
    • 2008
  • In this paper, Seoulmetro that is the first operation organization which operates a city railroad rolling-stock maintenance RIMS(rolling stock information maintenance system) collected and analyzed a light maintenance data and introduced time a series analysis technique to find the way how to contribute to a use efficiency improvement of a city railroad. The purpose of time a series analysis is to remove a seasonal change including data and to check an irregular fluctuation. First of all, a collection range of the data comes under a light maintenance, however it needs a data of more than 3 years to check the seasonal change. We put a study for an accumulated scope that the data satisfy a period like this and are able to extend a range of the study when time flys forward. The data used for study is filtered using a movement average method after passing proper selection working and is solved with a method which looks for season index. Using the season index that was getten in here, we predict a light working frequency, if it has an irregular change, we will contribute it to a city railroad a use efficiency improvement and establish the cause by carrying out prevent maintenance in advance.

  • PDF

Mathematical Modelling and Behavior Analysis of Addiction of Physical Exercise (운동 중독의 수학적 모델링과 거동 해석)

  • Bae, Young-Chul
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.24 no.6
    • /
    • pp.615-621
    • /
    • 2014
  • The Addiction problems have been became a social problem; the social efforts continue to solve these problems. One of those efforts, we need to establish a mathematical modeling for an addictive model to perform analysis of behavior by using this modeling. We need to process the research that can be judged before and after addictive status with result of the behavior analysis. We have to process an observation of transition from before to after addictive status. According to those necessary, this paper proposed the physical exercise model that is composed by novel second order system, which consisted of Spring-Damper-Mass system with equivalence in order to evolve an addictive equation for physical exercise. This paper also is analyzed by the behaviors for those the addictive equation of physical exercise.

A Modified Diffusion Model Considering Autocorrelated Disturbances: Applications on CT Scanners and FPD TVs (자기상관 오차항을 고려한 수정된 확산모형: CT-스캐너와 FPD TV에의 응용)

  • Cha, Kyoung Cheon;Kim, Sang-Hoon
    • Asia Marketing Journal
    • /
    • v.11 no.1
    • /
    • pp.29-38
    • /
    • 2009
  • Estimating the Bass diffusion model often creates a time-interval bias, which leads the OLS approach to overestimate sales at early stages and underestimate sales after the peak. Further, a specification error from omitted variables might raise serial correlations among residuals when marketing actions are not incorporated into the diffusion model. Autocorrelated disturbances may yield unbiased but inefficient estimation, and therefore invalid inference results. This phenomenon warrants a modified approach to estimating the Bass diffusion model. In this paper, the authors propose a modified Bass diffusion model handling autocorrelated disturbances. To validate the new approach, authors applied the method on two different data-sets: CT Scanners in the U.S, and FPD TV sales in Korea. The results showed improved model fit and the validity of the proposed model.

  • PDF

Development of Road Bridge Information Management System based on Internet (교량 현황정보 관리를 위한 인터넷 기반 정보시스템 개발)

  • Park, Kyung-Hoon;Sun, Jong-Wan
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.17 no.11
    • /
    • pp.716-723
    • /
    • 2016
  • A computerized information management system of road bridges as a national key infrastructure is needed to effectively collect data of the current status, improve the reliability of data, and use the results from the analysis of the accumulated data as fundamental resources for supporting the establishment of policies. The Internet-based Bridge Information System (BIS), including a database and geographic information systems (GIS), was designed, and the data items were comprised of essential information, such as GIS-based location coordinates, bridge condition grade information and so on. The BIS was developed to be connected with a related information system, and it is possible to make the current information of traffic volume, address and so on by adopting the GIS. To enhance the reliability of the information of current bridge status, it is also possible to improve the accuracy of data through an information verifying function to prevent entry errors. In addition, the BIS can easily support the establishment of policies offering various types of knowledge information that were available in the past based on an analysis of the accumulated data. The intuitive identification and analysis of the current status is to be feasible through a GIS screen. Improvement of the business efficiency and data accuracy and time-series information analysis are available by managing the information of current status through BIS. In the future, it is expected that BIS can be used effectively for the establishment of reasonable maintenance policies of the nation.

Forecasting Economic Impacts of Construction R&D Investment: A Quantitative System Dynamics Forecast Model Using Qualitative Data (건설 분야 정부 R&D 투자의 사업별 경제적 파급효과 분석 - 정성적 자료 기반의 시스템다이내믹스 예측모형 개발 -)

  • Hwang, Sungjoo;Park, Moonseo;Lee, Hyun-Soo;Jang, Youjin;Moon, Myung-Gi;Moon, Yeji
    • Korean Journal of Construction Engineering and Management
    • /
    • v.14 no.2
    • /
    • pp.131-140
    • /
    • 2013
  • Econometric forecast models based on past time-series data have been applied to a wide variety of applications due to their advantages in short-term point estimating. These models are particularly used in predicting the impact of governmental research and development (R&D) programs because program managers should assert their feasibility due to R&D program's huge amount of budget. The construction governmental R&D programs, however, separately make an investment by dividing total budget into five sub-business area. It make R&D program managers difficult to understand how R&D programs affect the whole system including economy because they are restricted with regard to many dependent and dynamic variables. In this regard, system dynamics (SD) model provides an analytic solution for complex, nonlinear, and dynamic systems such as the impacts of R&D programs by focusing on interactions among variables and understanding their structures. This research, therefore, developed SD model to capture the different impacts of five construction R&D sub-business by considering different characteristics of sub-business area. To overcome the SD's disadvantages in point estimating, this research also proposed the method for constructing quantitative forecasting model using qualitative data. Understanding the different characteristics of each construction R&D sub-business can support R&D program managers to demonstrate their feasibility of capital investment.

인터넷을 이용한 육상물류중개시스템 개발에 관한 연구

  • 박남규;최형림;송근곤;박영재;손형수
    • Proceedings of the Korea Database Society Conference
    • /
    • 1999.06a
    • /
    • pp.335-345
    • /
    • 1999
  • 오늘날 날로 증가하는 물류비는 개별 기업은 물론 국가 전체의 수출 경쟁력을 약화시키는 주요 원인으로 지적되고 있다. 그러나 그동안 우리나라에서는 물류비 절감을 위한 종합적이고 체계적인 대책이 이루어지지 못하였다. 특히 본 논문의 연구대상인 육상물류의 경우 그 비중이 전체 화물 운송의 60% 이상을 차지함에도 불구하고 심각한 교통체증 및 물류기반 시설의 미비, 효율적인 정보시스템의 미비 등으로 인하여 물류비가 계속 증가하는 양상을 보여 왔다. 따라서 본 논문에서는 우리나라 육상물류시스템이 안고 있는 문제점의 해결을 위한 방안들 중의 하나로 정보기술의 활용에 관한 내용을 다루고 있다. 즉 영세한 기업들도 누구나 손쉽게 이용할 수 있도록 인터넷을 이용한 육상물류중개시스템의 개발에 관한 내용을 소개하고 있다. 육상물류중개시스템은 복합화물주선업체인 (주) 대형물류와 함께 개발한 시스템으로 인터넷을 통하여 화주의 화물 운송의뢰를 접수받아 이를 여러 운송업체에게 제공해주는 역할을 수행하게 된다. 특히 육상물류중개시스템은 화물의 운송과 관련하여 발생하는 다양한 정보들을 데이터베이스에 저장하여 두었다가 세관을 비롯한 터미날에 대한 각종 신고업무에 이용할 수 있으며, 이밖에도 교통정보 및 화물 위치정보 등 다양한 서비스를 제공해줄 수 있다. 따라서 운송업체의 공차율을 줄이고 화주에게는 자신의 화물에 대한 정보를 실시간으로 전달해 줄 수 있다는 장점이 있다. 또한 이러한 육상물류중개시스템은 현재 개발중인 통합데이터베이스를 기반으로 한 항만물류원스톱서비스 시스템과 연계되어 차후에는 물류원스톱시스템으로 발전할 수 있을 것이다. 연구가 진행되고 있는 인공신경망과의 모형결합을 통해 기존연구와는 다른 새로운 통합예측방법론을 제시하고자 한다. 본 연구에서 제시하는 통합방법론은 크게 2단계 과정을 거쳐 예측모형으로 완성이 된다. 즉, 1차 모형단계에서 원시 재무시계열은 먼저 웨이블릿분석을 통해서 노이즈가 필터링 되는 동시에, 과거 재무시계열의 프랙탈 구조, 즉 비선형적인 움직임을 보다 잘 반영시켜 주는 다차원 주기요소를 가지는 시계열로 분해, 생성되며, 이렇게 주기에 따라 장단기로 분할된 시계열들은 2차 모형단계에서 신경망의 새로운 입력변수로서 사용되어 최종적인 인공 신경망모델을 구축하는 데 반영된다.ocioeconomic impacts are resulted from the program. It would be useful for the means of (ⅰ) fulfillment of public accountability to legitimate the program and to reveal the expenditure of pubic fund, and (ⅱ) managemental and strategical learning to give information necessary to improve the making. program and policy decision making, The objectives of the study are to develop the methodology of modeling the socioeconomic evaluation, and build up the practical socioeconomic ev

  • PDF