• Title/Summary/Keyword: TimeSeries Data

Search Result 3,647, Processing Time 0.033 seconds

Model Parameter Based Fault Detection for Time-series Data (시계열을 따르는 공정데이터의 모델 모수기반 이상탐지)

  • Park, Si-Jeo;Park, Cheong-Sool;Kim, Sung-Shick;Baek, Jun-Geol
    • Journal of the Korea Society for Simulation
    • /
    • v.20 no.4
    • /
    • pp.67-79
    • /
    • 2011
  • The statistical process control (SPC) assumes that observations follow the particular statistical distribution and they are independent to each other. However, the time-series data do not always follow the particular distribution, and most of cases are autocorrelated, therefore, it has limit to adopt the general SPC in tim series process. In this study, we propose a MPBC (Model Parameter Based Control-chart) method for fault detection in time-series processes. The MPBC builds up the process as a time-series model, and it can determine the faults by detecting changes parameters in the model. The process we analyze in the study assumes that the data follow the ARMA (p,q) model. The MPBC estimates model parameters using RLS (Recursive Least Square), and $K^2$-control chart is used for detecting out-of control process. The results of simulations support the idea that our proposed method performs better in time-series process.

A Research for Imputation Method of Photovoltaic Power Missing Data to Apply Time Series Models (태양광 발전량 데이터의 시계열 모델 적용을 위한 결측치 보간 방법 연구)

  • Jeong, Ha-Young;Hong, Seok-Hoon;Jeon, Jae-Sung;Lim, Su-Chang;Kim, Jong-Chan;Park, Chul-Young
    • Journal of Korea Multimedia Society
    • /
    • v.24 no.9
    • /
    • pp.1251-1260
    • /
    • 2021
  • This paper discusses missing data processing using simple moving average (SMA) and kalman filter. Also SMA and kalman predictive value are made a comparative study. Time series analysis is a generally method to deals with time series data in photovoltaic field. Photovoltaic system records data irregularly whenever the power value changes. Irregularly recorded data must be transferred into a consistent format to get accurate results. Missing data results from the process having same intervals. For the reason, it was imputed using SMA and kalman filter. The kalman filter has better performance to observed data than SMA. SMA graph is stepped line graph and kalman filter graph is a smoothing line graph. MAPE of SMA prediction is 0.00737%, MAPE of kalman prediction is 0.00078%. But time complexity of SMA is O(N) and time complexity of kalman filter is O(D2) about D-dimensional object. Accordingly we suggest that you pick the best way considering computational power.

KOSPI directivity forecasting by time series model (시계열 모형을 이용한 주가지수 방향성 예측)

  • Park, In-Chan;Kwon, O-Jin;Kim, Tae-Yoon
    • Journal of the Korean Data and Information Science Society
    • /
    • v.20 no.6
    • /
    • pp.991-998
    • /
    • 2009
  • This paper deals with directivity forecasting of time series which is useful for futures trading in stock market. Directivity forecasting of time series is to forecast whether a given time series will rise or fall at next observation time point. For directional forecasting, we consider time regression model and ARIMA model. In particular, we study two statistics, intra-model and extra-model deviation and then show usefulness of intra-model deviation.

  • PDF

The Comparison of Parameter Estimation and Prediction Methods for STBL Model

  • Kim, Duk-Gi;Kim, Sung-Soo;Lee, Chan-Hee;Lee, Keon-Myung;Lee, Sung-Duck
    • Journal of the Korean Data and Information Science Society
    • /
    • v.18 no.1
    • /
    • pp.17-29
    • /
    • 2007
  • The major purpose of this article is the comparison of estimation method with Newton-Raphson, Kalman-filter, and prediction method with Kalman prediction. Conditional expectation in space time bilinear(STBL) model, which is a very powerful and parsimonious nonlinear time-series model for the space time series data can be viewed as a set of time series collected simultaneously at a number of spatial locations and time points, and which have appeared in a important applications areas: geography, geology, natural resources, ecology, epidemiology, etc.

  • PDF

A Study on the Time-Dependent Bonus-Malus System in Automobile Insurance

  • Kang, Jung-Chul
    • Journal of the Korean Data and Information Science Society
    • /
    • v.16 no.4
    • /
    • pp.1147-1157
    • /
    • 2005
  • Bonus-Malus system is generally constructed based on claim frequency and Bayesian credibility model is used to represent claim frequency distribution. However, there is a problem with traditionally used credibility model for the purpose of constructing bonus-malus system. In traditional Bonus-Malus system adopted credibility model, individual estimates of premium rates for insureds are determined based solely on the total number of claim frequency without considering when those claims occurred. In this paper, a new model which is a modification of structural time series model applicable to counting time series data are suggested. Based on the suggested model relatively higher premium rates are charged to insured with more claim records.

  • PDF

A Climate Prediction Method Based on EMD and Ensemble Prediction Technique

  • Bi, Shuoben;Bi, Shengjie;Chen, Xuan;Ji, Han;Lu, Ying
    • Asia-Pacific Journal of Atmospheric Sciences
    • /
    • v.54 no.4
    • /
    • pp.611-622
    • /
    • 2018
  • Observed climate data are processed under the assumption that their time series are stationary, as in multi-step temperature and precipitation prediction, which usually leads to low prediction accuracy. If a climate system model is based on a single prediction model, the prediction results contain significant uncertainty. In order to overcome this drawback, this study uses a method that integrates ensemble prediction and a stepwise regression model based on a mean-valued generation function. In addition, it utilizes empirical mode decomposition (EMD), which is a new method of handling time series. First, a non-stationary time series is decomposed into a series of intrinsic mode functions (IMFs), which are stationary and multi-scale. Then, a different prediction model is constructed for each component of the IMF using numerical ensemble prediction combined with stepwise regression analysis. Finally, the results are fit to a linear regression model, and a short-term climate prediction system is established using the Visual Studio development platform. The model is validated using temperature data from February 1957 to 2005 from 88 weather stations in Guangxi, China. The results show that compared to single-model prediction methods, the EMD and ensemble prediction model is more effective for forecasting climate change and abrupt climate shifts when using historical data for multi-step prediction.

Generation of Synthetic Time Series Wind Speed Data using Second-Order Markov Chain Model (2차 마르코프 사슬 모델을 이용한 시계열 인공 풍속 자료의 생성)

  • Ki-Wahn Ryu
    • Journal of Wind Energy
    • /
    • v.14 no.1
    • /
    • pp.37-43
    • /
    • 2023
  • In this study, synthetic time series wind data was generated numerically using a second-order Markov chain. One year of wind data in 2020 measured by the AWS on Wido Island was used to investigate the statistics for measured wind data. Both the transition probability matrix and the cumulative transition probability matrix for annual hourly mean wind speed were obtained through statistical analysis. Probability density distribution along the wind speed and autocorrelation according to time were compared with the first- and the second-order Markov chains with various lengths of time series wind data. Probability density distributions for measured wind data and synthetic wind data using the first- and the second-order Markov chains were also compared to each other. For the case of the second-order Markov chain, some improvement of the autocorrelation was verified. It turns out that the autocorrelation converges to zero according to increasing the wind speed when the data size is sufficiently large. The generation of artificial wind data is expected to be useful as input data for virtual digital twin wind turbines.

Test for the Presence of Seasonality in Time Series Models

  • Lee, Sung-Duck
    • Journal of the Korean Data and Information Science Society
    • /
    • v.12 no.1
    • /
    • pp.71-78
    • /
    • 2001
  • Three test statistics are proposed for the presence of seasonality in multiplicative seasonal time series models. Further their common limiting distribution is derived under some assumptions.

  • PDF

Data anomaly detection for structural health monitoring of bridges using shapelet transform

  • Arul, Monica;Kareem, Ahsan
    • Smart Structures and Systems
    • /
    • v.29 no.1
    • /
    • pp.93-103
    • /
    • 2022
  • With the wider availability of sensor technology through easily affordable sensor devices, several Structural Health Monitoring (SHM) systems are deployed to monitor vital civil infrastructure. The continuous monitoring provides valuable information about the health of the structure that can help provide a decision support system for retrofits and other structural modifications. However, when the sensors are exposed to harsh environmental conditions, the data measured by the SHM systems tend to be affected by multiple anomalies caused by faulty or broken sensors. Given a deluge of high-dimensional data collected continuously over time, research into using machine learning methods to detect anomalies are a topic of great interest to the SHM community. This paper contributes to this effort by proposing a relatively new time series representation named "Shapelet Transform" in combination with a Random Forest classifier to autonomously identify anomalies in SHM data. The shapelet transform is a unique time series representation based solely on the shape of the time series data. Considering the individual characteristics unique to every anomaly, the application of this transform yields a new shape-based feature representation that can be combined with any standard machine learning algorithm to detect anomalous data with no manual intervention. For the present study, the anomaly detection framework consists of three steps: identifying unique shapes from anomalous data, using these shapes to transform the SHM data into a local-shape space and training machine learning algorithms on this transformed data to identify anomalies. The efficacy of this method is demonstrated by the identification of anomalies in acceleration data from an SHM system installed on a long-span bridge in China. The results show that multiple data anomalies in SHM data can be automatically detected with high accuracy using the proposed method.

Parameter Estimation and Comparison for SRGMs and ARIMA Model in Software Failure Data

  • Song, Kwang Yoon;Chang, In Hong;Lee, Dong Su
    • Journal of Integrative Natural Science
    • /
    • v.7 no.3
    • /
    • pp.193-199
    • /
    • 2014
  • As the requirement on the quality of the system has increased, the reliability is very important part in terms of enhance stability and to provide high quality services to customers. Many statistical models have been developed in the past years for the estimation of software reliability. We consider the functions for NHPP software reliability model and time series model in software failure data. We estimate parameters for the proposed models from three data sets. The values of SSE and MSE is presented from three data sets. We compare the predicted number of faults with the actual three data sets using the NHPP software reliability model and time series model.