Browse > Article
http://dx.doi.org/10.7232/JKIIE.2013.39.2.109

A Study of Estimation Method for Auto-Regressive Model with Non-Normal Error and Its Prediction Accuracy  

Lim, Bo Mi (School of Industrial Management Engineering, Korea University)
Park, Cheong-Sool (School of Industrial Management Engineering, Korea University)
Kim, Jun Seok (School of Industrial Management Engineering, Korea University)
Kim, Sung-Shick (School of Industrial Management Engineering, Korea University)
Baek, Jun-Geol (School of Industrial Management Engineering, Korea University)
Publication Information
Journal of Korean Institute of Industrial Engineers / v.39, no.2, 2013 , pp. 109-118 More about this Journal
Abstract
We propose a method for estimating coefficients of AR (autoregressive) model which named MLPAR (Maximum Likelihood of Pearson system for Auto-Regressive model). In the present method for estimating coefficients of AR model, there is an assumption that residual or error term of the model follows the normal distribution. In common cases, we can observe that the error of AR model does not follow the normal distribution. So the normal assumption will cause decreasing prediction accuracy of AR model. In the paper, we propose the MLPAR which does not assume the normal distribution of error term. The MLPAR estimates coefficients of auto-regressive model and distribution moments of residual by using pearson distribution system and maximum likelihood estimation. Comparing proposed method to auto-regressive model, results are shown to verify improved performance of the MLPAR in terms of prediction accuracy.
Keywords
Time Series Analysis; Auto-Regressive Model; Pearson Distribution System; Maximum Likelihood Estimation; Non-Normal Data;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Akaike, H. (1969), Power spectrum estimation through autoregressive model fitting, Annals of the institute of statistical mathematics, 21, 407-419.   DOI
2 Akaike, H. (1974), A New Look at the Statistical Model Identification, IEEE Transactions on automatic control, 19(6), 716-723.   DOI
3 Aldrich, J. (1997), R. A. Fisher and the making of Maximum Likelihood 1912 -1922, Statistical Science, 12(3), 162-176.   DOI   ScienceOn
4 Bowerman, B. L., O'Connellm R., and Koehler, A. (2005), Forecasting Time Series and Regression, 4th edition, Thomson Brooks/Cole, CA, USA.
5 Box, G. E. P., Jenkins, G. M., and Reinsel, G. C. (1994), Time Series Analysis : Forecasting and Control, 3rd edition, Prentice-Hall, NJ, USA.
6 Elderton, W. P. and Johnson, N. L. (2009), Systems of frequency curves, Cambridge University Press, NY, USA.
7 Endo, H. and Randall R. B. (2007), Enhancement of autoregressive model based gear tooth fault detection technique by the use of minimum entropy deconvolution filter, Mechanical Systems and Signal Processing, 21(2), 906-919.   DOI   ScienceOn
8 Gay, D. M. (1983), Algorithm 611. Subroutines for Unconstrained Minimization Using a Model.Trust, ACM Transcations on Mathematical Software, 9(4), 503-524.   DOI   ScienceOn
9 Gay, D. M. (1990), Usage Summary for Selected Optimization Routines, Computing Sicience Technical Report, AT&T Bell Laboratories, NJ, USA.
10 Last, M., Klein, Y., and Kandel, A. (2001), Knowledge Discovery in Time Series Databases, IEEE Transactions on systems, Man, and cybernetices- part B : cybernetics, 31(1), 160-169.   DOI   ScienceOn
11 Nagahara, Y. (2000), Non-Gaussian Filter and Smoother Based on the Pearson Distribution System, Journal of Time Series Analysis, 24(6), 721-738.
12 Nagahara, Y. (2004), A method of simulating multivariate nonnormal distributions by the Pearson distribution system and estimation, Computational Statistics and Data Analysis, 47(1), 1-29.   DOI   ScienceOn
13 Pankratz, A. (2008), Forecasting with Univariate Box-Jenkins Models : Concepts and Cases, John wiley and sons, NY, USA.
14 Parrish, R. S. (1983), On an integrated approach to member selection and parameter estimation for Pearson distributions, Computational Statistics and Data Analysis, 1, 239-255.   DOI   ScienceOn
15 Sethi, S. and Sorger G. (1991), A Theory of Rolling Horizon Decision Making, Annuals of Operations Research, 29, 387-416   DOI
16 Pearson, K. (1895), Contributions to the Mathematical Theory of Evolution. II. Skew Variation in Homogeneous Material, Philosophical Transactions of the Royal Society of London A, 186, 343-414.   DOI
17 Pearson, K. (1916), Mathematical Contributions to the Theory of Evolution. XIX. Second Supplement to a Memoiron Skew Variation, Philosophical Transactions of the Royal Society of London, Series A, Containing Papersof a Mathematical or Physical Character, 216, 429-457.   DOI
18 Rydberg, T. H. (2000), Realistic Statistical Modelling of Financial Data, International Statistical Review, 68(3), 233-258.   DOI
19 Walpole, R. E. Myers, R. H. Myers, S. L., and Ye, K. (2006), Probability and Statistics for engineerings and scientists, 9 edition, Prentice Hall, NJ, USA.