Browse > Article
http://dx.doi.org/10.5392/IJoC.2013.10.1.047

Improved Linear Dynamical System for Unsupervised Time Series Recognition  

Thi, Ngoc Anh Nguyen (School of Electronics and Computer Engineering Chonnam National University)
Yang, Hyung-Jeong (School of Electronics and Computer Engineering Chonnam National University)
Kim, Soo-Hyung (School of Electronics and Computer Engineering Chonnam National University)
Lee, Guee-Sang (School of Electronics and Computer Engineering Chonnam National University)
Kim, Sun-Hee (School of Electronics and Computer Engineering Chonnam National University)
Publication Information
International Journal of Contents / v.10, no.1, 2014 , pp. 47-53 More about this Journal
Abstract
The paper considers the challenges involved in measuring the similarities between time series, such as time shifts and the mixture of frequencies. To improve recognition accuracy, we investigate an improved linear dynamical system for discovering prominent features by exploiting the evolving dynamics and correlations in a time series, as the quality of unsupervised pattern recognition relies strongly on the extracted features. The proposed approach yields a set of compact extracted features that boosts the accuracy and reliability of clustering for time series data. Experimental evaluations are carried out on time series applications from the scientific, socio-economic, and business domains. The results show that our method exhibits improved clustering performance compared to conventional methods. In addition, the computation time of the proposed approach increases linearly with the length of the time series.
Keywords
Time Series; Linear Dynamical System; Kalman Filter; Principal Component Analysis; Clustering; Feature Extraction;
Citations & Related Records
연도 인용수 순위
  • Reference
1 K. Kalpakis, D. Gada, and V. Puttagunta, "Distance measure for effective clustering of ARIMA time series," In Proceedings of the 2001 IEEE International Conference on Data Mining, San Jose CA, Nov. 2001, pp. 273-280.
2 O. Lange Wishmuller and D. R. Derch, et al, "Cluster analysis of biomedical image time-series," International Journal of Computer Vision, 46(2), 2002, pp.103-128.   DOI
3 C. S. Moller Levet, F. Klawonn, and O. Wolkenhauer, "Fuzzy clustering of short-time series and unevenly distributed sampling points," In lecture notes in computer science, vol. 2811, 2003, pp. 330-340.
4 S. Changdrakala and C. C. Sekhar, "A density based method for multivariate time series clustering in kernel feature space," In proceedings of IEEE international joint conference on neural networks, 2008, pp. 1885-1890.
5 H. S. Guan and Q. S. Jiang, "Cluster financial time series for portfolio," In proceedings of international conference on wavelet analysis and pattern recognition, 2007, pp. 851-856.
6 M. Gavrilov, D. Anguelov, P. Indyk, and R. Motwani, "Mining the stock market: which measure is best?," in: Proceedings of the Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Boston, MA, USA, 20-23 August 2000, pp. 487-496.
7 T. Warren Liao, "Clustering of time series data- a survey," The journal of the pattern recognition, Elsevier, vol. 38, 2005, pp. 1857-1874.   DOI   ScienceOn
8 Ding and X. He, "K-means clustering via principal component analysis," In Proceedings of the twenty-first international conference on Machine learning, 2004, pp. 29-32.
9 I. T. Jolliffe, Principal Component Analysis, Springer, 2002.
10 L. Li, B. Aditya Prakash, and C. Faloutsos, "Parsimonious Linear Fingerprint for Time Series," Proceedings of the VLDB Endowment, vol. 3, 2010, pp. 385-396.
11 L. Li and B. Aditya Prakash, "Time Series Clustering: Complex is Simple!," In Proceedings of the 28th International Conference of Machine Learning, 2011.
12 A. Jain, E. Y. Chang, and Y.-F. Wang, "Adaptive stream resource management using Kalman Filter," In SIGMOD, 2004, pp. 11-22.
13 M. Jahangiri, D. Sacharidis, and C. Shahabi, "Shift-split: I/O efficient maintenance of wavelet-transformed multidimensional data," In proceedings of the ACM SIGMOD international conference on Management of data, 2005, pp. 275- 286.
14 F. Morchen, "Time series feature extraction for data mining using dwt and dft," Technical Report no. 33, Philipps-University Marburg, 2003.
15 L. Ralaivola and F. AlcheBuc, "Time series Filtering, Smoothing and Learning using the Kernel Kalman Filter," In Proceedings of International Joint Conference on Neural Network, Montreal, Canada, August 4, 2005.
16 D. Gunopulos and G. Das, "Time series similarity measures and time series indexing," In SIGMOD Conference, Santa Barbara, CA, 2001.
17 K. Deng, A. Moore, M. Nechyba, "Learning to recognize time series: Combining arma models with memory-based learning," Proc. of the International Symposium on Computational Intelligence in Robotics and Automation, 1997, pp. 246-250.
18 X. Wang, K. Smith, and R. Hyndman, "Characteristic-Based Clustering for Time Series Data," Data Mining and Knowledge Discovery, vol. 13, 2006, pp. 335-364.   DOI   ScienceOn
19 R. H. Shumway and D. S. Stoffer, "An approach to time series smoothing and forecasting using the EM algorithm," Journal of Time Series Analysis, 1982, pp. 253-264.
20 N. T. Ngoc Anh, H. J. Yang, S. H. Kim, and S. H. Kim, "Hidden Dynamic Learning for Long-Interval Consecutive Missing Values Reconstruction in EEG Time Series," In Proceedings of 2011 IEEE International Conference on Granular Computing, Taiwan, 2011, pp. 653-658.
21 E. Keogh and T. Folias, "The UCR time series data mining archive," 2002.
22 L. Li, J. McCann, N. Pollard, and C. Faloutsos, "Dynammo: Mining and summarization of coevolving sequences with missing values," In KDD, ACM, New York, NY, USA, 2009.
23 R. E. Kalman, "A new approach to linear filtering and prediction problems," Transactions of the ASME C Journal of Basic Engineering, 1960, pp. 25-45.
24 Z. Ghahramani and G. E. Hinton, "Parameter estimation for linear dynamical systems," Technical Report CRGTR-96-2, 1996.
25 Y. Xiong and D. Y. Yeung, "Time series clustering with ARMA mixtures," Pattern Recognition, vol. 37, issue 8, August 2004, pp. 1675-1689.   DOI   ScienceOn
26 http://lwf.ncdc.noaa.gov/oa/climate/clima-tedata.html
27 X. Zhang, J. Liu, Y. Du, and T. Lv, "A novel clustering method on time series data," Expert Systems with Applications, vol. 38, issue 9, 2011, pp. 11891-11900.   DOI   ScienceOn