Browse > Article

Processing Sliding Windows over Disordered Streams  

Kim, Hyeon-Gyu (한국과학기술원 전산학과)
Kim, Cheol-Ki (한국정보통신대학교 모바일 멀티미디어연구소)
Kim, Myoung-Ho (한국과학기술원 전산학과)
Publication Information
Journal of KIISE:Databases / v.33, no.6, 2006 , pp. 590-599 More about this Journal
Abstract
Disordered streams cause two issues in processing sliding windows: i) how to place input tuples into a buffer in an increasing order efficiently and ii) how to determine a time point to process the windows from input tuples in the buffer. To address these issues, we propose a structure and method of operators for processing sliding windows. We first present a structure of the operators using an index to handle input tuples efficiently. Then, we propose a method to determine the time point to process the windows, which is called a mean-based estimation. In the proposed method, users can describe parameters required for estimation in a query specification, which provides a way for users to control the properties of query results such as the accuracy or the response time according to application requirements. Our experimental results show that the mean-based estimation provides better adaptivity and stability than the one used in the existing method.
Keywords
Streams; Sliding Windows; Mean-based Estimation;
Citations & Related Records
연도 인용수 순위
  • Reference
1 SENSIM: http://csc.lsu.edu/sensor_web/simulator.html
2 Hyeon Gyu Kim, Cheolgi Kim and Myoung Ho Kim, Adaptive Disorder Control in Continuous Data Streams, IEEE CIT, September 2006   DOI
3 TinyDB: http://www.tinyos.net
4 Chuck Cranor, Theodore Johnson, Oliver Spataschek and Vladislav Shkapenyuk, Gigascope: A Stream Database for Network Applications. ACM SIGMOD, June 9-12 2003   DOI
5 A. Arasu, S. Babu and J. Widom, The CQL Continuous Query Language: Semantic Foundations and Query Execution. Stanford University Technical Report, Oct. 2003
6 Jin Li, David Maier, Kristin Tufte, Vassilis Papadirnos, Peter A. Tucker, Semantics and Evaluation Techniques for Window Aggregates in Data Streams. ACM SIGMOD 2005, June 14-16, 2005, Baltimore, Maryland, USA   DOI
7 U. Srivastava and J. Widom. Flexible Time Management in Data Stream Systems. ACM PODS 2004, June 2004   DOI
8 S. Babu, U. Srivastava and J. Widom, Exploiting k-Constraints to Reduce Memory Overhead in Continuous Queries over Data Streams. ACM TODS, Sep. 2004   DOI   ScienceOn
9 David Maier, Jin Li, Peter A. Tucker, Kristin Tufte and Vassilis Papadimos, Semantics of Data Streams and Operators. ICDT 2005, LNCS 3363, pp.37-52, 2005
10 J. Chen, D. J. DeWitt, F. Tian, and Y. Wang. NiagaraCQ: A scalable continuous query system for internet databases. ACM SIGMOD pages 379-390, May 2000   DOI   ScienceOn
11 Jin Li, David Maier, Kristin Tufte, Vassilis Papadimos, Peter A. Tucker, No Pane, No Gain: Efficient Evaluation of Sliding' Window Aggregates over Data Streams. SIGMOD Record, Vol 34, No.1, March 2005   DOI   ScienceOn
12 Peter A. Tucker, David Maier, Time Sheard, Leonidas Fegaras, Exploiting Punctuation Semantics in Continuous Data Streams. IEEE Transactions on Knowledge and Data Engineering, May/June 2003   DOI   ScienceOn
13 S. Babu and J Widom, Continuous Queries over Data Streams. ACM SIGMOD Record, Sep. 2001   DOI   ScienceOn
14 D. Abadi at al, The Design of the Borealis Stream Processing Engine. CIDR 2005, Asilomar, CA, January 2005
15 Sirish Chandrasekaran et ai, TelegraphCQ: Continuous Dataflow Processing for an Uncertain World. CIDR 2003   DOI
16 D. Abadi, D. Carney, U. Cetintemel, M. Cherniack, C. Convey, S. Lee, M. Stonebraker, N. Tatbul, S. Zdonik. Aurora: A New Model and Architecture for Data Stream Management. VLDB Journal (2)2: 120-139, August 2003   DOI
17 Arvind Arasu et al, STREAM: The Stanford Data Stream Management System. IEEE Data Engineering Bulletin, Vol. 26 No. 1, March 2003
18 Rajeev Motwani et al, Query Proessing, Resource Management, and Approximation in a Data Stream Management System. CIDR 2003, Jan. 2003
19 B. Babcock, S. Babu, M. Datar, R. Motwani, and J. Widom, Models and Issues in Data ,Stream Systems. Invited paper in Proc. of the 2002 ACM Symp, on Principles of Database Systems' (PODS 2002), June 2002   DOI
20 Douglas Terry, David Goldberg, David Nichols, and Brian Oki, Continuous Queries over Append Only Databases. ACM SIGMOD, 1992   DOI
21 NS2 Sensor Network Extension: http://pf.itd.nrl.navy.mil/nrlsensorsim
22 Samuel R. Madden, Mehul A. Shah, Joseph M. Hellerstein and Vijayshankar Raman, Continuously Adaptive Continuous Queries over Streams. ACM SIGMOD Conference, Madison, WI, June 2002   DOI