Browse > Article

MMJoin: An Optimization Technique for Multiple Continuous MJoins over Data Streams  

Byun, Chang-Woo (인하공업전문대학 컴퓨터시스템과)
Lee, Hun-Zu (서강대학교 컴퓨터공학과)
Park, Seog (서강대학교 컴퓨터공학과)
Publication Information
Journal of KIISE:Databases / v.35, no.1, 2008 , pp. 1-16 More about this Journal
Abstract
Join queries having heavy cost are necessary to Data Stream Management System in Sensor Network where plural short information is generated. It is reasonable that each join operator has a sliding-window constraint for preventing DISK I/O because the data stream represents the infinite size of data. In addition, the join operator should be able to take multiple inputs for overall results. It is possible for the MJoin operator with sliding-windows to do so. In this paper, we consider the data stream environment where multiple MJoin operators are registered and propose MMJoin which deals with issues of building and processing a globally shared query considering characteristics of the MJoin operator with sliding-windows. First, we propose a solution of building the global shared query execution plan. Second, we solved the problems of updating a window size and routing for a join result. Our study can be utilized as a fundamental research for an optimization technique for multiple continuous joins in the data stream environment.
Keywords
Data stream; multiple Join; Sharing; Multi-query Optimization;
Citations & Related Records
연도 인용수 순위
  • Reference
1 A. N. Wilschut and P. M. G. Apers, "Pipelining in query execution," Conf. on Database, Parallel Architectures and their Applications, p.562, 1991
2 K. Shim and T. Sellis. Multiple-query optimization. ACM Transactions on Database Systems, Vol.13, Issue 1, pp. 23-52, 1988   DOI   ScienceOn
3 M. Hammad, M. Franklin, W. Aref, and A. Elmagarmid, "Scheduling for Shared Window Joins over Data Streams," In Proc. 29th VLDB Conf., pp. 297-308, 2003
4 S. Krishnamurthy, M.J. Franklin, J. M. Hellerstein, and G. Jacobson, "The Case for Precision Sharing," In Proc. 30th VLDB Conf., pp. 972-986, 2004
5 J. Naughton, D. DeWitt, and D. Maier. The Niagara Internet Query System. IEEE Data Engineering Bulletin, Vol.24, No.2, pp. 27-33, 2001
6 T. Urhan and M. J. Franklin. XJoin: A reactively- scheduled pipelined join operator. IEEE Data Engineering Bulletin, Vol.23, No.2, pp. 27-33, 2000
7 B. Babcock, S. Babu, M. Datar, R. Motwani, and J. Widom, "Models and Issues in Data Stream Systems," In Proc. 21st ACM Sym. on Principles of Database Systems, pp. 1-16, 2002
8 J. Chen, and D. J. DeWitt, "Dynamic Re-grouping of Continuous Queries," In Proc. 28th VLDB Conf., pp.430-441, 2002
9 S. D. Viglas, J. F. Naughton, and J. Burger, "Maximizing the Output Rate of Multi-Way Join Queries over Streaming Information Sources," In Proc. 29th VLDB Conf., pp. 285-296, 2003
10 S. Wang, E. Rundensteiner, S. Ganguly, and S. Bhatnagar, "State-Slice: New Paradigm of Multi- Query Optimization of Window-Based Stream Queries," In Proc. 32nd VLDB Conf., pp.619-630, 2006
11 D. J. Abadi, D. Carney, U. Cetintemel, M. Cherniack, C. Convey, S. Lee, M. Stonebraker, N. Tatbul, and S. Zdonik. Aurora: a new model and architecture for data stream management. The International Journal on Very Large Data Bases, Vol.12, Issue 2, pp. 120-139, 2003   DOI   ScienceOn
12 J. Kang, J. F. Naughton, and S. D. Viglas, "Evaluating Window Joins over unbounded Streams," In ICDE03, pp. 341-352, 2003
13 L. Golab and M. T. Ozau, "Processing Sliding Window Multi-Joins in Continuous Queries over Data Streams," In Proc. 29th VLDB Conf., pp. 500-511, 2003
14 C. D. Manning and H. SchUtze. Foundations of Statistical Natural Language Processing. The MIT Press, 1999
15 L. Ding and E. A. Rundensteiner, "Evaluating Window Joins over Punctuated Streams," In Proc. 13th ACM Int. Conf. on Information and Knowledge Management, pp. 98-107, 2004
16 T. M. Ghanem, W. G. Aref, and A. K. Elmagarmid. Exploiting Predicate-Window Semantics over Data Streams. ACM SIGMOD Record, Vol. 35, Issue 1. March, pp. 555-568, 2006
17 S. Schmidt, M. Fiedler, and W.Lehner, "Source- aware Join Strategies of Sensor Data Streams," In Proc. 17th Int. Conf. on Scientific and statistical database management, pp. 123-132, 2005
18 Y. Watanabe, and H. Kitagawa, "A Multiple Continuous Query Optimization Method Based on Query Execution Pattern Analysis," DASFAA 2004, LNCS 2973, pp. 443-456, 2003
19 S. Chandrasekaran, O. Cooper, A. Deshpande, M. J. Franklin, J. M. Hellerstein, W. Hong, S. Krishnamurthy, S. Madden, V. Raman, F. Reiss, and M. Shah, "TelegraphCQ: Continuous Dataflow Processing for an Uncertain World," In Proc. 1st Biennial Conf. on Innovative Database Research, pp. 269-280, 2003
20 P. Bonnet, J. Gehrke, and P. Seshadri, "Towards Sensor Database Systems," In Proc. 2th Int. Conf. on Mobile Data Management, pp. 3-14, 2001