Browse > Article

An Efficient Incremental Maintenance Method for Data Cubes in Data Warehouses  

Lee, Ki-Yong (한국과학기술원 전산학)
Park, Chang-Sup (수원대학교 인터넷정보공학과)
Kim, Myoung-Ho (한국과학기술원 전산학)
Abstract
The data cube is an aggregation operator that computes group-bys for all possible combination of dimension attributes. %on the number of the dimension attributes is n, a data cube computes $2^n$ group-bys. Each group-by in a data cube is called a cuboid. Data cubes are often precomputed and stored as materialized views in data warehouses. These data cubes need to be updated when source relation change. The incremental maintenance of a data cube is to compute and propagate only its changes. To compute the change of a data cube of $2^n$ cuboids, previous works compute a delta cube that has the same number of cuboids as the original data cube. Thus, as the number of dimension attributes increases, the cost of computing a delta cube increases significantly. Each cuboid in a delta cube is called a delta cuboid. In this paper. we propose an incremental cube maintenance method that can maintain a data cube by using only $_nC_{{\lceil}n/2{\rceil}}$ delta cuboids. As a result, the cost of computing a delta cube is substantially reduced. Through various experiments, we show the performance advantages of our method over previous methods.
Keywords
Data Cube; Incremental View Maintenance; Cube Maintenance;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Surajit Chaudhuri, Kyuseok Shim. Including Group-By in Query Optimization. In Proceedings of the Twentieth International Conference on Very Large Databases, pp. 354-366, 1994
2 Zhimin Chen, Vivek Narasayya, 'Efficient Computation of Multiple Group By Queries,' In Proceedings of the ACM SIGMOD Conference, 2005   DOI
3 M. R. Garey, D. S. Johnson, Computers and Intractability, chapter Appendix, pp. 208-209
4 Yannis Kotidis, Aggregate View Management in Data Warehouses, Handbook of Massive Data Sets, pp. 711-741, 2002
5 V. Harinarayan, A. Rajaraman, J. D. Ullman, Implementing Data Cubes Efficiently, In Proceedings of the ACM SIGMOD Conference, 1996   DOI
6 Goetz Graefe, Query Evaluation Techniques for Large Databases, ACM Computing Surveys, Vol. 25, Issue 2, pp. 73-169, 1993   DOI   ScienceOn
7 Ying Feng, Divyakant Agrawal, Amr El Abbadi, Ahmed Metwally, Range CUBE: Efficient Cube Computation by Exploiting Data Correlation, In Proceedings of the International Conference on Data Engineering, 2004   DOI
8 S. Agarwal, R. Agrawal, P. M. Deshpande, A. Gupta, J. F. Naughton, R. Ramakrishnan, S. Sarawagi, On the Computation of Multidimensional Aggregates, In Proceedings of VLDB Conference, 1996
9 K. A. Ross, D. Srivastava, Fast Computation of Sparse Datacubes, In Proceedings of VLDB Conference, 1997
10 Kevin Beyer, Raghu Ramakrishnan, Bottom-Up Computation of Sparse and Iceberg CUBEs, In Proceedings of the ACM SIGMOD Conference, 1999   DOI
11 I. S. Mumick, D. Quass, B. S. Mumick, Maintenance of Data Cubes and Summary Tables in a Warehouse, In Proceedings of the ACM SIGMOD Conference, 1997   DOI
12 D. Quass, Maintenance expressions for views with aggregation, In Workshop on Materialized Views: Techniques and Applications, pp. 110-118, 1996
13 H. Gupta, I.S. Mumick, Incremental maintenance of aggregate and outerjoin expressions, Technical Report, Stanford University, 1999
14 Jim Gray, Adam Bosworth, Andrew Layman, Hamid Pirahesh, Data Cube: A Relational Aggregation Operator Generalizing Group-By, Cross-Tab, and Sub-Totals, In Proceedings of the 12th International Conference on Data Engineering, 1996   DOI
15 Nick Roussopoulos, Yannis Kotidis, Mema Roussopoulos, Cubetree: Organization of and Bulk Incremental Updates on the Data Cube, In Proceedings of the ACM SIGMOD Conference, 1997   DOI
16 C. A. Hurtado, A. O. Mendelzon, A. A. Vaisman, Maintaining Data Cubes under Dimension Updates, In Proceedings of ICDE, 1999
17 W. Lehner, R. Sidle, H. Pirahesh, R. Cochrane, Maintenance of Cube Automatic Summary Tables, In Proceedings of the ACM SIGMOD Conference, 2000   DOI
18 A. Gupta, I. S. Mumick, V. S. Subrahmanian, Maintaining views incrementally, In Proceedings of the ACM SIGMOD Conference, pp. 157-166, 1993   DOI
19 L. R. Foulds, R. L. Graham, The Steiner Problem in Phylogeny is NP-Complete, Advances in Applied Mathematics, vol. 3, pp. 43-49, 1982   DOI
20 TPC Committee, Transaction Processing Council, http://www.tpc.org/
21 C. H. Papadimitriou, K. Steiglitz, Combinatorial Optimization: Algorithms and Complexity, chapter 11, pp. 247-254, 1982