The KIPS Transactions:PartD (정보처리학회논문지D)

Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

An Efficient Incremental Maintenance of SPJ Materialized Views

SPJ 실체화 뷰의 효율적인 점진적 관리 기법

  • Published : 2006.10.31
Download PDF
⟨ Previous Next ⟩

Abstract

In the data warehouse environment, materialized views are typically used to support efficient query processing. Materialized views need to be updated when source data change. Since the update of the views need impose a significant overhead, it is essential to update the views efficiently. Though various view maintenance strategies have been discussed in the past, the efficient maintenance of SPJ materialized views has not been sufficiently investigated. In this paper, we propose an efficient incremental view maintenance method for SPJ materialized views that minimizes the total accesses to data sources. The proposed method finds an optimal view maintenance strategy using a dynamic programming algorithm. We also present various experimental results that shows the efficiency of our proposed method.

데이터 웨어하우스에서는 질의를 빠르게 처리하기 위해 실체화 뷰(materialized view)가 흔히 사용된다. 실체화 뷰는 그의 정의에 포함된 데이터 소스들이 변경되면 이를 반영하기 위해 갱신되어야 한다. 실체화 년의 갱신은 많은 부하를 야기하므로, 실체화 뷰를 효율적으로 갱신하는 것은 매우 중요한 문제이다. 실체화 뷰의 효율적인 갱신 방법에 대해서는 이미 많은 연구가 있어왔지만, SPJ(Select-Project-Join) 형태로 정의된 실체화 뷰를 효율적으로 갱신하는 방법은 충분히 연구되지 않았다. 본 논문에서는 데이터 소스들에 대한 접근 비용을 최소화함으로써 SPJ 실체화 뷰를 효율적으로 점진적으로 갱신하는 방법을 제안한다. 제안하는 방법은 동적 계획법 알고리즘을 사용하여 최적의 갱신 방법을 찾는다. 마지막으로, 다양한 성능 평가 실험을 통해 제안하는 방법이 우수한 성능을 가지고 있음을 보인다.

Keywords

References

  1. W. H. Immon, Building the Data Warehouse, Wiley Computer Publishing, 1996
  2. J. A. Blakeley, P. Larson, F. W. Tompa, Efficiently Updating Materialized Views, In Proceedings of ACM SIGMOD Conference, pp.61-71, 1986
  3. S. Ceri, J. Widom, Deriving production rules for incremental view maintenance, In Proceedings of the 7th International Conference on Very Large Databases, pp.108-119, 1991
  4. A. Gupta, I. S. Mumick, V. S. Subrahmanian, Maintaining views incrementally, In Proceedings of ACM SIGMOD Conference, pp.157-166, 1993
  5. T. Griffin, L. Libkin, Incremental maintenance of views with duplicates, In Proceedings of ACM SIGMOD Conference, pp.328-339, 1995
  6. L. S. Colby, T. Griffin, L. Libkin, I. S. Mumick, H. Trickey, Algorithms for deferred view maintenance, In Proceedings of ACM SIGMOD Conference, pp.469-492, 1996
  7. I. S. Mumick, D. Quass, B. S. Mumick, Maintenance of Data Cubes and Summary Tables in a Warehouse, In Proceedings of ACM SIGMOD Conference, pp.100-111, 1997 https://doi.org/10.1145/253260.253277
  8. W. J. Labio, R. Yerneni, H. Garcia-Molina, Shrinking the Warehouse Update Window, In Proceedings of ACM SIGMOD Conference, pp.383-394, 1999 https://doi.org/10.1145/304181.304216
  9. Ki Yong Lee, Myoung Ho Kim, 'Efficient Incremental View Maintenance in Data Warehouses,' Journal of KISS (B), 2000
  10. H. Mistry, R. Roy, S. Sudarshan, K. Ramamritham, Materialized View Selection and Maintenance Using Multi-Query Optimization, In Proceedings of ACM SIGMOD Conference, 2001
  11. D. Quass, Maintenance expressions for views with aggregation, In Workshop on Materialized Views: Techniques and Applications, pp.110-118, 1996
  12. H. Gupta, I.S. Mumick, Incremental maintenance of aggregate and outerjoin expressions, Technical Report, Stanford University, 1999
  13. Themistoklis Palpanas, Richard Sidle, Roberta Cochrane, Hamid Pirahesh, Incremental Maintenance for Non-Distributive Aggregate Functions, In Proceedings of VLDB, 2002
  14. Ke Yi, Hai Yu, Jun Yang, Gangqiang Xia, Yuguo Chen, Efficient Maintenance of Materialized Top-k Views, In Proceedings of International Conference on Data Engineering, 2003
  15. Songting Chen, Elke A. Rundensteiner, GPIVOT: Efficient Incremental Maintenance of Complex ROLAP Views, In Proceedings of International Conference on Data Engineering, 2005
  16. Y. Zhuge, H. Garcia-Molina, J. L. Wiener, Consistency Algorithms for Multi-Source Warehouse View Maintenance, Distributed and Parallel Databases, 6(1):7-40, 1998 https://doi.org/10.1023/A:1008698814840
  17. D. Agrawal, A. E. Abbadi, A. Singh, T. Yurek, Efficient View Maintenance at Data Warehouses, In Proceedings of ACM SIGMOD Conference, pp.417-427, 1997 https://doi.org/10.1145/253262.253355
  18. Gang Luo, Jeffrey F. Naughton, Curt Ellmann, Michael Watzke, A Comparison of Three Methods for Join View Maintenance in Parallel RDBMS, In Proceedings of International Conference on Data Engineering, 2003
  19. Bin Liu, Elke A. Rundensteiner: Cost-Driven General Join View Maintenance over Distributed Data Sources, In Proceedings of International Conference on Data Engineering (poster), 2005
  20. K. Salem, K. Beyer, B. Lindsay, How To Roll a Join: Asynchronous Incremental View Maintenance, In Proceedings of ACM SIGMOD Conference, pp.129-140, 2000
  21. Hao He, Junyi Xie, Jun Yang, Hai Yu: Asymmetric Batch Incremental View Maintenance, In Proceedings of International Conference on Data Engineering, 2005
  22. B. Niamir, Attribute Partitioning in a Self-Adaptive Relational Database System, Technical Report, Cambridge, Mass.: Laboratory for Computer Science, Massachusetts Institute of Technology, 1978
  23. M. Hammer, B. Niamir, A Heuristic Approach to Attribute Partitioning, In Proceedings of ACM SIGMOD Conference, pp.93-101, 1979 https://doi.org/10.1145/582095.582110
  24. TPC Committee, Transaction Processing Council, http://www.tpc.org/
  25. T. K. Sellis, Multiple Query Optimization, ACM Transactions on Database Systems, 13(1):23-52, March, 1988 https://doi.org/10.1145/42201.42203
  26. J. Park, A. Segev, Using Common Sub-expressions to Optimize Multiple Queries, In Proceedings of International Conference on Data Engineering, 1998
  27. K. Shim, T. Sellis, D. Nau, Improvements on a Heuristic Algorithm for Multi-query Optimization, Data and Knowledge Engineering, 12:197-222, 1994 https://doi.org/10.1016/0169-023X(94)90014-0
  28. P. Roy, S. Seshadri, S. Sudarshan, S. Bhobe, Efficient and Extensible Algorithms for Multi Query Optimization, In Proceedings of ACM SIGMOD Conference, pp.249-260, 2000 https://doi.org/10.1145/335191.335419