Browse > Article

A Disk Group Commit Protocol for Main-Memory Database Systems  

이인선 (신구대학 컴퓨터정보처리과)
염헌영 (서울대학교 전기 및 컴퓨터공학부)
Abstract
Main-Memory DataBase(MMDB) system where all the data reside on the main memory shows tremendous performance boost since it does not need any disk access during the transaction processing. Since MMDB still needs disk logging for transaction commit, it has become another bottleneck for the transaction throughput and the commit protocol should be examined carefully. There have been several attempts to reduce the logging overhead. The pre-commit and group commit are two well known techniques which do not require additional hardware. However, there has not been any research to analyze their effect on MMDB system. In this paper, we identify the possibility of deadlock resulting from the group commit and propose the disk group commit protocol which can be readily deployed. Using extensive simulation, we have shown that the group commit is effective on improving the MMDB transaction performance and the proposed disk group commit almost always outperform carefully tuned group commit. Also, we note that the pre-commit does not have any effect when used alone but shows some improvement if used in conjunction with the group commit.
Keywords
main-memory database system; commit protocol; group commit; pre-commit;
Citations & Related Records
Times Cited By KSCI : 1  (Citation Analysis)
연도 인용수 순위
1 Margaret H. Dunham, Jun-Lin Lin, and Xi Li, 'Fuzzy Checkpointing Alternatives for Main Memory Databases,' Recovery Mechanism in Database Systems, Prentice-Hall, 1997
2 Le Gruenwald and Sichen Liu, 'A performance Study of Concurrency Control in a Real-Time Main Memory Database System,' SIGMOD Record, Vol.22, No.4, pp.38-44, December 1993   DOI   ScienceOn
3 Juchang Lee, Kihong Kim, Sang K.Cha, 'Differential Logging: A Commutative and Associative Logging Scheme for Highly Parallel Main Memory Database,' Proceedings of International. Conference on Data Engineering, pp.73-183, 2001   DOI
4 Konstantin Knizhnik, 'FastDB Main Memory Database Management System,' From FastDB Homepage
5 J.Baulier, P.Bohannon, S.Gogate, C.Gupta, S.Haldar, S.Joshi, A.Khivesera, H.F.Korth, P.Mcllroy, J.Miller, P.P.S.Narayan, M.Nemeth, R.Rastogi, S.Seshadri, A.Silberschatz, S.Sudarshan, M.Wilder, C.Wei, 'Datablitz storage manager: Main memory database performance for critical applications,' In Proceedings of the ACM SIGMOD/PIDS International Conference on the Management of Data, June 1999   DOI
6 Jerry Baulier, Stephen Blott, Henry F.Korth, Avi Silberschatz, 'A Database System for Real-Time Event Aggregation in Telecommunication,' In Proceedings of the International Conference on VLDB Industrial track paper, August 1998
7 Bruce L. Worthington, Gregory R. Ganger, Yale N. Patt, John Wilkes, 'On-Line Extraction of SCSI Disk Drive Parameters,' Proceedings of the ACM Sigmetrics, 1995   DOI
8 H. Schewetman, 'CSIM user's guide for use with CSIM revision16,' MCC, June, 1992
9 Stephen Blott, Henry F. Korth, 'Almost-Serial Protocol for Transaction Execution in Main-Memory Database Systems,' Proceedings of the International Conference on VLDB, August 2002
10 Robert Hagmann, 'Reimplementing the Cedar File system Using Logging and Group Commit,' Proceedings of 11th Symposium on Operating System Principles, pp.155-162, November 1987   DOI
11 Gawlick, Dieter, and David. Kinkade, 'Varieties of Concurrency Control in IMS/VS FastPath,' IEEE Database Engineering, Vol.8, No.2, pp.3-10, June 1985
12 Ramesh Gupta, Javant Haritsa, Krithi Ramamritham, 'Revisiting Commit Processing in Distributed Database Systems,' Proceedings of the 1997 ACM SIGMOD, PP.486-497, 1997   DOI
13 Kenneth Salm, Hector Garcia-Molina, 'System M : A transaction Processing Testbed for Memory Resident Data,' IEEE Trans. on Knowledge and Data Engineering, Vol. 2, No.1, pp.161-172, March 1990   DOI   ScienceOn
14 Pat Helland, Harald Sammer, Jim Lyon, Richard Carr, Phill Garrett, Andres Reuter, 'Group Commit Timers and High Volume Transaction Systems,' Tandem Technical Report 88.1, March 1988
15 우승균, 이윤준, 김명호, '주기억 장치 데이터베이스 시스템에서의 회복 기법에 대한 고찰', 정보화학회지 제14권 제2호, pp.38-46, 1996.2   과학기술학회마을
16 Le Gruenwald and Margaret H. Eich, 'MMDB Reload Algorithms,' Proceedings of ACM SIGMOD, pp.397-405, 1991   DOI
17 Lehman, T.J. et al., 'An Evaluation of Starburst's Memory Resident Storage Component,' IEEE Transactions on Knowledge and Data Engineering, Vol. 4, No.6, pp.555-566, Dec. 1992   DOI   ScienceOn
18 Eliezer Levy and Avi Silberschatz, 'Incremental Recovery in Main memory Database System,' dept. of Computer Sciences University of Texas at Austin, TR-92-01
19 H. V. Jagadish, Avi Siberschatz, and S. Sudarshan, 'Recovering from Main-Memory Lapses,' Proceedings of 19th VLDB conference, pp.391-404, 1993
20 Xi Li, Margaret H. Eich, 'Post-crash Log Processing for Fuzzy Checkpoing Main Memory Database,' International Conference on Data Engineering, IEEE, pp.117-124, 1993   DOI
21 Tobin J.Lehman, 'Design and performance evaluation of a Main Memory Relational Database Systems,' Ph.D dissertation of computer sciences dept. Univ. of Wisconsin-madison, August 1986
22 Chen PM, Ng WT, Chandra S, Aycock CM, Rajamani G, Lowell D, 'The Rio File Cache: Surviving Operating System Crashes,' Proceedings of the 1996 International Conference on Architectural Support for Programming Languages and Operating Systems(ASPLOS), ACM Press, pp. 74-83   DOI
23 Wee Teck Ng, Peter M. Chen, 'International Journal on VLDB, Auguest 1998   DOI
24 Margaret H. Eich, 'A classification and comparison of main memory database recovery techniques,'Proceedings of International Conference on Data Engineering, pp.417-424, 1987
25 H. Garcia-Molina and K. Salem, 'Main Memory Database Systems: An Overview,' IEEE Transactions on' Knowledge and Data Engineering, 4(6), 1993   DOI   ScienceOn
26 Hector Garcia-Molina, Richard J.Lipton, and Jacobo valdes, 'A Massive Memory Machine,' IEEE Transactions on Computers, Vol. c-33, No.5, pp. 391-399, 1984   DOI   ScienceOn
27 DeWitt. D.J., Katz, RH., Olken. F., Shapiro, L.D., Stonebraker, M. R, and Wood, D., 'Implementation Techniques for Main Memory Database Systems,' Proceedings of SIGMOD '84, pp.1-8, June 1984   DOI
28 The TimesTen Team, 'In-Memory Data Management for Consumer Transactions The TimesTen Approach,' Proceedings of the ACM SIGMOD/PIDS International Conference on Management of Data, June 1999   DOI
29 Wu M, Zwaenepoel W(1994) 'eNVy: A Non-Volatile, Main Memory Storage System,' Proceedings of the 1994 International Conference on Architectural Support for Programming Languages and Operating Systems(ASPLOS), October 1994, ACM Press, pp. 86-97   DOI
30 American Power Conversion(1996), 'The Power Protection Handbook,' Technical report. American Power Conversion, West Kingston, RI
31 P.A. Bernstein, V.Hadzilacos, and N.Goodman, 'Concurrency Control and Recovery in Database Systems,' Addison-Wesley (Reading MA), 1987
32 Rosennblum M, Bugnion E, Herrod SA, Witchel E, Gupta A, 'The Impact of Architectural Trends on Operating System Performance,' Proceedings of the 1995 Symposium on Operating Systems Principles, ACM Press, pp.285-298, 1995   DOI
33 Margaret H. Eich, 'Forward Main Memory Databases : Current and Future Research Issues,' IEEE Trans. on Knowledge and Data Engineering, Vol. 4, No.6, pp.507-508, December 1992   DOI
34 H.V.Jagadish, D.Lieuwen, R.Rastogi, A.Silberschatz. 'Dali: A High Performance Main Memory Storage anager,' Proceedings of the 20th International Conference on Very Large Data Bases, pp.12-15, September 1994
35 Altibase Development Team, 'ALTIBASE System Architecture,' From Altibase mmdb system Homepage