Browse > Article
http://dx.doi.org/10.6109/jkiice.2010.14.1.167

Analysis and Evaluation of DBMS Bulk Data Loading Through Multi-tiered Architecture for Heterogeneous Systems  

Tan, Hee-Yuan (동서대학교 일반대학원)
Lim, Hyo-Taek (동서대학교 컴퓨터정보공학부)
Publication Information
Journal of the Korea Institute of Information and Communication Engineering / v.14, no.1, 2010 , pp. 167-176 More about this Journal
Abstract
Managing the growing number of data generated through various processes requires the aid of Database Management System (DBMS) to efficiently handle the huge amount of data. These data can be inserted into database m real time or in batch, that come from multiple sources, including those that are coming from inside and outside of a network. The insertion of large amount of data is commonly done through specific bulk loading or insertion function supplied by each individual DBMS. In this paper, we analyze and evaluate on handling data bulk loading for heterogeneous systems that is organised as multi-tiered architecture and compare the result of DBMS bulk loader against program insertion from a software development perspective. We propose a hybrid solution using staging database that can be easily deployed for enhancing bulk loading performance compared to insertion by application.
Keywords
Database Management System (DBMS); Bulk Loading; Heterogeneous Systems; Multi-tiered Architecture;
Citations & Related Records
연도 인용수 순위
  • Reference
1 The Internet Movie Database (IMDb). Retrieved 24 September 2009. Available from: http://www.imdb.com/interfaces
2 B.M. Subraya, "Integrated Approach to Web Performance Testing: A Practitioner's Guide," IRM Press, 2006.
3 MySQL 5.4 Reference Manual, Sun Microsystems, 2009. http://dev.mysql.com/doc/ refman/5.4/en/index.html
4 K. Rich et. al, "Part II : SQL*Loader," in Oracle Database Utilities, 11g Release 1(11.1), Oracle, Sept. 2007.
5 G. Lord, "The Importance of Data Architecture in a Client/Server Environment", in Designing a Total Data Solution: Technology, Implementation, and Deployment, R. E. Burkey and C. V. Breakfield, e.d., pp. 69-80, CRC Press, 2001.
6 SQL Server 2008 Books Online, Microsoft, October 2009. http://msdn.microsoft.com/en-us/library/ms130214.aspx