Welcome to the InfoSci Platform
Reference Hub87
Incremental Load in a Data Warehousing Environment

Incremental Load in a Data Warehousing Environment

Nayem Rahman
Copyright: © 2010 |Volume: 6 |Issue: 3 |Pages: 16
ISSN: 1548-3657|EISSN: 1548-3665|EISBN13: 9781609609115|DOI: 10.4018/jiit.2010070101
Cite Article Cite Article

MLA

Rahman, Nayem. "Incremental Load in a Data Warehousing Environment." IJIIT vol.6, no.3 2010: pp.1-16. http://doi.org/10.4018/jiit.2010070101

APA

Rahman, N. (2010). Incremental Load in a Data Warehousing Environment. International Journal of Intelligent Information Technologies (IJIIT), 6(3), 1-16. http://doi.org/10.4018/jiit.2010070101

Chicago

Rahman, Nayem. "Incremental Load in a Data Warehousing Environment," International Journal of Intelligent Information Technologies (IJIIT) 6, no.3: 1-16. http://doi.org/10.4018/jiit.2010070101

Export Reference

Mendeley
Favorite Full-Issue Download

Abstract

Incremental load is an important factor for successful data warehousing. Lack of standardized incremental refresh methodologies can lead to poor analytical results, which can be unacceptable to an organization’s analytical community. Successful data warehouse implementation depends on consistent metadata as well as incremental data load techniques. If consistent load timestamps are maintained and efficient transformation algorithms are used, it is possible to refresh databases with complete accuracy and with little or no manual checking. This paper proposes an Extract-Transform-Load (ETL) metadata model that archives load observation timestamps and other useful load parameters. The author also recommends algorithms and techniques for incremental refreshes that enable table loading while ensuring data consistency, integrity, and improving load performance. In addition to significantly improving quality in incremental load techniques, these methods will save a substantial amount of data warehouse systems resources.

Request Access

You do not own this content. Please login to recommend this title to your institution's librarian or purchase it from the IGI Global bookstore.