Welcome to the InfoSci Platform
Reference Hub2
Node Partitioned Data Warehouses: Experimental Evidence and Improvements

Node Partitioned Data Warehouses: Experimental Evidence and Improvements

Pedro Furtado
Copyright: © 2006 |Volume: 17 |Issue: 2 |Pages: 19
ISSN: 1063-8016|EISSN: 1533-8010|ISSN: 1063-8016|EISBN13: 9781615200504|EISSN: 1533-8010|DOI: 10.4018/jdm.2006040103
Cite Article Cite Article

MLA

Furtado, Pedro. "Node Partitioned Data Warehouses: Experimental Evidence and Improvements." JDM vol.17, no.2 2006: pp.43-61. http://doi.org/10.4018/jdm.2006040103

APA

Furtado, P. (2006). Node Partitioned Data Warehouses: Experimental Evidence and Improvements. Journal of Database Management (JDM), 17(2), 43-61. http://doi.org/10.4018/jdm.2006040103

Chicago

Furtado, Pedro. "Node Partitioned Data Warehouses: Experimental Evidence and Improvements," Journal of Database Management (JDM) 17, no.2: 43-61. http://doi.org/10.4018/jdm.2006040103

Export Reference

Mendeley
Favorite Full-Issue Download

Abstract

Data Warehouses (DWs) with large quantities of data present major performance and scalability challenges, and parallelism can be used for major performance improvement in such context. However, instead of costly specialized parallel hardware and interconnections, we focus on low-cost standard computing nodes, possibly in a non-dedicated local network. In this environment, special care must be taken with partitioning and processing. We use experimental evidence to analyze the shortcomings of a basic horizontal partitioning strategy designed for that environment, then propose and test improvements to allow efficient placement for the low-cost Node Partitioned Data Warehouse. We show experimentally that extra overheads related to processing large replicated relations and repartitioning requirements between nodes can significantly degrade speedup performance for many query patterns. We analyze a simple, easy-to-apply partitioning and placement decision that achieves good performance improvement results. Our experiments and discussion provide important insight into partitioning and processing issues for data warehouses in shared-nothing environments.

Request Access

You do not own this content. Please login to recommend this title to your institution's librarian or purchase it from the IGI Global bookstore.