Distributed Approach to Continuous Queries with kNN Join Processing in Spatial Telemetric Data Warehouse

Distributed Approach to Continuous Queries with kNN Join Processing in Spatial Telemetric Data Warehouse

Marcin Gorawski (Silesian Technical University, Poland) and Wojciech Gebczyk (Silesian Technical University, Poland)
DOI: 10.4018/978-1-60566-232-9.ch013
OnDemand PDF Download:
$37.50

Abstract

This chapter describes realization of distributed approach to continuous queries with kNN join processing in the spatial telemetric data warehouse. Due to dispersion of the developed system, new structural members were distinguished: the mobile object simulator, the kNN join processing service, and the query manager. Distributed tasks communicate using JAVA RMI methods. The kNN queries (k Nearest Neighbour) joins every point from one dataset with its k nearest neighbours in the other dataset. In our approach we use the Gorder method, which is a block nested loop join algorithm that exploits sorting, join scheduling, and distance computation filtering to reduce CPU and I/O usage.
Chapter Preview
Top

Introduction

With expansion of location-aware technologies such as the GPS (Global Positioning System) and growing popularity and accessibility of the mobile communication, location-aware data management becomes a significant problem in the mobile computing systems. Mobile devices become much more available with concurrent growth of their computational capabilities. It is expected that future mobile applications will require scalable architecture that will be able to process very large and quickly growing number of mobile objects, and to evaluate compound queries over their locations (Yiu, Papdias, Mamoulis, Tao, 2006).

The paper describes realization of distributed approach to the Spatial Location and Telemetric Data Warehouse (SDW(l/t)), which bases on the Spatial Telemetric Data Warehouse (STDW)), which consist of telemetric data containing information about water, gas, heat and electricity consumption (Gorawski, Wróbel, 2005). DSDW(l/t) (Distributed Spatial Location and Telemetric Data Warehouse) is supplied with datasets from Integrated Meter Reading (IMR) data system and by mobile objects location.

Integrated Meter Reading data system enables communication between medium meters and telemetric database system. Using GPRS or SMS technology, measurements from meters located on a wide geographical area are transferred to database, where they are processed and put forward for further analysis.

The SDW(l/t) supports making tactical decisions about size of medium productivity on the base of short-termed consumption predictions. Predictions are calculated basing on data stored in a data warehouse by ETL process.

Top

Designed Approach

First figure illustrates designed approach architecture. We can observe multiple, concurrently running mobile objects (query points), the Gorder (Chenyi, Hongjun, Beng Chin, Jing 2004) service responsible for processing simultaneous continuous queries over k nearest neighbors, RMI’s SDWServer and the central part of the designed data system - SDW(l/t), which is also referenced as a query manager. Communication between SDW(l/t) and query processing service is maintained with Java’s Remote Method Invocation (RMI) solutions.

Principal goal of the described approach is to distribute the previously designed system over many independent nodes. As a result we expect faster and more efficient processing of similarity join method Gorder. In the previous approach, all components shown in Figure 1 were linked together on a single computer. All active processes were using the same CPU. Because of high CPU usage and long evaluation time we decided to distribute the SDW (l/t) into independent services, linked together with Java RMI technology. The most efficient solution assumes moving the Gorder service to separate computer because it causes the highest CPU consumption from all components. Other components may be executed on different computers, or on the same computer; their influence on the CPU usage is insignificant.

Figure 1.

A scheme of DSDW(l/t) structure

The designed system works as follows. First, using SDW(l/t), we have to upload a road map and meters into a database running on Oracle Server, .Then we start the SDWServer, the Gorder service and as many mobile objects as we want to evaluate. Every new mobile object is registered in the database. In SDW(l/t) we define new queries for active mobile objects. Queries are also registered in the database. The Gorder service verifies periodically, if there are any new queries defined. Every query is processed during each cycle of the Gorder process. Results are sent to SDW(l/t), where they are submitted for further analysis. SDWServer secures steady RMI connection between running processes.

Complete Chapter List

Search this Book:
Reset
Editorial Advisory Board
Table of Contents
Preface
David Taniar
Chapter 1
Laila Niedrite, Maris Solodovnikova Treimanis, Liga Grundmane
There are many methods in the area of data warehousing to define requirements for the development of the most appropriate conceptual model of a data... Sample PDF
Development of Data Warehouse Conceptual Models: Method Engineering Approach
$37.50
Chapter 2
Stefano Rizzi
In the context of data warehouse design, a basic role is played by conceptual modeling, that provides a higher level of abstraction in describing... Sample PDF
Conceptual Modeling Solutions for the Data Warehouse
$37.50
Chapter 3
Hamid Haidarian Shahri
Entity resolution (also known as duplicate elimination) is an important part of the data cleaning process, especially in data integration and... Sample PDF
A Machine Learning Approach to Data Cleaning in Databases and Data Warehouses
$37.50
Chapter 4
Maurizio Pighin, Lucio Ieronutti
Data Warehouses are increasingly used by commercial organizations to extract, from a huge amount of transactional data, concise information useful... Sample PDF
Interactive Quality-Oriented Data Warehouse Development
$37.50
Chapter 5
Dirk Draheim, Oscar Mangisengi
Nowadays tracking data from activity checkpoints of unit transactions within an organization’s business processes becomes an important data resource... Sample PDF
Integrated Business and Production Process Data Warehousing
$37.50
Chapter 6
Jorge Loureiro, Orlando Belo
OLAP queries are characterized by short answering times. Materialized cube views, a pre-aggregation and storage of group-by values, are one of the... Sample PDF
Selecting and Allocating Cubes in Multi-Node OLAP Systems: An Evolutionary Approach
$37.50
Chapter 7
Jorge Loureiro, Orlando Belo
Globalization and market deregulation has increased business competition, which imposed OLAP data and technologies as one of the great enterprise’s... Sample PDF
Swarm Quant' Intelligence for Optimizing Multi-Node OLAP Systems
$37.50
Chapter 8
Franck Ravat, Olivier Teste, Ronan Tournier
With the emergence of Semi-structured data format (such as XML), the storage of documents in centralised facilities appeared as a natural adaptation... Sample PDF
Multidimensional Anlaysis of XML Document Contents with OLAP Dimensions
$37.50
Chapter 9
Hanene Ben-Abdallah, Jamel Feki, Mounira Ben Abdallah
Despite their strategic importance, the wide-spread usage of decision support systems remains limited by both the complexity of their design and the... Sample PDF
A Multidimensional Pattern Based Approach for the Design of Data Marts
$37.50
Chapter 10
Concepción M. Gascueña, Rafael Guadalupe
The Multidimensional Databases (MDB) are used in the Decision Support Systems (DSS) and in Geographic Information Systems (GIS); the latter locates... Sample PDF
A Multidimensional Methodology with Support for Spatio-Temporal Multigranularity in the Conceptual and Logical Phases
$37.50
Chapter 11
Francisco Araque, Alberto Salguero, Cecilia Delgado
One of the most complex issues of the integration and transformation interface is the case where there are multiple sources for a single data... Sample PDF
Methodology for Improving Data Warehouse Design using Data Sources Temporal Metadata
$37.50
Chapter 12
Shi-Ming Huang, John Tait, Chun-Hao Su, Chih-Fong Tsai
Data warehousing is a popular technology, which aims at improving decision-making ability. As the result of an increasingly competitive environment... Sample PDF
Using Active Rules to Maintain Data Consistency in Data Warehouse Systems
$37.50
Chapter 13
Marcin Gorawski, Wojciech Gebczyk
This chapter describes realization of distributed approach to continuous queries with kNN join processing in the spatial telemetric data warehouse.... Sample PDF
Distributed Approach to Continuous Queries with kNN Join Processing in Spatial Telemetric Data Warehouse
$37.50
Chapter 14
Maria Luisa Damiani, Stefano Spaccapietra
This chapter is concerned with multidimensional data models for spatial data warehouses. Over the last few years different approaches have been... Sample PDF
Spatial Data Warehouse Modelling
$37.50
Chapter 15
Jérôme Darmont
Performance evaluation is a key issue for designers and users of Database Management Systems (DBMSs). Performance is generally assessed with... Sample PDF
Data Warehouse Benchmarking with DWEB
$37.50
Chapter 16
Lars Frank, Christian Frank
A Star Schema Data Warehouse looks like a star with a central, so-called fact table, in the middle, surrounded by so-called dimension tables with... Sample PDF
Analyses and Evaluation of Responses to Slowly Changing Dimensions in Data Warehouses
$37.50
About the Contributors