Adaptive Control of Redundant Task Execution for Dependable Volunteer Computing

Adaptive Control of Redundant Task Execution for Dependable Volunteer Computing

Hong Wang (Tohoku University, Japan), Yoshitomo Murata (Tohoku University, Japan), Hiroyuki Takizawa (Tohoku University, Japan) and Hiroaki Kobayashi (Tohoku University, Japan)
Copyright: © 2011 |Pages: 20
DOI: 10.4018/978-1-60960-603-9.ch009
OnDemand PDF Download:
$30.00
List Price: $37.50

Abstract

On the volunteer computing platforms, inter-task dependency leads to serious performance degradation for failed task re-execution because of volatile peers. This paper discusses a performance-oriented task dispatch policy based on the failure probability estimation. The tasks with the highest failure probabilities are selected for dispatch when multiple task enquiries come to the dispatcher. The estimated failure probability is used to find the optimized task assignment that minimizes the overall failure probability of these tasks. This performance-oriented task dispatch policy is evaluated with two real world trace data sets on a simulator. Evaluation results demonstrate the effectiveness of this policy.
Chapter Preview
Top

Instruction

Volunteer computing (Anderson, 2004) uses Internet-connected individual computers to solve computing problems. The pioneering research projects, including GIMPS (The Great Internet Mersenne Prime Search, http://www.top500.org).

Despite the massive computing power offered by the existing volunteer computing platforms, they are lacking support for inter-task dependency. Our previous work solved this issue with a workflow management mechanism (Wang, 2007). However, inter-task dependency results in a status that none of the un-dispatched tasks can be dispatched, because these un-dispatched tasks require the results of one or several of the tasks that are being executed. This status may lead to serious performance degradation, because of the frequent task failures of volatile peers in volunteer computing platforms. Therefore, a redundant task dispatch policy (Wang, 2007) has been proposed to mitigate the performance degradation. Although the redundant task dispatch policy shown a significant performance improvement compared to the non-redundant one, it has a major limitation: the average failure rate model is not the best fit for the volunteer peers in the real world. Thus, this paper extends the policy so as to address the limitation.

Complete Chapter List

Search this Book:
Reset