Resource Management and Scheduling for Big Data Applications in Cloud Computing Environments

Resource Management and Scheduling for Big Data Applications in Cloud Computing Environments

Muhammed Tawfiqul Islam (The University of Melbourne, Australia) and Rajkumar Buyya (The University of Melbourne, Australia)
DOI: 10.4018/978-1-5225-8407-0.ch001

Abstract

This chapter presents software architectures of the big data processing platforms. It also provides in-depth knowledge on resource management techniques involved while deploying big data processing systems in the cloud environment. It starts from the very basics and gradually introduce the core components of resource management which are divided into multiple layers. It covers the state-of-art practices and researches done in SLA-based resource management with a specific focus on the job scheduling mechanisms.
Chapter Preview
Top

Background

In this section, we briefly discuss the key features of cloud computing. Moreover, we explain the architectures of the popular open-source software systems for processing big data applications. Also, we provide an overview of some popular cluster managers. Finally, we conclude with explaining why the cloud is a viable alternative to deploy a big data processing software and how cluster managers can be used for efficient management of the system.

Complete Chapter List

Search this Book:
Reset