Data Intensive Computing with Clustered Chirp ServersDouglas Thain (University of Notre Dame, USA), Michael Albrecht (University of Notre Dame, USA), Hoang Bui (University of Notre Dame, USA), Peter Bui (University of Notre Dame, USA), Rory Carmichael (University of Notre Dame, USA), Scott Emrich (University of Notre Dame, USA) and Patrick Flynn (University of Notre Dame, USA)
Copyright © 2012. 15 pages.
OnDemand Chapter PDF Download
Download link provided immediately after order completion
| $37.50 | |
Available.
Instant access upon order completion.
DOI: 10.4018/978-1-61520-971-2.ch006 Sample PDFCite
MLA
Thain, Douglas, Michael Albrecht, Hoang Bui, Peter Bui, Rory Carmichael, Scott Emrich and Patrick Flynn. "Data Intensive Computing with Clustered Chirp Servers." Data Intensive Distributed Computing: Challenges and Solutions for Large-scale Information Management. IGI Global, 2012. 140-154. Web. 18 May. 2013. doi:10.4018/978-1-61520-971-2.ch006
APA
Thain, D., Albrecht, M., Bui, H., Bui, P., Carmichael, R., Emrich, S., & Flynn, P. (2012). Data Intensive Computing with Clustered Chirp Servers. In T. Kosar (Ed.), Data Intensive Distributed Computing: Challenges and Solutions for Large-scale Information Management (pp. 140-154). Hershey, PA: Information Science Reference. doi:10.4018/978-1-61520-971-2.ch006
Chicago
Thain, Douglas, Michael Albrecht, Hoang Bui, Peter Bui, Rory Carmichael, Scott Emrich and Patrick Flynn. "Data Intensive Computing with Clustered Chirp Servers." In Data Intensive Distributed Computing: Challenges and Solutions for Large-scale Information Management, ed. Tevfik Kosar, 140-154 (2012), accessed May 18, 2013. doi:10.4018/978-1-61520-971-2.ch006
Export Reference
  | | TopAbstractOver the last few decades, computing performance, memory capacity, and disk storage have all increased by many orders of magnitude. However, I/O performance has not increased at nearly the same pace: a disk arm movement is still measured in milliseconds, and disk I/O throughput is still measured in megabytes per second. If one wishes to build computer systems that can store and process petabytes of data, they must have large numbers of disks and the corresponding I/O paths and memory capacity to support the desired data rate. A cost efficient way to accomplish this is by clustering large numbers of commodity machines together. This chapter presents Chirp as a building block for clustered data intensive scientific computing. Chirp was originally designed as a lightweight file server for grid computing and was used as a “personal” file server. The authors explore building systems with very high I/O capacity using commodity storage devices by tying together multiple Chirp servers. Several real-life applications such as the GRAND Data Analysis Grid, the Biometrics Research Grid, and the Biocompute Facility use Chirp as their fundamental building block, but provide different services and interfaces appropriate to their target communities. TopComplete Chapter List
Search this Book:
Reset | 1. |
Esma Yildirim (State University of New York at Buffalo (SUNY), USA), Mehmet Balman (Lawrence Berkeley National Laboratory, USA), Tevfik Kosar (State University of New York at Buffalo (SUNY), USA)
With the continuous increase in the data requirements of scientific and commercial applications, access to remote and distributed data has become a major bottleneck...
Sample PDF |
More details... | $37.50 |
| 2. |
Ioan Raicu (Illinois Institute of Technology, USA & Argonne National Laboratory, USA), Ian Foster (University of Chicago, USA & Argonne National Laboratory, USA), Yong Zhao (University of Electronic Science and Technology of China, China), Alex Szalay (Johns Hopkins University, USA), Philip Little (University of Notre Dame, USA), Christopher M. Moretti (University of Notre Dame, USA), Amitabh Chaudhary (University of Notre Dame, USA), Douglas Thain (University of Notre Dame, USA)
Many-task computing aims to bridge the gap between two computing paradigms, high throughput computing and high performance computing. Traditional techniques to suppo...
Sample PDF |
More details... | $37.50 |
| 3. |
Arcot Rajasekar (University of North Carolina at Chapel Hill, USA), Mike Wan (University of California at San Diego, USA), Reagan Moore (University of North Carolina at Chapel Hill, USA), Wayne Schroeder (University of California at San Diego, USA)
Service-oriented architectures (SOA) enable orchestration of loosely-coupled and interoperable functional software units to develop and execute complex but agile app...
Sample PDF |
More details... | $37.50 |
| 4. |
Sudharshan S. Vazhkudai (Oak Ridge National Laboratory, USA), Ali R. Butt (Virginia Polytechnic Institute and State University, USA), Xiaosong Ma (North Carolina State University, USA)
In this chapter, the authors present an overview of the utility of distributed storage systems in supporting modern applications that are increasingly becoming data...
Sample PDF |
More details... | $37.50 |
| 5. |
Ismail Akturk (Bilkent University, Turkey), Xinqi Wang (Louisiana State University, USA), Tevfik Kosar (State University of New York at Buffalo (SUNY), USA)
The unbounded increase in the size of data generated by scientific applications necessitates collaboration and sharing among the nation’s education and research inst...
Sample PDF |
More details... | $37.50 |
| 6. |
Douglas Thain (University of Notre Dame, USA), Michael Albrecht (University of Notre Dame, USA), Hoang Bui (University of Notre Dame, USA), Peter Bui (University of Notre Dame, USA), Rory Carmichael (University of Notre Dame, USA), Scott Emrich (University of Notre Dame, USA), Patrick Flynn (University of Notre Dame, USA)
Over the last few decades, computing performance, memory capacity, and disk storage have all increased by many orders of magnitude. However, I/O performance has not...
Sample PDF |
More details... | $37.50 |
| 7. |
Suraj Pandey (The Commonwealth Scientific and Industrial Research Organisation (CSIRO), Australia), Rajkumar Buyya (The University of Melbourne, Australia)
This chapter presents a comprehensive survey of algorithms, techniques, and frameworks used for scheduling and management of data-intensive application workflows. Ma...
Sample PDF |
More details... | $37.50 |
| 8. |
Ewa Deelman (University of Southern California, USA), Ann Chervenak (University of Southern California, USA)
Scientific applications such as those in astronomy, earthquake science, gravitational-wave physics, and others have embraced workflow technologies to do large-scale...
Sample PDF |
More details... | $37.50 |
| 9. |
Ann Chervenak (University of Southern California, USA), Robert Schuler (University of Southern California, USA)
Management of the large data sets produced by data-intensive scientific applications is complicated by the fact that participating institutions are often geographica...
Sample PDF |
More details... | $37.50 |
| 10. |
Judy Qiu (Indiana University - Bloomington, USA), Jaliya Ekanayake (Indiana University - Bloomington, USA), Thilina Gunarathne (Indiana University - Bloomington, USA), Jong Youl Choi (Indiana University - Bloomington, USA), Seung-Hee Bae (Indiana University - Bloomington, USA), Yang Ruan (Indiana University - Bloomington, USA), Saliya Ekanayake (Indiana University - Bloomington, USA), Stephen Wu (Indiana University - Bloomington, USA), Scott Beason (Computer Sciences Corporation, USA), Geoffrey Fox (Indiana University - Bloomington, USA), Mina Rho (Indiana University - Bloomington, USA), Haixu Tang (Indiana University - Bloomington, USA)
Data intensive computing, cloud computing, and multicore computing are converging as frontiers to address massive data problems with hybrid programming models and/or...
Sample PDF |
More details... | $37.50 |
| 11. |
Jason Leigh (University of Illinois at Chicago, USA), Andrew Johnson (University of Illinois at Chicago, USA), Luc Renambot (University of Illinois at Chicago, USA), Venkatram Vishwanath (University of Illinois at Chicago, USA & Argonne National Laboratory, USA), Tom Peterka (Argonne National Laboratory, USA), Nicholas Schwarz (Northwestern University, USA)
An effective visualization is best achieved through the creation of a proper representation of data and the interactive manipulation and querying of the visualizatio...
Sample PDF |
More details... | $37.50 |
| 12. |
Huadong Liu (University of Tennessee, USA), Jinzhu Gao (University of The Pacific, USA), Jian Huang (University of Tennessee, USA), Micah Beck (University of Tennessee, USA), Terry Moore (University of Tennessee, USA)
The emergence of high-resolution simulation, where simulation outputs have grown to terascale levels and beyond, raises major new challenges for the visualization co...
Sample PDF |
More details... | $37.50 |
|
| |