Welcome to the InfoSci Platform
Stochastic Approximation-Based Transport Profiling for Big Data Movement Over Dedicated Connections

Stochastic Approximation-Based Transport Profiling for Big Data Movement Over Dedicated Connections

Daqing Yun, Chase Q. Wu
Copyright: © 2018 |Pages: 26
ISBN13: 9781522550457|ISBN10: 1522550453|EISBN13: 9781522550464
DOI: 10.4018/978-1-5225-5045-7.ch005
Cite Chapter Cite Chapter

MLA

Yun, Daqing, and Chase Q. Wu. "Stochastic Approximation-Based Transport Profiling for Big Data Movement Over Dedicated Connections." Stochastic Methods for Estimation and Problem Solving in Engineering, edited by Seifedine Kadry, IGI Global, 2018, pp. 113-138. https://doi.org/10.4018/978-1-5225-5045-7.ch005

APA

Yun, D. & Wu, C. Q. (2018). Stochastic Approximation-Based Transport Profiling for Big Data Movement Over Dedicated Connections. In S. Kadry (Ed.), Stochastic Methods for Estimation and Problem Solving in Engineering (pp. 113-138). IGI Global. https://doi.org/10.4018/978-1-5225-5045-7.ch005

Chicago

Yun, Daqing, and Chase Q. Wu. "Stochastic Approximation-Based Transport Profiling for Big Data Movement Over Dedicated Connections." In Stochastic Methods for Estimation and Problem Solving in Engineering, edited by Seifedine Kadry, 113-138. Hershey, PA: IGI Global, 2018. https://doi.org/10.4018/978-1-5225-5045-7.ch005

Export Reference

Mendeley
Favorite

Abstract

High-performance networks featuring advance bandwidth reservation have been developed and deployed to support big data transfer in extreme-scale scientific applications. The performance of such big data transfer largely depends on the transport protocols being used. For a given protocol in a given network environment, different parameter settings may lead to different performance, and oftentimes the default settings do not yield the best performance. It is, however, impractical to conduct an exhaustive search in the large parameter space of transport protocols for a set of suitable parameter values. This chapter proposes a stochastic approximation-based transport profiler, namely FastProf, to quickly determine the optimal operational zone of a protocol over dedicated connections. The proposed method is evaluated using both emulations based on real-life measurements and experiments over physical connections. The results show that FastProf significantly reduces the profiling overhead while achieving a comparable level of transport performance with the exhaustive search-based approach.

Request Access

You do not own this content. Please login to recommend this title to your institution's librarian or purchase it from the IGI Global bookstore.