System Level Benchmarking of Public Clouds

System Level Benchmarking of Public Clouds

Sanjay P. Ahuja
Copyright: © 2022 |Pages: 17
DOI: 10.4018/IJCAC.309933
Article PDF Download
Open access articles are freely available for download

Abstract

It is important for cloud users to be able to evaluate and compare different cloud services to achieve high performance and maximize cost savings. To that end, this research benchmarked Amazon web services elastic compute cloud and Rackspace cloud infrastructure and compared the results for the two public cloud providers. The intent of the study was to determine how these selected providers perform with regards to system parameter usage and hence three system-level benchmarks: STREAM, IOR, and NPB-EP were run on different configurations to provide an insight to the cloud users in selection of provider on VM clusters of 1,2,4,6, and 8 nodes. The clusters were created with similar virtual machines from both providers. The benchmarks examined bandwidth, I/O and CPU performance. A comparison of results for the two providers is presented graphically and T-test applied to determine if differences are significant. Observations were taken at multiple times at different time periods on weekdays and weekends to examine variance of cloud performance.
Article Preview
Top

2. Cloud Computing Platform

AWS and Rackspace are among the leading public cloud infrastructure service providers and. offer competitive pricing. They each have their strengths which need to be looked at carefully to determine which one fits customer needs the best.

2.1. Amazon Web Services

Founded in 2006, Amazon’s AWS has about the same computing capacity as the next 12 vendors combined. So, nobody, not even fellow corporate titans Google and Microsoft, can really compete with Amazon on capacity. Not many can also compete on the breadth of offerings of AWS – storage, compute, databases, networking, configuration management, content delivery and many more.

Amazon also owns the largest data centers in the world. AWS data centers are in 9 regions around the world: 3 in the US and the other 6 scattered strategically around the world. In 2013 Amazon also won a contract to create GovCloud, a private cloud expressly for the U.S. government. Clearly, Amazon is the leader when it comes to cloud service providers. Amazon Web Services (AWS) is a subsidiary of Amazon. AWS proper rolled out in 2006 and has grown at astonishing speed to quickly become the market leader in IaaS / PaaS. The EC2 service is a major part of this success story, allowing users to quickly choose from a range of virtual servers. AWS also offers the following services as part of AWS:

  • Storage (with the S3 & Glacier products).

  • Databases (RDS, RedShift, SimpleDB, DynamoDB).

  • Networking (Route 53, VPC).

  • Deployment & Configuration Management (OpsWorks, Elastic Beanstalk, CloudFormation).

  • Content Delivery (CloudFront).

  • Load balancing.

  • Application development platforms.

With their wide array of services, direct comparisons between the two cloud providers can be difficult. So, we focus on two most important components – compute and storage. They seem to be closely matched in terms of pricing – knowing how competitive the IaaS market is, this is not a coincidence. Overall, AWS is cheaper, though this comes with some caveats as discussed later. And Amazon is also fond of regular price reductions – the business model for AWS seems to be thin-margin, high-volume.

AWS also has a variety of storage options including Simple Storage Service (S3), Elastic Block Storage (EBS), and RedShift the data warehousing platform. In the AWS marketplace users can spin up hundreds of types of services, like enterprise applications from SAP, or performance optimization tools from Riverbed and others.

AWS is much more flexible than others. In EC2 you can mix and match components from the server stack and pay for each independently and AWS offers a ‘Free Usage Tier’ for new customers; you get a small ‘starter’ server, but you must still first provide your credit card details.

Complete Article List

Search this Journal:
Reset
Volume 14: 1 Issue (2024)
Volume 13: 1 Issue (2023)
Volume 12: 4 Issues (2022): 2 Released, 2 Forthcoming
Volume 11: 4 Issues (2021)
Volume 10: 4 Issues (2020)
Volume 9: 4 Issues (2019)
Volume 8: 4 Issues (2018)
Volume 7: 4 Issues (2017)
Volume 6: 4 Issues (2016)
Volume 5: 4 Issues (2015)
Volume 4: 4 Issues (2014)
Volume 3: 4 Issues (2013)
Volume 2: 4 Issues (2012)
Volume 1: 4 Issues (2011)
View Complete Journal Contents Listing