Saturday, February 27, 2010

Cloud Storage Showdown Part 2 - What is the best storage for your cloud server?

In the previous post we discussed cloud storage for consumers. Probably a more common use case for cloud storage is to enable backups and/or extended storage from cloud servers and platforms. Over the past month, we have used our network of 25 global servers running in various public clouds to measure bandwidth throughput and latency to and from various cloud storage services including Microsoft's Azure Blob Storage, Amazon's Simple Storage Service (S3), SoftLayer's CloudLayer Storage, Nirvanix Storage Delivery Network, Rackspace Cloud Files, and Box.net. We conducted these bandwidth tests by reading and writing a 3MB test file (10MB for storage services in the same cloud such as EC2 to S3) to/from each storage services at random times twice daily. The results are separated by cloud server provider. The table displays all of the storage services tested within that cloud ordered by fastest downlink. We also tested storage in Microsoft's Azure platform.

The purpose of this test wasn't to measure the maximum throughput capacity between server and storage service, but rather to provide a comparison between different storage services. The 3MB test file is not sufficiently large for maximum capacity to be determined (for same cloud storage services the throughput will be more accurate because of the larger 10MB file size). Actual throughput for larger files will most likely be higher than the throughput calculations displayed here.

Bandwidth and storage pricing are other factors to consider when selecting a storage service. For example, Amazon does not charge for bandwidth to/from its S3 storage service and EC2 instances running in the same region. However, there are good reasons to use an external storage service for backups. If, for example, you use EC2 and store your backups using S3 in the same region, and that region happens to go down entirely for an extended period (an unlikely scenario of course), you will be without any means of recovering your data until the region is brought back online. For added fault tolerance, you may decide to keep backups in a separate Amazon S3 region (and pay the bandwidth costs) or even in a separate cloud like Microsoft's Azure.

Tests were performed using a small Azure instance.

South Central US (TX)
North Central US (IL)
Southeast Asia (Singapore)

Tests were performed using an m1.small instance in all regions.

US East Region
EU West Region
US West Region

All instances are Linode 360s

Newark, NJ
Atlanta, GA
Dallas, TX
Rackspace Cloud Files is run out of Dallas as well. Linode also provides GigE uplinks with all servers. This explains the very high downlink throughput result
London, UK
Fremont, CA

Our VoxCloud servers are the smallest 2GB model

New York
Singapore
Most likely Microsoft Azure and Voxel run out of data centers in very close proximity
Amsterdam, NL

GoGrid (CA, US)
We run a 512MB instance with GoGrid. Box.net tends to perform very well against US west coast servers.

Our rackspace node is also run on a 512MB instance. Throughput to and from Rackspace's own Cloud Files storage service was very good.



ReliaCloud (MN, US)



Dallas, TX
Auckland, NZ

5 comments:

  1. Great information, at Nasuni we've been looking at some of this information ourselves. You can see some of that on our blog:

    https://www.nasuni.com/news/nasuni-blog/testing-the-clouds-part-ii-performance/

    ReplyDelete
  2. You might want to check out www.drivehq.com, which offers far more than just cloud storage. It is offering Cloud IT Solution where you can move all your file server, email server, ftp server, web server and offsite backup system to the cloud. small businesses can save a lot of cost and get better services / features.

    ReplyDelete
  3. I really like reading this post and I am very happy that you posted it on this blog...

    ReplyDelete
  4. Thanks for publishing this article. You helped me to open up my eyes. Thanks for publishing and I'm looking forward to your new posts.

    ReplyDelete
  5. Interesting, no where on here is SugarSync mentioned. It seems like it must be the redheaded stepchild of Cloud storage. It is the only cloud storage that i have found that allows whole folders to be uploaded instead of only individual files, yet no blogs mention it except the one run by the company. I think it is definitely worth checking out. I did a quick review of it, if you are interested. Thanks,

    ben
    http://tiggity.blogspot.com/

    ReplyDelete