- blogbench
- timed build (apache, imagemagick, mysql, php)
- c-ray
- cachebench
- compress (7zip, gzip, lzma, pbzip2)
- dbench
- dcraw
- encode (ape, flac, mp3, ogg, wavpack)
- espeak
- ffmpeg
- fhourstones
- GeekBench
- gmpbench
- gnupg
- hdparm
- hmmer
- iozone
- john-the-ripper
- mafft
- memcache
- mencoder
- minion
- mysql-bench
- nero2d
- npb
- openssl
- opstone
- pgbench
- PHPBench
- postmark
- povray
- PyBench
- ramspeed
- ruby-benchmark-suite
- SPECjvm2008
- sqlite
- stream
- sudokut
- super-pi
- tiobench
- UnixBench
Tuesday, March 2, 2010
Cloud Server Performance Benchmarking
We are in the process of developing a benchmark suite to run in the cloud and use as a basis for comparing different IaaS (cloud server) vendors. There are lots of uses for cloud servers be it web, application or database servers; scientific computing; video encoding; etc. In establishing our benchmark suite we'd like to be as comprehensive as possible in order to provide decent coverage of most computational needs. Our current list of benchmarks includes the following:
Subscribe to:
Post Comments (Atom)
+ redis
ReplyDeleteI would add bonnie++ which is excellent for disk checks.
ReplyDeleteOne that is a bit harder to measure but would be very useful is deployment time. Basically a measure of how long it takes to add or remove servers/roles on average. For providers that have an API this could be measured in an automated fashion, but if it is a manual process that is also good information to know about (limits elasticity of the cloud and ability to auto-scale).
ReplyDeleteThanks for the feedback. We had added bonnie++ and tpcc-mysql to the performance benchmarks. Deployment latency is also on our list of benchmarks. http://www.cloudstatus.com currently provides deployment latency for EC2
ReplyDeleteWe'll also add redis-benchmark
ReplyDelete