Acunu Cassandra London Meetup
Upcoming SlideShare
Loading in...5
×
 

Acunu Cassandra London Meetup

on

  • 2,399 views

Richard Low of Acunu presented some performance results demonstrating how marvelous Acunu's distribution of Cassandra is compared to the vanilla version. There's a related blog post with updated ...

Richard Low of Acunu presented some performance results demonstrating how marvelous Acunu's distribution of Cassandra is compared to the vanilla version. There's a related blog post with updated range query results here: http://www.acunu.com/2011/03/cassandra-under-heavy-write-load-part-ii/

Statistics

Views

Total Views
2,399
Views on SlideShare
1,722
Embed Views
677

Actions

Likes
0
Downloads
21
Comments
0

5 Embeds 677

http://www.acunu.com 657
http://www.weebly.com 12
http://webcache.googleusercontent.com 6
http://embeds.coolsport.tv 1
http://www.docshut.com 1

Accessibility

Categories

Upload Details

Uploaded via as Apple Keynote

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • Introduce me\n
  • \n
  • \n
  • Old\nOracle, MySQL, etc; on top of legacy FS, volume mgr, RAID, hardware\nNew\nNoSQL (to get horizontal scalability)\nHardware evolving fast - but not evenly\nStuff in the middle hasn’t changed much\n\n\n
  • Old\nOracle, MySQL, etc; on top of legacy FS, volume mgr, RAID, hardware\nNew\nNoSQL (to get horizontal scalability)\nHardware evolving fast - but not evenly\nStuff in the middle hasn’t changed much\n\n\n
  • Old\nOracle, MySQL, etc; on top of legacy FS, volume mgr, RAID, hardware\nNew\nNoSQL (to get horizontal scalability)\nHardware evolving fast - but not evenly\nStuff in the middle hasn’t changed much\n\n\n
  • Old\nOracle, MySQL, etc; on top of legacy FS, volume mgr, RAID, hardware\nNew\nNoSQL (to get horizontal scalability)\nHardware evolving fast - but not evenly\nStuff in the middle hasn’t changed much\n\n\n
  • Old\nOracle, MySQL, etc; on top of legacy FS, volume mgr, RAID, hardware\nNew\nNoSQL (to get horizontal scalability)\nHardware evolving fast - but not evenly\nStuff in the middle hasn’t changed much\n\n\n
  • Old\nOracle, MySQL, etc; on top of legacy FS, volume mgr, RAID, hardware\nNew\nNoSQL (to get horizontal scalability)\nHardware evolving fast - but not evenly\nStuff in the middle hasn’t changed much\n\n\n
  • Old\nOracle, MySQL, etc; on top of legacy FS, volume mgr, RAID, hardware\nNew\nNoSQL (to get horizontal scalability)\nHardware evolving fast - but not evenly\nStuff in the middle hasn’t changed much\n\n\n
  • Old\nOracle, MySQL, etc; on top of legacy FS, volume mgr, RAID, hardware\nNew\nNoSQL (to get horizontal scalability)\nHardware evolving fast - but not evenly\nStuff in the middle hasn’t changed much\n\n\n
  • Old\nOracle, MySQL, etc; on top of legacy FS, volume mgr, RAID, hardware\nNew\nNoSQL (to get horizontal scalability)\nHardware evolving fast - but not evenly\nStuff in the middle hasn’t changed much\n\n\n
  • Old\nOracle, MySQL, etc; on top of legacy FS, volume mgr, RAID, hardware\nNew\nNoSQL (to get horizontal scalability)\nHardware evolving fast - but not evenly\nStuff in the middle hasn’t changed much\n\n\n
  • * performance is not just about speed, but also reliability + predictability ... \n* note the specific version tree, showing live / dev branches\n* monitoring goes from the cluster down to iostat\n* ... and includes management: easy cluster deployment\n* talk about performance here\n
  • * performance is not just about speed, but also reliability + predictability ... \n* note the specific version tree, showing live / dev branches\n* monitoring goes from the cluster down to iostat\n* ... and includes management: easy cluster deployment\n* talk about performance here\n
  • * performance is not just about speed, but also reliability + predictability ... \n* note the specific version tree, showing live / dev branches\n* monitoring goes from the cluster down to iostat\n* ... and includes management: easy cluster deployment\n* talk about performance here\n
  • * performance is not just about speed, but also reliability + predictability ... \n* note the specific version tree, showing live / dev branches\n* monitoring goes from the cluster down to iostat\n* ... and includes management: easy cluster deployment\n* talk about performance here\n
  • * performance is not just about speed, but also reliability + predictability ... \n* note the specific version tree, showing live / dev branches\n* monitoring goes from the cluster down to iostat\n* ... and includes management: easy cluster deployment\n* talk about performance here\n
  • * performance is not just about speed, but also reliability + predictability ... \n* note the specific version tree, showing live / dev branches\n* monitoring goes from the cluster down to iostat\n* ... and includes management: easy cluster deployment\n* talk about performance here\n
  • * performance is not just about speed, but also reliability + predictability ... \n* note the specific version tree, showing live / dev branches\n* monitoring goes from the cluster down to iostat\n* ... and includes management: easy cluster deployment\n* talk about performance here\n
  • * performance is not just about speed, but also reliability + predictability ... \n* note the specific version tree, showing live / dev branches\n* monitoring goes from the cluster down to iostat\n* ... and includes management: easy cluster deployment\n* talk about performance here\n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • e.g. facebook newsfeed, twitter stream\n
  • \n
  • \n
  • \n

Acunu Cassandra London Meetup Acunu Cassandra London Meetup Presentation Transcript

  • Cassandra performance testing Richard Low Software Engineer richard@acunu.comCassandra London Meetup, 21 Mar 2011
  • MenuBig DataCassandra testingQ &A
  • Big Data?Scale, Performance, Low Cost: Need all 3 :-|
  • RDBMS ext3,... LVM RAIDhardware
  • RDBMS ext3,... LVM RAIDhardware
  • Big Data ext3,... LVM RAIDhardware
  • Big Data ext3,... LVM RAIDnew HW!
  • Big Datanew HW!
  • Cassandra (vanilla) Cassandra (Acunu)
  • Cassandra (vanilla) Cassandra (Acunu) + performance
  • Cassandra (vanilla) Cassandra (Acunu) + performance + snapshots + clones
  • Cassandra (vanilla) Cassandra (Acunu) + performance + snapshots + clones + monitoring
  • Performance testing
  • Inserts• Single box, 24 GB RAM, 7 disks• 3 billion rows• 50 byte values• 8 byte keys• 1 column per row• Batch insert 100 at once
  • Random Inserts - Vanilla Cassandra
  • Insert summary Vanilla Cassandra Acunu Cassandra Insert time / hrs 26 18 Max 95thpercentile latency / 37 0.3 s
  • If you only care about writeperformance, /dev/null is great (and web-scale)
  • Range queries• High insert rate no use if reads are slow• High insert rate can impact range query performance• Test: insert 100 million rows, with same properties as before• After inserts, immediately perform small range queries (get_range_slices with random start key)
  • Summary...• Strong foundations for Big Data with order of magnitude performance improvement• v1: Back Cassandra (+others) and tools without modification• Fast, robust, simple platform• Makes test/dev cycle more effective
  • Thanks :)www.acunu.com/blog
  • Thanks :)www.acunu.com/blog