Your SlideShare is downloading. ×
Openstack AWS Cassandra - Cassandra Boston Users Group
Openstack AWS Cassandra - Cassandra Boston Users Group
Openstack AWS Cassandra - Cassandra Boston Users Group
Openstack AWS Cassandra - Cassandra Boston Users Group
Openstack AWS Cassandra - Cassandra Boston Users Group
Openstack AWS Cassandra - Cassandra Boston Users Group
Openstack AWS Cassandra - Cassandra Boston Users Group
Openstack AWS Cassandra - Cassandra Boston Users Group
Openstack AWS Cassandra - Cassandra Boston Users Group
Openstack AWS Cassandra - Cassandra Boston Users Group
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Openstack AWS Cassandra - Cassandra Boston Users Group

989

Published on

Presentation given on 9/19/2012 to the Cassandra Boston Users Group

Presentation given on 9/19/2012 to the Cassandra Boston Users Group

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
989
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
16
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. m Cassandra on Openstack and AWSpresenting to Thomas Vachon • September 2012Boston CassandraUsers Group
  • 2. Agenda• Current Openstack Implementation• Running Cassandra on Openstack• Lessons Learned about Cassandra on AWS• Connecting Openstack and AWS• Connecting Cassandra on Openstack and AWS• Questions• Show & Tell 1
  • 3. INTRODUCTIONCurrent Cassandra Implementation (AWS)• 9 Cassandra Nodes (3 per AZ) • Cassandra 1.0.10 • AWS m1.xlarge – 4 Drive RAID-0 Array • EC2Snitch • RF = 3 • Network Topology Aware• Statistics • Peak Traffic: 724 r/s with 1308 wr/s across the cluster • 3.5ms read latency avg • 1.7ms write latency avg 2
  • 4. Running Cassandra on Openstack• Ec2Snitch doesn’t work (looks to the wrong endpoint)• Its hard to guarantee you keep your instances on separate machines with a single zone• Contention/Steal is more easily achieved due to KVM and the lack of CPU throttling• As always, the faster the hardware, the better the performance• Perf Test - 5 Cassandra Nodes with RF=3 (cassandra-stress) • Read/s: 1,562 w/s • Writes/s: 3,846 r/s • Avg latency per op: 7.2ms • Seems to hurt the testing server more than the Cassandra Cluster 3
  • 5. Lessons Learned with Cassandra and AWS• Be proactive in adjusting your caches • Row cache is a great thing (keep it out of heap) • Key cache hit rates dictate if you should burn memory on them or not • KNOW your Data and Access Patterns• A slow node is worse than a dead node• CPU Steal is your mortal enemy 4
  • 6. Connecting Openstack and AWS• Two Options • Public Internet Replication (SSL Highly recommended) • HUGE transfer costs, risky • VPC Tunnel • Static Tunnel with ASA – ASA’s can only connect to one tunnel at a time even in an HA pair • BGP Tunnel with Routing – Each router connects to two endpoints, HSRP between, extremely redundant• Openstack Complexity – VLAN Tagging • If using VLAN tagging in Openstack, your tunnel device needs to participate in the VLAN which is used for VM’s (300 by default) 5
  • 7. Connecting Cassandra• Since EC2Snitch doesn’t work in OS, RackInferringSnitch must be used• Standard Multi-datacenter tokenization strategies are required• Replication lag is dependant on connectivity and latency• Tests from VPC IPSec tunnels in NJ show 8ms to Ashburn• Tests from Ashburn DC datacenters are about 4ms• The biggest problem is the volume of data and a hard cutover • We started in EC2, but are migrating to VPC 6
  • 8. m Questions/Suggestions? 7
  • 9. m P.S. - We are HIRING! 8
  • 10. m Show & Tell Come see our Openstack cluster 9

×