![Cassandra & Puppet:,[object Object],Scaling data at $15/month,[object Object],Constant Contact,[object Object],March 2011,[object Object],Dave Connors – VP Operations,[object Object],Jim Ancona – Systems Architect,[object Object],Mark Schena – Manager Systems Automation,[object Object]](https://image.slidesharecdn.com/cassandrapuppetscalingdataat15permonthslideshare-110405095846-phpapp02/75/cassandra-puppet-scaling-data-at-15-per-month-1-2048.jpg?cb=1667312831)
![Constant Contact,[object Object],Constant Contact,[object Object],2000 – 2010 ,[object Object],Market leader for Small Businesses,[object Object],[object Object]](https://image.slidesharecdn.com/cassandrapuppetscalingdataat15permonthslideshare-110405095846-phpapp02/75/cassandra-puppet-scaling-data-at-15-per-month-2-2048.jpg?cb=1667312831)
![No. 134 on the Deloitte Technology Fast 500 listingBusiness model,[object Object],[object Object]](https://image.slidesharecdn.com/cassandrapuppetscalingdataat15permonthslideshare-110405095846-phpapp02/75/cassandra-puppet-scaling-data-at-15-per-month-4-2048.jpg?cb=1667312831)
![~2 million database transactions per minute,[object Object]](https://image.slidesharecdn.com/cassandrapuppetscalingdataat15permonthslideshare-110405095846-phpapp02/75/cassandra-puppet-scaling-data-at-15-per-month-5-2048.jpg?cb=1667312831)
![Constant Contact ,[object Object],Small Businesses are looking to us for help with Social Media marketing,[object Object],[object Object]](https://image.slidesharecdn.com/cassandrapuppetscalingdataat15permonthslideshare-110405095846-phpapp02/75/cassandra-puppet-scaling-data-at-15-per-month-6-2048.jpg?cb=1667312831)
![Challenge with our business model,[object Object]](https://image.slidesharecdn.com/cassandrapuppetscalingdataat15permonthslideshare-110405095846-phpapp02/75/cassandra-puppet-scaling-data-at-15-per-month-7-2048.jpg?cb=1667312831)
![Time to market = ?,[object Object]](https://image.slidesharecdn.com/cassandrapuppetscalingdataat15permonthslideshare-110405095846-phpapp02/75/cassandra-puppet-scaling-data-at-15-per-month-9-2048.jpg?cb=1667312831)
![Roles & Responsibilities,[object Object]](https://image.slidesharecdn.com/cassandrapuppetscalingdataat15permonthslideshare-110405095846-phpapp02/75/cassandra-puppet-scaling-data-at-15-per-month-14-2048.jpg?cb=1667312831)
![Apache Cassandra,[object Object],Apache Cassandra,[object Object],[object Object]](https://image.slidesharecdn.com/cassandrapuppetscalingdataat15permonthslideshare-110405095846-phpapp02/75/cassandra-puppet-scaling-data-at-15-per-month-15-2048.jpg?cb=1667312831)
![Largest production cluster has over 100 TB of data in over 150 machines,[object Object]](https://image.slidesharecdn.com/cassandrapuppetscalingdataat15permonthslideshare-110405095846-phpapp02/75/cassandra-puppet-scaling-data-at-15-per-month-21-2048.jpg?cb=1667312831)
![Consistency options,[object Object]](https://image.slidesharecdn.com/cassandrapuppetscalingdataat15permonthslideshare-110405095846-phpapp02/75/cassandra-puppet-scaling-data-at-15-per-month-27-2048.jpg?cb=1667312831)
![Consistency LevelONE,[object Object],Consistency Level One,[object Object],Y,[object Object]](https://image.slidesharecdn.com/cassandrapuppetscalingdataat15permonthslideshare-110405095846-phpapp02/75/cassandra-puppet-scaling-data-at-15-per-month-28-2048.jpg?cb=1667312831)
![Consistency Level Quorum,[object Object],X,[object Object]](https://image.slidesharecdn.com/cassandrapuppetscalingdataat15permonthslideshare-110405095846-phpapp02/75/cassandra-puppet-scaling-data-at-15-per-month-29-2048.jpg?cb=1667312831)
![Risks and Mitigation,[object Object],Risks and Mitigation,[object Object],[object Object]](https://image.slidesharecdn.com/cassandrapuppetscalingdataat15permonthslideshare-110405095846-phpapp02/75/cassandra-puppet-scaling-data-at-15-per-month-30-2048.jpg?cb=1667312831)
Cassandra & puppet, scaling data at $15 per month
•9 likes•37,262 views
Download to read offline
Report
Constant Contact shares lessons learned from DevOps approach to implementing Cassandra to manage social media data for over 400k small business customers. Puppet is the critical in our tool chain. Single most important factor was the willingness of Development and Operations to stretch beyond traditional roles and responsibilities.
Recommended
More Related Content
What's hot
What's hot(20)
Viewers also liked
Viewers also liked(20)
Similar to Cassandra & puppet, scaling data at $15 per month
Similar to Cassandra & puppet, scaling data at $15 per month(20)
Recently uploaded
Recently uploaded(20)
Cassandra & puppet, scaling data at $15 per month
- 3. Over 400k paying customers
- 8. Cost = Low
- 10. Monitoring
- 11. Authentication
- 12. Logging
- 13. Risk profile
- 16. Open sourced in 2008
- 18. Became an Apache top-level project in 2010
- 20. In use at Digg, Facebook, Twitter, Reddit, Rackspace, Cloudkick, Cisco, …
- 22. Fault Tolerant
- 23. Elastic
- 24. Durable
- 25. Rich data model
- 26. Replicated data
- 41. Paid support and training is available: http://datastax.com
- 43. Mirroring
- 46. Flexible roles
- 49. 1 250G disk
- 50. No SWAP
- 51. RAID Zero Root Partition and Data Storage
- 54. Multiple Datacenters = 2
- 55. Use only half the available disk = 2
- 56. 12 Servers = ~1 TB Of Data Storage
- 61. Versioning of puppet code allows for adoption of development best practices
- 65. Cassandra uses log4j natively
- 66. Resources not available for remote log4j development
- 69. JMX trending
- 70. Identify critical data points
- 71. Rapid development of graphs
- 75. Development Best Practices with Life Cycle Management
Editor's Notes
- “… a highly scalable second-generation distributed database, bringing together Dynamo's fully distributed design and Bigtable'sColumnFamily-based data model.”
- Operational attributesFault TolerantData is automatically replicated to multiple nodes for fault-tolerance. Replication across multiple data centers is supported. Failed nodes can be replaced with no downtime.DecentralizedEvery node in the cluster is identical. There are no network bottlenecks. There are no single points of failure.ElasticRead and write throughput both increase linearly as new machines are added, with no downtime or interruption to applications.DurableCassandra is suitable for applications that can't afford to lose data, even when an entire data center goes down.Not just key-value. Replication and Consistency are configurable and datacenter aware
- Can also be configured cross-datacenter.
- Consistency Level is tunableONEQUORUMALLAt level ONE, one copy makes it to disk synchronously, before caller returns success.Same with reads. One node is read, so can get old data
- At QUORUM, two of three (QUORUM) written before returningQUORUM Read: Quorum must AGREEFirst two don’t, so wait for the third node to resolve the tie
- RISKS0.7.x in beta when we started, multiple betas and RCsRDBMS best practices are understood, if they exist for Cassandra how to discover them?Complicated system, lots of knobs, how to tune themMITIGATIONSWe deployed 0.7.2 across 72 servers in 90 minutes two days before we went live. 0.7.3 any day nowMailing lists, read code, file bugsA little about DatastaxStarted with a small app, higher risk ones come later, Mark will talk about monitoring—we have hundreds of graphs
- Data model: no joins, referential integrity or fixed schema. If you want those things, you have to code them.Rows with millions of columnsThrift: driver-level interface, doesn’t do things an application-level client should do, e.g. failover, retry
- Contributed bug reports and patches to Cassandra and HectorIncorporated in follow-on releasesNo need to maintain our own fork
- Mirror modeShort timeoutsLog errors DB2 is still database of record
- Necessary for success
- Authentication and Authorization; test basic functionaiity; rapidly deploy new changes