Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Pushing Cassandra’sBoundariesDarshan RawalVP Engineering, Openwave Messaging Inc.
2© 2013 Openwave Messaging | Confidential #Cassandra13Agenda! Introduction! Our Cassandra Journey! Spectrum of BIG Data ch...
3© 2013 Openwave Messaging | Confidential #Cassandra13Openwave Messaging Customers
4© 2013 Openwave Messaging | Confidential #Cassandra13Universal Messaging Suite
5© 2013 Openwave Messaging | Confidential #Cassandra13Our Cassandra Journey – 3.5 years
6© 2013 Openwave Messaging | Confidential #Cassandra13Cassandra Under Fire - A Story! Customer Emergency•  Where: Major No...
7© 2013 Openwave Messaging | Confidential #Cassandra13Spectrum of BIG Data Challenges
8© 2013 Openwave Messaging | Confidential #Cassandra13Cassandra Pivots
9© 2013 Openwave Messaging | Confidential #Cassandra13Atomic Batches – Client Side ImpactgetConnection()batch_mutate(…)fre...
10© 2013 Openwave Messaging | Confidential #Cassandra13Typical Cassandra Instance - YoY Change
11© 2013 Openwave Messaging | Confidential #Cassandra13Cassandra Journey Insights! It’s a new paradigm, will take time / i...
12© 2013 Openwave Messaging | Confidential #Cassandra13Cassandra InsightsAspect InsightReplication Factor Ratio of RF / Ri...
13© 2013 Openwave Messaging | Confidential #Cassandra13In retrospection
14© 2013 Openwave Messaging | Confidential #Cassandra13Current challenges @ Openwave Messaging
Darshan.Rawal@owmessaging.com
Upcoming SlideShare
Loading in …5
×

C* Summit 2013: (Re)-Building the Social Grid for Global Telcos @ 1/10th the Market Cost by Darshan Rawal

1,167 views

Published on

Darshan Rawal is leading the development of hybrid cloud based messaging products for global Tier 1 Telcos. Darshan has been working in Silicon valley since 2000, building nimble, cost effective products/services, handling millions of users and billions of transactions per day. Previous to Openwave Messaging, Darshan held engineering positions @ SS8 networks, Yahoo, DE Shaw, yp.com and has a M.S in Software Engineering from Carnegie Mellon University.

Published in: Technology, Business
  • Be the first to comment

C* Summit 2013: (Re)-Building the Social Grid for Global Telcos @ 1/10th the Market Cost by Darshan Rawal

  1. 1. Pushing Cassandra’sBoundariesDarshan RawalVP Engineering, Openwave Messaging Inc.
  2. 2. 2© 2013 Openwave Messaging | Confidential #Cassandra13Agenda! Introduction! Our Cassandra Journey! Spectrum of BIG Data challenges! Cassandra Pivots! Typical Cassandra Instance YoY change! Cassandra Insights! Conclusion
  3. 3. 3© 2013 Openwave Messaging | Confidential #Cassandra13Openwave Messaging Customers
  4. 4. 4© 2013 Openwave Messaging | Confidential #Cassandra13Universal Messaging Suite
  5. 5. 5© 2013 Openwave Messaging | Confidential #Cassandra13Our Cassandra Journey – 3.5 years
  6. 6. 6© 2013 Openwave Messaging | Confidential #Cassandra13Cassandra Under Fire - A Story! Customer Emergency•  Where: Major North American OWM customer•  When: Q4 2012•  What: File System corruption in legacy platform•  Impact: All (~800K) accounts without mail access! Resolution: A lab system goes live! Metrics:•  20 minutes to upgrade RAM per Cassandra Node•  Run wild maintainence/compaction; solved via SSDs•  100% Uptime
  7. 7. 7© 2013 Openwave Messaging | Confidential #Cassandra13Spectrum of BIG Data Challenges
  8. 8. 8© 2013 Openwave Messaging | Confidential #Cassandra13Cassandra Pivots
  9. 9. 9© 2013 Openwave Messaging | Confidential #Cassandra13Atomic Batches – Client Side ImpactgetConnection()batch_mutate(…)freeConnection()getConnection()batch_mutate(…)freeConnection()getConnection()batch_mutate(…)freeConnection()getConnection()batch_mutate( …)batch_mutate( …)batch_mutate( …)freeConnection()prepare_batch()getConnection()atomic_batch_mutate(…)freeConnection()Cassandra1.1xCassandra 1.2.xApplicationOptimization
  10. 10. 10© 2013 Openwave Messaging | Confidential #Cassandra13Typical Cassandra Instance - YoY Change
  11. 11. 11© 2013 Openwave Messaging | Confidential #Cassandra13Cassandra Journey Insights! It’s a new paradigm, will take time / investment! There is no free lunch; cool features have a price! Sizing is all about IOPS, not all IOPS are equal! Eventual Consistency is dual edged sword! Adapt paradigms that don’t fit upfront
  12. 12. 12© 2013 Openwave Messaging | Confidential #Cassandra13Cassandra InsightsAspect InsightReplication Factor Ratio of RF / Ring size plays a crucial role inthroughput. Linear growth as the ratio shrinksTombstones Needs effective tuning for delete heavy applicationsRefactor application level soft deletesSizing Plan for the perfect storm: Compaction + N Failures+ Recovery (especially for dense deployments)Reliable Counters Utilize Client side affinitySuper Cols Best AvoidedClient Interaction Thundering herd issues due to backend GC
  13. 13. 13© 2013 Openwave Messaging | Confidential #Cassandra13In retrospection
  14. 14. 14© 2013 Openwave Messaging | Confidential #Cassandra13Current challenges @ Openwave Messaging
  15. 15. Darshan.Rawal@owmessaging.com

×