Pushing Cassandra’sBoundariesDarshan RawalVP Engineering, Openwave Messaging Inc.
2© 2013 Openwave Messaging | Confidential #Cassandra13Agenda! Introduction! Our Cassandra Journey! Spectrum of BIG Data ch...
3© 2013 Openwave Messaging | Confidential #Cassandra13Openwave Messaging Customers
4© 2013 Openwave Messaging | Confidential #Cassandra13Universal Messaging Suite
5© 2013 Openwave Messaging | Confidential #Cassandra13Our Cassandra Journey – 3.5 years
6© 2013 Openwave Messaging | Confidential #Cassandra13Cassandra Under Fire - A Story! Customer Emergency•  Where: Major No...
7© 2013 Openwave Messaging | Confidential #Cassandra13Spectrum of BIG Data Challenges
8© 2013 Openwave Messaging | Confidential #Cassandra13Cassandra Pivots
9© 2013 Openwave Messaging | Confidential #Cassandra13Atomic Batches – Client Side ImpactgetConnection()batch_mutate(…)fre...
10© 2013 Openwave Messaging | Confidential #Cassandra13Typical Cassandra Instance - YoY Change
11© 2013 Openwave Messaging | Confidential #Cassandra13Cassandra Journey Insights! It’s a new paradigm, will take time / i...
12© 2013 Openwave Messaging | Confidential #Cassandra13Cassandra InsightsAspect InsightReplication Factor Ratio of RF / Ri...
13© 2013 Openwave Messaging | Confidential #Cassandra13In retrospection
14© 2013 Openwave Messaging | Confidential #Cassandra13Current challenges @ Openwave Messaging
Darshan.Rawal@owmessaging.com
Upcoming SlideShare
Loading in …5
×

C* Summit 2013: (Re)-Building the Social Grid for Global Telcos @ 1/10th the Market Cost by Darshan Rawal

1,015 views
925 views

Published on

Darshan Rawal is leading the development of hybrid cloud based messaging products for global Tier 1 Telcos. Darshan has been working in Silicon valley since 2000, building nimble, cost effective products/services, handling millions of users and billions of transactions per day. Previous to Openwave Messaging, Darshan held engineering positions @ SS8 networks, Yahoo, DE Shaw, yp.com and has a M.S in Software Engineering from Carnegie Mellon University.

Published in: Technology, Business
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,015
On SlideShare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
29
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

C* Summit 2013: (Re)-Building the Social Grid for Global Telcos @ 1/10th the Market Cost by Darshan Rawal

  1. 1. Pushing Cassandra’sBoundariesDarshan RawalVP Engineering, Openwave Messaging Inc.
  2. 2. 2© 2013 Openwave Messaging | Confidential #Cassandra13Agenda! Introduction! Our Cassandra Journey! Spectrum of BIG Data challenges! Cassandra Pivots! Typical Cassandra Instance YoY change! Cassandra Insights! Conclusion
  3. 3. 3© 2013 Openwave Messaging | Confidential #Cassandra13Openwave Messaging Customers
  4. 4. 4© 2013 Openwave Messaging | Confidential #Cassandra13Universal Messaging Suite
  5. 5. 5© 2013 Openwave Messaging | Confidential #Cassandra13Our Cassandra Journey – 3.5 years
  6. 6. 6© 2013 Openwave Messaging | Confidential #Cassandra13Cassandra Under Fire - A Story! Customer Emergency•  Where: Major North American OWM customer•  When: Q4 2012•  What: File System corruption in legacy platform•  Impact: All (~800K) accounts without mail access! Resolution: A lab system goes live! Metrics:•  20 minutes to upgrade RAM per Cassandra Node•  Run wild maintainence/compaction; solved via SSDs•  100% Uptime
  7. 7. 7© 2013 Openwave Messaging | Confidential #Cassandra13Spectrum of BIG Data Challenges
  8. 8. 8© 2013 Openwave Messaging | Confidential #Cassandra13Cassandra Pivots
  9. 9. 9© 2013 Openwave Messaging | Confidential #Cassandra13Atomic Batches – Client Side ImpactgetConnection()batch_mutate(…)freeConnection()getConnection()batch_mutate(…)freeConnection()getConnection()batch_mutate(…)freeConnection()getConnection()batch_mutate( …)batch_mutate( …)batch_mutate( …)freeConnection()prepare_batch()getConnection()atomic_batch_mutate(…)freeConnection()Cassandra1.1xCassandra 1.2.xApplicationOptimization
  10. 10. 10© 2013 Openwave Messaging | Confidential #Cassandra13Typical Cassandra Instance - YoY Change
  11. 11. 11© 2013 Openwave Messaging | Confidential #Cassandra13Cassandra Journey Insights! It’s a new paradigm, will take time / investment! There is no free lunch; cool features have a price! Sizing is all about IOPS, not all IOPS are equal! Eventual Consistency is dual edged sword! Adapt paradigms that don’t fit upfront
  12. 12. 12© 2013 Openwave Messaging | Confidential #Cassandra13Cassandra InsightsAspect InsightReplication Factor Ratio of RF / Ring size plays a crucial role inthroughput. Linear growth as the ratio shrinksTombstones Needs effective tuning for delete heavy applicationsRefactor application level soft deletesSizing Plan for the perfect storm: Compaction + N Failures+ Recovery (especially for dense deployments)Reliable Counters Utilize Client side affinitySuper Cols Best AvoidedClient Interaction Thundering herd issues due to backend GC
  13. 13. 13© 2013 Openwave Messaging | Confidential #Cassandra13In retrospection
  14. 14. 14© 2013 Openwave Messaging | Confidential #Cassandra13Current challenges @ Openwave Messaging
  15. 15. Darshan.Rawal@owmessaging.com

×