C* Summit 2013: (Re)-Building the Social Grid for Global Telcos @ 1/10th the Market Cost by Darshan Rawal
Upcoming SlideShare
Loading in...5
×
 

C* Summit 2013: (Re)-Building the Social Grid for Global Telcos @ 1/10th the Market Cost by Darshan Rawal

on

  • 1,007 views

Darshan Rawal is leading the development of hybrid cloud based messaging products for global Tier 1 Telcos. Darshan has been working in Silicon valley since 2000, building nimble, cost effective ...

Darshan Rawal is leading the development of hybrid cloud based messaging products for global Tier 1 Telcos. Darshan has been working in Silicon valley since 2000, building nimble, cost effective products/services, handling millions of users and billions of transactions per day. Previous to Openwave Messaging, Darshan held engineering positions @ SS8 networks, Yahoo, DE Shaw, yp.com and has a M.S in Software Engineering from Carnegie Mellon University.

Statistics

Views

Total Views
1,007
Views on SlideShare
1,006
Embed Views
1

Actions

Likes
2
Downloads
26
Comments
0

1 Embed 1

http://localhost 1

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

C* Summit 2013: (Re)-Building the Social Grid for Global Telcos @ 1/10th the Market Cost by Darshan Rawal C* Summit 2013: (Re)-Building the Social Grid for Global Telcos @ 1/10th the Market Cost by Darshan Rawal Presentation Transcript

  • Pushing Cassandra’sBoundariesDarshan RawalVP Engineering, Openwave Messaging Inc.
  • 2© 2013 Openwave Messaging | Confidential #Cassandra13Agenda! Introduction! Our Cassandra Journey! Spectrum of BIG Data challenges! Cassandra Pivots! Typical Cassandra Instance YoY change! Cassandra Insights! Conclusion
  • 3© 2013 Openwave Messaging | Confidential #Cassandra13Openwave Messaging Customers
  • 4© 2013 Openwave Messaging | Confidential #Cassandra13Universal Messaging Suite
  • 5© 2013 Openwave Messaging | Confidential #Cassandra13Our Cassandra Journey – 3.5 years
  • 6© 2013 Openwave Messaging | Confidential #Cassandra13Cassandra Under Fire - A Story! Customer Emergency•  Where: Major North American OWM customer•  When: Q4 2012•  What: File System corruption in legacy platform•  Impact: All (~800K) accounts without mail access! Resolution: A lab system goes live! Metrics:•  20 minutes to upgrade RAM per Cassandra Node•  Run wild maintainence/compaction; solved via SSDs•  100% Uptime
  • 7© 2013 Openwave Messaging | Confidential #Cassandra13Spectrum of BIG Data Challenges
  • 8© 2013 Openwave Messaging | Confidential #Cassandra13Cassandra Pivots
  • 9© 2013 Openwave Messaging | Confidential #Cassandra13Atomic Batches – Client Side ImpactgetConnection()batch_mutate(…)freeConnection()getConnection()batch_mutate(…)freeConnection()getConnection()batch_mutate(…)freeConnection()getConnection()batch_mutate( …)batch_mutate( …)batch_mutate( …)freeConnection()prepare_batch()getConnection()atomic_batch_mutate(…)freeConnection()Cassandra1.1xCassandra 1.2.xApplicationOptimization
  • 10© 2013 Openwave Messaging | Confidential #Cassandra13Typical Cassandra Instance - YoY Change
  • 11© 2013 Openwave Messaging | Confidential #Cassandra13Cassandra Journey Insights! It’s a new paradigm, will take time / investment! There is no free lunch; cool features have a price! Sizing is all about IOPS, not all IOPS are equal! Eventual Consistency is dual edged sword! Adapt paradigms that don’t fit upfront
  • 12© 2013 Openwave Messaging | Confidential #Cassandra13Cassandra InsightsAspect InsightReplication Factor Ratio of RF / Ring size plays a crucial role inthroughput. Linear growth as the ratio shrinksTombstones Needs effective tuning for delete heavy applicationsRefactor application level soft deletesSizing Plan for the perfect storm: Compaction + N Failures+ Recovery (especially for dense deployments)Reliable Counters Utilize Client side affinitySuper Cols Best AvoidedClient Interaction Thundering herd issues due to backend GC
  • 13© 2013 Openwave Messaging | Confidential #Cassandra13In retrospection
  • 14© 2013 Openwave Messaging | Confidential #Cassandra13Current challenges @ Openwave Messaging
  • Darshan.Rawal@owmessaging.com