Nflx ds meetup-5_dec2012

1,710 views

Published on

2013 Roadmap of Cassandra development at Netflix. Presented to the SV Cassandra User Group.

Published in: Technology
  • Be the first to comment

Nflx ds meetup-5_dec2012

  1. 1. 2013  Roadmap:   Cassandra  at  Ne4lix   5  December  2012   Jason  Brown  Senior  So@ware  Engineer  @  Ne4lix   @jasobrown        jasedbrown@gmail.com     hGp://www.linkedin.com/in/jasedbrown    
  2. 2. blah  blah     blah  
  3. 3. Cassandra  Deployment  Numbers  > 50 Production clusters> 800 Total nodes15 Number of multi-region clusters4 Max regions for one cluster144 Largest Cassandra cluster4 Size of Cassandra dev-ops team
  4. 4. Record  reads/writes  1.2  million  writes/second     300k  reads/second   72  node  cluster  –  m2.4xlarge  
  5. 5. 2013  Cassandra  Roadmap  • Priam    • Explorers  • Compliance/security  • Data  as  a  Service  
  6. 6. Priam  updates  • C*  1.2   • Virtual  nodes  integraSon  
  7. 7. Token  distribuSon  -­‐  now  
  8. 8. Token  distribuSon  -­‐  vnodes  
  9. 9. Vnodes  info  • @samoverton  (Acunu)  • hGp://www.acunu.com/2/post/2012/07/ virtual-­‐nodes-­‐strategies.html  (arScle)   • (images  borrowed  from  this  great  blog  post)  • hGp://tweets.acunu.com/tweets/ 240082932524523520  (video)  
  10. 10. Priam  updates  • C*  1.2   • Virtual  nodes  integraSon   • Grow  a  cluster  without  doubling   • Auto-­‐scale  c*  cluster  with  load  • Commit  log  backups  (CASSANDRA-­‐3690)   • Accelerated  BI  integraSon  
  11. 11. Explorers  • Web-­‐based  UI  • Cassandra  plugin  for  admin/query  • Coming  soon  to  a  github  repo  near  you  
  12. 12. Compliance  Everyone  to  the  cloud                …  even  billing!    Security,  encrypSon,  audiSng,  logging    Lots  of  details,  lots  of  quesSons  …        
  13. 13. Data  as  a  Service  • “Gimme  my  data”  • RESTful  interface  to  get/set  data  • More  than  just  C*    • Cluster  management  (consolidaSon)  
  14. 14. New  Year’s  ResoluSons  • Learn  CQL3    • Make  vnodes  rock  in  EC2  • More  open  source  contribuSons  • Watch  more  Ne4lix  ..  Rather  than  just  code  it    
  15. 15. Thanks!        

×