Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Cassandra in Docker at Yelp: Opportunities and Challenges

65 views

Published on

Cassandra in Docker talk was given at London Docker Meetup in May 2019.

Youtube: https://www.youtube.com/watch?v=1TshTqk2J2M&t=7s

Published in: Software
  • Be the first to comment

  • Be the first to like this

Cassandra in Docker at Yelp: Opportunities and Challenges

  1. 1. Raghavendra D Prabhu rprabhu@yelp.com @randomsurfer London Docker Meetup 16 May Cassandra in Docker at Yelp Opportunities and Challenges
  2. 2. Yelp’s Mission Connecting people with great local businesses.
  3. 3. OVERVIEW
  4. 4. ● About Cassandra ● Cassandra at Yelp ● Docker at Yelp ● Opportunities in Dockerization ● Challenges ● Conclusion Overview
  5. 5. ● Distributed wide-column NoSQL datastore ● Written in Java ● Multi data center ● Tunable consistency ● Write-friendly: LSM than B-tree ● Cloud-aware: gossip, failure detection, snitching, handoffs Cassandra
  6. 6. ● Both primary and derived data ● Deployed on AWS EC2: m5.* ● EBS for storage ● Automated schema management ● Backups into S3 ● Custom node discovery with Smartstack ● Managed with Taskerman Cassandra @
  7. 7. Yelp Cassandra @ 10000 ft
  8. 8. ● Yelp PaaSTA: Containers on Mesos ● Few thousand microservices deployed and growing ○ Our website runs on this! ● Hundreds of deployments every day ● Why PaaSTA: ○ Clusterman ○ Spot fleet ● Kubernetes for stateful services /
  9. 9. OPPORTUNITIES
  10. 10. Lifecycle Management
  11. 11. Safe Deployment
  12. 12. Maintenance
  13. 13. Auto/Scaling
  14. 14. Co$t
  15. 15. Security
  16. 16. Agile Infra
  17. 17. CHALLENGES
  18. 18. Noisy Neighbor
  19. 19. Cold Cache
  20. 20. Java Runtime
  21. 21. Configuration Management
  22. 22. Observability
  23. 23. Conclusion
  24. 24. www.yelp.com/careers/ We're Hiring!
  25. 25. ● Taskerman: A Distributed Cluster Task Manager ● How Yelp Autoscales Mesos + Marathon on AWS Spot Fleet ● Getting the Most Out of Your Mesos ● Autoscaling Mesos Clusters with Clusterman Related talks
  26. 26. Q & A
  27. 27. ● Apache cassandra logo ● https://www.yelp.com/brand for Yelp burst logo ● https://thenounproject.com/ ● https://pxhere.com/en/photo/1328995 Credits
  28. 28. @YelpEngineering fb.com/YelpEngineers engineeringblog.yelp.com github.com/yelp

×