Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Cassandra on Docker @ Walmart Labs

1,301 views

Published on

.

Published in: Technology
  • Be the first to comment

Cassandra on Docker @ Walmart Labs

  1. 1. Dense Node C* / S* / Spark on Dockers Walmart GEC-Database Engineering & Data Services Ani Mondal
  2. 2. NoSQL / Big Data Footprint 1500 Nodes (150 Clusters) Prod & Non- Prod Elastic Kafka
  3. 3. Proposed Container Cluster 1 2 3 4 5 6 7 8BM Cluster 1 2 3 4 Transform new C* hardware into containers thereby utilizing unused compute Build new clusters in containers & migrate old C* clusters into those Double the capacity on existing & newly ordered H/W for C* clusters thereby saving cost Reclaiming and reusing existing HW
  4. 4. App A Containers vs. VMs Hypervisor Host OS Server Guest OS Bins/ Libs App A’ Gues t OS Bins/ Libs App B Gues t OS Bins/ Libs AppA’ Docker Host OS Server Bins/Libs AppA Bins/Libs AppB AppB’ AppC AppC’ VM Container Containers are isolated, but share OS and, optionally, binaries/libraries Guest OS Guest OS Bins/ Libs App A Original App (No OS to take up space, resources, or require restart) Copy of App No OS. Can Share bins/libs App A’
  5. 5. Configuration Host OS Server (HP SL4540) Bins/Libs Bins/Libs Dockers Docker 1 Persistent DATA & LOGS Docker 2 Persistent DATA & LOGS OPSC Agent OPSC Agent Custom Orchestration Host Network – Dedicated NICs Docker Registry
  6. 6. Benchmark #s in-house application Comparison (+/-3 % Margin of Error) Bare Metal (Prod) Dockers (Prod HW) OpenStack (VM) AZURE VM Reads Total 276943 813428 999164 975179 Per Sec 4615.72 6778.57 651.77 5079.06 Avg. Latency (in ms) 0.68 0.92 9.77 1.40 Writes Total 499921 1000000 1000000 1000000 Per Sec 8332.02 8333.33 652.32 5208.3 Avg. Latency (in ms) 0.72 0.71 9.21 1.04
  7. 7. Patent • Kavindra Yerolkar • Jayakrishnan Parappalliyalil • Preetish Tripathi • Aniruddha Mondal

×