Evaluating Data Solutions for Large-Scale Production
•
0 likes•11 views
Dinesh Majrekar presented on evaluating data solutions for large-scale production at Civo. As the lead architect for the CivoStack platform, he discussed how Civo tested various options by setting up a representative test environment, measuring performance, and assessing scalability, durability, and day-2 operations when their previous data provider's contract was up for renewal. Some of the tools used in testing included Terraform, Gitlab CI pipelines, Ansible, FIO, and KubeVirt. The goal was to find a partnership where Civo could continue growing while avoiding vendor lock-in and ensuring performance and open source technologies.
Recommended
Recommended
More Related Content
Similar to Evaluating Data Solutions for Large-Scale Production
Similar to Evaluating Data Solutions for Large-Scale Production (20)
More from DoKC
More from DoKC (20)
Recently uploaded
Recently uploaded (20)
Evaluating Data Solutions for Large-Scale Production
- 1. Dinesh Majrekar DoK Day Europe 2022 @ KubeCon “Testing the Mettle: Evaluating data solutions for large-scale production to check who stacks up”
- 2. DoK Day Europe 2022 @ KubeCon Dinesh Majrekar “Testing the Mettle: Evaluating data solutions for large-scale production to check who stacks up” Who am I? • 15 years experience in the web hosting industry • Developer, System Architect, DevOps Engineer • Lead Architect for the CivoStack platform
- 3. DoK Day Europe 2022 @ KubeCon Dinesh Majrekar “Testing the Mettle: Evaluating data solutions for large-scale production to check who stacks up” Who are Civo? • The Cloud Native Service Provider • Focused on delivering Kubernetes Clusters • Simplified developer experience • Currently hosting over 200TB of end user data across 3 geographic regions
- 4. DoK Day Europe 2022 @ KubeCon Dinesh Majrekar “Testing the Mettle: Evaluating data solutions for large-scale production to check who stacks up” Why are we migrating? • Contract was up for renewal • Current provider was performing well • Allowed us an opportunity to review other offerings in the market
- 5. DoK Day Europe 2022 @ KubeCon Dinesh Majrekar “Testing the Mettle: Evaluating data solutions for large-scale production to check who stacks up” What are we looking for? • A partnership where we can grow together • Enterprise support options • Open Source / Avoid vendor lock-In • Underlying technology • Performance • Scalability and durability
- 6. DoK Day Europe 2022 @ KubeCon Dinesh Majrekar “Testing the Mettle: Evaluating data solutions for large-scale production to check who stacks up” How we tested the options? • Representative Test Environment • Installation and integration with our existing deployment pipelines • Comparing speed of Cluster launches • Evaluating performance loss compared to raw disk access • Day 2 Operations • Monitoring • Upgrades • Commercials
- 7. DoK Day Europe 2022 @ KubeCon Dinesh Majrekar “Testing the Mettle: Evaluating data solutions for large-scale production to check who stacks up” Some of the tools used • Terraform / Terragrunt • Gitlab CI pipelines • Ansible • FIO • KubeVirt
- 8. DoK Day Europe 2022 @ KubeCon Dinesh Majrekar “Testing the Mettle: Evaluating data solutions for large-scale production to check who stacks up” Learn More • Previous DoK talk about the migration process https://www.youtube.com/watch?v=GlUsPnSZI_Y • Meet us at KubeCon EU - SU12, Pavilion 2 • Reach out on the Civo Community Slack channel
- 9. DoK Day Europe 2022 @ KubeCon Thank you! Dinesh Majrekar “Testing the Mettle: Evaluating data solutions for large-scale production to check who stacks up”