Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Scalable SAAS Meetup - Oct 6th

101 views

Published on

Scaling lessons engineering and teams at Localytics

Published in: Software
  • Be the first to comment

  • Be the first to like this

Scalable SAAS Meetup - Oct 6th

  1. 1. Confidential and Proprietary Backend Engineering Best Practices Learned the Hard Way Mohit Dilawari
  2. 2. 2 Sr Director, Engineering 15 Years building SaaS products 5 Years at Localytics Mohit Dilawari
  3. 3. Some background on us...
  4. 4. 2010
  5. 5. Early 2014
  6. 6. 2014
  7. 7. This is 30% of our architecture Today
  8. 8. TBs of data ingested daily PBs of data stored
  9. 9. Our architecture/systems are becoming substantially more complicated
  10. 10. Culture of Ownership
  11. 11. Ownership means wearing many hats: ● Architect ● Developer ● QA ● Operations ● SRE ● Security ● Support
  12. 12. Lessons that helped us scale and operate complex system
  13. 13. “MySQL is the golden hammer” Company #1 Lesson #1
  14. 14. “Uses the best tool for the job” Company #2
  15. 15. What company has a larger operational cost?
  16. 16. Pick a few technologies and operationalize them to point you are world class at running them. Lesson #1
  17. 17. Few
  18. 18. Early Adopters SC1 Volumes
  19. 19. Operational cost should be the most important factor in your designs.
  20. 20. What do I mean by operational cost? ● Code efficiency ● Number of servers
  21. 21. What do I mean by operational cost? ● Code efficiency ● Number of servers ● Complexity of solution ● Engineer time ● Maintenance cost
  22. 22. How do you make it easy to make the best choice? Lesson #2
  23. 23. Invest in getting code to production fast!
  24. 24. Invest in tests
  25. 25. Invest in chatbots
  26. 26. Early 2014
  27. 27. 2014
  28. 28. Lesson #3
  29. 29. Cattle > Pets -Adrian Cockcroft
  30. 30. When we started, we had couple pets
  31. 31. When we started, we had couple pets Invested a lot to turn the pets to cattle.
  32. 32. Centralized Prerequisite for “cattle” Lesson #4
  33. 33. Lesson #5
  34. 34. QueueingQ
  35. 35. Product Manager on pager duty! Lesson #6
  36. 36. We had a few engineers and everyone knew our entire system In the early days... Lesson #7
  37. 37. HQ Metrics Dashboard ●Every service has one main dashboard ●Merge together system and business metrics
  38. 38. Percentiles Lesson #8
  39. 39. Codify your SOP Lesson #9
  40. 40. Learning Org Lesson #10
  41. 41. Learning Org
  42. 42. 1. Choose few technologies 2. Invest in system 3. Cattle not pets 4. Centralized Logging 5. ABQ 6. Engage product during prod issues 7. HQ Dashboards 8. Use percentiles 9. Codify your SOPs 10.Develop a learning org
  43. 43. Questions? Mohit Dilawari @mdilawari We are Hiring!

×