Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Monitoring the Dynamic Nature of Cloud Computing

211 views

Published on

Building visibility in modern applications

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Monitoring the Dynamic Nature of Cloud Computing

  1. 1. ©2008–18 New Relic, Inc. All rights reserved. Monitoring the Dynamic Nature of Cloud Computing Building visibility in modern applications Lee Atchison ∙ Senior Director Strategic Architecture at New Relic, Inc. leeatchison@leeatchison
  2. 2. ©2008–18 New Relic, Inc. All rights reserved You Have a Problem… 2
  3. 3. ©2008–18 New Relic, Inc. All rights reserved It’s Your Big Day 3 Busiest Day of the Year Black Friday Product Launch Election Day The day of the year when your company either… … makes it or breaks it
  4. 4. ©2008–18 New Relic, Inc. All rights reserved Will You Survive? Can you scale? Can you stay operational?
  5. 5. ©2008–18 New Relic, Inc. All rights reserved
  6. 6. ©2008–18 New Relic, Inc. All rights reserved
  7. 7. ©2008–18 New Relic, Inc. All rights reserved
  8. 8. ©2008–18 New Relic, Inc. All rights reserved It worked most of the time. Why are you complaining?
  9. 9. ©2008–18 New Relic, Inc. All rights reserved the Site Stays Up I Hope, I Hope, I Hope
  10. 10. ©2008–18 New Relic, Inc. All rights reserved Real life availability story… …overheard OPs conversation... ©2008–18 New Relic, Inc. All rights reserved
  11. 11. ©2008–18 New Relic, Inc. All rights reserved The Conversation… “We were wondering how changing a setting on our MySQL database might impact our performance… ©2008–18 New Relic, Inc. All rights reserved
  12. 12. ©2008–18 New Relic, Inc. All rights reserved The Conversation… “We were wondering how changing a setting on our MySQL database might impact our performance… … but we were worried that the change may cause our production database to fail…” ©2008–18 New Relic, Inc. All rights reserved
  13. 13. ©2008–18 New Relic, Inc. All rights reserved The “Scary” Overheard Conversation… “… Since we didn’t want to bring down production, we decided to make the change to our backup (replica) database instead… Under Construction … but we were worried that the change may cause our production database to fail…” ©2008–18 New Relic, Inc. All rights reserved
  14. 14. ©2008–18 New Relic, Inc. All rights reserved The “Scary” Overheard Conversation… … After all, it wasn’t being used for anything at the moment.” Under Construction ©2008–18 New Relic, Inc. All rights reserved “… Since we didn’t want to bring down production, we decided to make the change to our backup (replica) database instead…
  15. 15. ©2008–18 New Relic, Inc. All rights reserved The “Scary” Overheard Conversation… Under Construction X ©2008–18 New Relic, Inc. All rights reserved Until, of course, the backup was needed…
  16. 16. ©2008–18 New Relic, Inc. All rights reserved The “Scary” Overheard Conversation… This was a true story Under Construction !!! ! X X ©2008–18 New Relic, Inc. All rights reserved Until, of course, the backup was needed…
  17. 17. ©2008–18 New Relic, Inc. All rights reserved Availability can be more subtle, for example… ©2008–18 New Relic, Inc. All rights reserved
  18. 18. ©2008–18 New Relic, Inc. All rights reserved 300ms 1.5s 18
  19. 19. ©2008–18 New Relic, Inc. All rights reserved 19 .9s
  20. 20. ©2008–18 New Relic, Inc. All rights reserved 20
  21. 21. ©2008–18 New Relic, Inc. All rights reserved The Data from Monitoring Your App Dwarfs the Data Inside theApp
  22. 22. ©2008–18 New Relic, Inc. All rights reserved User Experience Business Outcome Servers Apps Big Data Problem ©2008–18 New Relic, Inc. All rights reserved
  23. 23. ©2008–18 New Relic, Inc. All rights reserved Server OS Server (Virtual) Hardware Application & Application Microservices Provisioning Application & Application Microservices Application & Application Microservices BrowserMobile InstrumentAll Parts of theApplication and Infrastructure DASHBOARDS Help you understand: • How app components work together • How is each component performing? • What are performance expectations of each component? Visibility in all parts of your application. Plan Migrate Run
  24. 24. ©2008–18 New Relic, Inc. All rights reserved Why Visibility Matters
  25. 25. ©2008–18 New Relic, Inc. All rights reserved Success in SoftwareAnalytics Application Performance Customer Experience Business Outcome
  26. 26. ©2008–18 New Relic, Inc. All rights reserved This is the old world…this is the old story… ©2008–18 New Relic, Inc. All rights reserved …It’s not just a static world now-a-days…
  27. 27. ©2008–18 New Relic, Inc. All rights reserved It’s Not Just Static Ops Previous - STATIC World
  28. 28. ©2008–18 New Relic, Inc. All rights reserved 28 Ops Static Data Centers It’s Not Just Static
  29. 29. ©2008–18 New Relic, Inc. All rights reserved 29 Dev Dynamic Cloud World Ops Static Data Centers Ops It’s Not Just Static
  30. 30. ©2008–18 New Relic, Inc. All rights reserved Dynamic Cloud Enables Better Applications Faster Traditional Data Center Cloud Data Center Dynamic Cloud Better Best The way you’ve done things in the past won’t work in the future. Good
  31. 31. ©2008–18 New Relic, Inc. All rights reserved Dynamic Usage Example… Docker Container Age (Count vs. Hours) 1 Hour 200 days 833 days
  32. 32. ©2008–18 New Relic, Inc. All rights reserved Dynamic Usage Example… Docker Container Age (by Minute and Hour) 1,200,000 11% under one minute Container age (minutes)
  33. 33. ©2008–18 New Relic, Inc. All rights reserved Dynamic Cloud Dynamic Cloud Easier Scaling Faster Change Faster Response Higher Availability
  34. 34. ©2008–18 New Relic, Inc. All rights reserved How do I track what the dynamic cloud is doing for me (or to me)? Dynamic Cloud has unique monitoring requirements…
  35. 35. ©2008–18 New Relic, Inc. All rights reserved What is a Dynamic CloudApplication? Dynamic Applications • Allocate resources on demand • Resize resources on demand • Provisioning process: • No longer a manual operations task • It’s part of the application • It’s dynamic Allows • Better Scaling • Higher Availability Server OS Server (Virtual) Hardware Application & Application Microservices Provisioning Application & Application Microservices Application & Application Microservices BrowserMobile
  36. 36. ©2008–18 New Relic, Inc. All rights reserved Visibility into a dynamic application Monitoring Dynamic Applications • Still has services to monitor • Still has servers to monitor • Still has an infrastructure • Still has user interfaces Server OS Server (Virtual) Hardware Application & Application Microservices Provisioning Application & Application Microservices Application & Application Microservices BrowserMobile Application Monitoring Infrastructure Monitoring DASHBOARDS
  37. 37. ©2008–18 New Relic, Inc. All rights reserved Server OS Server (Virtual) Hardware Application & Application Microservices Provisioning Application & Application Microservices Application & Application Microservices BrowserMobile Visibility into a dynamic application ?How do you monitor this?
  38. 38. ©2008–18 New Relic, Inc. All rights reserved Where did it go? It was just here!! The thing you monitored 10 minutes ago… ...doesn’t exist anymore!?
  39. 39. ©2008–18 New Relic, Inc. All rights reserved Visibility into Dynamic Applications In the Dynamic Cloud Monitor the Cloud Components themselves Gives you: Visibility into how the resources are working Monitor the lifecycle of the Cloud Components Gives you: Visibility into when the resources were used Very different than monitoring traditional Data Center components
  40. 40. ©2008–18 New Relic, Inc. All rights reserved Changing World Ops Previous - STATIC World
  41. 41. ©2008–18 New Relic, Inc. All rights reserved Changing World Dev Now - DYNAMIC World Ops Ops Previous - STATIC World
  42. 42. ©2008–18 New Relic, Inc. All rights reserved Changing World Dev Now - DYNAMIC World Ops Dynamic Applications • Resources Constantly Changing Monitoring Dynamic Applications • Track what resources are used when • Monitor provisioning process • And monitor static usage
  43. 43. ©2008–18 New Relic, Inc. All rights reserved Monitoring Just the Server Worked When Rate of Change Was Low… EC2 Instance Server OS Server (Virtual) Hardware Application & Application Microservices AWS CONSOLE CloudWatch
  44. 44. ©2008–18 New Relic, Inc. All rights reserved Dev Ops Dynamic World
  45. 45. Server OS Server (Virtual) Hardware Application & Application Microservices Provisioning Application & Application Microservices Application & Application Microservices BrowserMobile Visibility Requires Full Stack, Static & Dynamic Monitoring Application Monitoring Infrastructure Monitoring • Top to bottom monitoring of entire application • Static Monitoring of how Resource are used • Dynamic Monitoring of how Resources are provisioned and utilized Dynamic Cloud Monitoring Customer Experience Monitoring DASHBOARDS
  46. 46. ©2008–18 New Relic, Inc. All rights reserved
  47. 47. ©2008–18 New Relic, Inc. All rights reserved Customers demand modern applications Modern applications modern instrumentationrequire
  48. 48. ©2008–18 New Relic, Inc. All rights reserved 48 Ops Visibility helps you innovate • Speed to Innovate • Flexibility to Innovate
  49. 49. ©2008–18 New Relic, Inc. All rights reserved 49 Ops Innovation gives you confidence • Confidence to develop • Confidence to scale
  50. 50. ©2008–18 New Relic, Inc. All rights reserved 50 Dev Dynamic Cloud World Ops Static World Ops Visibility Gives You Confidence in the Dynamic Cloud
  51. 51. ©2008–18 New Relic, Inc. All rights reserved. Thank you Lee Atchison ∙ Senior Director Strategic Architecture at New Relic, Inc. leeatchison@leeatchison

×