2011 05-23 metrics-agilasverige-english
Upcoming SlideShare
Loading in...5
×
 

Like this? Share it with your network

Share

2011 05-23 metrics-agilasverige-english

on

  • 893 views

10 minute lightning talk delivered at Agilasverige (Agile Sweden) 2011

10 minute lightning talk delivered at Agilasverige (Agile Sweden) 2011

Statistics

Views

Total Views
893
Views on SlideShare
532
Embed Views
361

Actions

Likes
1
Downloads
3
Comments
0

3 Embeds 361

http://teskm49t7294ckk5lbbi99ck1slm2jju-a-sites-opensocial.googleusercontent.com 359
http://www.slideshare.net 1
url_unknown 1

Accessibility

Categories

Upload Details

Uploaded via as Apple Keynote

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • \n
  • My name is Mårten, I work as a software developer\nBut I usually also have one foot - sometimes a whole leg - in our infrastructure\n
  • I work here.\nWe provide a web site, that’s our offering. Our core.\n
  • Our site is, amongst other things, built from a slew of Java services\nWe have multiple services on each server\n
  • We like to be availbale, thus we have multiple servers\nSame service, on multiple servers\nMultiple services on same server\n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • ...or at least look at this to get inspired\n
  • \n
  • \n
  • JSON, not always funny to look at\nThe really interesting things are small tidbits of information “hidden” in this blob of data\n
  • Is it ok?\n
  • How much memory do we consume?\n
  • How many requests have we served?\n
  • \n
  • \n
  • \n
  • Visualization makes it easy to distinguish worse from better\n
  • Visualization makes it easy to distinguish worse from better\n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • \n
  • Obviously the top one\n
  • \n
  • \n
  • \n
  • \n
  • Your project / team probably have a build server monitor, which is a good thing.\nBut how much “dashboard estate” do you spend on production - where your code actually (hopefully) delivers value?\n
  • \n
  • \n
  • \n
  • The dashboard where I work - all servers, most services\n
  • \n
  • Thanks\n

2011 05-23 metrics-agilasverige-english Presentation Transcript

  • 1. What’s happening in production Mårten Gustafson @martengustafson http://marten.gustafson.pp.se/ marten.gustafson@gmail.com
  • 2. Hi!
  • 3. which services are utilized?
  • 4. most?
  • 5. least?
  • 6. most memory?
  • 7. highest latency?
  • 8. does it work?
  • 9. http://www.picpop.com/
  • 10. what’s happening in production?
  • 11. right. this. second.
  • 12. measure!
  • 13. everything!
  • 14. in real time!
  • 15. it’s cheap...
  • 16. ...and simple!
  • 17. meter = metrics.meter("results", "records", TimeUnit.SECONDS)...calculate result...meter.mark(results.size())
  • 18. counter = Metrics.newCounter( getClass(), "requests")...receive request...counter.inc()
  • 19. counters
  • 20. timers
  • 21. averages
  • 22. etc...
  • 23. how?
  • 24. develop something, or...
  • 25. ...for java & scala use:https://github.com/codahale/metrics
  • 26. JMX
  • 27. Servlet =HTTP + JSON
  • 28. ete.v2","application_status":"Ok","counter_tot":0,"request_counters":[{"name":"Autocomple {"name":"AutocompleteService","counter":0},{"name":"AutocompleteService: Queries exec "AutocompleteService","status":"Ok"}]},{"name":"geo","application_status":"Ok","counter_to0},{"name":"PointConverter-deprecated","counter":0}],"monitored_services":[{"name":"Point ication_status":"Ok","counter_tot":1,"request_counters":[{"name":"RouteService-iPhone","c monitored_services":[{"name":"RouteService","status":"Ok"}]},{"name":"image","application :[{"name":"ImageService","counter":19}],"monitored_services":[{"name":"ImageService","sta n_status":"Ok","counter_tot":0,"request_counters":[{"name":"LocalityResolverService-cityN e-countyCode","counter":0},{"name":"LocalityResolverService-countyName","counter":0}],"erService","status":"Ok"}]},{"name":"sms.v2","application_status":"Ok","counter_tot":0,"requ s","counter":0},{"name":"SmsService","counter":0}],"monitored_services":[{"name":"SmsServ ":"Ok","counter_tot":0,"request_counters":[{"name":"WeatherService-forecasts","counter":0ame":"WeatherService-forecast","counter":0}],"monitored_services":[{"name":"WeatherServiplication_status":"Ok","counter_tot":3,"request_counters":[{"name":"AutocompleteService:r ervice","counter":3}],"monitored_services":[{"name":"AutocompleteService","status":"Ok"}]}unter_tot":55,"request_counters":[{"name":"PoiService:chunks","counter":47},{"name":"PoiS ":"PoiService:poi","counter":0}],"monitored_services":[{"name":"PoiService","status":"Ok"}]}, ication_status":"Ok","counter_tot":12244,"request_counters":[{"name":"memory.allocated" 2749},{"name":"memory.max","counter":4079},{"name":"memory.used","counter":1329},{" :"JvmMonitor","status":"Ok"}]},{"name":"weather.v2","application_status":"Ok","counter_tot r-forecast","counter":0},{"name":"WeatherService-rectangle-forecasts","counter":0},{"namame":"WeatherService-total","counter":0},{"name":"WeatherService-everythirdhour-forecas ange-forecast","counter":0},{"name":"WeatherService-oneperday-forecast","counter":0}]," [{"name":"WeatherService","status":"Ok"}]}]}
  • 29. ete.v2","application_status":"Ok","counter_tot":0,"request_counters":[{"name":"Autocomple {"name":"AutocompleteService","counter":0},{"name":"AutocompleteService: Queries exec "AutocompleteService","status":"Ok"}]},{"name":"geo","application_status":"Ok","counter_to0},{"name":"PointConverter-deprecated","counter":0}],"monitored_services":[{"name":"Point ication_status":"Ok","counter_tot":1,"request_counters":[{"name":"RouteService-iPhone","c monitored_services":[{"name":"RouteService","status":"Ok"}]},{"name":"image","application :[{"name":"ImageService","counter":19}],"monitored_services":[{"name":"ImageService","sta n_status":"Ok","counter_tot":0,"request_counters":[{"name":"LocalityResolverService-cityN e-countyCode","counter":0},{"name":"LocalityResolverService-countyName","counter":0}],"erService","status":"Ok"}]},{"name":"sms.v2","application_status":"Ok","counter_tot":0,"requ s","counter":0},{"name":"SmsService","counter":0}],"monitored_services":[{"name":"SmsServ ":"Ok","counter_tot":0,"request_counters":[{"name":"WeatherService-forecasts","counter":0ame":"WeatherService-forecast","counter":0}],"monitored_services":[{"name":"WeatherServication_status":"ok","counter_tot":3,"request_counters":[{"name":"AutocompleteServervice","counter":3}],"monitored_services":[{"name":"AutocompleteService","status":"Ok"}]}unter_tot":55,"request_counters":[{"name":"PoiService:chunks","counter":47},{"name":"PoiS":"PoiService:poi","counter":0}],"monitored_services":[{"name":"PoiService","status":"Ok"}]},ication_status":"Ok","counter_tot":12244,"request_counters":[{"name":"memory.allocated" 2749},{"name":"memory.max","counter":4079},{"name":"memory.used","counter":1329},{" :"JvmMonitor","status":"Ok"}]},{"name":"weather.v2","application_status":"Ok","counter_totr-forecast","counter":0},{"name":"WeatherService-rectangle-forecasts","counter":0},{"namame":"WeatherService-total","counter":0},{"name":"WeatherService-everythirdhour-forecas ange-forecast","counter":0},{"name":"WeatherService-oneperday-forecast","counter":0}]," [{"name":"WeatherService","status":"Ok"}]}]}
  • 30. ete.v2","application_status":"Ok","counter_tot":0,"request_counters":[{"name":"Autocomple {"name":"AutocompleteService","counter":0},{"name":"AutocompleteService: Queries exec "AutocompleteService","status":"Ok"}]},{"name":"geo","application_status":"Ok","counter_to0},{"name":"PointConverter-deprecated","counter":0}],"monitored_services":[{"name":"Point ication_status":"Ok","counter_tot":1,"request_counters":[{"name":"RouteService-iPhone","c monitored_services":[{"name":"RouteService","status":"Ok"}]},{"name":"image","application :[{"name":"ImageService","counter":19}],"monitored_services":[{"name":"ImageService","sta n_status":"Ok","counter_tot":0,"request_counters":[{"name":"LocalityResolverService-cityN e-countyCode","counter":0},{"name":"LocalityResolverService-countyName","counter":0}],"erService","status":"Ok"}]},{"name":"sms.v2","application_status":"Ok","counter_tot":0,"requ s","counter":0},{"name":"SmsService","counter":0}],"monitored_services":[{"name":"SmsServ ":"Ok","counter_tot":0,"request_counters":[{"name":"WeatherService-forecasts","counter":0ame":"WeatherService-forecast","counter":0}],"monitored_services":[{"name":"WeatherServiplication_status":"Ok","counter_tot":3,"request_counters":[{"name":"AutocompleteService:r ervice","counter":3}],"monitored_services":[{"name":"AutocompleteService","status":"Ok"}]}unter_tot":55,"request_counters":[{"name":"PoiService:chunks","counter":47},{"name":"PoiS ":"PoiService:poi","counter":0}],"monitored_services":[{"name":"PoiService","status":"Ok"}]}, ication_status":"Ok","counter_tot":12244,"request_counters":[{"name":"memory.allocated"9},{"name":"memory.max","counter":4079},{"name":"memory.used","counter": 132 :"JvmMonitor","status":"Ok"}]},{"name":"weather.v2","application_status":"Ok","counter_totr-forecast","counter":0},{"name":"WeatherService-rectangle-forecasts","counter":0},{"namame":"WeatherService-total","counter":0},{"name":"WeatherService-everythirdhour-forecas ange-forecast","counter":0},{"name":"WeatherService-oneperday-forecast","counter":0}]," [{"name":"WeatherService","status":"Ok"}]}]}
  • 31. ete.v2","application_status":"Ok","counter_tot":0,"request_counters":[{"name":"Autocomple {"name":"AutocompleteService","counter":0},{"name":"AutocompleteService: Queries exec "AutocompleteService","status":"Ok"}]},{"name":"geo","application_status":"Ok","counter_to0},{"name":"PointConverter-deprecated","counter":0}],"monitored_services":[{"name":"Point ication_status":"Ok","counter_tot":1,"request_counters":[{"name":"RouteService-iPhone","c RouteService","counter":1}],"monitored_services":[{"name":"RouteService","status":"Ok"}]},us":"Ok","counter_tot": 19,"request_counters":[{"name":"ImageService","counter":19"}]},{"name":"locality","application_status":"Ok","counter_tot":0,"request_counters":[{"name":"LocalityResolverService-countyCode","counter":0},{"name":"LocalityResolverService-cou calityResolverService","status":"Ok"}]},{"name":"sms.v2","application_status":"Ok","counter s","counter":0},{"name":"SmsService","counter":0}],"monitored_services":[{"name":"SmsServ ":"Ok","counter_tot":0,"request_counters":[{"name":"WeatherService-forecasts","counter":0ame":"WeatherService-forecast","counter":0}],"monitored_services":[{"name":"WeatherServiplication_status":"Ok","counter_tot":3,"request_counters":[{"name":"AutocompleteService:r ervice","counter":3}],"monitored_services":[{"name":"AutocompleteService","status":"Ok"}]}unter_tot":55,"request_counters":[{"name":"PoiService:chunks","counter":47},{"name":"PoiS ":"PoiService:poi","counter":0}],"monitored_services":[{"name":"PoiService","status":"Ok"}]}, ication_status":"Ok","counter_tot":12244,"request_counters":[{"name":"memory.allocated" 2749},{"name":"memory.max","counter":4079},{"name":"memory.used","counter":1329},{" :"JvmMonitor","status":"Ok"}]},{"name":"weather.v2","application_status":"Ok","counter_tot r-forecast","counter":0},{"name":"WeatherService-rectangle-forecasts","counter":0},{"namame":"WeatherService-total","counter":0},{"name":"WeatherService-everythirdhour-forecas ange-forecast","counter":0},{"name":"WeatherService-oneperday-forecast","counter":0}]," [{"name":"WeatherService","status":"Ok"}]}]}
  • 32. data is good
  • 33. visualized data is better
  • 34. visualize
  • 35. visualization = insight
  • 36. insight = knowledge
  • 37. knowledge = safety
  • 38. does it work?
  • 39. No.
  • 40. does it work?
  • 41. Yes.
  • 42. which services are utilized?
  • 43. available memory?
  • 44. 1 screen + 1 computer =visualization!
  • 45. why not more?
  • 46. think build server...
  • 47. ...only bigger...
  • 48. ...and more
  • 49. what’s happening in production?
  • 50. visualizing data in real time givesinsight and safety