by RevelOps
Logs as Data:
Using Logs to track Web Application Performance
May 2014
by RevelOps
A Heritage in Advanced Research
• Founders hold PhDs in Distributed Systems
• Former Scientists at the IBM Cen...
by RevelOps
Developers, IT Operations and Business Analysts from…
Some of Our Customers
by RevelOpsOver 25k Users across 100 Countries
by RevelOpsWhat We Do?
by RevelOpsThe Humble Log
by RevelOpsMaking Log Data Accessible
by RevelOps
Logs As Data
by RevelOpsTop 10 Customer Use Cases
Production Monitoring
Production Troubleshooting
Debugging During Development
Web App...
by RevelOpsBenefits of Logs for Performance Monitoring
MACHINE
GENERATED
LOG DATA
#1: You can’t always instrument the cloud
by RevelOpsBenefits of Logs for Performance Monitoring
#2 Logs Maintain the Evidence
by RevelOpsBenefits of Logs for Performance Monitoring
#2 Logs Maintain the Evidence
by RevelOpsBenefits of Logs for Performance Monitoring
#2 Logs Maintain the Evidence
• Even with ephemeral servers
by RevelOpsBenefits of Logs for Performance Monitoring
#2 Logs Maintain the Evidence
• When you have performance issues on...
by RevelOpsBenefits of Logs for Performance Monitoring
#3 Logs can contain symptoms of failures
by RevelOpsBenefits of Logs for Performance Monitoring
#4 Events, App Performance, Resource Usage
by RevelOpsBenefits of Logs for Performance Monitoring
#5 Top to Bottom and End to End
by RevelOpsA Study across 25k users: Some Common Issues
Community Insights - Strength in Numbers
• Categories:
• Generic p...
by RevelOpsInvestigating Performance Issues w/ Logs
#1 Set Up Real Time Alerts: e.g. Response Time>500ms
by RevelOpsInvestigating Performance Issues w/ Logs
#2 Understand what single user behavior caused the issue
by RevelOpsInvestigating Performance Issues w/ Logs
#2 Understand if group user behavior caused the issue
by RevelOpsInvestigating Performance Issues w/ Logs
#3 What did resource usage look like?
by RevelOpsInvestigating Performance Issues w/ Logs
#4 Was performance effected?
by RevelOpsInvestigating Performance Issues w/ Logs
#4 Was performance effected? (Real User Monitoring)
by RevelOpsInvestigating Performance Issues w/ Logs
#5 What part of the application code caused the issue?
by RevelOpsInvestigating Performance Issues w/ Logs
#5 What part of the application code caused the issue?
(Tracing Transa...
by RevelOpsWhat part of the app code caused the issue?
• Step 1: Collate your logs
by RevelOpsWhat part of the app code caused the issue?
• Step 2: Refine the log entries
by RevelOps
• Step 3: Narrow the time range
What part of the app code caused the issue?
by RevelOpsWhat part of the app code caused the issue?
• Step 4: View the Transaction
by RevelOpsSummary
Benefits of Logs for Production Monitoring
1. You can’t always instrument the cloud
2. Logs Maintain th...
by RevelOpsGive it a Try for Free
• Get started in minutes with the free Logentries service!
• Lots of examples of using L...
by RevelOps
May 2014
Upcoming SlideShare
Loading in …5
×

Logs as Data: Using Logs to track Web Application Performance

485 views

Published on

Top 10 customer use cases for log management, benefits of logs for performance monitoring, common issues across 25k users, investigating performance issues with logs.

Published in: Technology, Business
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
485
On SlideShare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
13
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Logs as Data: Using Logs to track Web Application Performance

  1. 1. by RevelOps Logs as Data: Using Logs to track Web Application Performance May 2014
  2. 2. by RevelOps A Heritage in Advanced Research • Founders hold PhDs in Distributed Systems • Former Scientists at the IBM Center for Advanced Studies • Built Log Management Solution for IBM (RTCE) Global SaaS Log Management Service • More than 1,000 customers in over 100 countries, processing over 10B events daily • Locations in Boston, Dublin, Prague • Raised more than $11M in venture funding Trevor Parsons Formerly a scientist at IBM's Center for advanced studies with a PhD in Computer Science. Andrew Burton Proven software executive, with over 16 years of experience in start-ups & enterprise companies. Brendan Dillon Experienced software engineering & security executive, formerly CTO at Adaptive Mobile. Viliam Holub Over a decade developing enterprise software, with a PhD in Computer Science. Leadership Team Leigh Merrigan SaaS marketing, communications and branding executive, formerly with AppNeta. President & CEO Co-founder, Chief Scientist VP, Engineering Co-founder, CTO VP, Marketing About Logentries
  3. 3. by RevelOps Developers, IT Operations and Business Analysts from… Some of Our Customers
  4. 4. by RevelOpsOver 25k Users across 100 Countries
  5. 5. by RevelOpsWhat We Do?
  6. 6. by RevelOpsThe Humble Log
  7. 7. by RevelOpsMaking Log Data Accessible
  8. 8. by RevelOps Logs As Data
  9. 9. by RevelOpsTop 10 Customer Use Cases Production Monitoring Production Troubleshooting Debugging During Development Web Application Analytics Support Real User Monitoring Security Quality Assurance & Testing Business Analytics Mobile Application Analytics All Other Responses 71% 66% 41% 34% 32% 28% 22% 21% 10% 6% 5% © 2014 Logentries. All Rights Reserved. Confidential.
  10. 10. by RevelOpsBenefits of Logs for Performance Monitoring MACHINE GENERATED LOG DATA #1: You can’t always instrument the cloud
  11. 11. by RevelOpsBenefits of Logs for Performance Monitoring #2 Logs Maintain the Evidence
  12. 12. by RevelOpsBenefits of Logs for Performance Monitoring #2 Logs Maintain the Evidence
  13. 13. by RevelOpsBenefits of Logs for Performance Monitoring #2 Logs Maintain the Evidence • Even with ephemeral servers
  14. 14. by RevelOpsBenefits of Logs for Performance Monitoring #2 Logs Maintain the Evidence • When you have performance issues on ephemeral servers
  15. 15. by RevelOpsBenefits of Logs for Performance Monitoring #3 Logs can contain symptoms of failures
  16. 16. by RevelOpsBenefits of Logs for Performance Monitoring #4 Events, App Performance, Resource Usage
  17. 17. by RevelOpsBenefits of Logs for Performance Monitoring #5 Top to Bottom and End to End
  18. 18. by RevelOpsA Study across 25k users: Some Common Issues Community Insights - Strength in Numbers • Categories: • Generic patterns across all web logs • Tomcat specific patterns • IIS logs i.e. running a ASPX/ASP web app • Logentries Community Insights: logentries.com/doc/community-insights
  19. 19. by RevelOpsInvestigating Performance Issues w/ Logs #1 Set Up Real Time Alerts: e.g. Response Time>500ms
  20. 20. by RevelOpsInvestigating Performance Issues w/ Logs #2 Understand what single user behavior caused the issue
  21. 21. by RevelOpsInvestigating Performance Issues w/ Logs #2 Understand if group user behavior caused the issue
  22. 22. by RevelOpsInvestigating Performance Issues w/ Logs #3 What did resource usage look like?
  23. 23. by RevelOpsInvestigating Performance Issues w/ Logs #4 Was performance effected?
  24. 24. by RevelOpsInvestigating Performance Issues w/ Logs #4 Was performance effected? (Real User Monitoring)
  25. 25. by RevelOpsInvestigating Performance Issues w/ Logs #5 What part of the application code caused the issue?
  26. 26. by RevelOpsInvestigating Performance Issues w/ Logs #5 What part of the application code caused the issue? (Tracing Transactions)
  27. 27. by RevelOpsWhat part of the app code caused the issue? • Step 1: Collate your logs
  28. 28. by RevelOpsWhat part of the app code caused the issue? • Step 2: Refine the log entries
  29. 29. by RevelOps • Step 3: Narrow the time range What part of the app code caused the issue?
  30. 30. by RevelOpsWhat part of the app code caused the issue? • Step 4: View the Transaction
  31. 31. by RevelOpsSummary Benefits of Logs for Production Monitoring 1. You can’t always instrument the cloud 2. Logs Maintain the Evidence 3. Logs can contain of symptoms of more serious issues 4. Logs combine event data, resource usage, performance metrics 5. Top to Bottom and End to End Investigating Performance issues w/ Logs 1. Setup Real Time Alerts 2. Understand user behaviour 3. Inspect Resource Usage 4. Was Performance Effected 5. What Code caused the issue
  32. 32. by RevelOpsGive it a Try for Free • Get started in minutes with the free Logentries service! • Lots of examples of using Logs to Monitor Application Performance on our blog: http://blog.logentries.com • Contact us directly! • Trevor.parsons@logentries.com • Support@logentries.com
  33. 33. by RevelOps May 2014

×