Machine Analytics: Correlate Your Logs and Metrics
•Download as PPTX, PDF•
0 likes•500 views
To effectively manage your application, it’s critical to have visibility into both logs and metrics. Metrics can provide app and infrastructure KPI’s, while logs provide context into application and infrastructure execution KPIs. Managing one without the other, provides you with incomplete data; you need both to troubleshoot application issues quickly and efficiently. This webinar will feature a live demo of Sumo Logic’s Unified Logs and Metrics machine data analytics platform and show how to: Natively ingest your logs, host metrics, AWS metrics and Graphite-compatible metrics Proactively set alerts based on logs and metrics thresholds Analyze and correlate logs and metrics in real-time and in a unified way to reduce mean time to problem resolution (MTTR)
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Machine Analytics: Correlate Your Logs and Metrics
Similar to Machine Analytics: Correlate Your Logs and Metrics (20)
More from Sumo Logic
More from Sumo Logic (20)
Recently uploaded
Recently uploaded (20)
Machine Analytics: Correlate Your Logs and Metrics
- 1. Sumo Logic Confidential Correlate Your Logs and Metrics Kalyan Ramanathan VP of Product Marketing Mario Sánchez Director of Technical Content April 2017
- 2. Sumo Logic Confidential In this webinar, … Overview of Sumo Logic Unified Machine Data Platform Use Case: Hootsuite Scaling for Modern Apps Troubleshooting with a unified Logs & Metrics platform Sending Logs and Metrics to Sumo Logic Q&A
- 3. Sumo Logic Confidential SumoLogic Confidential 1200+ Customers 2-4x lifetime expand 1. 20 Million + Searches performed daily 100 PB + Data analyzed daily 300+ Trillion Records queried daily Tier-1 Investors Service Scale No limits Leading Machine Data Analytics Service
- 4. Sumo Logic Confidential SumoLogic Confidential DevOps Automation, Collaboration Micro-services Componentized architecture DevOps teams deploy 30x more Puppet Labs DevOps Survey 100+ services to build a page Amazon Architecture 200B+ in public cloud spend (2016) Gartner Cloud Adoption Elasticity, Scalability Rise of Modern Applications
- 5. Sumo Logic Confidential 5 Unified Machine Data Platform 1. Unified Machine Data Analytics Log, Metrics & Events Machine Learning Scalable & Elastic Modern Application Track End to End Performance Full Stack Visibility Real-Time Insights Fast troubleshooting and root-cause analysis Logs Metrics Events
- 6. Sumo Logic Confidential Use Case: Hootsuite Migration to Sumo Logic Logs Metrics ZERO Deploy & Upgrade times No Management Overhead Fully Elastic On Demand Unified Support of Logs and Metrics Machine Learning Analytics Secure by Design Next Generation Multi-tenant SaaS Webinar: Scaling your Tools for Modern Apps
- 7. Sumo Logic Confidential 7 Sumo Logic: How It Works Monitor Dashboard & Alert Troubleshoot Analyze & Correlate Optimize Trend & predict
- 8. Sumo Logic Confidential Troubleshooting Unified Logs and Metrics
- 9. Sumo Logic Confidential Unified Logs and Metrics – Troubleshooting Demo ALERT notifies of a critical event METRICS to identify what’s going on LOGS to identify why it’s happening
- 10. Sumo Logic Confidential TravelLogic – Travel Booking Site
- 11. Sumo Logic Confidential Summary Reduced MTTI/MTTR Faster Troubleshooting – Contextual analysis of logs and metrics Improved DevOps Collaboration Single source of truth for Ops & DevOps teams Reduced TCO Eliminate multiple tools for logs and metrics analytics
- 13. Sumo Logic Confidential Sumo Logic Confidential Sending Logs to Sumo Logic CollectorCloud Data Collection Centralized Data Collection Local Data Collection Collector CollectorCollector Collector Hosted Collectors Installed Collectors 1 2 3
- 14. Sumo Logic Confidential Sumo Logic Confidential Sending Metrics to Sumo Logic Collector Custom Code StatsD Server Collector Server/Device/Container OS/Container Metrics Library StatsD CollectD Host Metrics Graphite Graphite 3 2 1
- 15. Sumo Logic Confidential Questions? Search Documentation and Training Library of Past Webinars Search/Post @ Sumo Dojo Search, Post, Respond Submit Feature Requests Vote for Existing Ones Open a Support Case Contact Customer Success customer-success@sumologic.com
- 17. Sumo Logic Confidential 17 Metric Sources Host AWS Graphite-Compatible AWS ECS Webinar: Setting up Host Metrics Webinar: Setting up AWS Metrics Webinar: Setting up Graphite Metrics
- 18. Sumo Logic Confidential Graphite Challenges - Parsing
- 19. Sumo Logic Confidential Graphite-compatible Metrics: Metric Rules •Customers can continue to use their existing metrics structure • The rule is an instruction to parse an existing metric name so you can easily apply the Sumo Logic syntax
Editor's Notes
- PREPARATION: Open DemoSlack to #travel_app Open browser to TraveLogic Generate Errors for TravelLogic (CTRL + G) Open SE Demo + Operational Overview Dashboard Open CloudTrail Overview/Operations, AWS Lambda, AWS S3 Audit, Amazon VPC Flow, Host Mertics Launch GTW Survey: How familiar are you with Sumo Logic? I'm new(ish) to Sumo Logic I'm familiar with Sumo Logic Logs but new to Metrics I'm familiar with both Logs and Metrics Who is Sumo Logic? We are a cloud native machine data analytics company and we help our customers manage the operation and security of their mission critical applications. What is machine data it includes logs, metrics and events that are generated by apps and infrastructure. Sumo knows to ingest this data, Sumo knows to get insights from this data and leveraging this data, customers can deliver great apps to the end customers
- A bit about ourselves We 1,200+ Enterprise Customers – and great brands at that We provide fast value to our customers. AirBnB is a great example where the customer started out managing their app security with us and soon deployed it to many of their mission critical applications [USE YOUR FAVORITE EXAMPLE CUSTOMER STORIES TO HIGHLIGHT OUR CUSTOMER VALUE] We have built a very scapable platform In one day Sumo Logic ingested over 100 TB data and users query/analyze across 300+ trillion records We are funded by Tier 1 investors who find and fund big ideas. And we are happy to have them support us
- But what kinds of software applications are companies creating? Its not the traditional (legacy) software. We are now creating modern applications on modern infrastructure (Stop and ask the customer if they are using such technologies) We see 3 characteristics for these modern application They are generally built on cloud platform. And many a times on public cloud platform AWS, Azure etc. have very robust cloud platforms with excellent SLA’s They are built using DevOPs practices Applications are built faster and with higher quality [ASK CUSTOMER – ARE THEY USING THESE TECHNOLOGIES? ARE THEY GOING TO THE CLOUD?]
- There is a better way to manage your applications - and that is with a unified machine data analytics platform Your apps and infrastructure already generate lots of machine data (logs, metrics, events) If you can ingest this data and analyze this data (i.e correlate it, identify patterns in this data, be able to visualize and dashboard it), you can get lots of visibility into The full stack – from the app – infrastructure to the services The performance and availability of the application and infrastructure including proactively identifying issues Be able to manage the security of the application. Lastly, the platform should also be able to real-time data streams across all the dependent applications and infrastructures, and make sense of the volume of data collect, variety of the data, and variety of the data to provide real-time analytics to solve the problems that arise with this new architecture.
- HootSuite Cloud based modern apps and infrastructure All in Amazon AWS 1500+ nodes running cloud services Microservice based architecture DevOps/Agile Dynamic environment with dozens of deploys in production per week Initial Set up Easy to get started Widely adopted by startups and technology companies Open source (“free solution”) Good enough capabilities to get started Challenges Hard to scale and manage “What works for 100 nodes is challenging at 1000” Resource and cost expenditures Too many resources just managing “management software” Availability and redundancy adds additional expense to the solution “Open source for logging and metrics looks attractive on paper, costs add up when bulletproofing” Benefits Easy to get started Full support for AWS with OOB apps & dashboards Very scalable solution High performance and redundancy Zero upgrade costs Security and compliance of platform PCI, SOC2, etc. Low TCO One solution to manage all app operations data SaaS offering - no management required Unified support for logs and metrics One dashboard to visualize logs & metrics with integrated context Machine learning Analytics LogReduce, LogCompare dramatically reduce identification and troubleshooting times Metrics outlier, anomaly detection Multi-geo capable Available globally Focus on core Hootsuite infrastructure Sumo manages operations on monitoring and logging for us Deliver better metrics performance and SLA 5 times faster time for logs and metrics in dashboard High resolution Logging and metrics infrastructure SLA Reduced overall TCO of management of solution Ease of scale Ease of onboarding Zero management and infrastructure costs Build-in upgrades and feature improvements
- How does Sumo work? Sumo logic offers a Cloud native SaaS service – so we manage the service for you. Sumo Logic offers locally deployed Collectors or Cloud API to ingest the machine data from apps and infrastructure. Once ingested, Sumpo logic will index the data and you can instantly start to query and analyze the data You can setup alerts which will instantly inform you when your thresholds have been breached. You can also create dashboards and reports and share it with your team.
- This demo will show you how a unified Logs and Metrics solution can reduce your troubleshooting time. - First, we’ll use Alerts to notify a user of a critical event - The Alert will direct us to a Metrics dashboard that helps us identify WHAT is going on - Lastly, we’ll dive into the relevant logs to Identify WHY this is happening Let’s jump right into it.
- TraveLogic is a booking site that uses Sumo Logic the keep an eye on the health of it’s infrastructure as well as it’s own application. Let’s look at how they use Sumo to troubleshoot.
- Great! We’ve seen how Sumo can 1. Reduce the mean time to identification and resolution by providing contextual analysis 2. Improve your team’s collaboration by using a single source of truth that can be securely accessed and analyzed. 3. And lastly, a Unified Logs and Metrics solution eliminates the need for multiple tools, lowering your total cost of ownership.
- Hosted Collectors Allow for seamless collection from Amazon S3 buckets and HTTP Sources. Hosted Collectors don't require installation or activation, and they don’t have physical requirements, since they're hosted in AWS. Because there are no performance issues to consider, you can configure as many S3 and HTTP Sources as you'd like for a single Hosted Collector. Installed Collectors Sumo Logic Installed Collectors are lightweight and efficient. You can choose to install a small number of Collectors to minimize maintenance or just because you want to keep your topology simple (Centralized). Alternatively, you can choose to install many Collectors on many machines (Local) to distribute the bandwidth impact across your network. >> In SE Demo, search for CloudTrail Sources to demo a hosted collector. Installed Collectors are deployed in your environment, either on a local machine, a machine in your organization, or even an Amazon Machine Image (AMI). Installed Collectors require a software download and installation. Upgrades to Collector software are released regularly. >> In SE Demo, search for Okta Sources to demo a hosted collector.
- Here’s how the landscape will look when you start sending Graphite-compatible metrics to Sumo. CollectD, DropWizard, Metrics Libraries can all send their metrics straight to an Installed Collector which can forward to Sumo Logic. In the case of StatsD, the StatsD server can send to a Sumo Logic Collector. (Search: Additionally, this Collector do double-duty and can also ingest Host Metrics from your host server. (Search: Host Metrics) We can collect AWS Metrics via CloudWatch (Search AWS CloudWatch)
- 1. D you Support the Graphite naming convention? YES, >> Show graphite names in demo, show inline parsing functionality, and demo Metrics Rules functionality 2. I saw several ways of sending metrics to Sumo. Can you please review these? >> Review slide with 3 Metric source types 3. I'm an all AWS-shop, what AWS services do you Support? We support the commonly used services, and provide out of the box content for these. >> Show CloudTrail or VPC Flow logs
- From a metrics perspective, Sumo Logic can ingest metrics from 3 main sources: Host metrics from any of your host servers, regardless of OS. You can watch a video of this at Video Library Your AWS metrics, which we collect via CloudWatch Any Graphite-compatible metrics