Scaling Your Tools for Your Modern Application
•Download as PPTX, PDF•
1 like•274 views
In this presentation, we discuss Hootsuite - a customer of Sumo Logic and the leading provider of social media management services for enterprises - and their journey off of open source tools to Sumo Logic, including: - The challenges in running & managing solutions like ELK and Graphite - Sumo Logic unified logs and metrics monitoring solution and its advanced analytics, dashboarding and troubleshooting capabilities - How Hootsuite was able to leverage Sumo Logic to deliver excellent user experience to their end customers
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Scaling Your Tools for Your Modern Application
Similar to Scaling Your Tools for Your Modern Application (20)
More from Sumo Logic
More from Sumo Logic (20)
Recently uploaded
Recently uploaded (20)
Scaling Your Tools for Your Modern Application
- 1. Sumo Logic Confidential Scaling your Tools for Modern Apps Hootsuite and Sumo Logic
- 3. Sumo Logic Confidential Presenters November 14, 2016 Hootsuite Application Analytics
- 4. Sumo Logic Confidential Who is Hootsuite? Most widely used social media management platform for managing social media for businesses and organizations Trusted by more than 800 of the Fortune 1000
- 5. Sumo Logic Confidential Production Apps and Infrastructure • Cloud based modern apps and infrastructure – All in Amazon AWS – 1500+ nodes running including cloud services such as Cloudfront, Redshift, Lambda – Microservice based architecture (30+) • DevOps/Agile – Dynamic environment with dozens of deploys in production per week
- 6. Sumo Logic Confidential App Performance & Availability at Hootsuite User Experience is job # 1 99.9% uptime SLA goal 1000s of customers 15M+ users 175+ countries
- 7. Sumo Logic Confidential Logging and Metrics Infrastructure Initial Approach – Easy to get started – Widely adopted by startups and technology companies – Open source (“free solution”) – Good enough capabilities to get started + Logs Metrics
- 8. Sumo Logic Confidential Challenges with Management • Hard to scale and manage – “What works for 100 nodes is challenging at 1000” • Resource and cost expenditures – Too many resources just managing “management software” – Availability and redundancy adds additional expense to the solution “Open source for logging and metrics looks attractive on paper, costs add up when bulletproofing” + 8+ modules 4+ modules
- 9. Sumo Logic Confidential KPI Targets and Challenges • Mean Time to Detect (MTTD) < 1 min • Mean Time to React (MTTR) ~ 1 - 5 min • Availability of the application • Challenges amplified by Microservices
- 10. Sumo Logic Confidential Why Sumo Logic? Value of SaaS Platform • Easy to get started – Full support for AWS with OOB apps & dashboards • Very scalable solution – High performance and redundancy – Zero upgrade costs • Security and compliance of platform – PCI, SOC2, etc. • Low TCO – One solution to manage all app operations data – SaaS offering - no management required
- 11. Sumo Logic Confidential Why Sumo Logic? State-of-the-art Machine Data Analytics • Unified support for logs and metrics – One dashboard to visualize logs & metrics with integrated context • Machine learning Analytics – LogReduce, LogCompare dramatically reduce identification and troubleshooting times – Metrics outlier, anomaly detection • Multi-geo capable – Available globally
- 13. Sumo Logic Confidential Benefits with Sumo Logic • Focus on core Hootsuite infrastructure – Sumo manages operations on monitoring and logging for us • Deliver better metrics performance and SLA • 5 times faster time for logs and metrics in dashboard • High resolution Logging and metrics infrastructure SLA • Reduced overall TCO of management of solution – Ease of scale – Ease of onboarding – Zero management and infrastructure costs – Build-in upgrades and feature improvements
- 14. Sumo Logic Confidential Where are we going next? • Enrich API functionality to features parity with UI • Security analytics and incidents detection with Sumo • Improved correlation context between logs & metrics to reduce MTTR
- 15. Sumo Logic Confidential Learning (& best practices to succeed) • Open source is not FREE – Management and infrastructure costs add up – Keeps you away from your core responsibilities • Implement solutions that help you sleep better – Leverage expert and expert solutions – Don’t try to solve it all in-house – Don’t reinvent the wheel • Easy to get started with in-house solutions but it is much more effort when it comes to bulletproofing it
- 16. Sumo Logic Confidential Presenters November 14, 2016 Cloud-Native Machine Data Analytics
- 17. Sumo Logic Confidential 1200+ Customers 2-4x lifetime expand 1. 20 Million + Searches performed daily 100 PB + Data analyzed daily 300+ Trillion Records queried daily Tier-1 Investors Service Scale No limits Leading Machine Data Analytics Service
- 18. Sumo Logic Confidential DevOps Automation, Collaboration Micro-services Componentized architecture DevOps teams deploy 30x more Puppet Labs DevOps Survey 100+ services to build a page Amazon Architecture 200B+ in public cloud spend (2016) Gartner Cloud Adoption Elasticity, Scalability Rise of Modern Applications
- 19. Sumo Logic Confidential 19 Unified Machine Data Platform 1. Unified Machine Data Analytics Log, Metrics & Events Machine Learning Scalable & Elastic Modern Application Track End to End Performance Full Stack Visibility Real-Time Insights Fast troubleshooting and root-cause analysis
- 20. Sumo Logic Confidential 20 • SaaS architecture reduced TCO by 78% • Leveraging analytics to Reduce MTTI by 82% Cloud Migration ROI Sumo Logic Tangible ROI Use CaseCustomers • Reduction MTTR for production issues by 91% • 48% lower Total Cost of Ownership Application & Infrastructure operations • Reduced MTTI from 30 minutes to 2 minutes • Reduced Application Release Cycle times by 20%Improved DevOps & app performance • Scalable solution to support AWS migration • Machine learning reduced MTTR by 50% Cloud Migration, app operations & security • Rapid time to value; Low TCO • Deep visibility into cloud apps (Google, Okta, Salesforce) Application security & compliance
- 21. Sumo Logic Confidential 21 Sumo Logic: How It Works Monitor Dashboard & Alert Troubleshoot Analyze & Correlate Optimize Trend & predict
- 22. Sumo Logic Confidential 22 Monitor all machine data Unified dashboard of Logs, metrics, custom metrics
- 23. Sumo Logic Confidential 23 Log Analytics/Log Reduce to identify Root Cause Unified Troubleshooting 1 2 3 4 Correlated logs and metrics
- 24. Sumo Logic Confidential 24 Zero Management SaaS Service Only Approach to Manage Volume & Variety of Machine Data High TCO & Long TTV Limited flexibility & scalability Security as afterthought Legacy On Prem or Single-Tenant ZERO Deploy & Upgrade times Reduce Time to Value by 90% No Management Overhead Reduce TCO > 50% Fully Elastic On Demand Agility, Scale, Performance Always Available 4 Geos, 12AZs, 6 X Replication Superior Performance Guaranteed SLAs Secure by Design Industry’s Most Secure Platform Next Generation Multi-tenant SaaS “The unique combination of Sumo Logic’s SaaS architecture demonstrated that we would obtain the fast time-to-value and scalability”
- 25. Sumo Logic Confidential SumoLogic Confidential Industry’s Most Secure Cloud-Native Analytics Service • PCI/DSS 3.2 Service Provider Level 1 Certified • SOC 2 Type attestation • ISO 27001 certified • CSA Star certified • HIPAA-HITECH compliance • U.S. – EU Privacy Shield • AES 256-bit encryption at rest • TLS encryption in transit • FIPS 140-2 compliant Protecting Customer Data with Best-in-Class Security Fully Secure
- 26. Sumo Logic Confidential 26 Comprehensive cloud app visibility Full-Stack AWS, Azure an Hybrid Cloud Cloud Native, Multi-tenant Secure Architecture Machine learning for faster MTTI/MTTR Unified Logs & Metrics Data Why Sumo Logic?
- 27. Sumo Logic Confidential Presenters November 14, 2016 Q & A
Editor's Notes
- [BEFORE PRESENTING SUMO, ASK THE CUSTOMER – WHAT ARE YOUR IT PRIORITIES? WHAT ARE YOUR BIG CHALLENGES? WHAT KEEPS YOU UP AT NIGHT? AND TIE THIS TO THE SLIDES IN THE DECK] Who is Sumo Logic? We are a cloud native machine data analytics company and we help our customers manage the operation and security of their mission critical applications. What is machine data it includes logs, metrics and events that are generated by apps and infrastructure. Sumo knows to ingest this data, Sumo knows to get insights from this data and leveraging this data, customers can deliver great apps to the end customers
- [BEFORE PRESENTING SUMO, ASK THE CUSTOMER – WHAT ARE YOUR IT PRIORITIES? WHAT ARE YOUR BIG CHALLENGES? WHAT KEEPS YOU UP AT NIGHT? AND TIE THIS TO THE SLIDES IN THE DECK] Who is Sumo Logic? We are a cloud native machine data analytics company and we help our customers manage the operation and security of their mission critical applications. What is machine data it includes logs, metrics and events that are generated by apps and infrastructure. Sumo knows to ingest this data, Sumo knows to get insights from this data and leveraging this data, customers can deliver great apps to the end customers
- its not a joke
- point in evolution - build vs buy we are not looking to build better monitoring solution our goal is to sell social. there is a problem that I was solving and I dont want anymore. There are the higher value problems to solve. deconstructing into workflows and compaititive advantage of doing it.
- [BEFORE PRESENTING SUMO, ASK THE CUSTOMER – WHAT ARE YOUR IT PRIORITIES? WHAT ARE YOUR BIG CHALLENGES? WHAT KEEPS YOU UP AT NIGHT? AND TIE THIS TO THE SLIDES IN THE DECK] Who is Sumo Logic? We are a cloud native machine data analytics company and we help our customers manage the operation and security of their mission critical applications. What is machine data it includes logs, metrics and events that are generated by apps and infrastructure. Sumo knows to ingest this data, Sumo knows to get insights from this data and leveraging this data, customers can deliver great apps to the end customers
- A bit about ourselves We 1,200+ Enterprise Customers – and great brands at that We provide fast value to our customers. AirBnB is a great example where the customer started out managing their app security with us and soon deployed it to many of their mission critical applications [USE YOUR FAVORITE EXAMPLE CUSTOMER STORIES TO HIGHLIGHT OUR CUSTOMER VALUE] We have built a very scapable platform In one day Sumo Logic ingested over 100 TB data and users query/analyze across 300+ trillion records We are funded by Tier 1 investors who find and fund big ideas. And we are happy to have them support us
- But what kinds of software applications are companies creating? Its not the traditional (legacy) software. We are now creating modern applications on modern infrastructure (Stop and ask the customer if they are using such technologies) We see 3 characteristics for these modern application They are generally built on cloud platform. And many a times on public cloud platform AWS, Azure etc. have very robust cloud platforms with excellent SLA’s They are built using DevOPs practices Applications are built faster and with higher quality [ASK CUSTOMER – ARE THEY USING THESE TECHNOLOGIES? ARE THEY GOING TO THE CLOUD?]
- There is a better way to manage your applications - and that is with a unified machine data analytics platform Your apps and infrastructure already generate lots of machine data (logs, metrics, events) If you can ingest this data and analyze this data (i.e correlate it, identify patterns in this data, be able to visualize and dashboard it), you can get lots of visibility into The full stack – from the app – infrastructure to the services The performance and availability of the application and infrastructure including proactively identifying issues Be able to manage the security of the application. Lastly, the platform should also be able to real-time data streams across all the dependent applications and infrastructures, and make sense of the volume of data collect, variety of the data, and variety of the data to provide real-time analytics to solve the problems that arise with this new architecture.
- So lets talk about some real-world values of Sumo Logic Sumo Logic helps customers with: Complete visibility into their application, infrastructure and services Reduced MTTI and MTTR for operational issues Faster resolution of security issues The business value of our solution include Migrate to the cloud effectively with zero risk Reduce risk of Reduced TCO Excellent application experience and security
- How does Sumo work? Sumo logic offers a Cloud native SaaS service – so we manage the service for you. Sumo Logic offers locally deployed Collectors or Cloud API to ingest the machine data from apps and infrastructure. Once ingested, Sumpo logic will index the data and you can instantly start to query and analyze the data You can setup alerts which will instantly inform you when your thresholds have been breached. You can also create dashboards and reports and share it with your team.
- In this dashboard, We instantly provide full stack visibility for checkout service. Sumo Logic can ingest application and infrastructure logs and Metrics- and AWS services logs. Sumo Logic can collect and centralized the logs and metrics from EC2 instances, S3 storage, docker containers, ELB and application stack running on EC2. We provide full stack visibility. You can quickly overlay metrics and logs (point to any metrics in red and show them metrics and log overlay). Further, you can list the outlier<in payment gateway latency> (Note: Metrics and Log Overlay feature). Our outlier detection is based on dynamic baselining which reduces false positives with the help of dynamic threshold that adjusts to the data ingest pattern. <Showing Outlier detection in the dashboard). Let me take a few seconds and highlight Why Metrics and Logs ? Tool sprawl creates more confusion and more challenges. Difference of few seconds in logs and metrics timestamp can completely reverse the causality. To avoid hopping from one tool to another and one screen to another, we have combined logs and metrics to quickly get to the root cause. In this dashboard you already know there are following issues. Payment gateway latency is high based on outlier report (Note: Show Gateway latency average chart : Second chart on the right) CPU of one of the webserver host is running high based on the CPU metrics. In most efficient environment, you can use alerting mechanism to fix some of the known issues. For example : Running Lambda script for custom response, or rebooting the node. (Show Lambda in the list of Webhook options). In this case we have no idea why CPU is spiking for those nodes. We can drill down further into logs.
- This how logs can be overlayed on top of metrics. You can clearly see the log volume spike (darker orange strip on the top ) at the same time when the CPU is spiking. To further analyze why the checkout service is experiencing this spike lets get into logs.
- Why should you consider a Cloud-native SaaS service. The alternative is a on-prem or single instance model. Where you manage the analytics service. You are now responsible for Setting up the service Optimizing and scaling the service Upgrading the service And this is very cost and resource intensive (and also has long time to value) Sumo logic service is completely SaaS based. We manage the service for you – install, upgrade, optimization etc. Its available in many AWS zones And we have built in security from the get-go – so that you don’t have to worry about it.
- Speaker’s Notes: Sumo provides the most secure cloud-based analytics service on the market Only Sumo has achieved this level of validation and certification Key messages: Sumo takes data security VERY seriously Enterprise-grade security was built into Sumo’s architecture from the beginning None of our competitors provide the same level of security or attestations You can trust Sumo with your data Discovery Questions: In your current log management process, how concerned are you about the security of your data? What steps do you take to ensure it’s protected? What compliance and audit standards do you have? Who would need to be involved reviewing and validating Sumo’s approach to security and compliance?
- [BEFORE PRESENTING SUMO, ASK THE CUSTOMER – WHAT ARE YOUR IT PRIORITIES? WHAT ARE YOUR BIG CHALLENGES? WHAT KEEPS YOU UP AT NIGHT? AND TIE THIS TO THE SLIDES IN THE DECK] Who is Sumo Logic? We are a cloud native machine data analytics company and we help our customers manage the operation and security of their mission critical applications. What is machine data it includes logs, metrics and events that are generated by apps and infrastructure. Sumo knows to ingest this data, Sumo knows to get insights from this data and leveraging this data, customers can deliver great apps to the end customers