DevOps Indonesia #14 - Building monitoring framework on container infrastructure
•
0 likes•174 views
Building monitoring framework on container infrastructure by Mr. Yusuf Hadiwinata Sutandar
Recommended
More Related Content
What's hot
What's hot (20)
Similar to DevOps Indonesia #14 - Building monitoring framework on container infrastructure
Similar to DevOps Indonesia #14 - Building monitoring framework on container infrastructure (20)
More from DevOps Indonesia
More from DevOps Indonesia (20)
Recently uploaded
Recently uploaded (20)
DevOps Indonesia #14 - Building monitoring framework on container infrastructure
- 1. PAGE1 DEVOPS INDONESIA DEVOPS INDONESIA Jakarta, 28 Feb 2019 Building Monitoring Framework DevOpsCommunity in Indonesia
- 2. PAGE3 DEVOPS INDONESIA DEVOPS INDONESIA HOUSE RULES 100% ATTENTION TAKE NOTES, NOT CALLS RECEIVE KNOWLEDGE, NOT MESSAGES MUTE NOTIFICATIONS FOR SLACK QQ WHATSAPP IMESSAGE EMAIL TELEGRAM SNAPCHAT FACEBOOK WEIBO HANGOUTS VOXER SIGNAL G+ TWITTER VIBER SKYPE WECHAT LINE SMS ...
- 3. PAGE4 DEVOPS INDONESIA Let’s get know each otherLet's get know each other
- 4. PAGE5 DEVOPS INDONESIA Linux Geek | OpenSourceEnthusiast | Security Hobbies Senior Manager - Technology Operation Yusuf Hadiwinata Sutandar
- 5. PAGE6 DEVOPS INDONESIA Building Monitoring Framework
- 6. PAGE8 DEVOPS INDONESIA Raise You Hand! Who.. ...has implement monitoring?
- 7. PAGE9 DEVOPS INDONESIA Background... One of the biggest challenges facing IT ops teams is the lack of visibility across the entire infrastructure - physical, virtual and in the cloud. Making things even more complex, any infrastructure monitoring solution needs to not only meet the IT team’s needs, but also the needs of other stakeholders including line of business (LOB) owners and application developers
- 8. PAGE10 DEVOPS INDONESIA Monitoring is essential • Protecting revenue, brand, and security • Identification of issues before customers are impacted • Creating feedback loops and stability • Gathering information on usage and usability • Collecting information for future analysis
- 9. PAGE11 DEVOPS INDONESIA Comprehensive monitoring strategy • Monitor the components and the whole system level, component level, and overall applicationmetrics need to be includedto get the full picture. • Analyze first and third party performance. Problems with a third party affect the overall digital experiencejust as much as problems with first party content. • Measure individual pages and multi-step transactions. Users are visiting more than a single page, you should be monitoring more than the home page. • Configure alerts to be notified when performance varies from a baseline. Early identification of issues can help resolve problems before customers are impacted. • Compare your performance to competitors or industry leaders. Performance is relative, you are being compared to other sites on a daily basis, do you know how you stack up?
- 10. PAGE12 DEVOPS INDONESIA Comprehensive monitoring strategy • Monitor from the viewpoint of your users. Capture metrics from real users to get the broadest coverage and use those locations to influence where to capture synthetic measurementsfrom. • Measure performance across multiple connection types. Performance and availability can vary widely across connection types include a representative sample of your users. • Align metrics with business objectives. Why should others in the organization care about a metric? Describe how the monitoring data is relevant to objectives such as increasing customer loyalty, increasing revenue, or reducing costs. • Re-evaluate your strategy on a regular basis. As your company grows, and your application changes, your monitoring strategy should be re-evaluated. Are you still measuring from the geographies that matter? Have new components been introducedthat need to be monitored? • Look for the anomalies and outliers. We can learn more from the unexpected than from the everyday occurrences.
- 11. PAGE13 DEVOPS INDONESIA Breaking your strategy • This first component is collection. Any performance monitoring strategy starts with data collection. If you can’t monitor it, you can’t manage it. To prevent visibility gaps, your performance-monitoring platform should be data agnostic, with high frequency polling down to the second. • Building the baseline. Once you’ve collected the broadest set of performance data at the required granularity, it’s time to establish a baseline for every metric you monitor. It’s imperative to understand what “normal” conditions look like at any given moment, especially in dynamic virtualized environments. Baselines then become your basis for aneffective alerting method. • Setting alerts. In addition to setting static thresholds, it’s important to establish alerts based on deviation from baseline performance. Beyond a daily alert about high bandwidth usage, you need to know when an unexpected spike occurs during working hours due to a unique user-initiated action
- 12. PAGE14 DEVOPS INDONESIA Breaking your strategy cont.. • Creating reports. Canned reports reveal most utilized interfaces, highest packet loss and other key metrics. Yet, they don’t allow for the level of manipulation often required to troubleshoot performance issues • Analyzing data. The goal is to find actionable insight needed to proactively detect and avoid performance events, understand correlations that can help fine-tune infrastructure and make more informed forecasting decisions about the impact infrastructure has on the business. • Sharing results. Once armed with the strategic ability to collect, baseline, alert, report and analyze your performance data, its time to share insights with team members who can truly benefit from monitoring results.
- 13. PAGE15 DEVOPS INDONESIA ITOM Standarization Performance Monitoring Capacity Forecasting Business Insight Services Availability Security Event Domain Controller SMTP Centralize Log Server NTP Server Lifecycle Management Antivirus Agent Password Manager Standard Hardening Config Management New Deployment
- 14. PAGE16 DEVOPS INDONESIA Performance Monitoring Capacity Forecasting Business Insight Services Availability Data Center Devices Server Storage Network Platform Application Operating System Virtualization Container Application Database Public Service URL www.biznetgio.com Portal.neo.id cloud.biznetgiocloud.com Security & Compliance HIDS SIEM Compliance Vunl Management NIDS Automatic Alert, Call, Paging and Notification Security Event Automatic Escalation Management L1 L2 L3 ITOM Strategy
- 15. PAGE17 DEVOPS INDONESIA Monitoring, Alerting, and Capacity Planning No Category Allerting SIEM Services Availability Perfomance Monitoring Capacity Forecasting Sysops Network Data Center Sysops Network Data Center Sysops Network Data Center Bussiness /Sales 1 Visual Dashboard & Monitoring 1 a 2 Public Service URL Monitoring 1 a 3 Notification Tools 1 1st Layer Notification 2 2nd Layer Notification 3 Management Escalation Prepare Your Checklist
- 16. PAGE18 DEVOPS INDONESIA Data Center Monitoring - element • Asset configuration and change management • Know trends in data center for a better capacity planning • Sensing and monitoring temperature • Establish precision cooling control • Fluid and humidity detection • Integrate the environment with other sensors • Managing alarms and notifications • Establish Data center Environmental Monitoring Systems (EMS)
- 17. PAGE19 DEVOPS INDONESIA Data Center monitoring best practice • Testing and Maintenance • Be ready for emergencies • Have a backup plan ready • Have an automated recovery plan
- 18. PAGE20 DEVOPS INDONESIA Data Center monitoring – Temperature & Environment
- 19. PAGE21 DEVOPS INDONESIA Data Center monitoring – Perfomance
- 20. PAGE22 DEVOPS INDONESIA Data Center monitoring – Perfomance
- 21. PAGE23 DEVOPS INDONESIA Data Center monitoring – Business Insight
- 22. PAGE24 DEVOPS INDONESIA Data Center monitoring – Business Insight
- 23. PAGE25 DEVOPS INDONESIA Application and Platform Application monitoring is a process that ensures that a software application processes and performs in an expected manner and scope. This technique routinely identifies, measures and evaluates the performance of an application and provides the means to isolate and rectify any abnormalities or shortcomings.
- 24. PAGE26 DEVOPS INDONESIA Application and Platform Monitoring Element • Application response time • API perfomance • Service Bus perfomance • Processing perfomance
- 25. PAGE27 DEVOPS INDONESIA Database monitoring Measuring database attributes to monitor application productivity. • Get comprehensive insight into the health and performance of your databases • Track slow queries, expensive statements, response times, failures, page faults, Dead lock details and a whole lot of KPIs. • Monitor, easily identify and solve database issues that impact application performance.
- 26. PAGE28 DEVOPS INDONESIA Microservices monitoring Modern microservices are displacing monolithic application stacks, accelerating development and deployment speed, simplify scaling and more. With all of its advantages, a microservices-approach increases the complexity of monitoring and troubleshooting applications
- 27. PAGE29 DEVOPS INDONESIA Visualize Microservice Interaction Monitor’s transparent instrumentation observes all activity at a system call level. This helps you instantly see how your microservices interact and provides key metrics like response time, network traffic and resource utilization. Dynamic topology maps help you identify bottlenecks, visualize your application flow and drill down to the process level to understand what is running and where.
- 30. PAGE32 DEVOPS INDONESIA Monitor and troubleshoot transactions in complex distributed systems
- 34. PAGE36 DEVOPS INDONESIA Public Service Monitoring • Monitoring your public service from multiple geo location • Monitoring SSL expiration and domain expiration • Website Uptime & Performance Monitoring
- 35. PAGE37 DEVOPS INDONESIA Public Service Monitoring
- 36. PAGE38 DEVOPS INDONESIA Public Service Monitoring ProductName Rank 1-5 Price/Month (USD) Number Monitoring Check Internal Synthetic application SSL Check Status Page Panopta 3 6 1 1 Minutes Yes Yes Yes Updown.io 2.5 67.18 100 1 Minutes n/a Yes Yes Nodeping 2 15 200 1 Minutes n/a n/a Yes Pingdom 4 89.95 80 1 Minutes Yes Yes Yes Statuscake 3.5 20.41 100 1 Minutes Yes Yes Yes pingometer 3 29 15 1 Minutes n/a Yes Yes Monitis 5 136.95 100 1 Minutes Yes Yes n/a uptimerobot 3 8.5 100 1 Minutes n/a Yes Yes uptimerobot 3 Free 50 5 Minutes n/a No Yes serverguard24 4 129.9 200 1 Minutes Yes Yes Yes
- 37. PAGE39 DEVOPS INDONESIA Security Monitoring • Intrusion Detection - Detect threats and suspicious activities early with host, network, and cloud IDS. • Vulnerability Assessment - Identify vulnerabilities and AWS configuration issues that put your organization at risk. • Event Correlation - Automate event correlation and security analysis with AlienVault Threat Intelligence. • Log Management - Automate log collection and analysis and securely store raw logs in the AlienVault Cloud. • Compliance Reporting - Be audit-ready sooner with pre-built compliance reporting templates.
- 40. PAGE42 DEVOPS INDONESIA Paging, Alert and Notification When you are auditing or writing alerting rules, consider these things to keep your oncall rotation happier: • Pages should be urgent, important,actionable,and real. • They should represent either ongoing or imminent problems with your service. • Err on the side of removing noisy alerts – over monitoring is a harder problem to solve than under monitoring. • You should almost always be able to classify the problem into one of: availability & basic functionality; latency; correctness (completeness, freshness and durability of data); and feature specific problems. • Symptoms are a better way to capture more problems more comprehensively and robustly with less effort
- 41. PAGE43 DEVOPS INDONESIA Paging, Alert and Notification
- 42. PAGE44 DEVOPS INDONESIA Paging, Alert and Notification
- 43. PAGE45 DEVOPS INDONESIA Paging, Alert and Notification
- 46. PAGE48 DEVOPS INDONESIA Are You Awesome? We are Hiring ! https://www.linkedin.com/company/biznet-gio-cloud/jobs/
- 47. PAGE49 DEVOPS INDONESIA Alone We are smart, together We are brilliant THANK YOU ! Quote by Steve