Monitoring First - Instrumenting Your Entire Stack for the Ultimate in Observability

•

0 likes•304 views

1 PM EDT The Solarwinds Monitoring Cloud companies are experts in how to do monitoring at scale in very high throughput environments. During our time running on the cloud, we’ve used many DevOps concepts, including automation, to build a fully-instrumented stack from infrastructure all the way through the application that allows us to have observability into all areas of the stack and from multiple angles.

Software

Monitoring First: Instrumenting Your
Entire Stack for the Ultimate in
Observability
Dave Mangot
Head of Site Reliability Engineering,
SolarWinds Cloud Companies
@davemangot

© 2016 SOLARWINDS WORLDWIDE, LLC. ALL RIGHTS RESERVED.
ABOUT ME
•
•
•
•
5/9/16 1

3
but we wouldn’t be upset if you did :)
You do not need to purchase these
solutions from SolarWinds!
Disclaimer:

Data Driven
4
If we have data, let’s look at data. If all we
have are opinions, let’s go with mine.”
- Jim Barksdale

MDD
• Instrumentation-as-Code
• Single Source of Truth
7
By Minesweeper (Own work) [CC BY-SA 4.0 (http://creativecommons.org/licenses/by-sa/4.0)], via Wikimedia Commons

MDD
• Instrumentation-as-Code
• Single Source of Truth
• Developers Curate Visualizations and Alerts
8

MDD
• Instrumentation-as-Code
• Single Source of Truth
• Developers Curate Visualizations and Alerts
• Alert on What You See
9

MDD
• Instrumentation-as-Code
• Single Source of Truth
• Developers Curate Visualizations and Alerts
• Alert on What You See
• Don’t Measure Everything
10

"Just because you can measure
everything doesn't mean that you should."
—W. Edwards Deming
11

Nagios, etc.
Is a port listening?
Is that what I really care about?
15

Nagios, etc.
Is a port listening?
Is that what I really care about?
Are the number of requests over a period of time below a threshold?
What are my average # of requests?
What are the min/max/std dev of latency?
16

2nd Way of DevOps
The Second Way is about creating the right to left feedback loops. The goal of almost any process
improvement initiative is to shorten and amplify feedback loops so necessary corrections can be continually
made.
The outcomes of the Second Way include understanding and responding to all customers, internal and
external, shortening and amplifying all feedback loops, and embedding knowledge where we need it.
18http://itrevolution.com/the-three-ways-principles-underpinning-devops/

19
You can’t improve what you don’t
measure

Monitoring Cake
• Librato Agent
• Cloudwatch
• Statsite
• Syslog-ng
• Tracelytics
23
By Przykuta (Own work) [CC BY-SA 3.0 (http://creativecommons.org/licenses/by-sa/3.0)], via Wikimedia Commons

Application Instrumentation
33
# Timing a potentially latent operation with custom instrumentation
statsd.time("api.measures.source_match_build.time") do
metric_source_match_build(active, explicit, wildcards, negates)
end

Logging
37
•Application Development
•Troubleshooting
•Deployments
•Search Alerts

Application Development/Troubleshooting
38

© 2016 SOLARWINDS WORLDWIDE, LLC. ALL RIGHTS RESERVED.
Total Observability
5/9/16 46
Distributed
Tracing
Logging
Metrics
Uptime
MDD

Try for yourself
47
www.solarwinds.com/cloud-monitoring

The evolution of the Web over the past few years has deeply immersed us into a new era of engagement. Enterprises today are continually striving to achieve higher levels of customer engagement across all online channels – the Web, mobile, social media, and more. Traditional Web CMS solutions are falling short, so leading enterprises are starting to adopt Web Experience Management (WEM) solutions to address the rapidly changing needs in this new era. Over the last two years, Rivet Logic has helped several major enterprises build and deploy new and exciting WEM solutions into production. Based on our experience, we have distilled the essence of success to seven key ingredients.

QGIS LTR is making the world a better place by Saber Razmjooei

Shaun Lewis

Adversary Driven Defense in the Real World

James Wickett

AppSec Fast and Slow: Your DevSecOps CI/CD Pipeline Isn’t an SSA Program

Denim Group

With all the focus on DevSecOps and integrating security into Continuous Integration/Continuous Delivery (CI/CD) pipelines, some teams may be lured into thinking that the entirety of a Software Security Assurance (SSA) program can be baked into these pipelines. While integrating security into CI/CD offers many benefits, it is critical to understand that a full SSA program encompasses a variety of activities – many of which are incompatible with run time restrictions and other constraints imposed by these pipelines. This webinar looks at the breadth of activities involved in a mature SSA program and steps through the aspects of a program that can be realistically included in a pipeline, as well as those that cannot. It also reviews how these activities and related tooling have evolved over time as the application security discipline has matured and as development teams started to focus on cloud-native development techniques and technologies.

6 ways DevOps helped PrepSportswear move from monolith to microservices

Dynatrace

Like a lot of online businesses today, PrepSportswear’s success is 100% dependent on the availability, scalability and performance of their digital online services. If the website is down, the business stops. They knew they had to transform their business from that of a retailer with a website to a high caliber IT company that sells products online. In these webinar slides, Richard Dominguez, PrepSportswear’s Developer in Operations, shares their journey. They transformed from a team operating a monolithic app using waterfall development methodology on an old, hard to maintain code base, to a modern IT organization applying new practices from Agile development, DevOps and a Service-Oriented Architectural approach. The Impact? PrepSportswear’s Most Successful Online Holiday Shopping Season in Company History! Join us to: Learn how to identify if you are running a monolithic application that is dragging you down. Get tips on hiring the right people to inject a DevOps cultural mindset into your organization. Understand how to break the monolith into smaller pieces that support key lines of business. Discover where to automate monitoring into your pipeline and platform. Identify metrics for individual stakeholders (dev vs. test vs. business). Go forward, celebrate, learn from, and repeat success! Richard will be joined by Andreas Grabner, Performance Advocate at Dynatrace who will support why monitoring, application and end user metrics have to be a key part of your own transformation! Richard Dominguez has 9+ years’ experience as both a System Analyst and Software Developer in Test. He has worked on many high profile projects in Microsoft such as Hyper-V, Windows 7 Client Performance, and Windows Phone Services. Richard now works at PrepSportswear as the company’s DevOps engineer. His responsibilities include site reliability, external synthetic testing, release management and overall site performance. Andreas Grabner has 15+ years’ experience as an architect and developer in the Java and .NET space. In his current role, Andi works as an advocate for high performing applications in both the development and operations areas. He is a regular expert and contributor to large performance communities, a frequent speaker at technology conferences and regularly publishes articles blogs on blog.dynatrace.com

DevOps and the cloud: all hail the (developer) king - Daniel Bryant, Steve Poole

JAXLondon_Conference

OWASP San Antonio Meeting 10/2/20

Denim Group

Title: AppSec Fast and Slow: Your DevSecOps CI/CD Pipeline Isn’t an SSA Program Abstract: With all the focus on DevSecOps and integrating security into Continuous Integration/Continuous Delivery (CI/CD) pipelines, some teams may be lured into thinking that the entirety of a Software Security Assurance (SSA) program can be baked into these pipelines. While integrating security into CI/CD offers many benefits, it is critical to understand that a full SSA program encompasses a variety of activities – many of which are incompatible with run time restrictions and other constraints imposed by these pipelines. This webinar looks at the breadth of activities involved in a mature SSA program and steps through the aspects of a program that can be realistically included in a pipeline, as well as those that cannot. It also reviews how these activities and related tooling have evolved over time as the application security discipline has matured and as development teams started to focus on cloud-native development techniques and technologies. Speaker: Dan Cornell Bio: A globally recognized application security expert, Dan Cornell holds over 15 years of experience architecting, developing and securing web-based software systems. As Chief Technology Officer and Principal at Denim Group, Ltd., he leads the technology team to help Fortune 500 companies and government organizations integrate security throughout the development process.

JAXLondon 2015 "DevOps and the Cloud: All Hail the (Developer) King"

Daniel Bryant

Last year we talked about DevOps, what it was, why it was important and how to get started. Boy, was it scary. Now we’re wiser. More battle-scarred. The scale of the challenge for application writers exploiting cloud and DevOps is clearer, but so is the path forward. Understanding the DevOps approach is important but equally you must understand specific deployment technologies. How to exploit them and how they effect the design of applications. Whether creating simple applications or sophisticated microservice architectures many of the challenges are the same. Presented at JAXLondon 2015 with Steve Poole

In this talk you will learn how strategic tools like Wardley Maps, the C4 model and DDD’s strategic design helped a struggling CTO to fight against a crumbling monolith and the organizational practices that allowed its creation. Among other things we will cover: * How to plan, communicate and challenge strategies. * Why strategy and thinking strategically is important for software developers. * High-level overview of Simon Brown’s C4 Model * High-level overview of DDD’s strategic design * DDD Context Mapping * High-level overview Wardley Maps. * Wardley Maps: Landscape. * FUN random facts about software development in startups :)

QCon SF 2017 - Microservices: Service-Oriented Development

Ambassador Labs

Conventional wisdom is that microservices is an architecture that is the spiritual successor to service-oriented architecture. While true, this myopic view of microservices ignores some of the profound workflow shifts in today’s microservices organizations. The reality is that microservices is an architecture _and_ workflow. In this talk, we’ll introduce the workflow of service-oriented development. Rafael will talk about how the real goal of microservices is to break up a monolithic development workflow. We’ll show you how, by breaking up your workflow, you can build software that lets you move fast and make things.

Secure Your DevOps Pipeline Best Practices Meetup 08022024.pptx

lior mazor

State of microservices 2020 by tsh

mustafa sarac

Ship code like a keptn

Rob Jahn

Gaining visibility into your Openshift application container platform with Dy...

Dynatrace

AWS Community Day: From Monolith to Microservices - What Could Go Wrong?

Phuong Mai Nguyen

Almost every tech organisation right from start-ups to unimaginably big ones have had monolithic applications in the past and have moved on to nimbler approaches like microservices, making use of powerful cloud technologies. But not every organisation has made this move yet, with most of them still in analysing phase. If you are part of this or interested in exploring how major players in the industry have managed to convert monoliths to microservices, join us in the talk to get an in-depth knowledge about things that could go wrong and how to make the right choices using AWS services. On top of practical techniques and real-life case studies, we will also be exploring agile methodologies and discuss if microservices are the right choice for your field of work.

The LCG Digital Transformation Maturity Model

Lima Consulting Group

Welcome to the Metrics

VMware Tanzu

Crunching the numbers: Open Source Community Metrics at OSCON

Dawn Foster

Co-presented with Dave Neary at OSCON 2011. Every community manager knows that community metrics are important, but how do you come up with a plan and figure out what you want to measure? Most community managers have their own set of hacky scripts for extracting data from various sources after they decide what metrics to track. There is no standardised Community Software Dashboard you can use to generate near-real-time stats on your community growth. Like most open source projects, we have diverse community infrastructure for MeeGo, including Mailman, Drupal, Mediawiki, IRC, git, OpenSuse Build Service, Transifex and vBulletin. We wanted to unify these sources together, extract meaningful statistics from the data we had available to us, and present it to the user in a way that made it easy to see if the community was developing nicely or not. Building on the work of Pentaho, Talend, MLStats, gitdm and a host of others, we built a generic and open source community dashboard for the MeeGo project, and integrated it into the website. The project was run in the open at http://wiki.meego.com/Metrics/Dashboard and all products of the project are available for reuse. This presentation will cover the various metrics we wanted to measure, how we extracted the data from a diverse set of services to do it, and more importantly, how you can do it too.

Crunching the numbers: Open Source Community Metrics

Dawn Foster

Every community manager knows that community metrics are important, but how do you come up with a plan and figure out what you want to measure? Most community managers have their own set of hacky scripts for extracting data from various sources after they decide what metrics to track. There is no standardised Community Software Dashboard you can use to generate near-real-time stats on your community growth. Like most open source projects, we have diverse community infrastructure for MeeGo, including Mailman, Drupal, Mediawiki, IRC, git, OpenSuse Build Service, Transifex and vBulletin. We wanted to unify these sources together, extract meaningful statistics from the data we had available to us, and present it to the user in a way that made it easy to see if the community was developing nicely or not. Building on the work of Pentaho, Talend, MLStats, gitdm and a host of others, we built a generic and open source community dashboard for the MeeGo project, and integrated it into the website. The project was run in the open at http://wiki.meego.com/Metrics/Dashboard and all products of the project are available for reuse. This presentation will cover the various metrics we wanted to measure, how we extracted the data from a diverse set of services to do it, and more importantly, how you can do it too.

An Introduction to RedMonk Analytics

sogrady

Simplify Troubleshooting With Context in Your Logs

SolarWinds

Dipping Your Toes Into Cloud Native Application Development

Matthew Farina

Presented at CloudDevelop 2016 Building cloud native applications in containers is a new hot topic. Netflix and Google are two prime examples that have been doing it successfully for some time. Some of the new exciting projects like Docker and Kubernetes are focused on cloud native applications in containers. There are supposed to be numerous benefits including the ability to scale applications out easily while doing development on small systems like laptops, the ability for the system to handle some operational problems, and the capability to safely deploy updates to production many times per day. But, what does this look like in practice and how do you start the move to cloud native and containerized applications? In this session we'll look at what makes up a cloud native application, how they work, and how you can start small. We'll look at applications from an architecture and process point of view along with how you can deploy them to AWS, Azure, or Google Cloud. You'll walk away ready to start development on a cloud native app.

DSC UTeM DevOps Session#1: Intro to DevOps Presentation Slides

DSC UTeM

DevOps has been such a buzzword in the IT field nowadays. If you look into job postings, you might be surprised to find terms like "work with DevOps team", "work in an agile team" etc. What is DevOps? What is agile? And why all these? 樂 Join us on 24 May 2021, where we have a short session to explore on the events that led to the trend nowadays We will be exploring on the current trends, tech stacks and the existence of DevOps itself! 朗 Mark this date on your calendar and we'll see you there! * Note: This is an introductory "brief overview" session that gives you context on our upcoming events. Slides by KwongTN.

Microservice pitfalls

Mite Mitreski

Mer: How the community innovatesCarsten Munk

Clone Clone Make: a better way to build

DanHeidinga

Reveal the Security Risks in the software Development Lifecycle Meetup 060320...

lior mazor

Stay safe, grab a drink and join us virtually for our upcoming "Reveal the Security Risks in the Software Development Lifecycle" Meetup to learn how to find application security threats, issues in software development life cycle, build mature application security incident response processes and implement application security posture management. Agenda: 17:00 - 17:05 - 'Opening words' - by Gary Berman (Cyber Heroes Network) 17:05 - 17:35 - 'Why securing the SDLC fails at scale' - by Liav Caspi (Co-Founder & CTO at Legit Security) 17:35 - 18:05 - 'The Real AppSec Issues' - by Josh Grossman (CTO at BounceSecurity) 18:05 - 18:35 - 'Application security and IR process' - by Vitaly Davidoff (Application Security Lead at JFrog) 18:35 - 19:00 - 'The ASPM way - a new approach' - by Liav Caspi (Co-Founder & CTO at Legit Security)

Embracing the Rise of SecDevOps

Tom Cappetta

Exploring Prometheus: Combining Metrics and Alerting to Improve Incident Mana...

Monitoring First - Instrumenting Your Entire Stack for the Ultimate in Observability

Recommended

Recommended

More Related Content

Similar to Monitoring First - Instrumenting Your Entire Stack for the Ultimate in Observability

Similar to Monitoring First - Instrumenting Your Entire Stack for the Ultimate in Observability (20)

More from Deborah Schalm

More from Deborah Schalm (20)

Recently uploaded

Recently uploaded (20)

Monitoring First - Instrumenting Your Entire Stack for the Ultimate in Observability