Modern Monitoring - devopsdays Cuba

•

1 like•545 views

This document discusses monitoring in the context of containers and microservices. It provides an overview of the history and evolution of containers from chroot and jails to Docker. It outlines different approaches to monitoring from manual to reactive to proactive. It discusses challenges of monitoring ephemeral infrastructure and the need for automation. It also covers architectural considerations for monitoring containers and microservices as well as specific techniques for collecting events, logs and metrics from containerized applications.

@bridgetkromhout
lives:
Minneapolis,
Minnesota
works:
Pivotal
podcasts:
Arrested
DevOps
organizes:
devopsdays
Bridget Kromhout

@bridgetkromhout
“…measuring value, throughput,
and performance…
revenue rather than cost”
The Art of Monitoring (2016)
James Turnbull
artofmonitoring.com

@bridgetkromhout
Why monitor?
The Art of Monitoring (2016)
James Turnbull
artofmonitoring.com

@bridgetkromhout
Why monitor?
Two customers of monitoring with diﬀerent needs.
The Art of Monitoring (2016)
James Turnbull
artofmonitoring.com

@bridgetkromhout
Why monitor?
The business:
UX data for product &
engineering
Measure value delivered
Two customers of monitoring with diﬀerent needs.
The Art of Monitoring (2016)
James Turnbull
artofmonitoring.com

@bridgetkromhout
Why monitor?
The business:
UX data for product &
engineering
Measure value delivered
Information Technology:
Visibility into state and failures
Product & engineering decisions
Measure success of projects
Two customers of monitoring with diﬀerent needs.
The Art of Monitoring (2016)
James Turnbull
artofmonitoring.com

@bridgetkromhout
Method Type Focus
Manual
Checklists, simple
scripts
“Tribal knowledge” of
things broken in the past
Minimizing downtime,
managing assets
Reactive
disk, CPU,
memory checks
Thresholds, alerting;
updated after incidents
Availability, assets,
some customer
experience
Proactive
Automatic;
required for
deployment
Alerting includes
context, automated
remediation
Application
performance,
business outcomes
Monitoring Maturity Model
The Art of Monitoring (2016) - James Turnbull - artofmonitoring.com

@bridgetkromhout
Monitoring
Maturity
Model
The Art of Monitoring (2016)
James Turnbull
artofmonitoring.com

@bridgetkromhout
Typical reactive notiﬁcation
The Art of Monitoring (2016) - James Turnbull - artofmonitoring.com

@bridgetkromhout
Better notiﬁcations
Actionable
Provide necessary context
Prevent alert fatigue
The Art of Monitoring (2016) - James Turnbull - artofmonitoring.com
(in the brave new cloudy-with-a-chance-of-containers world)

@bridgetkromhout
“Nothing’s the same anymore.”
Jeﬀrey Sinclair
Babylon 5

@bridgetkromhout
containers:
dawn of the third age?

@bridgetkromhout
1979 (Version 7) 
1982 (BSD)
20042000
chroot FreeBSD jails Solaris Zones LXC
2008
A Brief History of Containers, Part 1
(before docker era)

@bridgetkromhout
A Brief History of Containers, Part 2
(docker common era)
2011
Cloud Foundry
2013
Docker
2014
Rocket (later rkt)
2015
Open Container
Initiative

@bridgetkromhout (autoscaling EC2 instances up & down over time)
ephemeral infrastructure

@bridgetkromhout
“cattle,
not pets”
(even
adorable
Attack
Kittens)

@bridgetkromhout
• cloud-based infrastructure
• static checks or thresholds no longer scale
• manual conﬁguration no longer scales
“cattle, not pets”

@bridgetkromhout
automation: solution? or problem?
(it depends)

@bridgetkromhout
architectural considerations

@bridgetkromhout
consistent development repeatable deployment
Why containers?

@bridgetkromhout
Monitoring containers
The Art of Monitoring (2016)
James Turnbull
artofmonitoring.com

@bridgetkromhout
Events - changes in your environment
Logs - diagnosis & troubleshooting
Metrics - seeing state in real time for
anomaly detection & pattern analysis

@bridgetkromhout
The Art of Monitoring (2016)
James Turnbull
artofmonitoring.com
Open source & SaaS
• choose TCP over UDP
• conﬁgurable granularity
• “push” vs “pull”

@bridgetkromhout
“Almost every task run
under Borg contains a
built-in HTTP server that
publishes information
about the health of the
task and thousands of
performance metrics”
Large-scale cluster management at Google with Borg - Verma et al. 2015
“Almost every task run
under Borg contains a
built-in HTTP server that
publishes information
about the health of the
task and thousands of
performance metrics”

@bridgetkromhout
Image credit: James Ernest

@bridgetkromhout
Security Pros & ConsContainers limit attack
surface & emitters don’t
need ports open
but…
Microservices move IPC
to network transactions &
complexity is distributed

@bridgetkromhout
removed restored
Information radiators

@bridgetkromhout
monitoring: the old way

@bridgetkromhout
monitoring: the new way

In pre-production, there’s lots of tools that help optimizing your code: debuggers, CI/CD, load tests, etc. There’s even tools that automatically deploy them into production. Plus, engineers usually have a whole sprint as a time frame. Once you’re in production, things are a bit different and all that convenience is just not there for operators. They need to be able to pinpoint trouble spots within minutes. They have to identify the handful of bad requests out of thousands that allows for reproduction of the problem. And then, they are finally required to hand all that information over to the developers as convenient and as soon as possible. And nothing of that is automated. Performance monitoring, call-tracing and visualization are the concepts any developer should know about to be able to provide as much insight as possible into running systems. This session introduces open-source tools that allow devs and ops to work together much closer. To name just a few: * statsd / collectd * Zipkin * Spring-Cloud Sleuth * and some more For the sake of completeness and to also cover the Enterprise user-space, the main commercial vendors in that space will also be mentioned real quick. After that session, you’ll see new ideas popping up inside your head and already have all the knowledge you need to directly jump into planning and implementation.

Mongodb meetup

Eytan Daniyalzade

Containers will not fix your broken culture (and other hard truths) - devopsd...

bridgetkromhout

PyData NYC 2015 - Automatically Detecting Outliers with Datadog

Datadog

Monitoring even a modestly-sized systems infrastructure quickly becomes untenable without automated alerting. For many metrics it is nontrivial to define ahead of time what constitutes “normal” versus “abnormal” values. This is especially true for metrics whose baseline value fluctuates over time. To make this problem more tractable, Datadog provides outlier detection functionality to automatically identify any host (or group of hosts) that is behaving abnormally compared to its peers. These slides cover the algorithms we use for outlier detection, and show how easy they are to implement using Python. This presentation also covers the lessons we've learned from using outlier detection on our own systems, along with some real-life examples on how to avoid false positives and negatives. Learn more at www.datadoghq.com.

Trace everything, when APM meets SysAdmins

Sysdig

ContainerDays NYC 2016: "Observability and Manageability in a Container Envir...

DynamicInfraDays

Distributed Tracing

Kevin Ingelman

Monitoring distributed (micro-)services

Rafael Winterhalter

micro(-service) components. While this approach to building software - if done correctly - can improve a system's maintainability and scalability, distributed applications also introduce challanges for operations. Where monolithic applications typically offered direct access to extensive monitoring dashbords, such easy overview is no longer available when multitude services are loosly connected over a network. But how to keep track of a system of such dynamic state? Distributed tracing is a method of connecting interaction of different services on a network. Collecting and processing such tracing information again allows for the observation of a distributed system in its entirety. This talk shares the presenter's insights gained by working on the JVM-support of distributed tracing for the APM tool Instana. Doing so, it introduces the landscape of distributed tracing on the JVM, discussing popular approaches such as Dapper, Zipkin or Brave/OpenTracing. In the process, it is discussed how byte code instrumentation can be used to capture systems without requiring a user to set up the software under observation. The presentation finishes with a discussion of typical problems of distributed tracing solutions and carefully examines the performance penalties APM tools entail.

Tracing 2000+ polyglot microservices at Uber with Jaeger and OpenTracing

Yuri Shkuro

Microservices Application Tracing Standards and Simulators - Adrians at OSCON

Adrian Cockcroft

Distributed Tracing with OpenTracing, ZipKin and Kubernetes

Container Solutions

Big Data perspectiva DevOps

Enrique Carbonell

En la actualidad el "Big Data" se ha convertido en una palabra de moda que genera confusión en muchos escenarios. Los conceptos que usualmente se le asocian son: gran cantidades de datos, analítica de redes sociales, modernas herramientas para gestionar datos, datos en tiempo real, entre otros. Independientemente de como lo catalogamos, las empresas necesitan comprender y explorar cómo procesar y analizar de nuevas formas la variedad de información que tienen a su disposición. En muchas de las investigaciones aparecen referencias de tecnologías como Spark y Cassandra que se mencionan como un recurso externo dado por sentado su existencia. Brindar una solución que incluya todos los componentes de procesamiento y análisis puede llegar a ser un reto desde la perspectiva de infraestructura que se requiere provisionar, monitorizar y gestionar por el personal de operaciones. Por otra parte crear la infraestructura de apoyo al desarrollo de estas aplicaciones bajo conceptos como inmutabilidad, consistencia y disponibilidad son elementos que se deben tener en cuenta desde las primeras fases de diseño de una solución. Ver el Big Data desde la perspectiva de DevOps en aras de viabilizar el desarrollo y liberación de aplicaciones y servicios con mayor velocidad es el tema central de esta presentación donde se abordaran conceptos y métodos generales, tecnologías y frameworks recomendados.

More nines for your dimes: Improving availability and lowering costs using au...

Amazon Web Services

Running your Amazon EC2 instances in Auto Scaling groups allows you to improve your application's availability right out of the box. Auto Scaling replaces impaired or unhealthy instances automatically to maintain your desired number of instances (even if that number is one). You can also use Auto Scaling to automate the provisioning of new instances and software configurations as well as to track of usage and costs by app, project, or cost center. Of course, you can also use Auto Scaling to adjust capacity as needed - on demand, on a schedule, or dynamically based on demand. In this session, we show you a few of the tools you can use to enable Auto Scaling for the applications you run on Amazon EC2.

Modern Monitoring - devops roadtrip

bridgetkromhout

Beyond Ad-hoc Automation: Leveraging Structured Platforms

bridgetkromhout

I volunteer as tribute: the future of oncall (Uptime)

bridgetkromhout

The Promise of a Cloud Native Platform (Code Freeze conf)

bridgetkromhout

Beyond Ad-hoc Automation - Leveraging Structured Platforms (Agile Day Twin Ci...

bridgetkromhout

Azure tales: a real world CQRS and ES Deep Dive - Andrea Saltarello

ITCamp

Both CQRS and Event Sourcing are by no means “new stuff” anymore, yet a lot can be told about how to use Azure’s PaaS to implement such patterns and unleash their power. The ingredients are: DocumentDB as the event storage, Service Bus as the events’ dispatcher, Could Services/Service Fabric as the scalable, fault tolerant business logic container, SQL Azure as the read model and ASP .NET Core as the application framework used to implement views and back-end services. Eager to know the recipe? Don’t miss this talk then.

The Fine Art of Time Travelling - Implementing Event Sourcing - Andrea Saltar...

ITCamp

If there is a common practice in architecting software systems, it is to have them store the last known state of business entities in a relational database: though widely adopted and effectively supported by existing development tools, this practice trades the easiness of implementation with the cost of losing the history of such entities. Event Sourcing provides a pivotal solution to this problem, giving systems the capability of restoring the state they had at any given point in time. Furthermore, injecting mock-up events and having them replayed by the business logic allows for an easy implementation of simulations and “what if” scenarios. In this session, Andrea will demonstrate how to design time travelling systems by examining real-world, production-tested solutions.

Cloud, Containers, Kubernetes (YOW Melbourne 2018)

bridgetkromhout

Viewers also liked

Distributed: of systems and teams (Agile Chicago)

bridgetkromhout

Pushing the hassle from production to developers. Easily

Martin Gutenbrunner

Mongodb meetup

Eytan Daniyalzade

Containers will not fix your broken culture (and other hard truths) - devopsd...

bridgetkromhout

PyData NYC 2015 - Automatically Detecting Outliers with Datadog

Datadog

Trace everything, when APM meets SysAdmins

Sysdig

ContainerDays NYC 2016: "Observability and Manageability in a Container Envir...

DynamicInfraDays

Distributed Tracing

Kevin Ingelman

Monitoring distributed (micro-)services

Rafael Winterhalter

Tracing 2000+ polyglot microservices at Uber with Jaeger and OpenTracing

Yuri Shkuro

Microservices Application Tracing Standards and Simulators - Adrians at OSCON

Adrian Cockcroft

Distributed Tracing with OpenTracing, ZipKin and Kubernetes

Container Solutions

Big Data perspectiva DevOps

Enrique Carbonell

More nines for your dimes: Improving availability and lowering costs using au...

Amazon Web Services

Viewers also liked (14)

Distributed: of systems and teams (Agile Chicago)

Pushing the hassle from production to developers. Easily

Mongodb meetup

Containers will not fix your broken culture (and other hard truths) - devopsd...

PyData NYC 2015 - Automatically Detecting Outliers with Datadog

Trace everything, when APM meets SysAdmins

ContainerDays NYC 2016: "Observability and Manageability in a Container Envir...

Distributed Tracing

Monitoring distributed (micro-)services

Tracing 2000+ polyglot microservices at Uber with Jaeger and OpenTracing

Microservices Application Tracing Standards and Simulators - Adrians at OSCON

Distributed Tracing with OpenTracing, ZipKin and Kubernetes

Big Data perspectiva DevOps

More nines for your dimes: Improving availability and lowering costs using au...

Similar to Modern Monitoring - devopsdays Cuba

Modern Monitoring - devops roadtrip

bridgetkromhout

Beyond Ad-hoc Automation: Leveraging Structured Platforms

bridgetkromhout

I volunteer as tribute: the future of oncall (Uptime)

bridgetkromhout

The Promise of a Cloud Native Platform (Code Freeze conf)

bridgetkromhout

Beyond Ad-hoc Automation - Leveraging Structured Platforms (Agile Day Twin Ci...

bridgetkromhout

Azure tales: a real world CQRS and ES Deep Dive - Andrea Saltarello

ITCamp

The Fine Art of Time Travelling - Implementing Event Sourcing - Andrea Saltar...

ITCamp

Cloud, Containers, Kubernetes (YOW Melbourne 2018)

bridgetkromhout

Global C4IR-1 Masterclass Adryan - Zuehlke Engineering 2017

Justin Hayward

M2M for Java Developers: MQTT with Eclipse Paho - Eclipsecon Europe 2013

Dominik Obermaier

Talk from the EclipseCon 2013. Mobile devices like smartphones and tablet computers became an integral part of our modern world and single-board computers like Raspberry Pi are cheaper today than at any time before. Simple and open Machine-to-Machine (M2M) protocols like MQTT enable these devices to communicate in an efficient manner, even in scenarios with unreliable und instable networks. This talk shows how Eclipse Paho - an Eclipse umbrella project for M2M protocols - can be utilized for professional and personal projects to build efficient and scalable solutions for (mobile) devices.

IoT Day 2016: Cloud Services for IoT Semantic Interoperability

Mark Underwood

jSpring 2018 "Continuous Delivery Patterns for Modern Architectures and Java"

Daniel Bryant

Modern Java applications are moving towards component-based architectures, as seen in the mainstream embrace of self-contained systems (SCS), microservices, and serverless architecture. We all know the benefits of component-based architectures, but there are also many challenges to delivering such applications in a continuous, safe, and rapid fashion. Daniel Bryant shares a series of patterns to help you identify and implement solutions for continuous delivery of contemporary service-based architectures. Topics include: – The core stages in the component delivery lifecycle: Develop, test, deploy, operate, and observe – How contemporary architectures impact continuous delivery and how to ensure that this is factored into the design – Modifying the build pipeline to support testability and deployability of components (with a hat tip to Jez Humble’s and Dave Farley’s seminal work) – Commonality between delivery of SCS, microservices, and serverless components – Continuous delivery, service contracts, and end-to-end validation: The good, the bad, and the ugly – Validating NFRs within a service pipeline – Lessons learned in the trenches

Azure Microservices in Practice - Radu Vunvulea

ITCamp

Horacio Gonzalez - Monitoring OVH - Codemotion Amsterdam 2019

Codemotion

What to do when you must monitor the whole infrastructure of the biggest European hosting and cloud provider? How to choose a tool when the most used ones fail to scale to your needs? How to build an Metrics platform to unify, conciliate and replace years of fragmented legacy partial solutions? In this talk we will relate our experience building and maintaining OVH Metrics, the platform used to monitor all OVH infrastructure. We needed to go to places where most monitoring solutions hadn’t gone before, it needed to operate at the scale of the biggest European hosting and cloud providers.

IoT digital disruption and new IoT business models

IoTAnalytics

Bem2034

Lisa Harris

UXCON16 / AR in Industry 4.0 / Mauro Rubin + Carla Conca

Sketchin

Azure Microservices in Practice, Radu Vunvulea, ITCamp 2016

Radu Vunvulea

Zühlke Meetup - Mai 2017

Boris Adryan

Considerations for Abstracting Complexities of a Real-Time ML Platform, Zhenz...

HostedbyConfluent

Considerations for Abstracting Complexities of a Real-Time ML Platform, Zhenzhong XU | Current 2022 If you are a data scientist or a platform engineer, you probably can relate to the pains of working with the current explosive growth of Data/ML technologies and toolings. With many overlapping options and steep learning curves for each, it’s increasingly challenging for data science teams. Many platform teams started thinking about building an abstracted ML platform layer to support generalized ML use cases. But there are many complexities involved, especially as the underlying real-time data is shifting into the mainstream. In this talk, we’ll discuss why ML platforms can benefit from a simple and ""invisible"" abstraction. We’ll offer some evidence on why you should consider leveraging streaming technologies even if your use cases are not real-time yet. We’ll share learnings (combining both ML and Infra perspectives) about some of the hard complexities involved in building such simple abstractions, the design principles behind them, and some counterintuitive decisions you may come across along the way. By the end of the talk, I hope data scientists can walk away with some tips on how to evaluate ML platforms, and platform engineers learned a few architectural and design tricks.

Similar to Modern Monitoring - devopsdays Cuba (20)

Modern Monitoring - devops roadtrip

Beyond Ad-hoc Automation: Leveraging Structured Platforms

I volunteer as tribute: the future of oncall (Uptime)

The Promise of a Cloud Native Platform (Code Freeze conf)

Beyond Ad-hoc Automation - Leveraging Structured Platforms (Agile Day Twin Ci...

Azure tales: a real world CQRS and ES Deep Dive - Andrea Saltarello

The Fine Art of Time Travelling - Implementing Event Sourcing - Andrea Saltar...

Cloud, Containers, Kubernetes (YOW Melbourne 2018)

Global C4IR-1 Masterclass Adryan - Zuehlke Engineering 2017

M2M for Java Developers: MQTT with Eclipse Paho - Eclipsecon Europe 2013

IoT Day 2016: Cloud Services for IoT Semantic Interoperability

jSpring 2018 "Continuous Delivery Patterns for Modern Architectures and Java"

Azure Microservices in Practice - Radu Vunvulea

Horacio Gonzalez - Monitoring OVH - Codemotion Amsterdam 2019

IoT digital disruption and new IoT business models

Bem2034

UXCON16 / AR in Industry 4.0 / Mauro Rubin + Carla Conca

Azure Microservices in Practice, Radu Vunvulea, ITCamp 2016

Zühlke Meetup - Mai 2017

Considerations for Abstracting Complexities of a Real-Time ML Platform, Zhenz...

Recently uploaded

PHP Frameworks: I want to break free (IPC Berlin 2024)

Ralf Eggert

In this presentation, we examine the challenges and limitations of relying too heavily on PHP frameworks in web development. We discuss the history of PHP and its frameworks to understand how this dependence has evolved. The focus will be on providing concrete tips and strategies to reduce reliance on these frameworks, based on real-world examples and practical considerations. The goal is to equip developers with the skills and knowledge to create more flexible and future-proof web applications. We'll explore the importance of maintaining autonomy in a rapidly changing tech landscape and how to make informed decisions in PHP development. This talk is aimed at encouraging a more independent approach to using PHP frameworks, moving towards a more flexible and future-proof approach to PHP development.

FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf

FIDO Alliance

GridMate - End to end testing is a critical piece to ensure quality and avoid...

ThomasParaiso2

The Future of Platform Engineering

Jemma Hussein Allen

FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf

FIDO Alliance

Epistemic Interaction - tuning interfaces to provide information for AI support

Alan Dix

Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024 https://alandix.com/academic/papers/synergy2024-epistemic/ As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.

Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx

nkrafacyberclub

Video Streaming: Then, Now, and in the Future

Alpen-Adria-Universität

In his public lecture, Christian Timmerer provides insights into the fascinating history of video streaming, starting from its humble beginnings before YouTube to the groundbreaking technologies that now dominate platforms like Netflix and ORF ON. Timmerer also presents provocative contributions of his own that have significantly influenced the industry. He concludes by looking at future challenges and invites the audience to join in a discussion.

By Design, not by Accident - Agile Venture Bolzano 2024

Pierluigi Pugliese

Transcript: Selling digital books in 2024: Insights from industry leaders - T...

BookNet Canada

The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more. Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/ Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.

GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...

Neo4j

Leonard Jayamohan, Partner & Generative AI Lead, Deloitte This keynote will reveal how Deloitte leverages Neo4j’s graph power for groundbreaking digital twin solutions, achieving a staggering 100x performance boost. Discover the essential role knowledge graphs play in successful generative AI implementations. Plus, get an exclusive look at an innovative Neo4j + Generative AI solution Deloitte is developing in-house.

GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...

Neo4j

Sudheer Mechineni, Head of Application Frameworks, Standard Chartered Bank Discover how Standard Chartered Bank harnessed the power of Neo4j to transform complex data access challenges into a dynamic, scalable graph database solution. This keynote will cover their journey from initial adoption to deploying a fully automated, enterprise-grade causal cluster, highlighting key strategies for modelling organisational changes and ensuring robust disaster recovery. Learn how these innovations have not only enhanced Standard Chartered Bank’s data infrastructure but also positioned them as pioneers in the banking sector’s adoption of graph technology.

Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf

Paige Cruz

Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack. While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack. I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:

SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf

Peter Spielvogel

Building better applications for business users with SAP Fiori. • What is SAP Fiori and why it matters to you • How a better user experience drives measurable business benefits • How to get started with SAP Fiori today • How SAP Fiori elements accelerates application development • How SAP Build Code includes SAP Fiori tools and other generative artificial intelligence capabilities • How SAP Fiori paves the way for using AI in SAP apps

PCI PIN Basics Webinar from the Controlcase Team

ControlCase

Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf

91mobiles

LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...

DanBrown980551

Do you want to learn how to model and simulate an electrical network from scratch in under an hour? Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)! During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook. PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides: - A fully editable and extendable library for grid component modelling; - Visualization tools to display your network; - Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses; The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well. What you will learn during the webinar: - For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills; - For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.

Pushing the limits of ePRTC: 100ns holdover for 100 days

Adtran

FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf

FIDO Alliance

FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf

FIDO Alliance

Recently uploaded (20)

PHP Frameworks: I want to break free (IPC Berlin 2024)

FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf

GridMate - End to end testing is a critical piece to ensure quality and avoid...

The Future of Platform Engineering

FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf

Epistemic Interaction - tuning interfaces to provide information for AI support

Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx

Video Streaming: Then, Now, and in the Future

By Design, not by Accident - Agile Venture Bolzano 2024

Transcript: Selling digital books in 2024: Insights from industry leaders - T...

GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...

GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...

Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf

SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf

PCI PIN Basics Webinar from the Controlcase Team

Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf

LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...

Pushing the limits of ePRTC: 100ns holdover for 100 days

FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf

FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf

Modern Monitoring - devopsdays Cuba

1. @bridgetkromhout Monitoring

2. @bridgetkromhout lives: Minneapolis, Minnesota works: Pivotal podcasts: Arrested DevOps organizes: devopsdays Bridget Kromhout

3. @bridgetkromhout “…measuring value, throughput, and performance… revenue rather than cost” The Art of Monitoring (2016) James Turnbull artofmonitoring.com

4. @bridgetkromhout Why monitor? The Art of Monitoring (2016) James Turnbull artofmonitoring.com

5. @bridgetkromhout Why monitor? Two customers of monitoring with diﬀerent needs. The Art of Monitoring (2016) James Turnbull artofmonitoring.com

6. @bridgetkromhout Why monitor? The business: UX data for product & engineering Measure value delivered Two customers of monitoring with diﬀerent needs. The Art of Monitoring (2016) James Turnbull artofmonitoring.com

7. @bridgetkromhout Why monitor? The business: UX data for product & engineering Measure value delivered Information Technology: Visibility into state and failures Product & engineering decisions Measure success of projects Two customers of monitoring with diﬀerent needs. The Art of Monitoring (2016) James Turnbull artofmonitoring.com

8. @bridgetkromhout Method Type Focus Manual Checklists, simple scripts “Tribal knowledge” of things broken in the past Minimizing downtime, managing assets Reactive disk, CPU, memory checks Thresholds, alerting; updated after incidents Availability, assets, some customer experience Proactive Automatic; required for deployment Alerting includes context, automated remediation Application performance, business outcomes Monitoring Maturity Model The Art of Monitoring (2016) - James Turnbull - artofmonitoring.com

9. @bridgetkromhout Monitoring Maturity Model The Art of Monitoring (2016) James Turnbull artofmonitoring.com

10. @bridgetkromhout Typical reactive notiﬁcation The Art of Monitoring (2016) - James Turnbull - artofmonitoring.com

11. @bridgetkromhout Better notiﬁcations Actionable Provide necessary context Prevent alert fatigue The Art of Monitoring (2016) - James Turnbull - artofmonitoring.com (in the brave new cloudy-with-a-chance-of-containers world)

12. @bridgetkromhout “Nothing’s the same anymore.” Jeﬀrey Sinclair Babylon 5

13. @bridgetkromhout containers: dawn of the third age?

14. @bridgetkromhout 1979 (Version 7)  1982 (BSD) 20042000 chroot FreeBSD jails Solaris Zones LXC 2008 A Brief History of Containers, Part 1 (before docker era)

15. @bridgetkromhout A Brief History of Containers, Part 2 (docker common era) 2011 Cloud Foundry 2013 Docker 2014 Rocket (later rkt) 2015 Open Container Initiative

16. @bridgetkromhout containing dramas

17. @bridgetkromhout (autoscaling EC2 instances up & down over time) ephemeral infrastructure

18. @bridgetkromhout “cattle, not pets” (even adorable Attack Kittens)

19. @bridgetkromhout • cloud-based infrastructure • static checks or thresholds no longer scale • manual conﬁguration no longer scales “cattle, not pets”

20. @bridgetkromhout automation: solution? or problem? (it depends)

21. @bridgetkromhout architectural considerations

22. @bridgetkromhout

23. @bridgetkromhout consistent development repeatable deployment Why containers?

24. @bridgetkromhout Monitoring containers The Art of Monitoring (2016) James Turnbull artofmonitoring.com

25. @bridgetkromhout Events - changes in your environment Logs - diagnosis & troubleshooting Metrics - seeing state in real time for anomaly detection & pattern analysis

26. @bridgetkromhout The Art of Monitoring (2016) James Turnbull artofmonitoring.com Open source & SaaS • choose TCP over UDP • conﬁgurable granularity • “push” vs “pull”

27. @bridgetkromhout “Almost every task run under Borg contains a built-in HTTP server that publishes information about the health of the task and thousands of performance metrics” Large-scale cluster management at Google with Borg - Verma et al. 2015 “Almost every task run under Borg contains a built-in HTTP server that publishes information about the health of the task and thousands of performance metrics”

28. @bridgetkromhout Image credit: James Ernest

29. @bridgetkromhout Security Pros & ConsContainers limit attack surface & emitters don’t need ports open but… Microservices move IPC to network transactions & complexity is distributed

30. @bridgetkromhout removed restored Information radiators

31. @bridgetkromhout monitoring: the old way

32. @bridgetkromhout monitoring: the new way

33. @bridgetkromhout

34. @bridgetkromhout Thanks!