Graphs: Fabric of DevOps

Speaker: Ashley Sun, LendingClub

Graphs:
The Fabric of DevOps
Ashley Sun
DevOps Engineer, LendingClub
@ashleycsun

Mercator
Neo4j
App Instance
App Instance
App Instance
<<REST>>

Mercator
Neo4j
App Instance
App Instance
App Instance
<<REST>>
AppInstance
AppId
Environment
Revision
Hostname
IP

Mercator
Neo4j
Load
Balancer
LoadBalancerServer
Hostname
Status
Traffic
Environment

AppInstance
AppId
Environment
Revision
Hostname
IP
LoadBalancerServer
Hostname
Status
Traffic
Environment

VirtualServer
AppId
Environment
Revision
Hostname
IP
Status
Traffic

VirtualServer
AppId lcui
Environment production
Revision abcd123
Hostname lcui-prod1
IP 1.2.3.4
Status active
Traffic 78

Mercator
Neo4j
EC2
Auto
Scaling
Elastic
Load
Balancing S3
RDS
Route 53
CodeDeploy
IAM
SQS

§ Get @ me! @ashleycsun
§ OSS Mercator:
https://github.com/LendingClub/mercator
§ Neo4j client + RxJava:
https://github.com/LendingClub/neorx
For more…

Angular 2 is now in Beta. Reactive Programming techniques are used to write the Angular 2 framework. The same APIs and techniques are exposed to Angular 2 developers for application development. This talk, by Geoff Filippi, will start with a brief overview of Reactive Programming. We will define and discuss the Observer Design Pattern. Observables are implemented in RxJS and are under consideration for standardization in ES2016. We will compare Observables, Promises, Events and callbacks. We will also discuss how Promises, Events and callbacks can be bridged into Observables. Finally we will discuss how RxJS is used to implement Angular 2. We will explore how Observables are used in change detection and ngZone, Http, Async Facade and Forms. We will also discuss how to make use of RxJS and Observables in our Angular 2 applications.

Heptio Contour - talk CNCF Nantes

Gaëlle Acas

Intro to os-faults library

Ilya Shakhat

Gatling @ Scala.Io 2013

slandelle

Angular 2 kickstart

Geoffrey Filippi

Slides from talk given on May 23, 2016 at the HTML5 Denver Meetup Group. Angular 2 is now in Release Candidate stage. We will use the new Angular CLI project to generate a new Angular 2 application. Next, we will take a quick tour through the scaffolded application structure. We will discuss how Angular 2 is bootstrapped and how modules are loaded. We will also show how to use the Angular CLI tool to generate a component and build our application.

OpenStack reliability metrics

Ilya Shakhat

We went from physical servers to the cloud and from running VMs in the cloud to running services in the cloud. And although the infrastructure got better and better, we still had to manage everything on our own. This is not the case anymore. Nowadays, we have the “serverless” services. There are many implementations to the idea. The most famous are the AWS Lambda and the Azure Functions. They provide a robust infrastructure for running your code in a scalable manner in a cloud environment. And since the solution is scalable, it is, by definition, a stateless solution. Does this mean that serverless is not a good solution? Is it just a cool gimmick? In this session, you are going to learn how we can manage state in a stateless, serverless environment on Azure, by utilizing Azure Durable Functions and how we can use the eco-system to build entire systems, completely serverless.

Benchmarking Service Meshes - CNCF Networking WG

Lee Calcote

Azure Durable Functions

Karthikeyan VK

[Kotlin Serverless 工作坊] 單元 4 - 實作 RSS Aggregator

Shengyou Fan

How to Live in a Post-Spring-Cloud-Netflix World - Olga Maciaszek-Sharma & Ja...

Load test REST APIs using gatling

Jayaram Sankaranarayanan

Things you wish you never knew about the Prometheus Remote Write API.

Kонструируем микросервисную архитектуру на Symfony и связываем с Kong

Alex Demchenko

From Streams to Reactive Streams

Oleg Tsal-Tsalko

Application Monitoring in a Post-Server World: Why Data Context is Critical

New Relic

The move towards microservices in Docker, EC2 and Lambda points to a shift towards shorter lived resources. These new application architectures are driving new agility and efficiency. But they, while providing developers with inherent scalability, elasticity, and flexibility, also present new challenges for application monitoring. The days of static server monitoring with a single health and status check are over. These days you need to know how your entire ecosystem of AWS EC2 instances are performing, especially since many of them are short lived and may only exist for a few minutes. With such transient ephemeral resources, there is no server to monitor; you need to understand performance along the lines of computational intent. And for this, you need the context in which these resources are performing. Join Kevin McGuire, Director of Engineering at New Relic, as he discusses trends in computing that we’ve gleaned from monitoring Docker and how they’ve helped us rethink how we monitor and analyze AWS. We’ll dive into the case for how contextual information like instance size, AMI, availability zone and tags can be used to drive an elevated understanding of transient infrastructure behavior and how it contributes to application performance. We’ll show how integrating status information gives you a more accurate view of EC2 lifecycle and health. And finally, how that information powers the ability for you to analyze and display that performance information in new and powerful ways.

Axon Server went RAFTing

J On The Beach

RAFT protocol is a well-known protocol for consensus in Distributed Systems. Want to learn how consensus is achieved in a system with a large amount of data such as Axon Server’s Event Store? Join this talk to hear about all specifics regarding data replication in highly available Event Store! Axon is a free and open source Java framework for writing Java applications following DDD, event sourcing, and CQRS principles. While especially useful in a microservices context, Axon provides great value in building structured monoliths that can be broken down into microservices when needed. Axon Server is a messaging platform specifically built to support distributed Axon applications. One of its key benefits is storing events published by Axon applications. In not so rare cases, the number of these events is over millions, even billions. Availability of Axon Server plays a significant role in the product portfolio. To keep event replication reliable we chose RAFT protocol for consensus implementation of our clustering features. In short, consensus involves multiple servers agreeing on values. Once they reach a decision on a value, that decision is final. Typical consensus algorithms make progress when any majority of their servers is available; for example, a cluster of 5 servers can continue to operate even if 2 servers fail. If more servers fail, they stop making progress (but will never return an incorrect result). Join this talk to learn why we chose RAFT; what were our findings during the design, the implementation, and testing phase; and what does it mean to replicate an event store holding billions of events!

Cortex: Prometheus as a Service, One Year On

Presented by Tom Wilkie at PromCon 2017 With Speaker Notes: https://goo.gl/V9qGva At PromCon 2016, I presented "Project Frankenstein: A multitenant, horizontally scalable Prometheus as a service". It's now one year later, and lots has changed - not least the name! This talk will discuss what we've learnt running a Prometheus service for the past year, the architectural changes we made from the original design, and the improvements we've made to the Cortex user experience.

Continuous performance management with Gatling

Radoslaw Smilgin

React meets o OCalm

Michał Załęcki

Altitude NY 2018: Leveraging Log Streaming to Build the Best Dashboards, Ever

Fastly

If knowing is half the battle, having the most information available is the best way to win. Using real-time log streaming and a knowledge of the data passing through the system, metrics can provide more depth and breadth in to the goings on requests as they pass through various parts of the stack. This session will cover the difference between logging and metrics, writing JSON and Influx Line Protocol in VCL, and building out dashboards to give deeper insights (and more importantly, alerting) on requests and responses at the edge.

What's new in c# 8.0

Moaid Hathot

Kube Your Enthusiasm - Paul Czarkowski

From AWS to GCP, TABLEAPP Architecture Story

Yen-Wen Chen

Handling Kubernetes Resources

Olivier Boukili

Zero downtime deployment of micro-services with Kubernetes

Wojciech Barczyński

StrongLoop Overview

Shubhra Kar

Red Hat Forum Benelux 2015

Microsoft

What's hot

State in stateless serverless functions

Alex Pshul

Benchmarking Service Meshes - CNCF Networking WG

Lee Calcote

Azure Durable Functions

Karthikeyan VK

[Kotlin Serverless 工作坊] 單元 4 - 實作 RSS Aggregator

Shengyou Fan

How to Live in a Post-Spring-Cloud-Netflix World - Olga Maciaszek-Sharma & Ja...

Load test REST APIs using gatling

Jayaram Sankaranarayanan

Things you wish you never knew about the Prometheus Remote Write API.

Kонструируем микросервисную архитектуру на Symfony и связываем с Kong

Alex Demchenko

From Streams to Reactive Streams

Oleg Tsal-Tsalko

Application Monitoring in a Post-Server World: Why Data Context is Critical

New Relic

Axon Server went RAFTing

J On The Beach

Cortex: Prometheus as a Service, One Year On

Continuous performance management with Gatling

Radoslaw Smilgin

React meets o OCalm

Michał Załęcki

Altitude NY 2018: Leveraging Log Streaming to Build the Best Dashboards, Ever

Fastly

What's new in c# 8.0

Moaid Hathot

Kube Your Enthusiasm - Paul Czarkowski

From AWS to GCP, TABLEAPP Architecture Story

Yen-Wen Chen

Handling Kubernetes Resources

Olivier Boukili

Zero downtime deployment of micro-services with Kubernetes

Wojciech Barczyński

What's hot (20)

State in stateless serverless functions

Benchmarking Service Meshes - CNCF Networking WG

Azure Durable Functions

[Kotlin Serverless 工作坊] 單元 4 - 實作 RSS Aggregator

How to Live in a Post-Spring-Cloud-Netflix World - Olga Maciaszek-Sharma & Ja...

Load test REST APIs using gatling

Things you wish you never knew about the Prometheus Remote Write API.

Kонструируем микросервисную архитектуру на Symfony и связываем с Kong

From Streams to Reactive Streams

Application Monitoring in a Post-Server World: Why Data Context is Critical

Axon Server went RAFTing

Cortex: Prometheus as a Service, One Year On

Continuous performance management with Gatling

React meets o OCalm

Altitude NY 2018: Leveraging Log Streaming to Build the Best Dashboards, Ever

What's new in c# 8.0

Kube Your Enthusiasm - Paul Czarkowski

From AWS to GCP, TABLEAPP Architecture Story

Handling Kubernetes Resources

Zero downtime deployment of micro-services with Kubernetes

Similar to Graphs: Fabric of DevOps

StrongLoop Overview

Shubhra Kar

Red Hat Forum Benelux 2015

Microsoft

Auto scaling with Ruby, AWS, Jenkins and Redis

Yi Hsuan (Jeddie) Chuang

How to build streaming data pipelines with Akka Streams, Flink, and Spark usi...

Lightbend

Node Interactive: Node.js Performance and Highly Scalable Micro-Services

Chris Bailey

The fundamental performance characteristics of Node.js, along with the improvements driven through the community benchmarking workgroup, makes Node.js ideal for highly performing micro-service workloads. Translating that into highly responsive, scalable solutions however is still far from easy. This session will discuss why Node.js is right for micro-services, introduce the best practices for building scalable deployments, and show you how to monitor and profile your applications to identify and resolve performance bottlenecks.

From Zero to still Zero: The most beautiful mistakes going into the cloud.

OPEN KNOWLEDGE GmbH

"Cloud is the new Normal”, so Andrew R. Jassy (CIO AWS). Was also liegt näher, als genau jetzt den Schritt in die Cloud zu wagen? Passende Blaupausen dazu gibt es mehr als genug. Aber ist dieser Schritt wirklich so einfach, wie uns die verschiedenen Cloud-Anbieter glauben machen wollen? Natürlich nicht. Diese Session zeigt anhand typischer Antipattern, wie der Weg in die Cloud garantiert im Desaster endet und wie man sich dagegen wappnen kann. Ähnlichkeiten zu existierenden Projekten sind rein zufällig – oder auch nicht.

2016 - Easing Your Way Into Docker: Lessons From a Journey to Production

devopsdaysaustin

What's new in android 2018 (dev fest)

Shady Selim

Seattle StrongLoop Node.js Workshop

Jimmy Guerrero

KubeCon EU 2016 Keynote: Pushing Kubernetes Forward

KubeAcademy

The Kubernetes community has aspirations of becoming the Linux kernel of distributed systems. Together we want to build a scalable, stable, and secure platform for distributed system that is the ubiquitous choice for people building server infrastructure. This talk will discuss the major community efforts made in recent months to deliver this goal and the work we need to do to continue our momentum. Sched Link: http://sched.co/68lU

Maxim Salnikov - Service Worker: taking the best from the past experience for...

Codemotion

There is no doubt that 2018 is the year when Progressive Web Apps will get the really broad adoption and recognition by all the involved parties: browser vendors (finally, all the major ones), developers, users. And the speed and smoothness of this process heavily depend on how correctly we, developers, use the power of new APIs. In my session based on the accumulated experience of developing and maintaining PWAs we go through the list of advanced tips & tricks, showcase best practices, learn how to avoid common pitfalls and have a look at the latest browser support and known limitations.

Camel on Cloud by Christina Lin

Tadayoshi Sato

Kubernetes One-Click Deployment: Hands-on Workshop (Mainz)

QAware GmbH

Cloud Native Night, April 2018, Mainz: Workshop led by Jörg Schad (@joerg_schad, Technical Community Lead / Developer at Mesosphere) Join our Meetup: https://www.meetup.com/de-DE/Cloud-Native-Night/ PLEASE NOTE: During this workshop, Jörg showed many demos and the audience could participate on their laptops. Unfortunately, we can't provide these demos. Nevertheless, Jörg's slides give a deep dive into the topic. DETAILS ABOUT THE WORKSHOP: Kubernetes has been one of the topics in 2017 and will probably remain so in 2018. In this hands-on technical workshop you will learn how best to deploy, operate and scale Kubernetes clusters from one to hundreds of nodes using DC/OS. You will learn how to integrate and run Kubernetes alongside traditional applications and fast data services of your choice (e.g. Apache Cassandra, Apache Kafka, Apache Spark, TensorFlow and more) on any infrastructure. This workshop best suits operators focussed on keeping their apps and services up and running in production and developers focussed on quickly delivering internal and customer facing apps into production. You will learn how to: - Introduction to Kubernetes and DC/OS (including the differences between both) - Deploy Kubernetes on DC/OS in a secure, highly available, and fault-tolerant manner - Solve operational challenges of running a large/multiple Kubernetes cluster - One-click deploy big data stateful and stateless services alongside a Kubernetes cluster

2016 - Open Mic - IGNITE - Open Infrastructure = ANY Infrastructure

devopsdaysaustin

OpenStack Preso: DevOps on Hybrid Infrastructure

rhirschfeld

Deep drive into Nova

Udayendu Kar

Serve Meals, Not Ingredients - ChefConf 2015

Chef

Business systems are meals. Nodes are a key ingredient. Do you configure and deploy business systems into multiple environments, with all the implied complexity of managing necessary variations and eliminating unwanted inconsistencies? Do you currently create Visio diagrams to describe your business systems, but long for something more actionable? Or do you use an existing definition format that you wish you could move into Chef? In this talk we will share techniques for template-driven deployment of topologies composed of Chef nodes, and describe the latest incarnation of these techniques, which is supported by the knife topo plugin and exchange format, as well as our Automate.Insights SaaS based offering. We will also describe our latest work to integrate with chef-provisioning, and how these techniques could be used to map from existing formats such as AWS CloudFormation. With such techniques you will be able to accelerate unleashing the awesome power of Chef across your enterprise.

Serve Meals, Not Ingredients (ChefConf 2015)

ThirdWaveInsights

Cloud-powered Continuous Integration and Deployment architectures - Jinesh Varia

Amazon Web Services

The presentation will discuss some architectural patterns in continuous integration, deployment and optimization and I will share some of the lessons learned from Amazon.com. The goal of the presentation is to convince you that if you invest your time where you get the maximum learning from your customers, automate everything else in the cloud (CI + CD + CO), you get fast feedback and will be able to release early, release often and recover quickly from your mistakes. Dynamism of the cloud allows you to increase the speed of your iteration and reduce the cost of mistakes so you can continuously innovate while keeping your cost down.

[Rakuten TechConf2014] [C-5] Ichiba Architecture on ExaLogic

Rakuten Group, Inc.

Similar to Graphs: Fabric of DevOps (20)

StrongLoop Overview

Red Hat Forum Benelux 2015

Auto scaling with Ruby, AWS, Jenkins and Redis

How to build streaming data pipelines with Akka Streams, Flink, and Spark usi...

Node Interactive: Node.js Performance and Highly Scalable Micro-Services

From Zero to still Zero: The most beautiful mistakes going into the cloud.

2016 - Easing Your Way Into Docker: Lessons From a Journey to Production

What's new in android 2018 (dev fest)

Seattle StrongLoop Node.js Workshop

KubeCon EU 2016 Keynote: Pushing Kubernetes Forward

Maxim Salnikov - Service Worker: taking the best from the past experience for...

Camel on Cloud by Christina Lin

Kubernetes One-Click Deployment: Hands-on Workshop (Mainz)

2016 - Open Mic - IGNITE - Open Infrastructure = ANY Infrastructure

OpenStack Preso: DevOps on Hybrid Infrastructure

Deep drive into Nova

Serve Meals, Not Ingredients - ChefConf 2015

Serve Meals, Not Ingredients (ChefConf 2015)

Cloud-powered Continuous Integration and Deployment architectures - Jinesh Varia

[Rakuten TechConf2014] [C-5] Ichiba Architecture on ExaLogic

More from Neo4j

FLOA - Détection de Fraude - GraphSummit Paris

SOPRA STERIA - GraphRAG : repousser les limitations du RAG via l’utilisation ...

Romain CAMPOURCY – Architecte Solution, Sopra Steria Patrick MEYER – Architecte IA Groupe, Sopra Steria La Génération de Récupération Augmentée (RAG) permet la réponse à des questions d’utilisateur sur un domaine métier à l’aide de grands modèles de langage. Cette technique fonctionne correctement lorsque la documentation est simple mais trouve des limitations dès que les sources sont complexes. Au travers d’un projet que nous avons réalisé, nous vous présenterons l’approche GraphRAG, une nouvelle approche qui utilise une base Neo4j générée pour améliorer la compréhension des documents et la synthèse d’informations. Cette méthode surpasse l’approche RAG en fournissant des réponses plus holistiques et précises.

ADEO - Knowledge Graph pour le e-commerce, entre challenges et opportunités ...

Charles Gouwy, Business Product Leader, Adeo Services (Groupe Leroy Merlin) Alors que leur Knowledge Graph est déjà intégré sur l’ensemble des expériences d’achat de leur plateforme e-commerce depuis plus de 3 ans, nous verrons quelles sont les nouvelles opportunités et challenges qui s’ouvrent encore à eux grâce à leur utilisation d’une base de donnée de graphes et l’émergence de l’IA.

GraphSummit Paris - The art of the possible with Graph Technology

GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...

Dr. Sean Tan, Head of Data Science, Changi Airport Group Discover how Changi Airport Group (CAG) leverages graph technologies and generative AI to revolutionize their search capabilities. This session delves into the unique search needs of CAG’s diverse passengers and customers, showcasing how graph data structures enhance the accuracy and relevance of AI-generated search results, mitigating the risk of “hallucinations” and improving the overall customer journey.

GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...

Leonard Jayamohan, Partner & Generative AI Lead, Deloitte This keynote will reveal how Deloitte leverages Neo4j’s graph power for groundbreaking digital twin solutions, achieving a staggering 100x performance boost. Discover the essential role knowledge graphs play in successful generative AI implementations. Plus, get an exclusive look at an innovative Neo4j + Generative AI solution Deloitte is developing in-house.

GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024

GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024

GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...

Sudheer Mechineni, Head of Application Frameworks, Standard Chartered Bank Discover how Standard Chartered Bank harnessed the power of Neo4j to transform complex data access challenges into a dynamic, scalable graph database solution. This keynote will cover their journey from initial adoption to deploying a fully automated, enterprise-grade causal cluster, highlighting key strategies for modelling organisational changes and ensuring robust disaster recovery. Learn how these innovations have not only enhanced Standard Chartered Bank’s data infrastructure but also positioned them as pioneers in the banking sector’s adoption of graph technology.

GraphAware - Transforming policing with graph-based intelligence analysis

Petr Matuska, Sales & Sales Engineering Lead, GraphAware Western Australia Police Force’s adoption of Neo4j and the GraphAware Hume graph analytics platform marks a significant advancement in data-driven policing. Facing the challenges of growing volumes of valuable data scattered in disconnected silos, the organisation successfully implemented Neo4j database and Hume, consolidating data from various sources into a dynamic knowledge graph. The result was a connected view of intelligence, making it easier for analysts to solve crime faster. The partnership between Neo4j and GraphAware in this project demonstrates the transformative impact of graph technology on law enforcement’s ability to leverage growing volumes of valuable data to prevent crime and protect communities.

GraphSummit Stockholm - Neo4j - Knowledge Graphs and Product Updates

KLARNA - Language Models and Knowledge Graphs: A Systems Approach

INGKA DIGITAL: Linked Metadata by Design

Your enemies use GenAI too - staying ahead of fraud with Neo4j

Delivered by Michael Down at Gartner Data & Analytics Summit London 2024 - Your enemies use GenAI too: Staying ahead of fraud with Neo4j. Fraudsters exploit the latest technologies like generative AI to stay undetected. Static applications can’t adapt quickly enough. Learn why you should build flexible fraud detection apps on Neo4j’s native graph database combined with advanced data science algorithms. Uncover complex fraud patterns in real-time and shut down schemes before they cause damage.

BT & Neo4j _ How Knowledge Graphs help BT deliver Digital Transformation.pptx

Delivered by Sreenath Gopalakrishna, Director of Software Engineering at BT, and Dr Jim Webber, Chief Scientist at Neo4j, at Gartner Data & Analytics Summit London 2024 this presentation examines how knowledge graphs and GenAI combine in real-world solutions. BT Group has used the Neo4j Graph Database to enable impressive digital transformation programs over the last 6 years. By re-imagining their operational support systems to adopt self-serve and data lead principles they have substantially reduced the number of applications and complexity of their operations. The result has been a substantial reduction in risk and costs while improving time to value, innovation, and process automation. Future innovation plans include the exploration of uses of EKG + Generative AI.

Workshop: Enabling GenAI Breakthroughs with Knowledge Graphs - GraphSummit Milan

Workshop - Architecting Innovative Graph Applications- GraphSummit Milan

Workshop 1. Architecting Innovative Graph Applications Join this hands-on workshop for beginners led by Neo4j experts guiding you to systematically uncover contextual intelligence. Using a real-life dataset we will build step-by-step a graph solution; from building the graph data model to running queries and data visualization. The approach will be applicable across multiple use cases and industries.

LARUS - Galileo.XAI e Gen-AI: la nuova prospettiva di LARUS per il futuro del...

Roberto Sannino, Larus Business Automation Nel panorama sempre più complesso dei progetti basati su grafi, LARUS ha consolidato una solida esperienza pluriennale, costruendo un rapporto di fiducia e collaborazione con Neo4j. Attraverso il LARUS Labs, ha sviluppato componenti e connettori che arricchiscono l’ecosistema Neo4j, contribuendo alla sua continua evoluzione. Tutto questo know-how è stato incanalato nell’innovativa soluzione Galileo.XAI di LARUS, un prodotto all’avanguardia che, integrato con la Generative AI, offre una nuova prospettiva nel mondo dell’Intelligenza Artificiale Spiegabile applicata ai grafi. In questo speech, si esplorerà il percorso di crescita di LARUS in questo settore, mettendo in luce le potenzialità della soluzione Galileo.XAI nel guidare l’innovazione e la trasformazione digitale.

GraphSummit Milan - Visione e roadmap del prodotto Neo4j

GraphSummit Milan & Stockholm - Neo4j: The Art of the Possible with Graph