OSMC 2021 | Observability will not fix your broken Monitoring , or CultureNETWAYS
Plenty of people are jumping on the new hype, Observability, lots of them are replacing their “legacy” monitoring stack. Not all of them achieve the goals they set. This talk will talk about the pittfals of adopting new technologies the wrong way, it will teach you how to improve your monitoring by adapting your culture and then maybe your tooling. Based on some real life stories.
Most people will claim that this never happens, others hope it never happens, but it happened on March 10, 2021, and it was not just the 1 datacenter that got impacted, but the whole campus of the provider that got powered down. This talk will explain how our customers survived this outage, how our culture, opensource tooling and automation saved the da(y,ta). A talk about disaster recovery, business continuity plans and building cloud agnostic stacks that survive disasters.
OSMC 2021 | Observability will not fix your broken Monitoring , or CultureNETWAYS
Plenty of people are jumping on the new hype, Observability, lots of them are replacing their “legacy” monitoring stack. Not all of them achieve the goals they set. This talk will talk about the pittfals of adopting new technologies the wrong way, it will teach you how to improve your monitoring by adapting your culture and then maybe your tooling. Based on some real life stories.
Most people will claim that this never happens, others hope it never happens, but it happened on March 10, 2021, and it was not just the 1 datacenter that got impacted, but the whole campus of the provider that got powered down. This talk will explain how our customers survived this outage, how our culture, opensource tooling and automation saved the da(y,ta). A talk about disaster recovery, business continuity plans and building cloud agnostic stacks that survive disasters.
Vincit Teatime 2015.2 - Niko Kurtti: SaaSiin pa(i)nostustaVincitOy
Modernin ohjelmistoprojektin odotetaan olevan yksikkö- ja integraatiotestattu, koodikattavuuden kartoitettu, muutosten katselmoitu, ja koodin siirtyvän automaattisesti versiohallinnasta ajoon beta- ja tuotantoklustereille. Milloin? No versiohallintaan puskettaessa tietysti. Versiohallintalähtöistä, automoitua lähdekoodin ja tuotteenhallintaa GitHubista Traviksen syövereihin ja ajoon Amazonin Elastic Beanstalkiin. Tule kuulemaan hiljaista tietoa tämän vuosituhannen ohjelmistokehityksen perustyökaluista.
Every customer-facing project aims to achieve high uptime. We, as developers, write thorough unit and integration tests to catch as many bugs as possible. We even set up staging environments to simulate production as well as we can. Yet, downtime still happens and not only once we had to revert a change.
Blue-Green deployment is a technique that allows us to ship code with high confidence, minimizing the risk of errors. We will go through the why and what of Blue-Green,as well as show how you can start doing it using Spinnaker.
BDEVOPS @ Adobe 11.04.2017
Kubernetes and the Rise of Application-centric ComputingBitnami
There is an ongoing transition in server-side infrastructure as successive technology layers emerge, evolve and mature. This talk introduces the architecture and features of Kubernetes and describes how Kubernetes is the natural “next step” in this changing landscape. We look at the new challenges in a world where the building blocks are “applications” rather than “servers” and finish with a glimpse into future function-centric serverless frameworks.
Building CI/CD Pipelines with Jenkins and KubernetesJanakiram MSV
Learn how to configure CI/CD pipelines with Jenkins and Kubernetes. We will show you to how to automate deployments from source code to production clusters.
We Need to Talk: How Communication Helps CodeDocker, Inc.
To build a successful open source project requires more than just code. As Docker and many other household-name projects show, communication is also an essential ingredient in growing a project to greatness. This introvert-friendly talk will help you level up your development game by highlighting three tools and techniques: user research, InnerSource, and documentation. First, I'll help you apply some basic user research practices to refine your project purpose, vision, and value proposition. Then I'll talk about the role of documentation and effective storytelling in generating interest and feedback from broad development audiences. Next, I'll move on to InnerSource: what it is, how it works, and how it can improve your team's communication and collaboration habits. For this, I'll share real-world examples (including some from Zalando) of how InnerSource enabled teams to develop more effectively and efficiently. Finally, I’ll offer some examples of open-source projects (including Docker) that demonstrate how great communication leads to great software. Ideally, you’ll come away inspired to integrate more communication into your development processes.
Those are slides from Dev.IL meetup talk, by Or Rosenblatt & Yshay Yaacobi from Soluto RND
https://www.meetup.com/Dev-IL/events/253252917/
-------------------------
You developed a cool java infrastructure for your team.
Your team then shifts to python, so you rewrite the utility in python.
Then the team next door asks you to do the same rewrite for their node/typescript service.
You ask for a raise and write it again in typescript.
Now your colleague reads in HackerNews about the next cool trending language in the block.
Ain’t nobody got time for that!!!
Join us to hear how the powerful combination sidecar pattern and Kubernetes can help you solve this issue by allowing different services to use the same utility, regardless of stack or language.
You will become stack-free forever!
Overview of Bamboo's Continuous Integration and Continuous Delivery features, including branch-per-issue unified development workflow. Also includes supported Operating Systems, Databases, and User Authentication mechanisms.
Package all the things, from #ihatepackaging to #packagingloveKris Buytaert
Slides as presented at LinuxCon 2014 in Dusseldorf
Automated Software Delivery on Linux,
Continuous Delivery of software on Linux ,
As operations persons we like to have software installed from apt or yum repositories in clean packages.
We want to be able to trace the origin of a file and have smooth upgrade paths.
But distributions make it hard on us, then languages reinvent the wheel, then developers want to ship software in different ways ..
fpm, fpmcookery, omnibus, specfiles to the rescue, or chaos and hairpulls.
This talk will guid you trough the maze of how to deploy software, from different sources in a sane way.
How and when to use different packaging tools that will make your life easier, and how this approach will help you in growing towards a #devops approach
Vincit Teatime 2015.2 - Niko Kurtti: SaaSiin pa(i)nostustaVincitOy
Modernin ohjelmistoprojektin odotetaan olevan yksikkö- ja integraatiotestattu, koodikattavuuden kartoitettu, muutosten katselmoitu, ja koodin siirtyvän automaattisesti versiohallinnasta ajoon beta- ja tuotantoklustereille. Milloin? No versiohallintaan puskettaessa tietysti. Versiohallintalähtöistä, automoitua lähdekoodin ja tuotteenhallintaa GitHubista Traviksen syövereihin ja ajoon Amazonin Elastic Beanstalkiin. Tule kuulemaan hiljaista tietoa tämän vuosituhannen ohjelmistokehityksen perustyökaluista.
Every customer-facing project aims to achieve high uptime. We, as developers, write thorough unit and integration tests to catch as many bugs as possible. We even set up staging environments to simulate production as well as we can. Yet, downtime still happens and not only once we had to revert a change.
Blue-Green deployment is a technique that allows us to ship code with high confidence, minimizing the risk of errors. We will go through the why and what of Blue-Green,as well as show how you can start doing it using Spinnaker.
BDEVOPS @ Adobe 11.04.2017
Kubernetes and the Rise of Application-centric ComputingBitnami
There is an ongoing transition in server-side infrastructure as successive technology layers emerge, evolve and mature. This talk introduces the architecture and features of Kubernetes and describes how Kubernetes is the natural “next step” in this changing landscape. We look at the new challenges in a world where the building blocks are “applications” rather than “servers” and finish with a glimpse into future function-centric serverless frameworks.
Building CI/CD Pipelines with Jenkins and KubernetesJanakiram MSV
Learn how to configure CI/CD pipelines with Jenkins and Kubernetes. We will show you to how to automate deployments from source code to production clusters.
We Need to Talk: How Communication Helps CodeDocker, Inc.
To build a successful open source project requires more than just code. As Docker and many other household-name projects show, communication is also an essential ingredient in growing a project to greatness. This introvert-friendly talk will help you level up your development game by highlighting three tools and techniques: user research, InnerSource, and documentation. First, I'll help you apply some basic user research practices to refine your project purpose, vision, and value proposition. Then I'll talk about the role of documentation and effective storytelling in generating interest and feedback from broad development audiences. Next, I'll move on to InnerSource: what it is, how it works, and how it can improve your team's communication and collaboration habits. For this, I'll share real-world examples (including some from Zalando) of how InnerSource enabled teams to develop more effectively and efficiently. Finally, I’ll offer some examples of open-source projects (including Docker) that demonstrate how great communication leads to great software. Ideally, you’ll come away inspired to integrate more communication into your development processes.
Those are slides from Dev.IL meetup talk, by Or Rosenblatt & Yshay Yaacobi from Soluto RND
https://www.meetup.com/Dev-IL/events/253252917/
-------------------------
You developed a cool java infrastructure for your team.
Your team then shifts to python, so you rewrite the utility in python.
Then the team next door asks you to do the same rewrite for their node/typescript service.
You ask for a raise and write it again in typescript.
Now your colleague reads in HackerNews about the next cool trending language in the block.
Ain’t nobody got time for that!!!
Join us to hear how the powerful combination sidecar pattern and Kubernetes can help you solve this issue by allowing different services to use the same utility, regardless of stack or language.
You will become stack-free forever!
Overview of Bamboo's Continuous Integration and Continuous Delivery features, including branch-per-issue unified development workflow. Also includes supported Operating Systems, Databases, and User Authentication mechanisms.
Package all the things, from #ihatepackaging to #packagingloveKris Buytaert
Slides as presented at LinuxCon 2014 in Dusseldorf
Automated Software Delivery on Linux,
Continuous Delivery of software on Linux ,
As operations persons we like to have software installed from apt or yum repositories in clean packages.
We want to be able to trace the origin of a file and have smooth upgrade paths.
But distributions make it hard on us, then languages reinvent the wheel, then developers want to ship software in different ways ..
fpm, fpmcookery, omnibus, specfiles to the rescue, or chaos and hairpulls.
This talk will guid you trough the maze of how to deploy software, from different sources in a sane way.
How and when to use different packaging tools that will make your life easier, and how this approach will help you in growing towards a #devops approach
My DrupalCon 2014 Amsterdam talk, introducing the audience to #devops and the current state of #devops and Drupal based on the 2014 Drupal and Devops Survey
Adopting Devops , Stories from the trenchesKris Buytaert
As presented at Baltic Devops in Talllinn ,
Starting with devops is either the most trivial, or the hardest thing to do.
This talk will teach you a number of tricks on how to make life easier for your team. How to work together with your management and how to convince them devops is a relevant thing
Docker 1 0 1 0 1: a Docker introduction, actualized for the stable release of...Jérôme Petazzoni
If you're not familiar yet with Docker, here is your chance to catch up. This presentation includes a quick overview of the Open Source Docker Engine, and its associated services delivered through the Docker Hub. Recent features are listed, as well as a glimpse at what's next in the Docker world.
This presentation was given during OSCON, at a meet-up hosted by New Relic, with co-presentations from CoreOS and Rackspace OnMetal.
OSMC 2014 | From monitoringsucks to monitoringlove, and back by Kris BuytaertNETWAYS
Im Juni 2011 wetterte John Vincent auf Twitter über Monitoring mit dem Hashtag #monitoringsucks und für viele von uns, traf er damit genau ins Schwarze.
Bei den #devopsdays im November 2012 in Rom verkündete Ulf Mansson seine neu gefundene Liebe zu Monitoring und der Hashtag #monitoringlove wurde ins Leben gerufen. Aufgrund einer neuen Ära von Open Source Monitoring Tools, entwickelt er wieder eine Leidenschaft für Monitoring und viele von uns taten es ihm gleich.
Während der letzten 5 Jahre veröffentlichte die Community eine enorme Anzahl an neuen Tools und Mustern, die manchmal mit #devops getaggt wurden und fast alle Open Source waren.
Haben Sie noch einen Überblick darüber, welches Tool man für was verwendet und was die Unterschiede sind?
Dieser Vortrag wird Ihnen einen Überblick über die Open-Source- Monitoring-Landschaft verschaffen und aufzeigen, welche Tools man am besten nutzt oder aber Ihnen die Entscheidung sogar noch schwerer machen:)
Introduction to Docker at the Azure Meet-up in New YorkJérôme Petazzoni
This is the presentation given at the Azure New York Meet-Up group, September 3rd.
It includes a quick overview of the Open Source Docker Engine and its associated services delivered through the Docker Hub. It also covers the new features of Docker 1.0, and briefly explains how to get started with Docker on Azure.
OSMC 2014: From monitoringsucks to monitoringlove (and back) | Kris BuytaertNETWAYS
Back in June 2011 John Vincent ranted on twitter that #monitoringsucks, and for a lot of us he was absolutely right.
At #devopsdays Rome 2012, in November, Ulf Mansson proclaimed his new found love for monitoring and we changed the hashtag into #monitoringlove.
Based on a new era of open source tools, Ulf started loving monitoring again. And for a lot of us he was absolutely right. Over the past 5 years an enormous amount of new tools and new patterns has come out of the community sometimes tagged with #devops, pretty much all of them open source. Do you still know what you should be using for what? And what the differences are?
An opinionated overview of the open source monitoring landscape to clear up the confusion on what you should use, or make the decision even more difficult on you :)
Netflix Open Source: Building a Distributed and Automated Open Source Programaspyker
Netflix has been using and contributing to open source for several years. Over the years, Netflix has released over one hundred Netflix Open Source (aka NetflixOSS) libraries, servers, and technologies. Netflix engineers benefit by accepting contributions and gathering feedback with key collaborators around the world. Users of NetflixOSS from many industries benefit from our solutions including Big Data, Build and Delivery Tools, Runtime Services and Libraries, Data Persistence, Insight, Reliability and Performance, Security and User Interface. With such a large and mature open source program, Netflix has worked on approaches and tools that help manage and improve the NetflixOSS source offerings and communities. Netflix has taken a different approach to building support for open source as compared to other Internet scale companies. Come to this session to learn about the unique approaches Netflix has taken to both distribute and automate the responsibilities of building a world-class open source program.
Building a Distributed & Automated Open Source Program at NetflixAll Things Open
Andrew Spyker
Senior Software Engineer for Netflix
Find more by Andrew Spyker: http://www.slideshare.net/aspyker
All Things Open
October 26-27, 2016
Raleigh, North Carolina
Join this info-packed and hands-on workshop where we will cover:
Introduction to Kubernetes & GitOps talk:
We'll cover the most popular path that has brought success to many users already - GitOps as a natural evolution of Kubernetes. We'll give an overview of how you can benefit from Kubernetes and GitOps: greater security, reliability, velocity and more. Importantly, we cover definitions and principles standardized by the CNCF's OpenGitOps group and what it means for you.
Get Started with GitOps:
You'll have GitOps up and running in about 30 mins using our free and open source tools! We'll give a brief vision of where you want to be with those security, reliability, and velocity benefits, and then we'll support you while go through the getting started steps. During the workshop, you'll also experience in action and see demos for:
* an opinionated repo structure to minimize decision fatigue
* disaster recovery using GitOps
* Helm charts example
* Multi-cluster example
* all with free and open source tools mostly in the CNCF (eg. Flux and Helm).
If you have questions before or after the workshop, talk to us at #weave-gitops http://bit.ly/WeaveGitOpsSlack (If you need to invite yourself to the Slack, visit https://slack.weave.works/)
Similar to Building and Deploying MediaSalsa, an Open Source DAM as Saas platform (20)
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
Neuro-symbolic is not enough, we need neuro-*semantic*Frank van Harmelen
Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”.
All of this illustrated with link prediction over knowledge graphs, but the argument is general.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
Let's dive deeper into the world of ODC! Ricardo Alves (OutSystems) will join us to tell all about the new Data Fabric. After that, Sezen de Bruijn (OutSystems) will get into the details on how to best design a sturdy architecture within ODC.
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
Building and Deploying MediaSalsa, an Open Source DAM as Saas platform
1. Building and Deploying MediaSalsa
A Digital Asset Management System as a Service
Kris Buytaert
@krisbuytaert
Slides by Michel van de Ven and
Julien Pivotto
2. Kris BuytaertKris Buytaert
● I used to be a Dev,I used to be a Dev,
● Then Became an OpThen Became an Op
● Chief Trolling Officer and Open SourceChief Trolling Officer and Open Source
Consultant @inuits.euConsultant @inuits.eu
● Everything is an effing DNS ProblemEverything is an effing DNS Problem
● Building Clouds since before the bookstoreBuilding Clouds since before the bookstore
● Some books, some papers, some blogsSome books, some papers, some blogs
● Evangelizing devopsEvangelizing devops
3. MediaMosa
● Drupal-based Digital Asset Management system
● Commissioned by SURFnet and Kennisnet
● Open Source (GPLv2), Open Standards
● Webservice oriented: REST
● Store & retrieve assets
● Manage metadata using open standards
– Dublin Core, Qualified DC, IEEE/LOM, CZP
– OAI-PMH, BagIt
● Transcode video, audio, images, PDF &c, stream content
● Users: Kennisnet, NIBG, UGent, UvA, TiU, RUG, Radboud, UOslo,
Avans, PolitieAcademie, Acquia (NBC Sport), Cineca &c
● http://mediamosa.org
8. Inuits
● Inuits is an Open Source company
– We contribute back
● +40 people in 3 countries (BE, NL, UA)
● One language: English
● We offer
– Consulting
● Development
● System Administration
– and a niche Saas Platform
11. Distributed team
● Daily virtual stand-up over XMPP / Hangout
● Redmine project management
– Issues, tasks, sprints
– Repositories
– Documentation (wiki)
● Internal mailing lists
● Jenkins notifications by mail and XMPP
● Internal training
12. Dev and Ops
● Dev
● Architecture
● Develop new features
● Write unit tests (!)
● Ops
● Infrastructure (puppet)
● CD and CI (jenkins)
→ Ops teach dev about monitoring and
distributed services
→ Dev teach ops about required libraries and
testing, dependencies
15. CD
● Continuous Delivery vs Continuous Deployment
– “Continuous Delivery doesn't mean every change is deployed to production
ASAP. It means every change is proven to be deployable at any time”
(@ccaum)
● Puppet code
– Deployed to dev environment
– Same puppet code for each environment
– User-triggered deployments to UAT & Prod
– Feature flags in Puppet code per environment (switchable architecture)
● Application code
– Continuous integration in dev
– User-triggered deployments to UAT
– Deployment to prod is a business decision
16. Testing
● Developers test a lot, but
– The tests don’t work
– It works on my machine™
– Wrong platform
– Wrong PHP version
Fixed now, thanks to Jenkins!
and Vagrant...
17. Version Control
● Git
● Code is under revision control
– Prefer small commits
– Local features branches
● Infrastructure as code → git / hiera
18. Using OS packaging system
● Consistency, security, dependencies
● Uniquely identify where files are coming from
● Source repo may not be reacheable
● Little overhead when you automate
● Configuration does not belong in a package
19. Pipelines
● A collection of jobs
● Run in sequence
● Start on checkout, end on deployment
● From the developers’ side:
→ Git push
← Mail with changes + link to deploy
21. Pipelines steps
● Checkout
● Syntax: php -l
● Style: Drupal Coder
● Package: FPM
● Deploy to dev environment: mcollective
● Tests in dev environment: drush run-tests
● Publish package and promote: mcollective
22. Promotion
● At the end of the pipeline
● Send a simple email
● A link to the promotion page
● The changelog
● Promotion page contains one button per environment
● Must promote to UAT before Production
23. Tools used with Jenkins
● Pulp to manage RPM repositories
● Mcollective to update packages, run drush