In this slides is presented a light solution based on the integration between Puppet-Foreman and Gitolite to the problem: How to enable many sysadmins to work together on one work environment without interfering with each other?
Slides for a quick introduction to Linux containers (lxc) and Docker from a hands-on talk given at the Johannesburg Linux User Group on the 20th Jan 2014
Webinar topic: Using GIT for Everyone
Presenter: Achmad Mardiansyah
In this webinar series, We are discussing Using GIT for Everyone
Please share your feedback or webinar ideas here: http://bit.ly/glcfeedback
Check our schedule for future events: https://www.glcnetworks.com/schedule/
Follow our social media for updates: Facebook, Instagram, YouTube Channel, and telegram
Recording available on Youtube
https://youtu.be/xMUWYqNc7pg
OpenNebula Conf 2014: CentOS, QA an OpenNebula - Christoph GaluschkaNETWAYS
CentOS, the Community Enterprise OS, uses Opennebula as virtualization plattform for its automated QA-process. The opennebula setup consists of 3 nodes, all running CentOS-6, who handle the following tasks:
– sunstone as cloud controller
– local mirror/DNS-Server/http-Server for the VMs to pull in packages
– one VM to run a jenkins instance to launch the various tests (ci.de.centos.org)
– nginx on the cloud controller to forward http traffic to the jenkins VM
A public git repository (http://www.gitorious.org/testautomation) is used to allow whoever wants to contribute to pull the current test suite – t_functional, a series of bash scripts used to do funtional tests of various applications, binaries, configuration files and Trademark issues. As new tests are added to the repo via personal clones and merge requests, those tests first need to complete a test run via jenkins. Each test run currently consists of 4 VMs (one for each arch for C5 and C6 – C7 to come), which run the complete test suite. All VMs used for theses tests are instantiated and torn down on demand, whenever the call to testrun a personal clone is issued (via IRC).
Once completed successfully, the request is merged into the main repo. The jenkins node monitors this repository and which automatically triggers another complete test run.
Besides these triggered test runs, the test suite is automatically triggered daily to run. This is used to verify functionality of published updates – a handfull of failty updates have allready been discovered this way.
Besides t_functional, the Linux Test Project Suite of tests is also run on a daily basis, also to verify functionality of the OS and all updates.
The third setup is used to test the available and functional integrity of published docker images for CentOS.
All these tests are later – during the QA-phase of a point release – used to verify functionality of new packages inside the CentOS QA-Setup.
Libcontainer: joining forces under one roofAndrey Vagin
Libcontainer is a project that aims to create a common library for container management across different technologies like Docker and LXC. It avoids external dependencies and supports multiple container types through a common API. The goal is to allow cooperation and code reuse across projects through a shared container management library. Libct is a companion C library that provides a frontend API for managing the entire container lifecycle.
LAS16-211: Using LAVA V2 for advanced KVM testingLinaro
LAS16-211: Testing LAVA V2 for advanced KVM testing
Speakers: Riku Voipio
Date: September 27, 2016
★ Session Description ★
The new LAVA dispatcher allows explicit control of starting/controlling guest. Walk through how to use V2 dispatcher for KVM and other VM testing and explore usage of libvirt etc. Share experiences in using V2 dispatcher in general. Plan support for migration and other advanced multinode tests.
★ Resources ★
Etherpad: pad.linaro.org/p/las16-211
Presentations & Videos: http://connect.linaro.org/resource/las16/las16-211/
★ Event Details ★
Linaro Connect Las Vegas 2016 – #LAS16
September 26-30, 2016
http://www.linaro.org
http://connect.linaro.org
This document discusses Debian packaging for Python applications and libraries. It provides an overview of making source and binary packages, using PPAs and recipe builds to publish packages, and submitting packages to Debian or Ubuntu. It also discusses future directions like using distutils metadata to automatically generate Debian packages and tools to convert packages between PyPI and Debian repositories.
A brief introduction to Publican for members of the OpenStack documentation community. Originally presented at the OpenStack documentation bootcamp on the 10th of September 2013
Monitoring the Hashistack with PrometheusGrafana Labs
Prometheus has become the defacto monitoring system for cloud native applications, but for a while was eschewed by the Hashistack in favour of more traditional technologies. Thats all changing: Hashicorp's project are beginning to export metrics in the native Prometheus format, and many exporters exist to bridge the gap.
In this talk Tom will give a brief introduction to Prometheus, show you how to piece it all together, and give some recommendation on what to monitor and alert on.
Slides for a quick introduction to Linux containers (lxc) and Docker from a hands-on talk given at the Johannesburg Linux User Group on the 20th Jan 2014
Webinar topic: Using GIT for Everyone
Presenter: Achmad Mardiansyah
In this webinar series, We are discussing Using GIT for Everyone
Please share your feedback or webinar ideas here: http://bit.ly/glcfeedback
Check our schedule for future events: https://www.glcnetworks.com/schedule/
Follow our social media for updates: Facebook, Instagram, YouTube Channel, and telegram
Recording available on Youtube
https://youtu.be/xMUWYqNc7pg
OpenNebula Conf 2014: CentOS, QA an OpenNebula - Christoph GaluschkaNETWAYS
CentOS, the Community Enterprise OS, uses Opennebula as virtualization plattform for its automated QA-process. The opennebula setup consists of 3 nodes, all running CentOS-6, who handle the following tasks:
– sunstone as cloud controller
– local mirror/DNS-Server/http-Server for the VMs to pull in packages
– one VM to run a jenkins instance to launch the various tests (ci.de.centos.org)
– nginx on the cloud controller to forward http traffic to the jenkins VM
A public git repository (http://www.gitorious.org/testautomation) is used to allow whoever wants to contribute to pull the current test suite – t_functional, a series of bash scripts used to do funtional tests of various applications, binaries, configuration files and Trademark issues. As new tests are added to the repo via personal clones and merge requests, those tests first need to complete a test run via jenkins. Each test run currently consists of 4 VMs (one for each arch for C5 and C6 – C7 to come), which run the complete test suite. All VMs used for theses tests are instantiated and torn down on demand, whenever the call to testrun a personal clone is issued (via IRC).
Once completed successfully, the request is merged into the main repo. The jenkins node monitors this repository and which automatically triggers another complete test run.
Besides these triggered test runs, the test suite is automatically triggered daily to run. This is used to verify functionality of published updates – a handfull of failty updates have allready been discovered this way.
Besides t_functional, the Linux Test Project Suite of tests is also run on a daily basis, also to verify functionality of the OS and all updates.
The third setup is used to test the available and functional integrity of published docker images for CentOS.
All these tests are later – during the QA-phase of a point release – used to verify functionality of new packages inside the CentOS QA-Setup.
Libcontainer: joining forces under one roofAndrey Vagin
Libcontainer is a project that aims to create a common library for container management across different technologies like Docker and LXC. It avoids external dependencies and supports multiple container types through a common API. The goal is to allow cooperation and code reuse across projects through a shared container management library. Libct is a companion C library that provides a frontend API for managing the entire container lifecycle.
LAS16-211: Using LAVA V2 for advanced KVM testingLinaro
LAS16-211: Testing LAVA V2 for advanced KVM testing
Speakers: Riku Voipio
Date: September 27, 2016
★ Session Description ★
The new LAVA dispatcher allows explicit control of starting/controlling guest. Walk through how to use V2 dispatcher for KVM and other VM testing and explore usage of libvirt etc. Share experiences in using V2 dispatcher in general. Plan support for migration and other advanced multinode tests.
★ Resources ★
Etherpad: pad.linaro.org/p/las16-211
Presentations & Videos: http://connect.linaro.org/resource/las16/las16-211/
★ Event Details ★
Linaro Connect Las Vegas 2016 – #LAS16
September 26-30, 2016
http://www.linaro.org
http://connect.linaro.org
This document discusses Debian packaging for Python applications and libraries. It provides an overview of making source and binary packages, using PPAs and recipe builds to publish packages, and submitting packages to Debian or Ubuntu. It also discusses future directions like using distutils metadata to automatically generate Debian packages and tools to convert packages between PyPI and Debian repositories.
A brief introduction to Publican for members of the OpenStack documentation community. Originally presented at the OpenStack documentation bootcamp on the 10th of September 2013
Monitoring the Hashistack with PrometheusGrafana Labs
Prometheus has become the defacto monitoring system for cloud native applications, but for a while was eschewed by the Hashistack in favour of more traditional technologies. Thats all changing: Hashicorp's project are beginning to export metrics in the native Prometheus format, and many exporters exist to bridge the gap.
In this talk Tom will give a brief introduction to Prometheus, show you how to piece it all together, and give some recommendation on what to monitor and alert on.
CfgMgmtCamp 2015 - Managing the Content Lifecycle with KatelloStephen Benjamin
This document provides an overview of content management and lifecycles using Katello. It discusses how Katello allows you to sync or upload content, create content views to filter and control packages/modules, and promote content views through defined environments. It also covers features like errata awareness, composite content views, and incremental updates to quickly push out emergency patches.
This document provides instructions for using Miniedit, a GUI tool for creating Mininet virtual network topologies. Miniedit allows users to visually design network topologies and either run them directly or export them as Mininet scripts. Key steps include launching Miniedit, building a topology, and saving or exporting the design to run it with Mininet or modify it as a Python script. Miniedit requires an X server and works on Linux, Mac, and Windows.
Embedded recipes 2018 - End-to-end software production for embedded - Guy Lun...Anne Nicolas
At this point, anyone can put a quick GNU/Linux distro together to test on almost any device. The tooling has been greatly simplified and the hardware enablement has come a long way. So why do we need this talk? Quite literally for the mountain of challenges that unfortunately get completely eclipsed by the mirage of these one-time build and forget environments and tools that everyone tickers with nowadays. Being able to produce solid repeatable results does not mean being able to run the same scripts more than once but rather a true complete Continuous Integration solution accounting for all aspects of the new product. This talk will discuss actual situations experienced by Collabora and will open the discussion for others to share and contribute.
Michael Irwin graduated from VT in 2011 and started using Docker for QA work in 2015. He attended his first DockerCon in 2016 and deployed Summit, his first production project using Docker, on AWS later that year. He started the Blacksburg Docker Meetup in 2016. In 2017, he was recognized as a Docker Captain. Docker provides containerization which isolates processes using kernel namespaces. Images are built from layers containing filesystem changes and metadata. Docker can be used to standardize environments for development, testing, and production.
Matthew Mosesohn - Configuration Management at Large Companies Yandex
Right from the PuppetConf, which gathered a lot of engineers at San Francisco, Matt will pass the experience of configuration management at big companies. Of course, with his own opinion and criticism, which you are welcome to discuss.
Introduction to Docker, the open source Linux containers engine.
Presentation for the Montreal DevOps meetup on Jan 6, 2014.
Material, code, examples available at https://github.com/colinsurprenant/devopsmtl-docker
OpenStack Cinder On-Boarding Education - Boston Summit - 2017Jay Bryant
These slides were presented at the Boston Summit for people interested in learning how to start contributing to OpenStack's Block Storage project, Cinder. Includes an overview of Cinder's architecture, an introduction to our development processes and a description of our code tree.
The document summarizes the agenda for the Q2 MeetUp on May 31st 2017, including check-in, introductions, operational war stories, a discussion on OpenContrail, and information on upcoming events. Stacy Véronneau will provide an intro and recap of the OpenStack Summit. Noura Daadaa will discuss the OpenStack Ottawa User Group. Mohammed Naser will share operational war stories from deploying and running OpenStack.
OpenStack Cinder On-Boarding Room - Vancouver Summit 2018Jay Bryant
These are the slides presented in the Cinder On-Boarding room at the OpenStack Summit in Vancouver on May 22, 2018. Includes an overview of the Cinder project, team members and processes.
NuGet (anti-)patterns - Tales from the TrenchesXavier Decoster
Xavier Decoster discusses NuGet package versioning, repositories, and lessons learned. He covers semantic versioning, maintaining a smooth upgrade path, splitting package repositories, not deleting packages once published, and having fallback repositories. Decoster also discusses binding redirects, sample packages, uninstalling packages completely, and package promotion between repositories.
Flavio Castelli, Engineering Manager for the Docker project presso SUSE, partendo dall'assunto che non è sufficiente avere solo Docker, ci ha descritto la soluzione di orchestrazione dei Linux Conteiners che SUSE ha deciso di sostenere. Ha inoltre spiegato perché lo hanno fatto e come i loro utenti potranno trarne beneficio.
Cinder On-boarding Room - Berlin (11-13-2018)Jay Bryant
These are the slides presented during the Berlin OpenStack Summit. The presentation includes information about the Cinder Team and our processes. Intended to help new contributors to get involved developing with the team upstream.
The document discusses profiling tools and techniques for optimizing performance. It begins with an introduction to profiling and defines it as gathering data on a system's performance metrics like CPU and memory usage to find where time is being spent. It then covers types of profiling like event-based and statistical profiling. The rest of the document provides tips on profiling different languages and frameworks like PHP, Ruby, and Node.js. It also discusses tools like XHProf, XDebug, flamegraphs, and EXPLAIN queries to help optimize databases.
OpenNebula can provide virtual infrastructure for virtual machines (VMs) and consists of a typical environment with:
- A frontend node running OpenNebula services and a hypervisor for VMs.
- Additional backend nodes running just hypervisors for VMs and sharing storage and networks.
- VMs communicate via a shared bridge and private network.
The tutorial covers installing OpenNebula on a lab environment with two backend nodes, configuring hosts, images, networks and templates. It then demonstrates basic usage like deploying VMs, managing their life cycle and contextualization using groups, quotas and different user views.
Developing In Python On Red Hat Platforms (Nick Coghlan & Graham Dumpleton)Red Hat Developers
Red Hat Software Collections, OpenShift and the Red Hat Container Development Kit open up many new possibilities for Python developers targeting Red Hat Enterprise Linux. At the same time, the wider Python ecosystem is undergoing two significant transitions - one being the ongoing migration from Python 2 to Python 3, and the other the shift to correctly validating HTTPS connections by default. In this session we will cover the currently available options for developing with Python on Red Hat platforms, as well as provide some insight into where things are headed in the context of the wider Python ecosystem.
The summary of the Q2 MeetUp document is:
1) The meetup agenda included check-in and networking, an introduction, a presentation on OpenContrail, a summit recap, break, and operational war stories.
2) Stuart Mackie from Juniper Networks gave a presentation on OpenContrail.
3) Stacy Véronneau from CloudOps gave a recap of the recent OpenStack summit, including attendee numbers, award winners, and a summary of keynotes.
OpenDaylight is an open source SDN controller written in Java. The document provides instructions for installing OpenDaylight on CentOS 7, including downloading the Karaf distribution, installing Java, and activating features like the DLux core and nodes through the Karaf feature manager. Basic commands are also provided to check the status, start, and stop the OpenDaylight service and view the web interface.
This document provides an overview of Kubernetes 101. It begins with asking why Kubernetes is needed and provides a brief history of the project. It describes containers and container orchestration tools. It then covers the main components of Kubernetes architecture including pods, replica sets, deployments, services, and ingress. It provides examples of common Kubernetes manifest files and discusses basic Kubernetes primitives. It concludes with discussing DevOps practices after adopting Kubernetes and potential next steps to learn more advanced Kubernetes topics.
CfgMgmtCamp 2015 - Managing the Content Lifecycle with KatelloStephen Benjamin
This document provides an overview of content management and lifecycles using Katello. It discusses how Katello allows you to sync or upload content, create content views to filter and control packages/modules, and promote content views through defined environments. It also covers features like errata awareness, composite content views, and incremental updates to quickly push out emergency patches.
This document provides instructions for using Miniedit, a GUI tool for creating Mininet virtual network topologies. Miniedit allows users to visually design network topologies and either run them directly or export them as Mininet scripts. Key steps include launching Miniedit, building a topology, and saving or exporting the design to run it with Mininet or modify it as a Python script. Miniedit requires an X server and works on Linux, Mac, and Windows.
Embedded recipes 2018 - End-to-end software production for embedded - Guy Lun...Anne Nicolas
At this point, anyone can put a quick GNU/Linux distro together to test on almost any device. The tooling has been greatly simplified and the hardware enablement has come a long way. So why do we need this talk? Quite literally for the mountain of challenges that unfortunately get completely eclipsed by the mirage of these one-time build and forget environments and tools that everyone tickers with nowadays. Being able to produce solid repeatable results does not mean being able to run the same scripts more than once but rather a true complete Continuous Integration solution accounting for all aspects of the new product. This talk will discuss actual situations experienced by Collabora and will open the discussion for others to share and contribute.
Michael Irwin graduated from VT in 2011 and started using Docker for QA work in 2015. He attended his first DockerCon in 2016 and deployed Summit, his first production project using Docker, on AWS later that year. He started the Blacksburg Docker Meetup in 2016. In 2017, he was recognized as a Docker Captain. Docker provides containerization which isolates processes using kernel namespaces. Images are built from layers containing filesystem changes and metadata. Docker can be used to standardize environments for development, testing, and production.
Matthew Mosesohn - Configuration Management at Large Companies Yandex
Right from the PuppetConf, which gathered a lot of engineers at San Francisco, Matt will pass the experience of configuration management at big companies. Of course, with his own opinion and criticism, which you are welcome to discuss.
Introduction to Docker, the open source Linux containers engine.
Presentation for the Montreal DevOps meetup on Jan 6, 2014.
Material, code, examples available at https://github.com/colinsurprenant/devopsmtl-docker
OpenStack Cinder On-Boarding Education - Boston Summit - 2017Jay Bryant
These slides were presented at the Boston Summit for people interested in learning how to start contributing to OpenStack's Block Storage project, Cinder. Includes an overview of Cinder's architecture, an introduction to our development processes and a description of our code tree.
The document summarizes the agenda for the Q2 MeetUp on May 31st 2017, including check-in, introductions, operational war stories, a discussion on OpenContrail, and information on upcoming events. Stacy Véronneau will provide an intro and recap of the OpenStack Summit. Noura Daadaa will discuss the OpenStack Ottawa User Group. Mohammed Naser will share operational war stories from deploying and running OpenStack.
OpenStack Cinder On-Boarding Room - Vancouver Summit 2018Jay Bryant
These are the slides presented in the Cinder On-Boarding room at the OpenStack Summit in Vancouver on May 22, 2018. Includes an overview of the Cinder project, team members and processes.
NuGet (anti-)patterns - Tales from the TrenchesXavier Decoster
Xavier Decoster discusses NuGet package versioning, repositories, and lessons learned. He covers semantic versioning, maintaining a smooth upgrade path, splitting package repositories, not deleting packages once published, and having fallback repositories. Decoster also discusses binding redirects, sample packages, uninstalling packages completely, and package promotion between repositories.
Flavio Castelli, Engineering Manager for the Docker project presso SUSE, partendo dall'assunto che non è sufficiente avere solo Docker, ci ha descritto la soluzione di orchestrazione dei Linux Conteiners che SUSE ha deciso di sostenere. Ha inoltre spiegato perché lo hanno fatto e come i loro utenti potranno trarne beneficio.
Cinder On-boarding Room - Berlin (11-13-2018)Jay Bryant
These are the slides presented during the Berlin OpenStack Summit. The presentation includes information about the Cinder Team and our processes. Intended to help new contributors to get involved developing with the team upstream.
The document discusses profiling tools and techniques for optimizing performance. It begins with an introduction to profiling and defines it as gathering data on a system's performance metrics like CPU and memory usage to find where time is being spent. It then covers types of profiling like event-based and statistical profiling. The rest of the document provides tips on profiling different languages and frameworks like PHP, Ruby, and Node.js. It also discusses tools like XHProf, XDebug, flamegraphs, and EXPLAIN queries to help optimize databases.
OpenNebula can provide virtual infrastructure for virtual machines (VMs) and consists of a typical environment with:
- A frontend node running OpenNebula services and a hypervisor for VMs.
- Additional backend nodes running just hypervisors for VMs and sharing storage and networks.
- VMs communicate via a shared bridge and private network.
The tutorial covers installing OpenNebula on a lab environment with two backend nodes, configuring hosts, images, networks and templates. It then demonstrates basic usage like deploying VMs, managing their life cycle and contextualization using groups, quotas and different user views.
Developing In Python On Red Hat Platforms (Nick Coghlan & Graham Dumpleton)Red Hat Developers
Red Hat Software Collections, OpenShift and the Red Hat Container Development Kit open up many new possibilities for Python developers targeting Red Hat Enterprise Linux. At the same time, the wider Python ecosystem is undergoing two significant transitions - one being the ongoing migration from Python 2 to Python 3, and the other the shift to correctly validating HTTPS connections by default. In this session we will cover the currently available options for developing with Python on Red Hat platforms, as well as provide some insight into where things are headed in the context of the wider Python ecosystem.
The summary of the Q2 MeetUp document is:
1) The meetup agenda included check-in and networking, an introduction, a presentation on OpenContrail, a summit recap, break, and operational war stories.
2) Stuart Mackie from Juniper Networks gave a presentation on OpenContrail.
3) Stacy Véronneau from CloudOps gave a recap of the recent OpenStack summit, including attendee numbers, award winners, and a summary of keynotes.
OpenDaylight is an open source SDN controller written in Java. The document provides instructions for installing OpenDaylight on CentOS 7, including downloading the Karaf distribution, installing Java, and activating features like the DLux core and nodes through the Karaf feature manager. Basic commands are also provided to check the status, start, and stop the OpenDaylight service and view the web interface.
This document provides an overview of Kubernetes 101. It begins with asking why Kubernetes is needed and provides a brief history of the project. It describes containers and container orchestration tools. It then covers the main components of Kubernetes architecture including pods, replica sets, deployments, services, and ingress. It provides examples of common Kubernetes manifest files and discusses basic Kubernetes primitives. It concludes with discussing DevOps practices after adopting Kubernetes and potential next steps to learn more advanced Kubernetes topics.
Using Docker Platform to Provide ServicesGLC Networks
Webinar topic: Using Docker Platform to Provide Services
Presenter: Achmad Mardiansyah
In this webinar series, We are discussing Using Docker Platform to Provide Services
Please share your feedback or webinar ideas here: http://bit.ly/glcfeedback
Check our schedule for future events: https://www.glcnetworks.com/en/schedule/
Follow our social media for updates: Facebook, Instagram, YouTube Channel, and telegram
Recording available on Youtube
https://youtu.be/FgG91X6-HQY
For the Docker users out there, Sematext's DevOps Evangelist, Stefan Thies, goes through a number of different Docker monitoring options, points out their pros and cons, and offers solutions for Docker monitoring. Webinar contains actionable content, diagrams and how-to steps.
PuppetConf 2016: Why Network Automation Matters, and What You Can Do About It...Puppet
Here are the slides from Rick Sherman's PuppetConf 2016 presentation called Why Network Automation Matters, and What You Can Do About It. Watch the videos at https://www.youtube.com/playlist?list=PLV86BgbREluVjwwt-9UL8u2Uy8xnzpIqa
Join this info-packed and hands-on workshop where we will cover:
Introduction to Kubernetes & GitOps talk:
We'll cover the most popular path that has brought success to many users already - GitOps as a natural evolution of Kubernetes. We'll give an overview of how you can benefit from Kubernetes and GitOps: greater security, reliability, velocity and more. Importantly, we cover definitions and principles standardized by the CNCF's OpenGitOps group and what it means for you.
Get Started with GitOps:
You'll have GitOps up and running in about 30 mins using our free and open source tools! We'll give a brief vision of where you want to be with those security, reliability, and velocity benefits, and then we'll support you while go through the getting started steps. During the workshop, you'll also experience in action and see demos for:
* an opinionated repo structure to minimize decision fatigue
* disaster recovery using GitOps
* Helm charts example
* Multi-cluster example
* all with free and open source tools mostly in the CNCF (eg. Flux and Helm).
If you have questions before or after the workshop, talk to us at #weave-gitops http://bit.ly/WeaveGitOpsSlack (If you need to invite yourself to the Slack, visit https://slack.weave.works/)
The monolith to cloud-native, microservices evolution has driven a shift from monitoring to observability. OpenTelemetry, a merger of the OpenTracing and OpenCensus projects, is enabling Observability 2.0. This talk gives an overview of the OpenTelemetry project and then outlines some production-proven architectures for improving the observability of your applications and systems.
Slow, Flaky and Legacy Tests: FTFY - Our New Testing Strategy at Net-A-Porter...Sauce Labs
As part of a recent replatforming exercise, Net-A-Porter has worked hard not only to refresh their technology, but to create a great testing culture. As a result, they have come a long way from “throwing tests over the wall.” Testing concerns are now part of their NFRs and technical decisions. Developers are responsible for unit and functional tests, working alongside test specialists who are part of every delivery team for guidance.
In this SauceCon 2018 session, Adela Mosincat and James Collins will walk attendees through how Sauce Labs has helped in this process. She will review how the “test-runner” was born to facilitate the consistent and seamless running of their tests on Sauce Labs across teams. The test-runner is a Docker image, whose purpose is to handle the running of the tests both locally and in their CI pipeline. It parallelizes the tests as much as possible, executes intelligent waiting for VMs and retrying for flaky tests, supports test tagging and quarantining and handles reporting to both Sauce Labs and Jenkins.
In addition to the test-runner, Adela and Jim will review how Net-A-Porter improved their dev/test culture and CI pipeline, and share what they learned along the way.
This short document discusses the Puppet configuration management tool. It begins with a quote about controlling the spice and universe from Dune and includes the author's name and date. The document then lists various Puppet features like scalability, flexibility, simple installation, and modules. It provides examples of large sites using Puppet like Google and describes Puppet's client-server and masterless models. In closing, it emphasizes Puppet's flexibility, community support, and over 1200 pre-built configurations.
DevOps Days Boston 2017: Real-world Kubernetes for DevOpsAmbassador Labs
DevOps Days Boston 2017
Microservices is an increasingly popular approach to building cloud-native applications. Dozens of new technologies that streamline adopting microservices development such as Docker, Kubernetes, and Envoy have been released over the past few years. But how do you actually use these technologies together to develop, deploy, and run microservices?
In this presentation, we’ll cover the nuances of deploying containerized applications on Kubernetes, including creating a Kubernetes manifest, debugging and logging, and how to build an automated continuous deployment pipeline. Then, we’ll do a brief tour of some of the advanced concepts related to microservices, including service mesh, canary deployments, resilience, and security.
No production system is complete without a way to monitor it. In software, we define observability as the ability to understand how our system is performing. This talk dives into capabilities and tools that are recommended for implementing observability when running K8s in production as the main platform today for deploying and maintaining containers with cloud-native solutions.
We start by introducing the concept of observability in the context of distributed systems such as K8s and the difference with monitoring. We continue by reviewing the observability stack in K8s and the main functionalities. Finally, we will review the tools K8s provides for monitoring and logging, and get metrics from applications and infrastructure.
Between the points to be discussed we can highlight:
-Introducing the concept of observability
-Observability stack in K8s
-Tools and apps for implementing Kubernetes observability
-Integrating Prometheus with OpenMetrics
Free GitOps Workshop (with Intro to Kubernetes & GitOps)Weaveworks
View this video on Youtube here: https://youtu.be/tK4S8y3j5TA
In this info-packed and hands-on workshop we covered:
Introduction to Kubernetes & GitOps talk:
We covered the most popular path that has brought success to many users already - GitOps as a natural evolution of Kubernetes. We'll give an overview of how you can benefit from Kubernetes and GitOps: greater security, reliability, velocity and more. Importantly, we cover definitions and principles standardized by the CNCF's OpenGitOps group and what it means for you.
Get Started with GitOps:
You'll have GitOps up and running in about 30 mins using our free and open source tools! We'll give a brief vision of where you want to be with those security, reliability, and velocity benefits, and then we'll support you while go through the getting started steps. During the workshop, you'll also experience in action and see demos for:
- an opinionated repo structure to minimize decision fatigue
- disaster recovery using GitOps
- Helm charts example
- Multi-cluster example
- all with free and open source tools mostly in the CNCF (eg. Flux and Helm).
If you have questions before or after the workshop, talk to us at #weave-gitops http://bit.ly/WeaveGitOpsSlack (If you need to invite yourself to the Slack, visit https://slack.weave.works/)
This document discusses combining Ceph with Kubernetes for container-based storage management. It describes how Rook provides a simplified way to consume Ceph storage using Kubernetes concepts and APIs. The Ceph dashboard and Ceph management daemon (ceph-mgr) could also be integrated with Rook to provide a unified management experience. This would allow configuring Ceph storage through Kubernetes and the dashboard without needing deep Ceph expertise. The document outlines several ongoing projects aimed at further simplifying Ceph management, such as automatic placement group configuration and progress monitoring. The overall goal is to reduce the cognitive load on users and enable more automated workflows.
PuppetConf 2017: Zero to Kubernetes -Scott Coulton, PuppetPuppet
Containers are no longer in the distant future; a lot of businesses are starting to, or are already using, containers in dev/test. In this talk, we will walk through the offerings Puppet has to help you leap from dev/test to a production-from-scratch environment in the cloud. We will run through deploying Puppet Enterprise in AWS with Puppet's ready-made CloudFormation templates that leverage Puppet's AWS AMI for Puppet Enterprise. Then we'll use code deploy to pull the Puppet Kubernetes module, and deploy our production-ready cluster with our first application in a highly available configuration, using garethr/kubernetes. Not only will we run through the process — in theory, we will deploy the cluster live in real time. So you will not only have the tools to deploy a production-ready cluster, you will have had the experience of seeing it done in the real world.
Webinar topic: Mikrotik Hotspot
Presenter: Achmad Mardiansyah
In this webinar series, We are discussing Mikrotik Hotspot
Please share your feedback or webinar ideas here: http://bit.ly/glcfeedback
Check our schedule for future events: https://www.glcnetworks.com/en/schedule/
Follow our social media for updates: Facebook, Instagram, YouTube Channel, and telegram
The recording is available on Youtube
https://youtu.be/CX1STkMY3zQ
This document contains the slides for a webinar on Mikrotik RouterOS presented by GLC Networks. The webinar covers an introduction to RouterOS, its features, and a live practice session. It begins with reviewing prerequisite networking knowledge like the OSI model, TCP/IP protocols, routing tables, and network devices. It then introduces Mikrotik as a company and product line, and dives into the features and capabilities of RouterOS. The presentation concludes by advertising GLC Network's training courses and inviting questions.
What’s New in CloudStack 4.19 - Abhishek Kumar - ShapeBlueShapeBlue
This session gives a brief introduction of the new and exciting feature in the latest (upcoming) CloudStack LTS release, ie, 4.19.0. The discussion includes the details on the timeline of the CloudStack 4.19.0 release, overview of some of the marquee, new feature of the release – Object storage framework, KVM ingestion, Hypervisor agnostic simple DRS, CAPC aware CKS, OAuth2, DRaaS with Multi zone disaster recovery, etc and a summary of improvements added since the previous major LTS release of the CloudStack, ie, 4.18.0.
-----------------------------------------
The CloudStack Collaboration Conference 2023 took place on 23-24th November. The conference, arranged by a group of volunteers from the Apache CloudStack Community, took place in the voco hotel, in Porte de Clichy, Paris. It hosted over 350 attendees, with 47 speakers holding technical talks, user stories, new features and integrations presentations and more.
This document summarizes a workshop on the Tulipp project, which aims to develop ubiquitous low-power image processing platforms. The workshop covered shortcomings of existing platforms, introduced the Maestro real-time operating system as the reference platform, and described the concept of the Tulipp project to provide an operating system and tools to support heterogeneous architectures including FPGA and multi-core processors. Attendees participated in hands-on labs demonstrating how to build applications with Maestro, leverage OpenMP for parallelism, and use SDSoC tools to automatically accelerate functions in FPGA hardware.
Montreal Kubernetes Meetup: Developer-first workflows (for microservices) on ...Ambassador Labs
1. The document discusses developer-first workflows for building and operating microservices on Kubernetes.
2. It recommends creating self-sufficient, autonomous teams and using Kubernetes, Docker, and Envoy to provide the basic infrastructure primitives needed for distributed workflows.
3. The strategies suggested depend on the service maturity level and include using similar development and production environments for prototyping, implementing software redundancy for production services, and defining service level objectives and network observability for internal dependencies.
Similar to Integrating Puppet and Gitolite for sysadmins cooperations (20)
Mobile App Development Company In Noida | Drona InfotechDrona Infotech
Drona Infotech is a premier mobile app development company in Noida, providing cutting-edge solutions for businesses.
Visit Us For : https://www.dronainfotech.com/mobile-application-development/
The Rising Future of CPaaS in the Middle East 2024Yara Milbes
Explore "The Rising Future of CPaaS in the Middle East in 2024" with this comprehensive PPT presentation. Discover how Communication Platforms as a Service (CPaaS) is transforming communication across various sectors in the Middle East.
UI5con 2024 - Bring Your Own Design SystemPeter Muessig
How do you combine the OpenUI5/SAPUI5 programming model with a design system that makes its controls available as Web Components? Since OpenUI5/SAPUI5 1.120, the framework supports the integration of any Web Components. This makes it possible, for example, to natively embed own Web Components of your design system which are created with Stencil. The integration embeds the Web Components in a way that they can be used naturally in XMLViews, like with standard UI5 controls, and can be bound with data binding. Learn how you can also make use of the Web Components base class in OpenUI5/SAPUI5 to also integrate your Web Components and get inspired by the solution to generate a custom UI5 library providing the Web Components control wrappers for the native ones.
Consistent toolbox talks are critical for maintaining workplace safety, as they provide regular opportunities to address specific hazards and reinforce safe practices.
These brief, focused sessions ensure that safety is a continual conversation rather than a one-time event, which helps keep safety protocols fresh in employees' minds. Studies have shown that shorter, more frequent training sessions are more effective for retention and behavior change compared to longer, infrequent sessions.
Engaging workers regularly, toolbox talks promote a culture of safety, empower employees to voice concerns, and ultimately reduce the likelihood of accidents and injuries on site.
The traditional method of conducting safety talks with paper documents and lengthy meetings is not only time-consuming but also less effective. Manual tracking of attendance and compliance is prone to errors and inconsistencies, leading to gaps in safety communication and potential non-compliance with OSHA regulations. Switching to a digital solution like Safelyio offers significant advantages.
Safelyio automates the delivery and documentation of safety talks, ensuring consistency and accessibility. The microlearning approach breaks down complex safety protocols into manageable, bite-sized pieces, making it easier for employees to absorb and retain information.
This method minimizes disruptions to work schedules, eliminates the hassle of paperwork, and ensures that all safety communications are tracked and recorded accurately. Ultimately, using a digital platform like Safelyio enhances engagement, compliance, and overall safety performance on site. https://safelyio.com/
14 th Edition of International conference on computer visionShulagnaSarkar2
About the event
14th Edition of International conference on computer vision
Computer conferences organized by ScienceFather group. ScienceFather takes the privilege to invite speakers participants students delegates and exhibitors from across the globe to its International Conference on computer conferences to be held in the Various Beautiful cites of the world. computer conferences are a discussion of common Inventions-related issues and additionally trade information share proof thoughts and insight into advanced developments in the science inventions service system. New technology may create many materials and devices with a vast range of applications such as in Science medicine electronics biomaterials energy production and consumer products.
Nomination are Open!! Don't Miss it
Visit: computer.scifat.com
Award Nomination: https://x-i.me/ishnom
Conference Submission: https://x-i.me/anicon
For Enquiry: Computer@scifat.com
A neural network is a machine learning program, or model, that makes decisions in a manner similar to the human brain, by using processes that mimic the way biological neurons work together to identify phenomena, weigh options and arrive at conclusions.
UI5con 2024 - Keynote: Latest News about UI5 and it’s EcosystemPeter Muessig
Learn about the latest innovations in and around OpenUI5/SAPUI5: UI5 Tooling, UI5 linter, UI5 Web Components, Web Components Integration, UI5 2.x, UI5 GenAI.
Recording:
https://www.youtube.com/live/MSdGLG2zLy8?si=INxBHTqkwHhxV5Ta&t=0
Project Management: The Role of Project Dashboards.pdfKarya Keeper
Project management is a crucial aspect of any organization, ensuring that projects are completed efficiently and effectively. One of the key tools used in project management is the project dashboard, which provides a comprehensive view of project progress and performance. In this article, we will explore the role of project dashboards in project management, highlighting their key features and benefits.
8 Best Automated Android App Testing Tool and Framework in 2024.pdfkalichargn70th171
Regarding mobile operating systems, two major players dominate our thoughts: Android and iPhone. With Android leading the market, software development companies are focused on delivering apps compatible with this OS. Ensuring an app's functionality across various Android devices, OS versions, and hardware specifications is critical, making Android app testing essential.
Everything You Need to Know About X-Sign: The eSign Functionality of XfilesPr...XfilesPro
Wondering how X-Sign gained popularity in a quick time span? This eSign functionality of XfilesPro DocuPrime has many advancements to offer for Salesforce users. Explore them now!
Baha Majid WCA4Z IBM Z Customer Council Boston June 2024.pdfBaha Majid
IBM watsonx Code Assistant for Z, our latest Generative AI-assisted mainframe application modernization solution. Mainframe (IBM Z) application modernization is a topic that every mainframe client is addressing to various degrees today, driven largely from digital transformation. With generative AI comes the opportunity to reimagine the mainframe application modernization experience. Infusing generative AI will enable speed and trust, help de-risk, and lower total costs associated with heavy-lifting application modernization initiatives. This document provides an overview of the IBM watsonx Code Assistant for Z which uses the power of generative AI to make it easier for developers to selectively modernize COBOL business services while maintaining mainframe qualities of service.
The Key to Digital Success_ A Comprehensive Guide to Continuous Testing Integ...kalichargn70th171
In today's business landscape, digital integration is ubiquitous, demanding swift innovation as a necessity rather than a luxury. In a fiercely competitive market with heightened customer expectations, the timely launch of flawless digital products is crucial for both acquisition and retention—any delay risks ceding market share to competitors.
Microservice Teams - How the cloud changes the way we workSven Peters
A lot of technical challenges and complexity come with building a cloud-native and distributed architecture. The way we develop backend software has fundamentally changed in the last ten years. Managing a microservices architecture demands a lot of us to ensure observability and operational resiliency. But did you also change the way you run your development teams?
Sven will talk about Atlassian’s journey from a monolith to a multi-tenanted architecture and how it affected the way the engineering teams work. You will learn how we shifted to service ownership, moved to more autonomous teams (and its challenges), and established platform and enablement teams.
Unlock the Secrets to Effortless Video Creation with Invideo: Your Ultimate G...The Third Creative Media
"Navigating Invideo: A Comprehensive Guide" is an essential resource for anyone looking to master Invideo, an AI-powered video creation tool. This guide provides step-by-step instructions, helpful tips, and comparisons with other AI video creators. Whether you're a beginner or an experienced video editor, you'll find valuable insights to enhance your video projects and bring your creative ideas to life.
E-Invoicing Implementation: A Step-by-Step Guide for Saudi Arabian CompaniesQuickdice ERP
Explore the seamless transition to e-invoicing with this comprehensive guide tailored for Saudi Arabian businesses. Navigate the process effortlessly with step-by-step instructions designed to streamline implementation and enhance efficiency.
Integrating Puppet and Gitolite for sysadmins cooperations
1. Cooperating sysadmins: it’s not
an oxymoron.
Integrating Puppet and Gitolite to make our lives easier.
Luca Mazzaferro
04 December 2014
2. Outline
● About me...
● The Motivations
● The Ingredients
● Puppet-Gitolite integration
● Final considerations.
● Conclusions.
...in 20 minutes (approximately)
2
3. About me...
Born 33 years
ago here...
Master Degree in
Physics at “La
Sapienza”
PhD in Physics at
“Tor Vergata”
Rome: a place with many
cultural interests, but I
was still looking for other
experiences...
Why not München?
3
4. RZG Garching
Computing support for many experiments and collaborations:
Storage and Data archiving for Max Planck Scientists:
● up to 90PBytes
● 30K Tapes
IBM Supercomputer Hydra (80k cores, total memory: 260 TByte;
water cooling):
● Research on Nuclear Fusions and Plasma Physics
● High Energy Physics
● Material Science
● Simulations
Applications support of high-performance-computing
applications to Max-Planck Institutes:
● development
● optimization
● analysis
● visualization
http://www.rzg.mpg.de/
4
Many dedicated linux clusters
9. Puppet
● It’s an opensource multiplatform management tool
based on Ruby (“Wikipedia”).
● It helps to manage an entire infrastructure throughout its
lifecycle from the provisioning and configuration to
orchestration and reporting (“PuppetLabs.com”)
● In few word it is like a good orchestra
conductor
9
10. Quick overview about Puppet
Puppet
Code
3. Enforce the changes
Install...
Update...
Configure...
Restart...
etc...
4. Reporting
2. Simulate them before
deploying changes
1. Define your services/resources in
reusable manifests eventually
organized in modules
10
Dashboard
Foreman
Terminal
11. Foreman
● Foreman is an open source project that gives system
administrators the power to easily automate repetitive
tasks, quickly deploy applications, and proactively
manage servers, on-premises or in the cloud. [http:
//theforeman.org/]
● We use it on top of Puppet as
○ User and grants management
○ Monitor
○ Report collector
○ External Node Classifier (ENC)
11
12. Quick overview about Gitolite
12
“Gitolite allows you to setup git hosting on a central server,
with fine-grained access control and many more powerful
features”. [http://gitolite.com/gitolite/index.html]
● Easy to install: it’s a tarball working with few setup
● Security based on ssh-key exchange
● Easy manageable via a dedicated repository (no direct intervention on the
server)
● Extensible with plugins and graphical interface
● Hooks and Triggers available to add customizations
14. Putting things together
● Puppet:
○ deployment service
● Foreman:
○ puppet management service (stops
admins interfering with each other)
● Gitolite:
○ enables admins to develop and share
modules without interfering each other.
○ avoiding direct access to puppet server
14
20. Puppet User Management
/environments
/
/modules
/manifests
Exp/App
Storage
CP Nodes
Storage
Foreman Interface as ENC:
● User management:
○ association environments <-> users
○ association environments <-> nodes
○ correlation with gitolite repositories
● Centralized management of puppet master,
certificates,
● Monitoring
20
21. A bit deeper inside Gitolite
gitweb
Experiments.git Storage.git Compute Nodes.git
Experiments
/environments
Storage Compute Nodes
Repositories
Experiments
[applications]
gitolite
● Access to repositories via git protocol
● Authorizations and Authentications
based on ssh-keys
● Web interface (gitweb) for modules
visualization
21
22. Some considerations about Gitolite
Benefits:
● Allows several sysadmins to work on the same puppet
master in a safe way
● Provide a revision control
● Web Interface (gitweb) for code viewing
● Allows simply code sharing
22
24. ● Closed environments to avoid
errors propagation but...
● ... still enabling code sharing
between different sysadmins
● One only centralized service to
maintain
● Revision controller
● Increase the safety
● Open Source
● Suggestions?
● Maybe: a bit tricky to install and
configure the first time?! But
Doable!
● Suggestions?
24
25. Next Steps
● continuous integration + continuous delivery:
○ Docker and/or Jenkins?
● Improve authorization and access in the
gitolite web interface
25
26. Conclusions
Enable many sysadmins to work together on
one centralize puppet master without
interfering with each other!
● Increase the safety: no direct interaction with P.M.
● Revision Control
● Just started but looks promising
26
27. Thanks for your attention
Any question or suggestion?
27
luca.mazzaferro@rzg.mpg.de
28. Some Tech Details
Very Light Weight
Type: VM
OS: SL6.6
cpu: 1
mem: 2G
Docker Version: 1.3.1
Foreman Version: 1.6.1
Puppet Master: 3.7.3
/var/log
/etc/foreman
link
/var/lib/puppet/ssl
/etc/puppet/environments
/etc/puppet/modules
gitolite
About our infrastructure
Computing farm for physics
experiments:
● Storage: 1.5 PBytes
● Computes Nodes: hundreds
● Many services for users
Research Communities:
● up to 10
Owncloud internal service:
● just started
Total sysadmins supported:
● three
22
29. Motivations
What ONE sysadmin would like to have:
● Easy life:
○ easily deploy of new softwares or upgrades
○ fast and easy reconfigurations/restart of the
services
○ possibly, one interface for different tools
○ OS independent
○ higher level of abstraction
○ automation
6
30. Motivations
...but what if MANY sysadmins are working on
the same system?
● closed environments
● sharing of the code and configurations
● writing code?! Revision controller!
● centralized automation system
7