PuppetConf 2017: A Not So Bumpy Road to Puppet4 at CERN- Nacho Barrientos, CERN
•
0 likes•141 views
The CERN IT department provides Puppet-powered configuration management services to LHC experiments and to the department itself for more than 26,000 physical and virtual machines in two data centres. This presentation will give an overview of the current deployment (figures and CERN specials), our experience and methodology migrating to Puppet4 and other ongoing projects such as multitenancy support.
Report
Share
Report
Share
Download to read offline
Recommended
LF_OVS_17_State of the OVN
OVN has come a long way since its initial focus on providing virtual networking for OpenStack in a way that had minimal dependencies and complexity. Over several OpenStack releases, OVN has implemented key Neutron abstractions like logical switches, routers, security groups, and load balancing using OpenFlow. It provides distributed implementations of these functions along with new capabilities like ACL logging, DHCP services, and L3 gateway high availability. OVN is now reusable outside of OpenStack as well with integrations for Kubernetes, Docker, and other platforms.
LF_OVS_17_LXC Linux Containers over Open vSwitch
This document discusses using LXC Linux containers over Open vSwitch (OVS) for container networking. It provides information on the Orabuntu-LXC project which builds and installs OVS and LXC to deploy containerized Oracle software. It describes how LXC 2.1.0 added explicit support for OVS and how OVS can be configured as a systemd service. It also discusses using OVS with containerized DNS/DHCP and sending container traffic over GRE tunnels.
Kubernetes Intro
This document provides an overview of Kubernetes. It begins by introducing Kubernetes and its origins at Google. It then discusses key Kubernetes concepts like pods, deployments, services, ingress, namespaces, labels, and storage. It explains how Kubernetes provides automation of application deployment, scaling, and management using containers. It also discusses how Kubernetes helps enable continuous integration, continuous deployment, and digital transformation. The document concludes by mentioning the Kubernetes ecosystem and Cloud Native Computing Foundation.
LF_OVS_17_OVN and Containers - An update.
This document discusses integrating Open vSwitch (OVS) and Open Virtual Network (OVN) with containers and orchestrators like Docker and Kubernetes. It provides examples of using OVS and OVN commands to connect containers running in different namespaces to logical switches managed by OVN. It also describes how OVN implements Kubernetes networking concepts like pods, services, load balancing, and network policies using logical ports, switches and routers.
Sdn command line controller lab
This document provides instructions for using Mininet and the POX controller to simulate a software-defined networking (SDN) environment. It describes downloading a virtual machine appliance containing Mininet and checking the Linux setup. It then explains how to use Mininet to create a simple network topology with hosts, switches, and links. Basic OpenFlow commands are demonstrated like adding flows manually and viewing flow tables. Finally, it shows how to activate Wireshark for examining OpenFlow traffic.
Ovn vancouver
OVN is an open source virtual network solution for Open vSwitch that provides logical L2 and L3 networking, including logical switches, routers, security groups, and multiple tunneling protocols. It is designed to scale to thousands of hypervisors and VMs, improve performance over existing plugins, and integrate with OpenStack and other cloud management systems through its databases and daemons. OVN aims to become the default virtual network solution in OpenStack Neutron by replacing the existing OVS plugin.
Sfo15 408- odp-dpdk platform performance
SFO15-408: ODP-DPDK platform performance
Speaker: Zoltan Kiss
Date: September 24, 2015
★ Session Description ★
ODP-DPDK platform performance.
★ Resources ★
Video:
Presentation:
Etherpad: pad.linaro.org/p/sfo15-408
Pathable: https://sfo15.pathable.com/meetings/303080
★ Event Details ★
Linaro Connect San Francisco 2015 - #SFO15
September 21-25, 2015
Hyatt Regency Hotel
http://www.linaro.org
http://connect.linaro.org
LinuxCon 2015 Stateful NAT with OVS
As containers are being deployed as part of multi tenant clusters, virtual multi layer switches become essential to interconnect containers while providing isolation guarantees. Assigning tenants their own private networks requires stateful network address translation (NAT) implemented in a scalable architecture to expose containers to public networks. Existing virtual switches integrated into the Linux kernel did not support stateful NAT so far. This presentation introduces a new virtual NAT service deployable as container built using existing kernel functionality such as network namespaces, routing rules and Netfilter to provide NAT services to existing virtual switches such as Open vSwitch and the Linux bridge but also the core L3 layer of Linux.
Recommended
LF_OVS_17_State of the OVN
OVN has come a long way since its initial focus on providing virtual networking for OpenStack in a way that had minimal dependencies and complexity. Over several OpenStack releases, OVN has implemented key Neutron abstractions like logical switches, routers, security groups, and load balancing using OpenFlow. It provides distributed implementations of these functions along with new capabilities like ACL logging, DHCP services, and L3 gateway high availability. OVN is now reusable outside of OpenStack as well with integrations for Kubernetes, Docker, and other platforms.
LF_OVS_17_LXC Linux Containers over Open vSwitch
This document discusses using LXC Linux containers over Open vSwitch (OVS) for container networking. It provides information on the Orabuntu-LXC project which builds and installs OVS and LXC to deploy containerized Oracle software. It describes how LXC 2.1.0 added explicit support for OVS and how OVS can be configured as a systemd service. It also discusses using OVS with containerized DNS/DHCP and sending container traffic over GRE tunnels.
Kubernetes Intro
This document provides an overview of Kubernetes. It begins by introducing Kubernetes and its origins at Google. It then discusses key Kubernetes concepts like pods, deployments, services, ingress, namespaces, labels, and storage. It explains how Kubernetes provides automation of application deployment, scaling, and management using containers. It also discusses how Kubernetes helps enable continuous integration, continuous deployment, and digital transformation. The document concludes by mentioning the Kubernetes ecosystem and Cloud Native Computing Foundation.
LF_OVS_17_OVN and Containers - An update.
This document discusses integrating Open vSwitch (OVS) and Open Virtual Network (OVN) with containers and orchestrators like Docker and Kubernetes. It provides examples of using OVS and OVN commands to connect containers running in different namespaces to logical switches managed by OVN. It also describes how OVN implements Kubernetes networking concepts like pods, services, load balancing, and network policies using logical ports, switches and routers.
Sdn command line controller lab
This document provides instructions for using Mininet and the POX controller to simulate a software-defined networking (SDN) environment. It describes downloading a virtual machine appliance containing Mininet and checking the Linux setup. It then explains how to use Mininet to create a simple network topology with hosts, switches, and links. Basic OpenFlow commands are demonstrated like adding flows manually and viewing flow tables. Finally, it shows how to activate Wireshark for examining OpenFlow traffic.
Ovn vancouver
OVN is an open source virtual network solution for Open vSwitch that provides logical L2 and L3 networking, including logical switches, routers, security groups, and multiple tunneling protocols. It is designed to scale to thousands of hypervisors and VMs, improve performance over existing plugins, and integrate with OpenStack and other cloud management systems through its databases and daemons. OVN aims to become the default virtual network solution in OpenStack Neutron by replacing the existing OVS plugin.
Sfo15 408- odp-dpdk platform performance
SFO15-408: ODP-DPDK platform performance
Speaker: Zoltan Kiss
Date: September 24, 2015
★ Session Description ★
ODP-DPDK platform performance.
★ Resources ★
Video:
Presentation:
Etherpad: pad.linaro.org/p/sfo15-408
Pathable: https://sfo15.pathable.com/meetings/303080
★ Event Details ★
Linaro Connect San Francisco 2015 - #SFO15
September 21-25, 2015
Hyatt Regency Hotel
http://www.linaro.org
http://connect.linaro.org
LinuxCon 2015 Stateful NAT with OVS
As containers are being deployed as part of multi tenant clusters, virtual multi layer switches become essential to interconnect containers while providing isolation guarantees. Assigning tenants their own private networks requires stateful network address translation (NAT) implemented in a scalable architecture to expose containers to public networks. Existing virtual switches integrated into the Linux kernel did not support stateful NAT so far. This presentation introduces a new virtual NAT service deployable as container built using existing kernel functionality such as network namespaces, routing rules and Netfilter to provide NAT services to existing virtual switches such as Open vSwitch and the Linux bridge but also the core L3 layer of Linux.
Improving Network Application Performance using Load Aware Libeventdev
Compared to load unaware packet distribution mechanisms often used in the run to completion model, an event scheduler improves core utilization and better handles dynamic traffic mixes by scheduling packets to cores according to their load. It simultaneously provides both atomicity and packet ordering. Hardware-based event schedulers can also provide low-latency inter-core communication. The libeventdev library from Data Plane Development Kit (DPDK) helps developers leverage the event scheduler model.
About the presenter: Sundar Vedantham, Intel, is a Senior Technical Manager working in the Data Center Group in Allentown, PA. His research interests include network traffic and congestion management, high-speed networking, and theoretical computer models, areas in which he holds patents and has published papers, book chapter & articles. He received his Ph.D. in Computer Science in 1997 from Louisiana State University. He enjoys writing articles in English and Tamil to help improve public understanding of technical details behind the fields he has worked on and to attract young students to get into STEM fields.
Excitingly simple multi-path OpenStack networking: LAG-less, L2-less, yet ful...
Yuki Nishiwaki / Samir Ibradzic (LINE Corporation)
OpenStack Summit Vancouver, May 2018
https://www.openstack.org/summit/vancouver-2018/summit-schedule/global-search?t=Yuki%20Nishiwaki
Red Hat demo of OpenStack and ODL at ODL summit 2016
Red Hat demonstrated OpenDaylight (ODL) as an SDN Controller for OpenStack. We showed the integration of the Boron release of OpenDaylight with the Mitaka release of OpenStack. The primary objective of the demo was to show how NetVirt can easily create and manage virtual networks that are flexible, secure and scalable.
Heartache and Heartbleed - 31c3
Heartache and Heartbleed: An inside look a the aftermath of Heartbleed. Presented at 31c3 in Hamburg on December 29, 2014.
DOD 2016 - Kamil Szczygieł - Patching 100 OpenStack Compute Nodes with Zero-d...
YouTube: https://www.youtube.com/watch?v=OsgNn-D9KFc&index=15&list=PLnKL6-WWWE_VtIMfNLW3N3RGuCUcQkDMl
Undisclosed vulnerabilities are very serious threat to the cloud security. Once the flaw leaks to the public information, the risk of attacks increases dramatically. In our talk we will go through case study of patching 100 OpenStack compute nodes consisting of 4000 virtual machines with zero-day patch within 16 hours. We will talk about the challenges we have encountered, how we faced them and we will answer the most important question – did we make it within 16 hours.
Deploying OpenDaylight and OpenStack at Ease
Looking for a way to deploy a stable OpenStack Cloud Environment with Opendaylight at ease? This session is about learning to deploy a Cloud environment with OPNFV Fuel deployer. Fuel is a deployment tool which deploys a wide variety of distributions with third party plugins like OpenDayLight, while abstracting out complexities of the deployment. The intent of this session is to familiarize deployment of OpenStack with OpenDaylight.
About the author: Pramod is a software developer in OpenStack and OpenDayLight, working for OTC, SSG at Intel. His Area of Interest is in Cloud Networking and Applications. He has prior experience in Databases and his current focus is on developing features of Cloud Networking Platform. He holds Masters Degree from San Jose State University.
A Deep Dive into Kafka Controller
Speaker: Jun Rao, VP of Apache Kafka and Co-founder of Confluent
The controller is the brain of Apache Kafka®. A big part of what the controller does is to maintain the consistency of the replicas and determine which replica can be used to serve the clients, especially during individual broker failure.
In this talk, Jun will outline the main data flow in the controller—in particular, when a broker fails, how the controller automatically promotes another replica as the leader to serve the clients, and when a broker is started, how the controller resumes the replication pipeline in the restarted broker. Jun will then describe recent improvements to the controller that allow it to handle certain edge cases correctly and increase its performance, which allows for more partitions in a Kafka cluster.
Jun Rao is the co-founder of Confluent, a company that provides a streaming data platform on top of Apache Kafka. Previously, Jun was a senior staff engineer at LinkedIn, where he led the development of Kafka, and a researcher at IBM's Almaden research datacenter, where he conducted research on database and distributed systems. Jun is the PMC chair of Apache Kafka and a committer of Cassandra. He writes at https://cnfl.io/blog-jun-rao.
Opensource approach to design and deployment of Microservices based VNF
Microservice is gaining increased adoption in the Telco NFV world. It is key to understand the design and deployment methodologies involved in developing Microservice based VNF. This talk provides an opensource practitioner approach to building and deploying a Microservice based VNF and includes the following: - Design patterns, workflow models - Design models for VNF placement, capacity management, scale-in/out and resiliency - Deployment considerations that includes handing of scale and fault tolerant VNF using well known Opensource tools.
About the presenter: Prem Sankar works for Ericsson Opensource Ecosystem team and part of the Opendaylight and OPNFV team in Ericsson. Prem evangelizes SDN and Cloud and has given many sessions and conducted workshops around SDN and ODL. Prem is PTL of ODL COE project and currently driving the Kuberenetes and ODL Integration in Opendaylight community. Prem is a frequent speaker at opensource summits and has presented in Opendaylight, OPNFV and Open networking summits.
Open vSwitch Offload: Conntrack and the Upstream Kernel
Offloading all or part of the Open vSwitch datapath to SmartNICs has been shown to not only release CPU resources on the server, but improve traffic processing performance. Recently steps have been made to support such offloading in the upstream Linux kernel. This has focused on creating an OVS datapath using the TC flower filter and utilizing the offload hooks already present here. This presentation focuses on how Connection Tracking (Conntrack) may fit into this model. It describes current work being undertaken with the Netfilter community to allow offloading of Conntrack entries. It continues to link this work with the offloading of Conntrack rules within OVS-TC.
OVN: Scaleable Virtual Networking for Open vSwitch
OVN is a network virtualization architecture that allows for scalable virtual networking on Open vSwitch. It abstracts virtual networking from physical networking and provides the same features as physical networks. OVN uses distributed logical flows and databases coordinated by local controllers to convert logical flows to physical flows. This allows for high performance, scalable virtual networking without depending on the physical topology.
Open daylight and Openstack
OpenDaylight can be used as the SDN controller for OpenStack networking. The document discusses:
1. What OpenDaylight and SDN controllers are and their roles.
2. How to configure OpenStack to use OpenDaylight by cleaning Neutron configurations, installing OpenDaylight, configuring Open vSwitch to connect to OpenDaylight, and setting OpenDaylight as the ML2 mechanism driver.
3. This allows OpenDaylight to centrally manage network policies and topologies for OpenStack.
Quic Tools Presentation
QUICTools is a toolkit for Quantel's Q System that provides media management, movement, and integration workflow solutions. It has a vast range of media management functions like browsing, searching, and editing metadata for clips across multiple Quantel servers and zones. It can also move media between file shares, FTP servers and Power Portals. Additionally, QUICTools has an open architecture that allows custom workflows to be added for integration tasks and provides APIs for developers.
Taking Security Groups to Ludicrous Speed with OVS (OpenStack Summit 2015)
Open vSwitch (OVS) has long been a critical component of the Neutron's reference implementation, offering reliable and flexible virtual switching for cloud environments.
Being an early adopter of the OVS technology, Neutron's reference implementation made some compromises to stay within the early, stable featureset OVS exposed. In particular, Security Groups (SG) have been so far implemented by leveraging hybrid Linux Bridging and IPTables, which come at a significant performance overhead. However, thanks to recent developments and ongoing improvements within the OVS community, we are now able to implement feature-complete security groups directly within OVS.
In this talk we will summarize the existing Security Groups implementation in Neutron and compare its performance with the Open vSwitch-only approach. We hope this analysis will form the foundation of future improvements to the Neutron Open vSwitch reference design.
How OPNFV Uses OpenStack & How It's Useful
OpenStack has been a part of OPNFV from the start and the OpenStack and OPNFV communities have strong areas of overlap. We will explain OPNFV from an Openstack and practical perspective, providing a specific example (SFC scenario) of how we are daily testing different components of OpenStack and other communities (ODL, OVS, etc). We’ll also talk about how OPNFV is useful to OpenStack because (hint: telco requirements & testing) and briefly describe several OPNFV projects which have contributed to OpenStack: NetReady, Multisite, Doctor, Cross CI, Copper, etc.
Automating linux network performance testing
The new virtualization technologies and cloud environments are a big challenge for testing network performance. We need a new approach for testing, using realistic scenarios and flexible tools that allow us to generate packets at high speed. Trex is an Open Source network generator with all these batteries included.
eBPF - Rethinking the Linux Kernel
The Linux kernel is undergoing the most fundamental architecture evolution in history and is becoming a microkernel. Why is the Linux kernel evolving into a microkernel? The potentially biggest fundamental change ever happening to the Linux kernel. This talk covers how companies like Facebook and Google use BPF to patch 0-day exploits, how BPF will change the way features are added to the kernel forever, and how BPF is introducing a new type of application deployment method for the Linux kernel.
Breaking the monolith
A lightening talk I gave at the last Kubernetes Milano Meetup about what it takes to split a monolithic codebase, when you should do it and a few tips to keep in mind during the process.
OpenDaylight: an open source SDN for your OpenStack cloud
Presented at the 2013 OpenStack Summit in Hong Kong.
Authors: Stephan Baucke, Kyle Mestery, Anees Shaikh, Chris Wright
OpenDaylight is an exciting new community-led, open source project focused on accelerating adoption of software-defined networking (SDN) by providing a robust SDN platform on which the industry can build and innovate. An OpenDaylight controller provides flexible management of both physical and virtual networks. The open source nature of the project and its flexible network management capabilities make it an ideal SDN platform to integrate with Neutron.
In this session, OpenDaylight community members from Cisco, IBM, RedHat, and Ericsson will describe the OpenDaylight project goals and platform architecture, as well as the roadmap and progress to date. OpenDaylight brings together a number of virtual networking approaches, and we will discuss integration approaches with OpenStack Neutron that provide flexibility for OpenStack administrators and users. Details of our initial Neutron integration will also be demonstrated for attendees.
Attendees will leave this session with a greater understanding of what OpenDaylight is, and how it can integrate with OpenStack Neutron to provide a powerful SDN-based networking solution for OpenStack Clouds.
PAC 2019 virtual Scott Moore
Scott Moore presented on performance testing HTTP/3 (QUIC). He provided background on the timeline of HTTP/3 development and how it aims to solve head of line blocking that still exists with HTTP/2 over TCP. Moore demonstrated performance tests of HTTP/1.1, HTTP/2, and HTTP/3 with and without network emulation of LTE and satellite connections. The results showed HTTP/3's potential to remove head of line blocking but also challenges around increased server load and UDP optimizations needed. Moore concluded that HTTP/3 benefits will be most noticeable on low bandwidth connections and additional protocols will need to support it as adoption increases over time.
F5 OpenShift Workshop
This document provides an overview of an OpenShift/F5 Container Ingress Services workshop. It begins with an introduction and agenda. It then covers OpenShift and Kubernetes concepts like containers, pods, deployments, services and the overall architecture. It discusses what Container Ingress Services (CIS) is and how it integrates F5 BIG-IP devices. The lab will demonstrate CIS components like the controller, configmaps and deployment methods. It concludes with next steps and resources for further learning.
Integrating Puppet and Gitolite for sysadmins cooperations
In this slides is presented a light solution based on the integration between Puppet-Foreman and Gitolite to the problem: How to enable many sysadmins to work together on one work environment without interfering with each other?
Puppet Camp Berlin 2015: Configuration Management @ CERN: Going Agile with Style
CERN uses Puppet for configuration management of its large infrastructure including 15k servers and 300PB of storage. Puppet is used to configure services across the infrastructure through modules, hostgroups, and environments. Changes go through a review process involving testing in custom environments before being merged to production. Tools like Jens, Jenkins, Rundeck, and Mcollective help automate operations and configuration changes at scale. Configuration drift and package inventory are challenges addressed through tools and snapshots. Puppet allows CERN to efficiently manage its resources in an agile manner while reducing intervention times.
More Related Content
What's hot
Improving Network Application Performance using Load Aware Libeventdev
Compared to load unaware packet distribution mechanisms often used in the run to completion model, an event scheduler improves core utilization and better handles dynamic traffic mixes by scheduling packets to cores according to their load. It simultaneously provides both atomicity and packet ordering. Hardware-based event schedulers can also provide low-latency inter-core communication. The libeventdev library from Data Plane Development Kit (DPDK) helps developers leverage the event scheduler model.
About the presenter: Sundar Vedantham, Intel, is a Senior Technical Manager working in the Data Center Group in Allentown, PA. His research interests include network traffic and congestion management, high-speed networking, and theoretical computer models, areas in which he holds patents and has published papers, book chapter & articles. He received his Ph.D. in Computer Science in 1997 from Louisiana State University. He enjoys writing articles in English and Tamil to help improve public understanding of technical details behind the fields he has worked on and to attract young students to get into STEM fields.
Excitingly simple multi-path OpenStack networking: LAG-less, L2-less, yet ful...
Yuki Nishiwaki / Samir Ibradzic (LINE Corporation)
OpenStack Summit Vancouver, May 2018
https://www.openstack.org/summit/vancouver-2018/summit-schedule/global-search?t=Yuki%20Nishiwaki
Red Hat demo of OpenStack and ODL at ODL summit 2016
Red Hat demonstrated OpenDaylight (ODL) as an SDN Controller for OpenStack. We showed the integration of the Boron release of OpenDaylight with the Mitaka release of OpenStack. The primary objective of the demo was to show how NetVirt can easily create and manage virtual networks that are flexible, secure and scalable.
Heartache and Heartbleed - 31c3
Heartache and Heartbleed: An inside look a the aftermath of Heartbleed. Presented at 31c3 in Hamburg on December 29, 2014.
DOD 2016 - Kamil Szczygieł - Patching 100 OpenStack Compute Nodes with Zero-d...
YouTube: https://www.youtube.com/watch?v=OsgNn-D9KFc&index=15&list=PLnKL6-WWWE_VtIMfNLW3N3RGuCUcQkDMl
Undisclosed vulnerabilities are very serious threat to the cloud security. Once the flaw leaks to the public information, the risk of attacks increases dramatically. In our talk we will go through case study of patching 100 OpenStack compute nodes consisting of 4000 virtual machines with zero-day patch within 16 hours. We will talk about the challenges we have encountered, how we faced them and we will answer the most important question – did we make it within 16 hours.
Deploying OpenDaylight and OpenStack at Ease
Looking for a way to deploy a stable OpenStack Cloud Environment with Opendaylight at ease? This session is about learning to deploy a Cloud environment with OPNFV Fuel deployer. Fuel is a deployment tool which deploys a wide variety of distributions with third party plugins like OpenDayLight, while abstracting out complexities of the deployment. The intent of this session is to familiarize deployment of OpenStack with OpenDaylight.
About the author: Pramod is a software developer in OpenStack and OpenDayLight, working for OTC, SSG at Intel. His Area of Interest is in Cloud Networking and Applications. He has prior experience in Databases and his current focus is on developing features of Cloud Networking Platform. He holds Masters Degree from San Jose State University.
A Deep Dive into Kafka Controller
Speaker: Jun Rao, VP of Apache Kafka and Co-founder of Confluent
The controller is the brain of Apache Kafka®. A big part of what the controller does is to maintain the consistency of the replicas and determine which replica can be used to serve the clients, especially during individual broker failure.
In this talk, Jun will outline the main data flow in the controller—in particular, when a broker fails, how the controller automatically promotes another replica as the leader to serve the clients, and when a broker is started, how the controller resumes the replication pipeline in the restarted broker. Jun will then describe recent improvements to the controller that allow it to handle certain edge cases correctly and increase its performance, which allows for more partitions in a Kafka cluster.
Jun Rao is the co-founder of Confluent, a company that provides a streaming data platform on top of Apache Kafka. Previously, Jun was a senior staff engineer at LinkedIn, where he led the development of Kafka, and a researcher at IBM's Almaden research datacenter, where he conducted research on database and distributed systems. Jun is the PMC chair of Apache Kafka and a committer of Cassandra. He writes at https://cnfl.io/blog-jun-rao.
Opensource approach to design and deployment of Microservices based VNF
Microservice is gaining increased adoption in the Telco NFV world. It is key to understand the design and deployment methodologies involved in developing Microservice based VNF. This talk provides an opensource practitioner approach to building and deploying a Microservice based VNF and includes the following: - Design patterns, workflow models - Design models for VNF placement, capacity management, scale-in/out and resiliency - Deployment considerations that includes handing of scale and fault tolerant VNF using well known Opensource tools.
About the presenter: Prem Sankar works for Ericsson Opensource Ecosystem team and part of the Opendaylight and OPNFV team in Ericsson. Prem evangelizes SDN and Cloud and has given many sessions and conducted workshops around SDN and ODL. Prem is PTL of ODL COE project and currently driving the Kuberenetes and ODL Integration in Opendaylight community. Prem is a frequent speaker at opensource summits and has presented in Opendaylight, OPNFV and Open networking summits.
Open vSwitch Offload: Conntrack and the Upstream Kernel
Offloading all or part of the Open vSwitch datapath to SmartNICs has been shown to not only release CPU resources on the server, but improve traffic processing performance. Recently steps have been made to support such offloading in the upstream Linux kernel. This has focused on creating an OVS datapath using the TC flower filter and utilizing the offload hooks already present here. This presentation focuses on how Connection Tracking (Conntrack) may fit into this model. It describes current work being undertaken with the Netfilter community to allow offloading of Conntrack entries. It continues to link this work with the offloading of Conntrack rules within OVS-TC.
OVN: Scaleable Virtual Networking for Open vSwitch
OVN is a network virtualization architecture that allows for scalable virtual networking on Open vSwitch. It abstracts virtual networking from physical networking and provides the same features as physical networks. OVN uses distributed logical flows and databases coordinated by local controllers to convert logical flows to physical flows. This allows for high performance, scalable virtual networking without depending on the physical topology.
Open daylight and Openstack
OpenDaylight can be used as the SDN controller for OpenStack networking. The document discusses:
1. What OpenDaylight and SDN controllers are and their roles.
2. How to configure OpenStack to use OpenDaylight by cleaning Neutron configurations, installing OpenDaylight, configuring Open vSwitch to connect to OpenDaylight, and setting OpenDaylight as the ML2 mechanism driver.
3. This allows OpenDaylight to centrally manage network policies and topologies for OpenStack.
Quic Tools Presentation
QUICTools is a toolkit for Quantel's Q System that provides media management, movement, and integration workflow solutions. It has a vast range of media management functions like browsing, searching, and editing metadata for clips across multiple Quantel servers and zones. It can also move media between file shares, FTP servers and Power Portals. Additionally, QUICTools has an open architecture that allows custom workflows to be added for integration tasks and provides APIs for developers.
Taking Security Groups to Ludicrous Speed with OVS (OpenStack Summit 2015)
Open vSwitch (OVS) has long been a critical component of the Neutron's reference implementation, offering reliable and flexible virtual switching for cloud environments.
Being an early adopter of the OVS technology, Neutron's reference implementation made some compromises to stay within the early, stable featureset OVS exposed. In particular, Security Groups (SG) have been so far implemented by leveraging hybrid Linux Bridging and IPTables, which come at a significant performance overhead. However, thanks to recent developments and ongoing improvements within the OVS community, we are now able to implement feature-complete security groups directly within OVS.
In this talk we will summarize the existing Security Groups implementation in Neutron and compare its performance with the Open vSwitch-only approach. We hope this analysis will form the foundation of future improvements to the Neutron Open vSwitch reference design.
How OPNFV Uses OpenStack & How It's Useful
OpenStack has been a part of OPNFV from the start and the OpenStack and OPNFV communities have strong areas of overlap. We will explain OPNFV from an Openstack and practical perspective, providing a specific example (SFC scenario) of how we are daily testing different components of OpenStack and other communities (ODL, OVS, etc). We’ll also talk about how OPNFV is useful to OpenStack because (hint: telco requirements & testing) and briefly describe several OPNFV projects which have contributed to OpenStack: NetReady, Multisite, Doctor, Cross CI, Copper, etc.
Automating linux network performance testing
The new virtualization technologies and cloud environments are a big challenge for testing network performance. We need a new approach for testing, using realistic scenarios and flexible tools that allow us to generate packets at high speed. Trex is an Open Source network generator with all these batteries included.
eBPF - Rethinking the Linux Kernel
The Linux kernel is undergoing the most fundamental architecture evolution in history and is becoming a microkernel. Why is the Linux kernel evolving into a microkernel? The potentially biggest fundamental change ever happening to the Linux kernel. This talk covers how companies like Facebook and Google use BPF to patch 0-day exploits, how BPF will change the way features are added to the kernel forever, and how BPF is introducing a new type of application deployment method for the Linux kernel.
Breaking the monolith
A lightening talk I gave at the last Kubernetes Milano Meetup about what it takes to split a monolithic codebase, when you should do it and a few tips to keep in mind during the process.
OpenDaylight: an open source SDN for your OpenStack cloud
Presented at the 2013 OpenStack Summit in Hong Kong.
Authors: Stephan Baucke, Kyle Mestery, Anees Shaikh, Chris Wright
OpenDaylight is an exciting new community-led, open source project focused on accelerating adoption of software-defined networking (SDN) by providing a robust SDN platform on which the industry can build and innovate. An OpenDaylight controller provides flexible management of both physical and virtual networks. The open source nature of the project and its flexible network management capabilities make it an ideal SDN platform to integrate with Neutron.
In this session, OpenDaylight community members from Cisco, IBM, RedHat, and Ericsson will describe the OpenDaylight project goals and platform architecture, as well as the roadmap and progress to date. OpenDaylight brings together a number of virtual networking approaches, and we will discuss integration approaches with OpenStack Neutron that provide flexibility for OpenStack administrators and users. Details of our initial Neutron integration will also be demonstrated for attendees.
Attendees will leave this session with a greater understanding of what OpenDaylight is, and how it can integrate with OpenStack Neutron to provide a powerful SDN-based networking solution for OpenStack Clouds.
PAC 2019 virtual Scott Moore
Scott Moore presented on performance testing HTTP/3 (QUIC). He provided background on the timeline of HTTP/3 development and how it aims to solve head of line blocking that still exists with HTTP/2 over TCP. Moore demonstrated performance tests of HTTP/1.1, HTTP/2, and HTTP/3 with and without network emulation of LTE and satellite connections. The results showed HTTP/3's potential to remove head of line blocking but also challenges around increased server load and UDP optimizations needed. Moore concluded that HTTP/3 benefits will be most noticeable on low bandwidth connections and additional protocols will need to support it as adoption increases over time.
F5 OpenShift Workshop
This document provides an overview of an OpenShift/F5 Container Ingress Services workshop. It begins with an introduction and agenda. It then covers OpenShift and Kubernetes concepts like containers, pods, deployments, services and the overall architecture. It discusses what Container Ingress Services (CIS) is and how it integrates F5 BIG-IP devices. The lab will demonstrate CIS components like the controller, configmaps and deployment methods. It concludes with next steps and resources for further learning.
What's hot (20)
Improving Network Application Performance using Load Aware Libeventdev
Improving Network Application Performance using Load Aware Libeventdev
Excitingly simple multi-path OpenStack networking: LAG-less, L2-less, yet ful...
Excitingly simple multi-path OpenStack networking: LAG-less, L2-less, yet ful...
Red Hat demo of OpenStack and ODL at ODL summit 2016
Red Hat demo of OpenStack and ODL at ODL summit 2016
DOD 2016 - Kamil Szczygieł - Patching 100 OpenStack Compute Nodes with Zero-d...
DOD 2016 - Kamil Szczygieł - Patching 100 OpenStack Compute Nodes with Zero-d...
Opensource approach to design and deployment of Microservices based VNF
Opensource approach to design and deployment of Microservices based VNF
Open vSwitch Offload: Conntrack and the Upstream Kernel
Open vSwitch Offload: Conntrack and the Upstream Kernel
OVN: Scaleable Virtual Networking for Open vSwitch
OVN: Scaleable Virtual Networking for Open vSwitch
Taking Security Groups to Ludicrous Speed with OVS (OpenStack Summit 2015)
Taking Security Groups to Ludicrous Speed with OVS (OpenStack Summit 2015)
OpenDaylight: an open source SDN for your OpenStack cloud
OpenDaylight: an open source SDN for your OpenStack cloud
Similar to PuppetConf 2017: A Not So Bumpy Road to Puppet4 at CERN- Nacho Barrientos, CERN
Integrating Puppet and Gitolite for sysadmins cooperations
In this slides is presented a light solution based on the integration between Puppet-Foreman and Gitolite to the problem: How to enable many sysadmins to work together on one work environment without interfering with each other?
Puppet Camp Berlin 2015: Configuration Management @ CERN: Going Agile with Style
CERN uses Puppet for configuration management of its large infrastructure including 15k servers and 300PB of storage. Puppet is used to configure services across the infrastructure through modules, hostgroups, and environments. Changes go through a review process involving testing in custom environments before being merged to production. Tools like Jens, Jenkins, Rundeck, and Mcollective help automate operations and configuration changes at scale. Configuration drift and package inventory are challenges addressed through tools and snapshots. Puppet allows CERN to efficiently manage its resources in an agile manner while reducing intervention times.
Puppet Camp Berlin 2015: Andrea Giardini | Configuration Management @ CERN: G...
In 2011, CERN decided to start using Puppet as main tool for development, machines configuration and provisioning as replacement of Quattor.
Since then the infrastructure has changed a lot, the "Agile infrastructure" project evolved is a series of tools and softwares that currently allow more than 10.000 nodes to be configured and provisioned following custom definitions.
Foreman, Git, Openstack and our homemade librarian Jens are only a few of the tools that will be described during the talk, that aims to give an overview about the current workflow for machines lifecycle at CERN.
This talk will cover how Puppet allows us to deal with several hundred of installations a day and, at the same time, provide highly customizable machine configurations for service owners.
8051 Embedded Programming in C - Book-II
This document provides an overview of an upcoming course on implementing software and hardware for embedded systems using multiple 8051 microcontrollers. The course will cover designing software for multi-processor embedded applications using small microcontrollers and implementing those designs in C. By the end of the course, students will be able to design and program reliable multi-processor embedded systems. The main text used will be "Patterns for time-triggered embedded systems". Prerequisites include completion of an introductory embedded systems course. Upcoming seminars will provide an overview of a flexible scheduler and describe its design and implementation.
Open MPI SC'15 State of the Union BOF
This document summarizes updates from the Open MPI State of the Union community meeting at SC'15. Key points include: the new Open MPI versioning scheme uses A.B.C triples where A breaks backwards compatibility, B adds features, and C are bug fixes; v1.10.1 was recently released and adds some new features while maintaining backwards compatibility; v2.0 is targeted for Q1 2016 and will include many new features and be MPI-3.1 compliant; and integration with technologies like UCX and PMIx was discussed.
Migration Effort in the Cloud - The Case of Cloud Platforms
Get the book "On the Portability of Applications in Platform as a Service" at https://www.amazon.de/dp/3863096312
Presentation from IEEE CLOUD 2015. Full paper at http://bit.ly/paasmigration
Monitoring federation open stack infrastructure
Monitoring GEi used in the FI-WARE and XiFi project in order to recover information of the servers, hosts and OpenStack instances
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
The microservices honeymoon is over. When starting a new project or revamping a legacy monolith, teams started looking for alternatives to microservices. The Modular Monolith, or 'Modulith', is an architecture that reaps the benefits of (vertical) functional decoupling without the high costs associated with separate deployments. This talk will delve into the advantages and challenges of this progressive architecture, beginning with exploring the concept of a 'module', its internal structure, public API, and inter-module communication patterns. Supported by spring-modulith, the talk provides practical guidance on addressing the main challenges of a Modultith Architecture: finding and guarding module boundaries, data decoupling, and integration module-testing. You should not miss this talk if you are a software architect or tech lead seeking practical, scalable solutions.
About the author
With two decades of experience, Victor is a Java Champion working as a trainer for top companies in Europe. Five thousands developers in 120 companies attended his workshops, so he gets to debate every week the challenges that various projects struggle with. In return, Victor summarizes key points from these workshops in conference talks and online meetups for the European Software Crafters, the world’s largest developer community around architecture, refactoring, and testing. Discover how Victor can help you on victorrentea.ro : company training catalog, consultancy and YouTube playlists.
Parallel_and_Cluster_Computing.ppt
This document discusses parallel and cluster computing. It begins with an introduction to cluster computing and classifications of cluster computing. It then discusses technologies used in cluster computing like Beowulf clusters and their construction. It describes how cluster computing is used in fields like bioinformatics and parallel computing through projects like Folding@Home. The document outlines different types of clusters and provides details about building a science cluster, including hardware, networking, operating systems, and parallel programming environments. It gives examples of cluster applications in science, computation, and other domains.
An Essential Relationship between Real-time and Resource Partitioning
(ELC Europe 2013)
Running real-time and general purpose applications on a same hardware is normally a crazy idea in most case. However, we strongly focus to run both applications on a hardware without virtualization. Resource Partitioning enables the assignment of hardware resource (e.g.: core, execution time, memory bandwidth or device access) to processes with special requirements (e.g: real-time performance or safety requirements).
In this talk, we would like to discuss current limitation on Linux kernel and describe how to solve it.
2009-10-07 IBM zExpo 2009, Current & Future Linux on System z
This document summarizes the current and future Linux on System z technology presented by Shawn Wells of Red Hat. For RHEL 5.4, it highlights updates like support for Named Saved Segments and fiber channel drivers. It also provides a tentative roadmap for RHEL 6 and discusses ongoing CMM development. For future technology, it will cover areas like storage, networking, usability, and crypto that IBM and Red Hat are working on for Linux on System z.
Shifter singularity - june 7, 2018 - bw symposium
In this video from the Blue Waters 2018 Symposium, Maxim Belkin presents a tutorial on Containers: Shifter and Singularity on Blue Waters.
Container solutions are a great way to seamlessly execute code on a variety of platforms. Not only they are used to abstract away from the software stack of the underlying operating system, they also enable reproducible computational research. In this mini-tutorial, I will review the process of working with Shifter and Singularity on Blue Waters.
Watch the video: https://wp.me/p3RLHQ-iXO
Learn more: https://bluewaters.ncsa.illinois.edu/blue-waters-symposium-2018
Sign up for our insideHPC Newsletter: http://insidehpc.com/newsletter
Introduction to Civil Infrastructure Platform
CIP is target to establish an open source base layer of industrial grade software to enable the use and implementation of software. This slide will introduce the current status and road map in CIP
btNOG 5: Network Automation
Senior Network Analyst Tashi Phuntsho gives an overview of network automation at the fifth Bhutan Network Operators Group (btNOG 5) meeting on 4 June 2018.
OpenCORD MiniSummit - Physical POD test and deployments
The document discusses OpenCORD, an open source project for building software-defined infrastructure. It defines a full POD as the minimum hardware needed for testing CORD features, including 4 white-box switches, 3 standard servers, and a management switch. It describes the network connectivity between components in the POD and steps for deploying CORD, which includes downloading the code, creating a dev VM, fetching packages, and configuring and deploying to nodes. It raises issues around automating resets of the POD for continuous integration and references documentation and contact information for OpenCORD.
Programming embedded systems ii
This document provides an overview of a 10-week course on embedded systems using C programming. It discusses the design and implementation of a flexible scheduler for single-processor embedded systems over the course of two seminar sessions. The scheduler will allow tasks to be added and deleted dynamically. The document outlines the key topics that will be covered in each seminar, including an introduction to schedulers, building a basic scheduler, analog I/O, PID control, and linking multiple processors together using various communication protocols.
Midokura Gluecon 2014 - Level up your OpenStack Neutron Networking
OpenStack Neutron Networking OVS Plugin Overview. Improve networking scale and performance with a third party distributed overlay solution, such as MidoNet.
2009-09-24 Get the Hype on System z Webinar with IBM, Current & Future Linux ...
Joint webinar series with Hans Picht (Linux on System z Lead, IBM). Covered recent release of Red Hat Enterprise Linux 5.4, which had the inclusion of Named Saved Segments (NSS), updated fiber channel, and rebasing of s390utils. Stepped through roadmap for RHEL on System z and gave update on CMM2 development activities.
Mobicents Summit 2012 - Jean Deruelle - Mobicents SIP Servlets
Mobicents SIP Servlets is an open source project that provides a SIP servlet container. The document summarizes achievements of the project including support for more RFCs, congestion control features, JAIN SIP NIO support, and testing frameworks. It outlines the community around the project and releases of Mobicents SIP Servlets 2.0. Roadmaps discussed include features for high availability, WebRTC support, SNMP, auto scaling, and rolling upgrades.
Introduction to OpenDaylight and Hydrogen, Learnings from the Year, What's Ne...
OpenDaylight is an open source SDN platform developed under the Linux Foundation. The presentation discusses OpenDaylight and its first release (Hydrogen). Key points:
- OpenDaylight aims to create a common, extensible SDN platform to further adoption and innovation.
- The Hydrogen release included 14 projects and delivered core SDN functions. It faced various issues during development.
- Looking ahead, the speaker discusses continuing to build the community, improving code quality, and releasing new projects to address areas like security and distributed systems. The overall goal is to advance the OpenDaylight platform.
Similar to PuppetConf 2017: A Not So Bumpy Road to Puppet4 at CERN- Nacho Barrientos, CERN (20)
Integrating Puppet and Gitolite for sysadmins cooperations
Integrating Puppet and Gitolite for sysadmins cooperations
Puppet Camp Berlin 2015: Configuration Management @ CERN: Going Agile with Style
Puppet Camp Berlin 2015: Configuration Management @ CERN: Going Agile with Style
Puppet Camp Berlin 2015: Andrea Giardini | Configuration Management @ CERN: G...
Puppet Camp Berlin 2015: Andrea Giardini | Configuration Management @ CERN: G...
Migration Effort in the Cloud - The Case of Cloud Platforms
Migration Effort in the Cloud - The Case of Cloud Platforms
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
An Essential Relationship between Real-time and Resource Partitioning
An Essential Relationship between Real-time and Resource Partitioning
2009-10-07 IBM zExpo 2009, Current & Future Linux on System z
2009-10-07 IBM zExpo 2009, Current & Future Linux on System z
OpenCORD MiniSummit - Physical POD test and deployments
OpenCORD MiniSummit - Physical POD test and deployments
Midokura Gluecon 2014 - Level up your OpenStack Neutron Networking
Midokura Gluecon 2014 - Level up your OpenStack Neutron Networking
2009-09-24 Get the Hype on System z Webinar with IBM, Current & Future Linux ...
2009-09-24 Get the Hype on System z Webinar with IBM, Current & Future Linux ...
Mobicents Summit 2012 - Jean Deruelle - Mobicents SIP Servlets
Mobicents Summit 2012 - Jean Deruelle - Mobicents SIP Servlets
Introduction to OpenDaylight and Hydrogen, Learnings from the Year, What's Ne...
Introduction to OpenDaylight and Hydrogen, Learnings from the Year, What's Ne...
More from Puppet
Puppet camp2021 testing modules and controlrepo
This document discusses testing Puppet code when using modules versus a control repository. It recommends starting with simple syntax and unit tests using PDK or rspec-puppet for modules, and using OnceOver for testing control repositories, as it is specially designed for this purpose. OnceOver allows defining classes, nodes, and a test matrix to run syntax, unit, and acceptance tests across different configurations. Moving from simple to more complex testing approaches like acceptance tests is suggested. PDK and OnceOver both have limitations for testing across operating systems that may require customizing spec tests. Infrastructure for running acceptance tests in VMs or containers is also discussed.
Puppetcamp r10kyaml
This document appears to be for a PuppetCamp 2021 presentation by Corey Osman of NWOPS, LLC. It includes information about Corey Osman and NWOPS, as well as sections on efficient development, presentation content, demo main points, Git strategies including single branch and environment branch strategies, and workflow improvements. Contact information is provided at the bottom.
2021 04-15 operational verification (with notes)
The document discusses operational verification and how Puppet is working on a new module to provide more confidence in infrastructure health. It introduces the concept of adding check resources to catalogs to validate configurations and service health directly during Puppet runs. Examples are provided of how this could detect issues earlier than current methods. Next steps outlined include integrating checks into more resource types, fixing reporting, integrating into modules, and gathering feedback. This allows testing and monitoring to converge by embedding checks within configurations.
Puppet camp vscode
This document provides tips and tricks for using Puppet with VS Code, including links to settings examples and recommended extensions to install like Gitlens, Remote Development Pack, Puppet Extension, Ruby, YAML Extension, and PowerShell Extension. It also mentions there will be a demo.
Modules of the twenties
- The document discusses various patterns and techniques the author has found useful when working with Puppet modules over 10+ years, including some that may be considered unorthodox or anti-patterns by some.
- Key topics covered include optimization of reusable modules, custom data types, Bolt tasks and plans, external facts, Hiera classification, ensuring resources for presence/absence, application abstraction with Tiny Puppet, and class-based noop management.
- The author argues that some established patterns like roles and profiles can evolve to be more flexible, and that running production nodes in noop mode with controls may be preferable to fully enforcing on all nodes.
Applying Roles and Profiles method to compliance code
This document discusses adapting the roles and profiles design pattern to writing compliance code in Puppet modules. It begins by noting the challenges of writing compliance code, such as it touching many parts of nodes and leading to sprawling code. It then provides an overview of the roles and profiles pattern, which uses simple "front-end" roles/interfaces and more complex "back-end" profiles/implementations. The rest of the document discusses how to apply this pattern when authoring Puppet modules for compliance - including creating interface and implementation classes, using Hiera for configuration, and tools for reducing boilerplate code. It aims to provide a maintainable structure and simplify adapting to new compliance frameworks or requirements.
KGI compliance as-code approach
This document discusses Kinney Group's Puppet compliance framework for automating STIG compliance and reporting. It notes that customers often implement compliance Puppet code poorly or lack appropriate Puppet knowledge. The framework aims to standardize compliance modules that are data-driven and customizable. It addresses challenges like conflicting modules and keeping compliance current after implementation. The framework generates automated STIG checklists and plans future integration with Puppet Enterprise and Splunk for continued compliance reporting. Kinney Group cites practical experience implementing the framework for various military and government customers.
Enforce compliance policy with model-driven automation
This document discusses model-driven automation for enforcing compliance. It begins with an overview of compliance benchmarks and the CIS benchmarks. It then discusses implementing benchmarks, common challenges around configuration drift and lack of visibility, and how to define compliance policy as code. The key points are that automation is essential for compliance at scale; a model-driven approach defines how a system should be configured and uses desired-state enforcement to keep systems compliant; and defining compliance policy as code, managing it with source control, and automating it with CI/CD helps achieve continuous compliance.
Keynote: Puppet camp compliance
This document discusses how organizations can move from a reactive approach to compliance to a proactive approach using automation. It notes that over 50% of CIOs cite security and compliance as a barrier to IT modernization. Puppet offers an end-to-end compliance solution that allows organizations to automatically eliminate configuration drift, enforce compliance at scale across operating systems and environments, and define policy as code. The solution helps organizations improve compliance from 50% to over 90% compliant. The document argues that taking a proactive automation approach to compliance can turn it into a competitive advantage by improving speed and innovation.
Automating it management with Puppet + ServiceNow
As the leading IT Service Management and IT Operations Management platform in the marketplace, ServiceNow is used by many organizations to address everything from self service IT requests to Change, Incident and Problem Management. The strength of the platform is in the workflows and processes that are built around the shared data model, represented in the CMDB. This provides the ‘single source of truth’ for the organization.
Puppet Enterprise is a leading automation platform focused on the IT Configuration Management and Compliance space. Puppet Enterprise has a unique perspective on the state of systems being managed, constantly being updated and kept accurate as part of the regular Puppet operation. Puppet Enterprise is the automation engine ensuring that the environment stays consistent and in compliance.
In this webinar, we will explore how to maximize the value of both solutions, with Puppet Enterprise automating the actions required to drive a change, and ServiceNow governing the process around that change, from definition to approval. We will introduce and demonstrate several published integration points between the two solutions, in the areas of Self-Service Infrastructure, Enriched Change Management and Automated Incident Registration.
Puppet: The best way to harden Windows
This document promotes Puppet as a tool for hardening Windows environments. It states that Puppet can be used to harden Windows with one line of code, detect drift from desired configurations, report on missing or changing requirements, reverse engineer existing configurations, secure IIS, and export configurations to the cloud. Benefits of Puppet mentioned include hardening Windows environments, finding drift for investigation, easily passing audits, compliance reporting, easy exceptions, and exporting configurations. It also directs users to Puppet Forge modules for securing Windows and IIS.
Simplified Patch Management with Puppet - Oct. 2020
Does your company struggle with patching systems? If so, you’re not alone — most organizations have attempted to solve this issue by cobbling together multiple tools, processes, and different teams, which can make an already complicated issue worse.
Puppet helps keep hosts healthy, secure and compliant by replacing time-consuming and error prone patching processes with Puppet’s automated patching solution.
Join this webinar to learn how to do the following with Puppet:
Eliminate manual patching processes with pre-built patching automation for Windows and Linux systems.
Gain visibility into patching status across your estate regardless of OS with new patching solution from the PE console.
Ensure your systems are compliant and patched in a healthy state
How Puppet Enterprise makes patch management easy across your Windows and Linux operating systems.
Presented by: Margaret Lee, Product Manager, Puppet, and Ajay Sridhar, Sr. Sales Engineer, Puppet.
Accelerating azure adoption with puppet
The document discusses how Puppet can be used to accelerate adoption of Microsoft Azure. It describes lift and shift migration of on-premises workloads to Azure virtual machines. It also covers infrastructure as code using Puppet and Terraform for provisioning, configuration management using Puppet Bolt, and implementing immutable infrastructure patterns on Azure. Integrations with Azure services like Key Vault, Blob Storage and metadata service are presented. Patch management and inventory of Azure resources with Puppet are also summarized.
Puppet catalog Diff; Raphael Pinson
This document discusses using Puppet Catalog Diff to analyze the impact of changes between Puppet environments or catalogs. It provides the command line usage and options for Puppet Catalog Diff. It also discusses how to integrate Puppet Catalog Diff into CI/CD pipelines for automated impact analysis when merging code changes. Additional resources like GitHub projects and Dev.to posts are provided for learning more about diffing Puppet environments and catalogs.
ServiceNow and Puppet- better together, Kevin Reeuwijk
ServiceNow and Puppet can be integrated in four key areas: 1) Self-service infrastructure allows non-Puppet experts to control infrastructure through a ServiceNow interface; 2) Enriched change management automatically generates ServiceNow change requests from Puppet changes and populates them with impact details; 3) Automated incident registration forwards details of configuration drift corrections in Puppet to ServiceNow to create incidents; and 4) Up-to-date asset management would periodically upload Puppet inventory data to ServiceNow to keep the CMDB accurate without disruptive discovery runs.
Take control of your dev ops dumping ground
This document discusses how Puppet Relay uses Tekton pipelines to orchestrate containerized workflows. It provides an overview of how Tekton fits into the Relay architecture, with Tekton controllers managing taskrun pods to execute workflow steps defined in YAML. Triggers can initiate workflows based on events, with reusable and composable steps for tasks like provisioning infrastructure or clearing resources. Relay also includes features for parameters, secrets, outputs, and approvals to customize workflows. An ecosystem of open source integrations provides sample workflows and steps for common use cases.
100% Puppet Cloud Deployment of Legacy Software
This document discusses deploying legacy software into the AWS cloud using Puppet. It proposes modeling AWS resources like security groups, autoscaling groups, and launch configurations as Puppet resources. This would allow Puppet to provision the underlying AWS infrastructure and configure servers launched in autoscaling groups. It acknowledges challenges around server reboots but suggests they can be addressed. In summary, it argues custom Puppet resources can easily model AWS resources and using Puppet to configure autoscaling servers is possible despite some challenges around rebooting servers during deployment.
Puppet User Group
This document discusses a partnership between Republic Polytechnic's School of Infocomm and Puppet to promote DevOps practices. It introduces several people involved with the partnership and outlines their mission to prepare more IT companies and individuals for jobs in the DevOps field through training courses. The document describes some short courses offered on DevOps topics and using the Puppet and Microsoft Azure platforms. It provides an example of how Republic Polytechnic has automated infrastructure configuration using Puppet to save time and reduce errors. There is a request at the end for readers to register their interest in DevOps by completing a survey.
Continuous Compliance and DevSecOps
This document discusses continuous compliance and DevSecOps best practices followed by financial services organizations.
Continuous compliance is defined as an ongoing process of proactive risk management that delivers predictable, transparent, and cost-effective compliance results. It involves continuously monitoring compliance controls, providing real-time alerts for failures and remediation recommendations, and maintaining up-to-date policies. Best practices for continuous compliance discussed include defining CIS controls and benchmarks, achieving transparent compliance dashboards and automated fixes for breaches.
DevSecOps is introduced as bringing security earlier in the application development lifecycle to minimize vulnerabilities. It aims to make everyone accountable for security. Challenges discussed include security teams struggling to keep up with DevOps pace and
The Dynamic Duo of Puppet and Vault tame SSL Certificates, Nick Maludy
The document discusses using Puppet and Vault together to dynamically manage SSL certificates. Puppet can use the vault_cert resource to request signed certificates from Vault and configure services to use the certificates. On Windows, some additional logic is needed to retrieve certificates' thumbprints and bind services to certificates using those thumbprints. This approach provides automated certificate renewal and distribution across platforms.
More from Puppet (20)
Applying Roles and Profiles method to compliance code
Applying Roles and Profiles method to compliance code
Enforce compliance policy with model-driven automation
Enforce compliance policy with model-driven automation
Simplified Patch Management with Puppet - Oct. 2020
Simplified Patch Management with Puppet - Oct. 2020
ServiceNow and Puppet- better together, Kevin Reeuwijk
ServiceNow and Puppet- better together, Kevin Reeuwijk
The Dynamic Duo of Puppet and Vault tame SSL Certificates, Nick Maludy
The Dynamic Duo of Puppet and Vault tame SSL Certificates, Nick Maludy
Recently uploaded
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
Maruthi Prithivirajan, Head of ASEAN & IN Solution Architecture, Neo4j
Get an inside look at the latest Neo4j innovations that enable relationship-driven intelligence at scale. Learn more about the newest cloud integrations and product enhancements that make Neo4j an essential choice for developers building apps with interconnected data and generative AI.
Communications Mining Series - Zero to Hero - Session 1
This session provides introduction to UiPath Communication Mining, importance and platform overview. You will acquire a good understand of the phases in Communication Mining as we go over the platform with you. Topics covered:
• Communication Mining Overview
• Why is it important?
• How can it help today’s business and the benefits
• Phases in Communication Mining
• Demo on Platform overview
• Q/A
Securing your Kubernetes cluster_ a step-by-step guide to success !
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
As the digital landscape continually evolves, operating systems play a critical role in shaping user experiences and productivity. The launch of Nitrux Linux 3.5.0 marks a significant milestone, offering a robust alternative to traditional systems such as Windows 11. This article delves into the essence of Nitrux Linux 3.5.0, exploring its unique features, advantages, and how it stands as a compelling choice for both casual users and tech enthusiasts.
Removing Uninteresting Bytes in Software Fuzzing
Imagine a world where software fuzzing, the process of mutating bytes in test seeds to uncover hidden and erroneous program behaviors, becomes faster and more effective. A lot depends on the initial seeds, which can significantly dictate the trajectory of a fuzzing campaign, particularly in terms of how long it takes to uncover interesting behaviour in your code. We introduce DIAR, a technique designed to speedup fuzzing campaigns by pinpointing and eliminating those uninteresting bytes in the seeds. Picture this: instead of wasting valuable resources on meaningless mutations in large, bloated seeds, DIAR removes the unnecessary bytes, streamlining the entire process.
In this work, we equipped AFL, a popular fuzzer, with DIAR and examined two critical Linux libraries -- Libxml's xmllint, a tool for parsing xml documents, and Binutil's readelf, an essential debugging and security analysis command-line tool used to display detailed information about ELF (Executable and Linkable Format). Our preliminary results show that AFL+DIAR does not only discover new paths more quickly but also achieves higher coverage overall. This work thus showcases how starting with lean and optimized seeds can lead to faster, more comprehensive fuzzing campaigns -- and DIAR helps you find such seeds.
- These are slides of the talk given at IEEE International Conference on Software Testing Verification and Validation Workshop, ICSTW 2022.
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
Leonard Jayamohan, Partner & Generative AI Lead, Deloitte
This keynote will reveal how Deloitte leverages Neo4j’s graph power for groundbreaking digital twin solutions, achieving a staggering 100x performance boost. Discover the essential role knowledge graphs play in successful generative AI implementations. Plus, get an exclusive look at an innovative Neo4j + Generative AI solution Deloitte is developing in-house.
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar
UiPath Test Automation using UiPath Test Suite series, part 6
Welcome to UiPath Test Automation using UiPath Test Suite series part 6. In this session, we will cover Test Automation with generative AI and Open AI.
UiPath Test Automation with generative AI and Open AI webinar offers an in-depth exploration of leveraging cutting-edge technologies for test automation within the UiPath platform. Attendees will delve into the integration of generative AI, a test automation solution, with Open AI advanced natural language processing capabilities.
Throughout the session, participants will discover how this synergy empowers testers to automate repetitive tasks, enhance testing accuracy, and expedite the software testing life cycle. Topics covered include the seamless integration process, practical use cases, and the benefits of harnessing AI-driven automation for UiPath testing initiatives. By attending this webinar, testers, and automation professionals can gain valuable insights into harnessing the power of AI to optimize their test automation workflows within the UiPath ecosystem, ultimately driving efficiency and quality in software development processes.
What will you get from this session?
1. Insights into integrating generative AI.
2. Understanding how this integration enhances test automation within the UiPath platform
3. Practical demonstrations
4. Exploration of real-world use cases illustrating the benefits of AI-driven test automation for UiPath
Topics covered:
What is generative AI
Test Automation with generative AI and Open AI.
UiPath integration with generative AI
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
UiPath Test Automation using UiPath Test Suite series, part 5
Welcome to UiPath Test Automation using UiPath Test Suite series part 5. In this session, we will cover CI/CD with devops.
Topics covered:
CI/CD with in UiPath
End-to-end overview of CI/CD pipeline with Azure devops
Speaker:
Lyndsey Byblow, Test Suite Sales Engineer @ UiPath, Inc.
A tale of scale & speed: How the US Navy is enabling software delivery from l...
Rapid and secure feature delivery is a goal across every application team and every branch of the DoD. The Navy’s DevSecOps platform, Party Barge, has achieved:
- Reduction in onboarding time from 5 weeks to 1 day
- Improved developer experience and productivity through actionable findings and reduction of false positives
- Maintenance of superior security standards and inherent policy enforcement with Authorization to Operate (ATO)
Development teams can ship efficiently and ensure applications are cyber ready for Navy Authorizing Officials (AOs). In this webinar, Sigma Defense and Anchore will give attendees a look behind the scenes and demo secure pipeline automation and security artifacts that speed up application ATO and time to production.
We will cover:
- How to remove silos in DevSecOps
- How to build efficient development pipeline roles and component templates
- How to deliver security artifacts that matter for ATO’s (SBOMs, vulnerability reports, and policy evidence)
- How to streamline operations with automated policy checks on container images
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Unlocking Productivity: Leveraging the Potential of Copilot in Microsoft 365, a presentation by Christoforos Vlachos, Senior Solutions Manager – Modern Workplace, Uni Systems
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AIVladimir Iglovikov, Ph.D.
Presented by Vladimir Iglovikov:
- https://www.linkedin.com/in/iglovikov/
- https://x.com/viglovikov
- https://www.instagram.com/ternaus/
This presentation delves into the journey of Albumentations.ai, a highly successful open-source library for data augmentation.
Created out of a necessity for superior performance in Kaggle competitions, Albumentations has grown to become a widely used tool among data scientists and machine learning practitioners.
This case study covers various aspects, including:
People: The contributors and community that have supported Albumentations.
Metrics: The success indicators such as downloads, daily active users, GitHub stars, and financial contributions.
Challenges: The hurdles in monetizing open-source projects and measuring user engagement.
Development Practices: Best practices for creating, maintaining, and scaling open-source libraries, including code hygiene, CI/CD, and fast iteration.
Community Building: Strategies for making adoption easy, iterating quickly, and fostering a vibrant, engaged community.
Marketing: Both online and offline marketing tactics, focusing on real, impactful interactions and collaborations.
Mental Health: Maintaining balance and not feeling pressured by user demands.
Key insights include the importance of automation, making the adoption process seamless, and leveraging offline interactions for marketing. The presentation also emphasizes the need for continuous small improvements and building a friendly, inclusive community that contributes to the project's growth.
Vladimir Iglovikov brings his extensive experience as a Kaggle Grandmaster, ex-Staff ML Engineer at Lyft, sharing valuable lessons and practical advice for anyone looking to enhance the adoption of their open-source projects.
Explore more about Albumentations and join the community at:
GitHub: https://github.com/albumentations-team/albumentations
Website: https://albumentations.ai/
LinkedIn: https://www.linkedin.com/company/100504475
Twitter: https://x.com/albumentationsArtificial Intelligence for XMLDevelopment
In the rapidly evolving landscape of technologies, XML continues to play a vital role in structuring, storing, and transporting data across diverse systems. The recent advancements in artificial intelligence (AI) present new methodologies for enhancing XML development workflows, introducing efficiency, automation, and intelligent capabilities. This presentation will outline the scope and perspective of utilizing AI in XML development. The potential benefits and the possible pitfalls will be highlighted, providing a balanced view of the subject.
We will explore the capabilities of AI in understanding XML markup languages and autonomously creating structured XML content. Additionally, we will examine the capacity of AI to enrich plain text with appropriate XML markup. Practical examples and methodological guidelines will be provided to elucidate how AI can be effectively prompted to interpret and generate accurate XML markup.
Further emphasis will be placed on the role of AI in developing XSLT, or schemas such as XSD and Schematron. We will address the techniques and strategies adopted to create prompts for generating code, explaining code, or refactoring the code, and the results achieved.
The discussion will extend to how AI can be used to transform XML content. In particular, the focus will be on the use of AI XPath extension functions in XSLT, Schematron, Schematron Quick Fixes, or for XML content refactoring.
The presentation aims to deliver a comprehensive overview of AI usage in XML development, providing attendees with the necessary knowledge to make informed decisions. Whether you’re at the early stages of adopting AI or considering integrating it in advanced XML development, this presentation will cover all levels of expertise.
By highlighting the potential advantages and challenges of integrating AI with XML development tools and languages, the presentation seeks to inspire thoughtful conversation around the future of XML development. We’ll not only delve into the technical aspects of AI-powered XML development but also discuss practical implications and possible future directions.
Video Streaming: Then, Now, and in the Future
In his public lecture, Christian Timmerer provides insights into the fascinating history of video streaming, starting from its humble beginnings before YouTube to the groundbreaking technologies that now dominate platforms like Netflix and ORF ON. Timmerer also presents provocative contributions of his own that have significantly influenced the industry. He concludes by looking at future challenges and invites the audience to join in a discussion.
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack.
While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack.
I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:
GridMate - End to end testing is a critical piece to ensure quality and avoid...
End to end testing is a critical piece to ensure quality and avoid regressions. In this session, we share our journey building an E2E testing pipeline for GridMate components (LWC and Aura) using Cypress, JSForce, FakerJS…
How to Get CNIC Information System with Paksim Ga.pptx
Pakdata Cf is a groundbreaking system designed to streamline and facilitate access to CNIC information. This innovative platform leverages advanced technology to provide users with efficient and secure access to their CNIC details.
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
The choice of an operating system plays a pivotal role in shaping our computing experience. For decades, Microsoft's Windows has dominated the market, offering a familiar and widely adopted platform for personal and professional use. However, as technological advancements continue to push the boundaries of innovation, alternative operating systems have emerged, challenging the status quo and offering users a fresh perspective on computing.
One such alternative that has garnered significant attention and acclaim is Nitrux Linux 3.5.0, a sleek, powerful, and user-friendly Linux distribution that promises to redefine the way we interact with our devices. With its focus on performance, security, and customization, Nitrux Linux presents a compelling case for those seeking to break free from the constraints of proprietary software and embrace the freedom and flexibility of open-source computing.
Recently uploaded (20)
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
GridMate - End to end testing is a critical piece to ensure quality and avoid...
GridMate - End to end testing is a critical piece to ensure quality and avoid...
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
PuppetConf 2017: A Not So Bumpy Road to Puppet4 at CERN- Nacho Barrientos, CERN
- 1. 1
- 2. A not-so-bumpy road to Puppet 4 at CERN nacho.barrientos@cern.ch CERN IT Department 2
- 3. On the French-Swiss border 22 member states Collaborators from all around the world What do we do? 3
- 4. 4Large Hadron Collider (LHC)
- 5. 5
- 6. 6Compact Muon Solenoid (CMS)
- 8. 8
- 9. 9
- 10. 10
- 11. 11
- 12. 12
- 13. 34kactive nodes in PuppetDB Base catalog contains 1.2kresources 350catalogs compiled per minute 191changes* per day 350puppeteers 13
- 14. 14 CONFIG TEAM
- 15. 15 CONFIG TEAM
- 17. CONFIG TEAM SERVICE MANAGERS shared modules base modules individual modules hostgroups Formalised QA process 17 risk and impact Only one service 100% nodes
- 18. Changes to QA are announced publicly Typical QA duration: 1 week All service managers can stop them 18
- 20. Our trip from Puppet 3 to Puppet 4 20
- 21. 21 Parallel server infrastructure CI framework Base configuration dual compatibility Planning and communication The preps...
- 22. 3 2 1 22
- 23. 3 2 1 Volunteer runs against Puppet 4 servers CI preaching 23
- 24. 24 When the ground started to shake Castings that became errors Changed boolean interpretation (‘’) Variable scope and nested classes Hiera variable names (dots)
- 25. 25
- 26. 3 2 1 Volunteer runs against Puppet 4 servers CI preaching Bugging people! 26
- 27. 27
- 28. 28
- 29. 3 2 1 Agents (still Puppet 3) pointed to Puppet 4 29
- 30. (in the meantime) Preparing the agent upgrade... puppet-3.8.7cern5 puppet-3.8.7cern6 puppet-agent-0.0.0 puppet-agent-1.8.2.10 1 2 3 30
- 31. (in the meantime) Preparing the agent upgrade... Custom facts (Facter 2.x → Facter 3.x) Dual configuration ([/etc/puppet, /etc/mcollective] ↔ /etc/puppetlabs/*) 31
- 32. Agent upgrade to Puppet 4 3 2 1 32
- 33. QA 24H PRODUCTION ROLL-OUT 33
- 35. And that 5%? broken catalog, Puppet disabled, broken software updates… please rebuild/reinstall 35
- 36. Unable! unpin software repositories, fix dependency problems, copy puppet.conf and run Puppet… ...usually helped 36
- 37. 37 What did go wrong?
- 38. 38 What could we have done better? Earlier CI Catalog diffs (octocatalog-diff?)
- 41. 41
- 44. Backup slides 44
- 45. but … what about development? 45
- 46. 46
- 47. 47
- 48. 48
- 49. myapp/frontend/sso top-level subhostgroup subhostgroup hostgroup A node belongs to a hostgroup 49
- 54. it-puppet-hostgroup-myapp code manifests init.pp frontend.pp frontend sso.pp data hostgroup myapp.yaml myapp frontend.yaml frontend sso.yaml it-puppet-module-apache files lib manifests init.pp vhost.pp … templates class hg_myapp::frontend { … class {‘apache’: server_signature => ‘off’ … } apache::vhost { … } … } frontend.pp 54
- 55. it-puppet-hostgroup-myapp code manifests init.pp frontend.pp frontend sso.pp data hostgroup myapp.yaml myapp frontend.yaml frontend sso.yaml fqdns appc003.cern.ch.yaml shibboleth::session_storage: 'memcache' shibboleth::memcached_servers: - foomc01.cern.ch - foomc02.cern.ch shibboleth::memcached_prefix: "MY_PREFIX:" shibboleth::remote_user: 'ADFS_LOGIN' shibboleth::application_name: foo_application shibboleth::site_name: foo.bar.cern.ch class hg_myapp::frontend::sso { … include shibboleth … } sso.yaml sso.pp 55
- 56. 393 modules (upstream and homegrown) 206 top-level hostgroups (services) 56
- 57. shared modules base modules individual modules risk and impact hostgroups (cloud_common) (apache) (eos) (stdlib) Only one service 100% nodes 57
- 58. Or just log in and out! 58
- 59. USERS 59