SaltStack is used at Bloglovin to manage tens of millions of monthly website visitors across hundreds of servers. SaltStack allows them to execute commands concurrently across servers, react dynamically to changes through events, and manage infrastructure in a next generation way. Key SaltStack components used include states, pillars, grains, reactors, beacons, engines and orchestration.
Orchestrate Event-Driven Infrastructure with SaltStackLove Nyberg
Saltstack is by it's design a event driven configuration management tool. In talk will do a deep dive into salt reactor, runners and beacon systems. Talk will also cover a demo of event driven application releases process.
Using SaltStack to orchestrate microservices in application containers at Sal...Love Nyberg
More and more applications are being built or re-built with a micro-service architecture. Application containers are great working blocks to quickly and easily get a micro-service system up and running. Saltstack is then a perfect match to scale such a system. This talk will dive into how Saltstack can be used to scale a micro-service system like Docker.
Integration testing for salt states using aws ec2 container serviceSaltStack
A SaltConf16 use case talk by Steven Braverman of Dun & Bradstreet. Testing configuration changes for multiple server roles can be time consuming when real instances or legacy container systems are used. Applying configuration changes to each role in parallel can be difficult. So what's the best way to test configuration changes efficiently, quickly, and securely prior to applying them? See how an integrated test setup using AWS EC2 Container Service (ECS), AWS AutoScaling Group, and SaltStack simplifies the application of configuration changes and allows you to test configuration changes in parallel to reduce the time spent testing.
Altitude NY 2018: 132 websites, 1 service: Your local news runs on FastlyFastly
When Gannett moved to Fastly, they migrated over one hundred websites in the USA Today Network. The ability to self-service CDN configurations, securely store config files, and spread the responsibility of managing configurations fundamentally changed the way they deliver media and troubleshoot — in fact it changed the way they work. Additionally, a number of changes Gannett made as they migrated to Fastly have benefited their business and put developers in a better state. This keynote will touch on topics such as instant publish, HTTPS/HTTP2, paywall, and instant metrics to demonstrate the changes they've made, as well as look to the future and what’s ahead for their relationship with Fastly.
Initially delivered at LA RubyConf 2013, this presentation describes how cutting-edge technology helped to triple performance and drastically cut costs in a mobile social game. Juan Pablo Genovese, a Ruby Architect from Altoros Systems Argentina, explains how, despite the extremely tight budget, the customer managed to:
- go from ~450 req/s to ~1300 req/s
- reduce the number of EC2 application servers from four to one
- provide fast and reliable video uploading and processing
- achieve very easy scaling with automation
while maintaining all the functions of the original RoR app.
Altitude NY 2018: Don't let the weeds overwhelm the gardenFastly
A year ago, our technical debt was incurring compound interest and we weren’t going to be able to keep making the minimum payments. We had to take a hard look at how we built our infrastructure—we had a code base that had evolved over time, with no design patterns and little structure. Changes in one Chef cookbook would have cascading failures in seemingly unrelated places elsewhere. We had dependencies upon dependencies. We faced a critical decision: fix what we have in place or start over again using what we’d had before as a guide. We chose the latter.
And so, over the past 12 months, we rewrote the majority of our infrastructure code, upgraded the operating system, and rebuilt every single server in our public cache fleet from the ground up—without anyone noticing. Previously, it took Fastly about six people over six weeks to install a new POP. Now, it requires just one person and a single week. We attribute our ability to rapidly scale, both safely and reliably, to a new approach, which we'll discuss in this talk. We will relive the design and redeployment of our public cache fleet, the challenges faced, lessons learned, and benefits gained from our new architecture.
Automated Application Management with SaltStackinovex GmbH
SaltStack is a new System Management Platform that provides various automations for the lifecycle of systems (HW/VMs). This makes it possible to trigger routines based on specific events using Salt Reactor. The event-based orchestration component of SaltStack recognizes f.e. the adding of new Salt minions (agents) in the Salt host inventory/database, the start of minions after the first system booting, the execution of any (distributed) commands (local or master-triggered) and much more. You can use this framework to provision newly created hosts/VMs with packages and configuration files, or to fully automate the rollout/deployment of new software releases and pre/post actions (DB backup, schema update, removal von temporary files, etc.).
Event: inovex Meetup Köln, 08.06.2016
Speaker: Arnold Bechtoldt
weitere Tech-Vorträge: https://www.inovex.de/de/content-pool/vortraege/
Orchestrate Event-Driven Infrastructure with SaltStackLove Nyberg
Saltstack is by it's design a event driven configuration management tool. In talk will do a deep dive into salt reactor, runners and beacon systems. Talk will also cover a demo of event driven application releases process.
Using SaltStack to orchestrate microservices in application containers at Sal...Love Nyberg
More and more applications are being built or re-built with a micro-service architecture. Application containers are great working blocks to quickly and easily get a micro-service system up and running. Saltstack is then a perfect match to scale such a system. This talk will dive into how Saltstack can be used to scale a micro-service system like Docker.
Integration testing for salt states using aws ec2 container serviceSaltStack
A SaltConf16 use case talk by Steven Braverman of Dun & Bradstreet. Testing configuration changes for multiple server roles can be time consuming when real instances or legacy container systems are used. Applying configuration changes to each role in parallel can be difficult. So what's the best way to test configuration changes efficiently, quickly, and securely prior to applying them? See how an integrated test setup using AWS EC2 Container Service (ECS), AWS AutoScaling Group, and SaltStack simplifies the application of configuration changes and allows you to test configuration changes in parallel to reduce the time spent testing.
Altitude NY 2018: 132 websites, 1 service: Your local news runs on FastlyFastly
When Gannett moved to Fastly, they migrated over one hundred websites in the USA Today Network. The ability to self-service CDN configurations, securely store config files, and spread the responsibility of managing configurations fundamentally changed the way they deliver media and troubleshoot — in fact it changed the way they work. Additionally, a number of changes Gannett made as they migrated to Fastly have benefited their business and put developers in a better state. This keynote will touch on topics such as instant publish, HTTPS/HTTP2, paywall, and instant metrics to demonstrate the changes they've made, as well as look to the future and what’s ahead for their relationship with Fastly.
Initially delivered at LA RubyConf 2013, this presentation describes how cutting-edge technology helped to triple performance and drastically cut costs in a mobile social game. Juan Pablo Genovese, a Ruby Architect from Altoros Systems Argentina, explains how, despite the extremely tight budget, the customer managed to:
- go from ~450 req/s to ~1300 req/s
- reduce the number of EC2 application servers from four to one
- provide fast and reliable video uploading and processing
- achieve very easy scaling with automation
while maintaining all the functions of the original RoR app.
Altitude NY 2018: Don't let the weeds overwhelm the gardenFastly
A year ago, our technical debt was incurring compound interest and we weren’t going to be able to keep making the minimum payments. We had to take a hard look at how we built our infrastructure—we had a code base that had evolved over time, with no design patterns and little structure. Changes in one Chef cookbook would have cascading failures in seemingly unrelated places elsewhere. We had dependencies upon dependencies. We faced a critical decision: fix what we have in place or start over again using what we’d had before as a guide. We chose the latter.
And so, over the past 12 months, we rewrote the majority of our infrastructure code, upgraded the operating system, and rebuilt every single server in our public cache fleet from the ground up—without anyone noticing. Previously, it took Fastly about six people over six weeks to install a new POP. Now, it requires just one person and a single week. We attribute our ability to rapidly scale, both safely and reliably, to a new approach, which we'll discuss in this talk. We will relive the design and redeployment of our public cache fleet, the challenges faced, lessons learned, and benefits gained from our new architecture.
Automated Application Management with SaltStackinovex GmbH
SaltStack is a new System Management Platform that provides various automations for the lifecycle of systems (HW/VMs). This makes it possible to trigger routines based on specific events using Salt Reactor. The event-based orchestration component of SaltStack recognizes f.e. the adding of new Salt minions (agents) in the Salt host inventory/database, the start of minions after the first system booting, the execution of any (distributed) commands (local or master-triggered) and much more. You can use this framework to provision newly created hosts/VMs with packages and configuration files, or to fully automate the rollout/deployment of new software releases and pre/post actions (DB backup, schema update, removal von temporary files, etc.).
Event: inovex Meetup Köln, 08.06.2016
Speaker: Arnold Bechtoldt
weitere Tech-Vorträge: https://www.inovex.de/de/content-pool/vortraege/
Sides accompanying the tale of using saltcheck from the salt project to validate OS, app deployment, users, AWS resources, and more for multiple hadoop clusters.
This presentation covers how to setup an Airflow instance as a cluster which spans multiple machines instead of the traditional 1 machine distribution. In addition, it covers an added step you can take to ensure High Availability in that cluster.
Example of how you can leverage the salt event bus to support your infrastructure life-cycle for monitoring with Zabbix.
Enable workflows like when adding salt states to a minion automatically apply associated monitoring templates. or when decommissioning hosts, automatically remove them from Zabbix.
Monitoring Kubernetes with Prometheus (Kubernetes Ireland, 2016)Brian Brazil
Prometheus is a next-generation monitoring system. Since being publicly announced last year it has seen wide-spread interest and adoption. This talk will look at the concepts behind monitoring with Prometheus, and how to use it with Kubernetes which has direct support for Prometheus.
Presentation of Consul Service Discovery for use-case in Alice O2 Quality Control and its Information Service. How to use Consul to share states of published data by processes.
Monitoring Uptime on the NeCTAR Research Cloud - Andy Botting, University of ...OpenStack
Audience Level
Intermediate
Synopsis
We will discuss how we do monitoring on the Nectar research cloud, utilising tools like OpenStack tempest, Nagios and translating this into a user facing dashboard.
Speaker Bio:
Andy is a DevOps engineer working at the University of Melbourne in the Core Services team for the Nectar Research Cloud.
Continuous Integration for Fun and Profitinovex GmbH
Agile Continuous Integration verspricht mithilfe von Pipelines die Entwicklung und Auslieferung von Software signifikant zu verbessern. Der Weg zur finalen Implementierung kann jedoch mit einigen unvorhergesehenen Aufwänden gepflastert sein. So werden wir uns einige hilfreiche Methoden und Tools zur Umsetzung solcher Pipelines mit dem Fokus auf Continuous Integration ansehen, um unseren agilen Entwicklungsprozess abzurunden und dadurch Zeit für die wichtigen Dinge im Alltag zu gewinnen.
Vorkenntnisse: Grundverständnis von Softwarentwicklung
Lernziele: Wir werden die Hintergründe von Continuous Integration/Delivery diskutieren und sehen uns ein Beispiel aus der Praxis an, das vor allem die Vorteile von CI/CD hevorheben soll.
Event: enterJS, 16.06.2016, Darmstadt
Speaker: Arnold Bechtoldt
Weitere Tech-Vorträge: https://www.inovex.de/de/content-pool/vortraege/
For many years Capistrano has been the defacto deployment tool, but many organisations have yet to realise the benefits of automating their deployment process. Automated Deployments are fast, less error prone, easier to rollback and you can dish out the keys to other team members so anyone can deploy.
During this talk we’ll look at how to “capify” a simple PHP project and deploy it in a few minutes. And, as Capistrano is a “remote server automation and deployment tool”, we’ll also look at some of the other things Capistrano can do for you such as restarting apache or grepping server log (and more). We’ll also take a look at the various plug-ins available and see how easy it can be to write your own.
If you are deploying using ssh / git pull / apache restart? Then it’s time to make a change: automate all the things and live in a world of “repeatable success”.
Learn how to use Capistrano to automate the deployment of your Ruby on Rails applications. Apply best practices and add-ons for customizing Capistrano.
Running at Scale: Practical Performance Tuning with Puppet - PuppetConf 2013Puppet
"Running at Scale: Practical Performance Tuning with Puppet" by Sam Kottler Engineer, Red Hat.
Presentation Overview: This session will talk about some production issues I've seen running Puppet in large environments. From how to manage a single master with hundreds of hosts to real-life patterns for building high availability clusters that scale to 10's of thousands of agents. Another important topic that will be covered is how to deploy networked filesystems that perform well under high load and streaming files to many hosts simultaneously.
Speaker Bio: Sam Kottler is a software engineer in the Virtualization R&D group at Red Hat. He's helped build infrastructure for leading startups, including Digg.com, Acquia, and Venmo and is a contributor to Puppet, the Fedora Project, Drupal, and the Rubygems.org. Sam speaks around the world on the topics of internet security, systems automation, and software architecture.
Host Health Monitoring with Docker RunNoah Zoschke
In this presentation I offer an overview of host monitoring over the years, then explain how Docker and container schedulers truly improve the state of the art for failure monitoring and recovery.
Video: https://www.hashicorp.com/resources/operating-consul-at-scale
With more than 35k machines and first external Contributor, Criteo is a very large Consul User. This presentation describes how we operate Consul at Scale at Criteo.
Presentation at HashiTalks 2019.
Creating SaltStack State data with PyobjectsEvan Borgstrom
Pyobjects is an alternative renderer that allows you to author SaltStack state data in pure Python using a Pythonic API.
This presentation takes an in-depth look at the motivation behind creating the SaltStack Pyobjects renderer and cover how to use it, and best practices.
Automate your development environment with Jira and SaltstackNetworkedAssets
Presentation by Wojciech from NetworkedAssets for the Atlassian User Group Lower Silesia on April 20th, 2016 about how to automatically manage development environments with simple Jira tickets and Saltstack.
Sides accompanying the tale of using saltcheck from the salt project to validate OS, app deployment, users, AWS resources, and more for multiple hadoop clusters.
This presentation covers how to setup an Airflow instance as a cluster which spans multiple machines instead of the traditional 1 machine distribution. In addition, it covers an added step you can take to ensure High Availability in that cluster.
Example of how you can leverage the salt event bus to support your infrastructure life-cycle for monitoring with Zabbix.
Enable workflows like when adding salt states to a minion automatically apply associated monitoring templates. or when decommissioning hosts, automatically remove them from Zabbix.
Monitoring Kubernetes with Prometheus (Kubernetes Ireland, 2016)Brian Brazil
Prometheus is a next-generation monitoring system. Since being publicly announced last year it has seen wide-spread interest and adoption. This talk will look at the concepts behind monitoring with Prometheus, and how to use it with Kubernetes which has direct support for Prometheus.
Presentation of Consul Service Discovery for use-case in Alice O2 Quality Control and its Information Service. How to use Consul to share states of published data by processes.
Monitoring Uptime on the NeCTAR Research Cloud - Andy Botting, University of ...OpenStack
Audience Level
Intermediate
Synopsis
We will discuss how we do monitoring on the Nectar research cloud, utilising tools like OpenStack tempest, Nagios and translating this into a user facing dashboard.
Speaker Bio:
Andy is a DevOps engineer working at the University of Melbourne in the Core Services team for the Nectar Research Cloud.
Continuous Integration for Fun and Profitinovex GmbH
Agile Continuous Integration verspricht mithilfe von Pipelines die Entwicklung und Auslieferung von Software signifikant zu verbessern. Der Weg zur finalen Implementierung kann jedoch mit einigen unvorhergesehenen Aufwänden gepflastert sein. So werden wir uns einige hilfreiche Methoden und Tools zur Umsetzung solcher Pipelines mit dem Fokus auf Continuous Integration ansehen, um unseren agilen Entwicklungsprozess abzurunden und dadurch Zeit für die wichtigen Dinge im Alltag zu gewinnen.
Vorkenntnisse: Grundverständnis von Softwarentwicklung
Lernziele: Wir werden die Hintergründe von Continuous Integration/Delivery diskutieren und sehen uns ein Beispiel aus der Praxis an, das vor allem die Vorteile von CI/CD hevorheben soll.
Event: enterJS, 16.06.2016, Darmstadt
Speaker: Arnold Bechtoldt
Weitere Tech-Vorträge: https://www.inovex.de/de/content-pool/vortraege/
For many years Capistrano has been the defacto deployment tool, but many organisations have yet to realise the benefits of automating their deployment process. Automated Deployments are fast, less error prone, easier to rollback and you can dish out the keys to other team members so anyone can deploy.
During this talk we’ll look at how to “capify” a simple PHP project and deploy it in a few minutes. And, as Capistrano is a “remote server automation and deployment tool”, we’ll also look at some of the other things Capistrano can do for you such as restarting apache or grepping server log (and more). We’ll also take a look at the various plug-ins available and see how easy it can be to write your own.
If you are deploying using ssh / git pull / apache restart? Then it’s time to make a change: automate all the things and live in a world of “repeatable success”.
Learn how to use Capistrano to automate the deployment of your Ruby on Rails applications. Apply best practices and add-ons for customizing Capistrano.
Running at Scale: Practical Performance Tuning with Puppet - PuppetConf 2013Puppet
"Running at Scale: Practical Performance Tuning with Puppet" by Sam Kottler Engineer, Red Hat.
Presentation Overview: This session will talk about some production issues I've seen running Puppet in large environments. From how to manage a single master with hundreds of hosts to real-life patterns for building high availability clusters that scale to 10's of thousands of agents. Another important topic that will be covered is how to deploy networked filesystems that perform well under high load and streaming files to many hosts simultaneously.
Speaker Bio: Sam Kottler is a software engineer in the Virtualization R&D group at Red Hat. He's helped build infrastructure for leading startups, including Digg.com, Acquia, and Venmo and is a contributor to Puppet, the Fedora Project, Drupal, and the Rubygems.org. Sam speaks around the world on the topics of internet security, systems automation, and software architecture.
Host Health Monitoring with Docker RunNoah Zoschke
In this presentation I offer an overview of host monitoring over the years, then explain how Docker and container schedulers truly improve the state of the art for failure monitoring and recovery.
Video: https://www.hashicorp.com/resources/operating-consul-at-scale
With more than 35k machines and first external Contributor, Criteo is a very large Consul User. This presentation describes how we operate Consul at Scale at Criteo.
Presentation at HashiTalks 2019.
Creating SaltStack State data with PyobjectsEvan Borgstrom
Pyobjects is an alternative renderer that allows you to author SaltStack state data in pure Python using a Pythonic API.
This presentation takes an in-depth look at the motivation behind creating the SaltStack Pyobjects renderer and cover how to use it, and best practices.
Automate your development environment with Jira and SaltstackNetworkedAssets
Presentation by Wojciech from NetworkedAssets for the Atlassian User Group Lower Silesia on April 20th, 2016 about how to automatically manage development environments with simple Jira tickets and Saltstack.
Event-driven Infrastructure - Mike Place, SaltStack - DevOpsDays Tel Aviv 2016DevOpsDays Tel Aviv
"As we move into the age of containerization, it becomes more important than ever to figure out how to automate, monitor and deploy systems which are resilient and well-understood.
In this talk, we'll discuss methods for building infrastructures with universal event buses and reactive systems which can act as a nervous system for our computing environments."
Saltconf16 - Salt is Not Configuration ManagementDrew Malone
Saltstack is often used for configuration management. However, we give a quick crash course on some of the features of Salt that show how it's more of a platform for developing automated solutions for data centers.
PuppetConf 2016: Keynote: Pulling the Strings to Containerize Your Life - Sco...Puppet
Here are the slides from Scott Coulton's PuppetConf 2016 presentation called Pulling the Strings to Containerize Your Life. Watch the videos at https://www.youtube.com/playlist?list=PLV86BgbREluVjwwt-9UL8u2Uy8xnzpIqa
Get 30 social media posts across your social channels for just £295/month
ContentCal AutoPilot is for businesses that want to build a lively and engaging social media presence, but struggle to find the time, resource or ideas to do so.
Using SaltStack to Auto Triage and Remediate Production SystemsMichael Kehoe
LinkedIn created an auto-remediation system named Nurse which leverages SaltStack and the CherryPy API to auto-triage and remediate issues with production systems. See how LinkedIn uses SaltStack with Nurse in its production environment and learn how to architect your own auto-triage and remediation system.
Conway’s Law, DevOps, Continuous Delivery, Automatisierung – das sind die üblichen Buzzwords, die man bei Kick-offs zu Microservices-Projekten hört. Doch nach und nach wird man von der Realität eingeholt, und neben organisatorischen Hürden trifft man auf nicht triviale technische Probleme. In dieser Session gehen wir nicht nur auf die üblichen High-Level-Punkte ein, sondern betrachten konkrete technische Probleme am Beispiel einer verteilten Architektur innerhalb von AWS und zeigen Lösungen, die sich in unserer Praxis bewährt haben.
Event: JAX 2016, 19.04.2016
Speaker: Michael Bruns, René Lengwinat, inovex GmbH
Noch mehr Technologie-Vorträge: https://www.inovex.de/de/content-pool/vortraege/
QCon Beijing. Web APIs are the new de facto approach to architecture integration for all innovative digital business applications across cloud, mobile, B2B, Big Data or Internet of Things (IoT) technologies. For many of these projects, enterprise architecture and service delivery is adapting from an "inside-out" model towards a microservices and API First approach, which offers greater flexibility and agility around core IT services. In this session we investigate the promise of microservices, and consider how they will work in real enterprises with existing applications, complex SOA environments and strict organizational or governance structures.
DevOps on AWS: Deep Dive on Infrastructure as Code - TorontoAmazon Web Services
While many organizations have started to automate their software development processes, many still engineer their infrastructure largely by hand. Treating your infrastructure just like any other piece of code creates a “programmable infrastructure” that allows you to take full advantage of the scalability and reliability of the AWS cloud. This session will walk through practical examples of how AWS customers have merged infrastructure configuration with application code to create application-specific infrastructure and a truly unified development lifecycle. You will learn how AWS customers have leveraged tools like CloudFormation, orchestration engines, and source control systems to enable their applications to take full advantage of the scalability and reliability of the AWS cloud, create self-reliant applications, and easily recover when things go seriously wrong with their infrastructure.
Infrastructure as Code 101: Steve Tegeler + Nathan Ness, VMwareOpenStack
Audience: Beginner
About: As OpenStack gains traction in today’s enterprise environments, other cloudy concepts are beginning to take hold in enterprises as well. Today’s enterprises are transitioning from waterfall to agile, more interested in DevOps, and are adopting programmable infrastructure faster than ever before. To maximize returns on the investments today’s enterprises are making, IT departments need to learn new skills and new concepts. Infrastructure as Code (IAC) is one of those concepts that everyone hears a lot about, but in many cases, it is not well understood. Appdevs need to learn infrastructure, infrastructure teams need to learn software development strategies. Bridging the gaps between the two teams can drive the overall consumption of an OpenStack cloud. This session will discuss the basic concepts of infrastructure as code and how to get started. We will also review what it takes to get started (Software repositories, Version Control, etc) and strategies for selling your cloud.
Speaker Bio: Steve Tegeler – Director of Systems Engineering, VMware
Steve currently leads a team of experts who help customers deploy OpenStack in their organizations. Over the last 10 years Steve has spent a tremendous amount of time with IT departments making choices around IaaS. Steve came to VMware through the acquisition of Nicira. At Nicira, Steve spent time not only on Network & Security virtualization, but the overall automation strategy. He’s seen a lot of success, and also a lot of failures.
Speaker Bio: Nathan Ness – Staff Systems Engineer, VMware
Nathan Ness has been a part of the Networking and Security Business Unit at VMware since the acquisition of Nicira. His background includes datacenter networking and security with an emphasis in cloud and virtualization technologies. Currently at VMware he focuses on anything & everything related to OpenStack + VMware. He holds certifications in Cisco, Microsoft, and VMware NSX.
OpenStack Australia Day - Sydney 2016
https://events.aptira.com/openstack-australia-day-sydney-2016/
Axway Introduction & Digital Business (by Jo Van Audenhove & Rogier van Boxtel)ACA IT-Solutions
https://www.axway.com - Accelerate your Digital Transformation: An Axway & ACA IT-Solutions Seminar Invitation focussing on innovations in mobile enterprise: Appcelerator.
Cloud Wars – what‘s the smartest data platform? Vergleich Microsoft Azure, Am...inovex GmbH
Die großen Public-Cloud-Anbieter locken inzwischen mit vielversprechenden Platform-as-a-Service-Angeboten um Daten jeglicher Art performant und kosteneffizient zu speichern und zu verarbeiten. Neben unterschiedlichen Datenbanken gibt es dazu Dienste für Batch- und Realtime-Processing. In diesem Vortrag werden einige der wichtigen Data Driven Services anhand eines typischen IoT-Szenarios aus der Praxis beleuchtet. Dazu gehen drei Schwergewichte des Cloud Business ins Rennen: Microsoft Azure vs. Amazon Web Services vs. Google Cloud Platform.
Event: inovex Meetup: "Let's talk about the Cloud!", 22.06.2016
Speaker: Thomas Neureuther, Stefan Kirner, inovex GmbH
Mehr Technologie-Vorträge: https://www.inovex.de/de/content-pool/vortraege/
It has long been debated whether OpenStack is production ready. In this session you will learn how a major bank has gone to production with more than 5000 VMs that delivered the results of a 40% decrease in cost, reduced deployment time to hours not weeks, 56 new technologies introduced, 7 new platforms launched - all in under a year. Learn how their platform built on Rackspace and RHEL, coupled with best of breed open source tooling - SaltStack, Jenkins, Cloudify, and Nexus are the enablers for production-grade OpenStack.
http://sched.co/7fH1
A Practical Approach to Building a Streaming Processing Pipeline for an Onlin...Databricks
Yelp’s ad platform handles millions of ad requests everyday. To generate ad metrics and analytics in real-time, they built they ad event tracking and analyzing pipeline on top of Spark Streaming. It allows Yelp to manage large number of active ad campaigns and greatly reduce over-delivery. It also enables them to share ad metrics with advertisers in a more timely fashion.
This session will start with an overview of the entire pipeline and then focus on two specific challenges in the event consolidation part of the pipeline that Yelp had to solve. The first challenge will be about joining multiple data sources together to generate a single stream of ad events that feeds into various downstream systems. That involves solving several problems that are unique to real-time applications, such as windowed processing and handling of event delays. The second challenge covered is with regards to state management across code deployments and application restarts. Throughout the session, the speakers will share best practices for the design and development of large-scale Spark Streaming pipelines for production environments.
SaltStack is built around an event infrastructure that can be leveraged and extended to drive reactive provisioning, configuration, and management across all devices in your infrastructure.
Given at YAPC::EU 2012
Dancer + WebSocket + AnyEvent + Twiggy
This in *not* a talk about doing a hello world in Dancer, as there are plenty of it. This is a real-life example of using Dancer to address a problem in an elegant and powerful way
At $job, we have cpan mirrors. We want them to stay a bit behind the real CPAN for stability, but we have a tool to update modules from the real CPAN to our mirrors. Cool.
I wanted to have a web interface to trigger it, and monitor the injection. This problem is not a typical one (blog, wiki, CRUD, etc). Here we have a long running operation that shall happen only one at a time, that generates logs to be displayed, with states that need keeping. In this regard, it's interesting to see how Dancer is versatile enough to address these situations with ease.
This talk details how I did that, the technology I used, and the full source code (which is quite short). I used Dancer + WebSocket + AnyEvent + Twiggy + some other stuff.
This talk doesn't require any particular knowledge beyond basic Perl, and very basic web server understanding.
Burn down the silos! Helping dev and ops gel on high availability websitesLindsay Holmwood
HA websites are where the rubber meets the road - at 200km/h. Traditional separation of dev and ops just doesn't cut it.
Everything is related to everything. Code relies on performant and resilient infrastructure, but highly performant infrastructure will only get a poorly written application so far. Worse still, root cause analysis in HA sites will more often than not identify problems that don't clearly belong to either devs or ops.
The two options are collaborate or die.
This talk will introduce 3 core principles for improving collaboration between operations and development teams: consistency, repeatability, and visibility. These principles will be investigated with real world case studies and associated technologies audience members can start using now. In particular, there will be a focus on:
- fast provisioning of test environments with configuration management
- reliable and repeatable automated deployments
- application and infrastructure visibility with statistics collection, logging, and visualisation
Configuration Management with Saltstackinovex GmbH
Freie Configuration Managment Systeme wie Puppet, Chef und CFEngine gibt es schon seit einiger Zeit. Doch nicht jede historisch gewachsene Software stellt heute schnell den gewünschten Ertrag bereit. Dieser Vortrag liefert eine kurze Einführung in die Materie, thematisiert Real-World Probleme im Enterprise-Umfeld und bietet Hoffnung für stresserprobte Admins. Als alternative Software für das Configuration Management wird SaltStack vorgestellt, ein seit Jahren wachsendes Projekt mit dem Anspruch die wiederholten Fehler anderer Configuration Management Systeme zu verhindern und Admins neue und bereits gewünschte Möglichkeiten zu offenbaren. Denn auch für kleinere Umgebungen kann Configuration Management durchaus sinnvoll sein. Der Vortrag zeigt auf warum SaltStack einen genaueren Blick wert ist und wofür SaltStack heute bereits eingesetzt wird. Unentschlossenen wird aufgezeigt wie sie das vorgestellte Beispiel-Setup, dem automatisierten Deployment einer Deployment-Infrastruktur und Private Cloud mit Foreman und OpenNebula mit frei verfügbaren SaltStack-Modulen selber nachstellen können.
Arnold Bechtoldt, Inovex GmbH Linux systems engineer - Configuration Manageme...SaltStack
Arnold gave this presentation at the Secure Linux Admin Conference in Berlin Germany. He provides an overview of what configuration management systems do, explains the fundamentals of SaltStack and provides a look inside.
The slide deck used in the Apache Camel / Syndesis Seminar at Red Hat, K.K., Ebisu --
https://jcug-oss.connpass.com/event/99168/
Uploaded with permission of Christina Lin
In the French FedEx company we used Prometheus to monitor the infrastructure. It hosts a CQRS Architecture composed with Kafka, Spark, Cassandra, ElasticSearch, and microservices APIs in scala.
This presentation is about using Prometheus in production, you will see why we choosed Prometheus, how we integrated it, configured it and what kind of insights we extracted from the whole infrastructure.
In addition, you will see how Prometheus changed our way of working, how we implemented self-healing based on Prometheus, how we configured systemd to trigger AlertManager API, integration with slack and other cool stuffs.
DevoxxUK: Optimizating Application Performance on KubernetesDinakar Guniguntala
Now that you have your apps running on K8s, wondering how to get the response time that you need ? Tuning a polyglot set of microservices to get the performance that you need can be challenging in Kubernetes. The key to overcoming this is observability. Luckily there are a number of tools such as Prometheus that can provide all the metrics you need, but here is the catch, there is so much of data and metrics that is difficult make sense of it all. This is where Hyperparameter tuning can come to the rescue to help build the right models.
This talk covers best practices that will help attendees
1. To understand and avoid common performance related problems.
2. Discuss observability tools and how they can help identify perf issues.
3. Look closer into Kruize Autotune which is a Open Source Autonomous Performance Tuning Tool for Kubernetes and where it can help.
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualityInflectra
In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring.
Learn about:
• The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks.
• Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective.
• Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification.
• Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process.
Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
State of ICS and IoT Cyber Threat Landscape Report 2024 previewPrayukth K V
The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development.
The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers:
State of global ICS asset and network exposure
Sectoral targets and attacks as well as the cost of ransom
Global APT activity, AI usage, actor and tactic profiles, and implications
Rise in volumes of AI-powered cyberattacks
Major cyber events in 2024
Malware and malicious payload trends
Cyberattack types and targets
Vulnerability exploit attempts on CVEs
Attacks on counties – USA
Expansion of bot farms – how, where, and why
In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East
Why are attacks on smart factories rising?
Cyber risk predictions
Axis of attacks – Europe
Systemic attacks in the Middle East
Download the full report from here:
https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/
"Impact of front-end architecture on development cost", Viktor TurskyiFwdays
I have heard many times that architecture is not important for the front-end. Also, many times I have seen how developers implement features on the front-end just following the standard rules for a framework and think that this is enough to successfully launch the project, and then the project fails. How to prevent this and what approach to choose? I have launched dozens of complex projects and during the talk we will analyze which approaches have worked for me and which have not.
Let's dive deeper into the world of ODC! Ricardo Alves (OutSystems) will join us to tell all about the new Data Fabric. After that, Sezen de Bruijn (OutSystems) will get into the details on how to best design a sturdy architecture within ODC.
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
PHP Frameworks: I want to break free (IPC Berlin 2024)Ralf Eggert
In this presentation, we examine the challenges and limitations of relying too heavily on PHP frameworks in web development. We discuss the history of PHP and its frameworks to understand how this dependence has evolved. The focus will be on providing concrete tips and strategies to reduce reliance on these frameworks, based on real-world examples and practical considerations. The goal is to equip developers with the skills and knowledge to create more flexible and future-proof web applications. We'll explore the importance of maintaining autonomy in a rapidly changing tech landscape and how to make informed decisions in PHP development.
This talk is aimed at encouraging a more independent approach to using PHP frameworks, moving towards a more flexible and future-proof approach to PHP development.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
3. bloglovin
tens of millions of monthly unique visitors
hundred of millions requests per day
couple of million stories parsed per day
hybrid bare-metal servers/cloud vm’s
4 salt masters
~90 salt minions
4. salt @ bloglovin
Parts we use!
States/Pillars/Grains
Pillarstack*
Orchestrate
Reactor
Beacons
Engines
5. Parallel execu=on
to run all the resources concurrently
Event driven
to monitor and react dynamically only to changes
Next genera=on
11. Goals
Monitoring - How can salt react to monitoring events and adjust
system without any manual interference
Minions - When a new device is connected get it’s data and no=fy
me, chat Vw!
Containers - When a new container starts, update load balancer
for that cluster and start sending traffic. Also when a container
stops, get logs and restart and send logs to team
14. State events
Enabling state events causes the Salt minion to send progress events as
each func5on in a state run completes execu5on.
state_events: True
minion
15. State events
Which can become an over load, let’s fire only on specific states
installed/vim:
pkg.installed:
- name: vim
- fire_event: installed/vim
minion
16. Custom event
Enabling state events causes the Salt minion to send progress events as
each func5on in a state run completes execu5on.
salt-call event.send /deploy/test/case '{"data": "Ready"}'
/deploy/test/case {
"_stamp": "2016-04-13T11:01:24.553140",
"cmd": "_minion_event",
"data": {
"__pub_fun": "event.send",
"__pub_jid": "20160413070124500641",
"__pub_pid": 17046,
"__pub_tgt": "salt-call",
"data": "Ready"
…
minion
20. Reactor
Salt’s Reactor system gives you the ability to trigger ac5ons in response to any event.
reactor: # Master config section "reactor"
- 'salt/minion/*/start': # Match tag "salt/minion/*/start"
- /srv/reactor/start.sls # Things to do when a minion starts
- 'deploy/containers': # Match tag "deploy/containers"
- /srv/reactor/deploy-containers.sls # Things to do when a container is deployed
- 'salt/netapi/hook/api/devlovin/create': # Listing on salt api for /devlovin/create
- /srv/reactor/devlovin-create.sls # Things to do when a create request is sent
master
21. Reactor
Salt’s Reactor system gives you the ability to trigger ac5ons in response to any event.
Remote execu=on: run an execu=on module on the targeted
minions.
Runners: These are tasks you would start using salt-run.
Wheel: Wheel commands manage your Salt environment.
master
22. Reactor
Salt’s Reactor system gives you the ability to trigger ac5ons in response to any event.
<section id>:
local.<function>:
- tgt: <target>
- arg:
<arguments>
master
23. # This script is to be called from the reactor system
{%- set application = data['data']['application'] %}
{%- set container = data['data']['container'] %}
{%- set target = data['data']['target'] %}
{%- set tag = data['data']['tag'] %}
sync-states:
local.saltutil.sync_states:
- tgt: {{ target }}
deploy-containers:
local.state.sls:
- tgt: {{ target }}
- arg:
- containers.{{ container }}
- kwarg:
pillar:
containers:
imagetag:
{{ application }}: {{ tag }}
master
27. Demo
Monitoring - How can salt react to monitoring events and adjust
system without any manual interference
28. Demo
Minions - When a new device is connected get it’s data and no=fy
me, chat Vw!
29. Demo
Containers - When a new container starts, update load balancer
for that cluster and start sending traffic. Also when a container
stops, get logs and restart and send logs to team