SFScon18 - Ivan Sieder - The price of moving into the cloud. More time for debugging!
•
0 likes•224 views
“Managing servers is fun” – No developer ever. Moving to a cloud environment can be awesome and beneficial if done right. But it can also be expensive and a real pain if done wrong. What we found in building apps on cloud platforms, which pitfalls we encountered and when it’s suited an when not.
Report
Share
Report
Share
Download to read offline
Recommended
DevOpsDaysRiga 2017 Ignite: Daniel Houston - Thinking outside the box: The Do...
The Docker socket is insecure when mounted through to containers, allowing subsequent contains to escape the docker model and root the docker host.
Many use Docker in their CI pipelines; but few everyday users are aware of the security issues surrounding the docker socket on docker hosts and the complications this brings. I want to highlight one such issue with the docker socket when creating docker containers within docker containers.
OpenStack in the Enterprise - Are You Ready? - Maish Saidel-Keesing
OpenStack is becoming more popular - that is obvious - but are you ready to have it host your Tier-1 applications? In this session we will discuss what needs to be done in order to provide a stable management plane for the OpenStack - what progress has been made over the years and where we still need to go.
Zero to Nova: A VMware Admin's Month of Openstack
I don't know anything about OpenStack. My mission is to learn this platform in the four weeks leading up to VMworld and then teach it to you, or at least start you out on how to learn it. I'll talk about where to start, how todig into it, what you'll likely stumble over as a VMware admin, and how to build a homelab. I would hope that this 10 minutes would give you the tools to learn OpenStack in two weeks instead of four!
Rakuten openstack
Presentation about OpenStack hacks by Rakuten and the community @ YLUG Kernel Code Reading Partyカーネル読書会 112th
Docker echosystemtelaviv
During the last few months we saw an explosion of the new tools around Docker and the tools able to deliver new functionality due to the rise of containers. At this talk we will order around the tools zoo and show examples of the most popular ones. This will include Serf/Consul, CoreOS/Project Atomic, Mesos and others.
Cloud Surfing: Kubernetes on Mesos
Kubernetes: it’s new; it’s cool; and you want it! But you have questions… Is deployment easy? Does it scale? Can it be upgraded in place? Will it work with your existing services? Can it handle big data workloads?
You wish you could learn just one platform and never have to learn another one, but that's not how software works. Today’s epic swell is tomorrow's choppy ripples. Today's cloud nine is tomorrow's smog. What you really need to learn is how to surf… on clouds.
So catch the wave and we’ll ride the white fluffies together. We’ll start with Kubernetes, the cloud container orchestration engine Google seeded, and Mesos, the scheduling framework from which Twitter and Apple are hanging ten. Then we’ll throw on the afterburner with the Mesosphere Datacenter Operating System (DCOS) and deploy orchestrators, like Kubernetes and Marathon, alongside distributed services, like Spark and Cassandra, to open up a universe of possibilities.
KubeCon schedule link: http://sched.co/4V0d
Securing OpenStack and Beyond with Ansible
The openstack-ansible-security role applies security hardening configurations to any system -- those running OpenStack and those that don't -- without disruption.
Apps rollback patches1
This document discusses different techniques for rolling back application patches. It describes traditional methods of backing up files and databases before applying small or big patches. It then presents a better approach using database flashback and application file snapshots to quickly rollback if a patch fails. The benefits are reducing downtime and risks when testing and applying patches in production environments.
Recommended
DevOpsDaysRiga 2017 Ignite: Daniel Houston - Thinking outside the box: The Do...
The Docker socket is insecure when mounted through to containers, allowing subsequent contains to escape the docker model and root the docker host.
Many use Docker in their CI pipelines; but few everyday users are aware of the security issues surrounding the docker socket on docker hosts and the complications this brings. I want to highlight one such issue with the docker socket when creating docker containers within docker containers.
OpenStack in the Enterprise - Are You Ready? - Maish Saidel-Keesing
OpenStack is becoming more popular - that is obvious - but are you ready to have it host your Tier-1 applications? In this session we will discuss what needs to be done in order to provide a stable management plane for the OpenStack - what progress has been made over the years and where we still need to go.
Zero to Nova: A VMware Admin's Month of Openstack
I don't know anything about OpenStack. My mission is to learn this platform in the four weeks leading up to VMworld and then teach it to you, or at least start you out on how to learn it. I'll talk about where to start, how todig into it, what you'll likely stumble over as a VMware admin, and how to build a homelab. I would hope that this 10 minutes would give you the tools to learn OpenStack in two weeks instead of four!
Rakuten openstack
Presentation about OpenStack hacks by Rakuten and the community @ YLUG Kernel Code Reading Partyカーネル読書会 112th
Docker echosystemtelaviv
During the last few months we saw an explosion of the new tools around Docker and the tools able to deliver new functionality due to the rise of containers. At this talk we will order around the tools zoo and show examples of the most popular ones. This will include Serf/Consul, CoreOS/Project Atomic, Mesos and others.
Cloud Surfing: Kubernetes on Mesos
Kubernetes: it’s new; it’s cool; and you want it! But you have questions… Is deployment easy? Does it scale? Can it be upgraded in place? Will it work with your existing services? Can it handle big data workloads?
You wish you could learn just one platform and never have to learn another one, but that's not how software works. Today’s epic swell is tomorrow's choppy ripples. Today's cloud nine is tomorrow's smog. What you really need to learn is how to surf… on clouds.
So catch the wave and we’ll ride the white fluffies together. We’ll start with Kubernetes, the cloud container orchestration engine Google seeded, and Mesos, the scheduling framework from which Twitter and Apple are hanging ten. Then we’ll throw on the afterburner with the Mesosphere Datacenter Operating System (DCOS) and deploy orchestrators, like Kubernetes and Marathon, alongside distributed services, like Spark and Cassandra, to open up a universe of possibilities.
KubeCon schedule link: http://sched.co/4V0d
Securing OpenStack and Beyond with Ansible
The openstack-ansible-security role applies security hardening configurations to any system -- those running OpenStack and those that don't -- without disruption.
Apps rollback patches1
This document discusses different techniques for rolling back application patches. It describes traditional methods of backing up files and databases before applying small or big patches. It then presents a better approach using database flashback and application file snapshots to quickly rollback if a patch fails. The benefits are reducing downtime and risks when testing and applying patches in production environments.
Connections install in 45 mins
How long does it really take to install and configure IBM Connections - 99% of your time is taken up by waiting for things to install.
In this 45 minute presentation everything you need to know about installing and configuring your first connections install
Sai devops - the art of being specializing generalist
Devops aims to bring developers and operations teams together to collaborate more closely. As systems become more complex, the traditional separation of duties has caused issues with deployment, configuration, and monitoring. By integrating development and operations work, organizations can deploy code changes more rapidly and reliably while improving system performance, security, and availability. Effective devops processes include continuous integration, automated testing of infrastructure changes, configuration management, and monitoring systems in production.
Infrastructure as Code to Maintain your Sanity
This document provides guidance on maintaining sanity when using infrastructure as code (IaC). It discusses why IaC is used, compares developer and operations mindsets, and explains how DevOps helps. It emphasizes designing IaC declaratively using modules and planes of responsibility. Changes should be tested across environments before production. Automation and monitoring are key to reduce risk and ensure stability. Following these practices allows for more predictability, less stress, and improved uptime.
High Performance Sites with Drupal and Cache Control Module
This document discusses how to use the Cache Control module to improve performance on Drupal sites. It provides examples of three different sites: Jatkoaika.com, an ice hockey site with many anonymous users; Demi.fi, a community site with many authenticated users generating content; and Tekla Campus, an e-learning site using a CDN. Cache Control can significantly improve site speed by caching content in Varnish and loading personalized content asynchronously, but requires careful configuration and may need custom code to work optimally for different site types and user behaviors.
DUG'20: 05 - Very Early Experiences with a 0.5 PByte DAOS Testbed
Steffen Christgau, Supercomputing dept., Zuse Institute Berlin
Tobias Watermann, Supercomputing dept., Zuse Institute Berlin
Thomas Steinke, Supercomputing dept., Zuse Institute Berlin
DAOS User Group event, November 2020.
Using Docker in the Real World
Looking at how people, with current deployments, can start using docker with out having to replace anything. Also giving a migration path that allows testing the separate pieces and migrating over slowly without painting yourself into a corner. Also covering why you might want to do this and the problems it may help to solve.
Introduction to DevOps
DevOps aims to automate the process between software development and IT operations. This includes continuous integration, continuous delivery, and infrastructure management. The document discusses definitions of DevOps, tools for source control, continuous integration, deployment, testing, monitoring and containers/orchestration. It emphasizes creating automation to reduce errors and speed up development cycles. Automation should be implemented gradually by focusing on the most painful manual tasks each sprint.
Extensible dev secops pipelines with Jenkins, Docker, Terraform, and a kitche...
Extensible dev secops pipelines with Jenkins, Docker, Terraform, and a kitche...Richard Bullington-McGuire
Have you ever needed to wrestle a legacy application onto a modern, scalable cloud platform, while increasing security test coverage? Sometimes real applications are not easily stuffed into a Docker container and deployed in a container orchestration system. In this talk, Modus Create Principal Architect Richard Bullington-McGuire will show how to compose Jenkins, Docker, Terraform, Packer, Ansible, Packer, Vagrant, Gauntlt, OpenSCAP, the CIS Benchmark for Linux, AWS CodeDeploy, Auto Scaling Groups, Application Load Balancers, and other AWS services to create a performant and scalable solution for deploying applications. A local development environment using Vagrant mirrors the cloud deployment environment to minimize surprises upon deployment.Let me introduce you: DOTS
DOTS (Domino OSGi Tasklet Service) allows developers to create tasklets outside of the Notes client to perform background tasks on the Domino server. Tasklets can be run on a schedule or manually and outperform Java agents. To use DOTS, it must be installed on the Domino server and Eclipse is used for development. Tasklets are developed as OSGi bundles and can be deployed to the server through a jar file or update site. Logging, progress monitoring, and annotations help developers code efficient tasklets. Multiple profiles allow isolating tasklets from each other.
Java one 2015 - v1
This session investigates using the existing JVM shared cache optimization in the Docker and Cloud Foundry environments. Although this optimization achieves higher density and performance by default in other environments, more work is required to achieve these benefits in Docker and Cloud Foundry.
The presentation provides a blueprint for achieving higher density and performance in the cloud and covers • The unique characteristics of the Docker and Cloud Foundry environments that are a challenge • What needs to be done to enable the optimization • The experiments the speaker and his colleagues ran, and results measured
Parallelizing CI using Docker Swarm-Mode
Presented at Open Source Summit Japan (http://sched.co/AOmo)
- - -
Slowness of CI is a critical issue in software development, because it discourages engineers from writing tests, and hence deteriorates the quality of the product.
In this presentation, Akihiro Suda will talk about how to accelerate CI by executing test functions in parallel, across a Docker Swarm-mode cluster.
One of the major challenges was the nonuniformity of the makespan. e.g. some chunk of test functions can take 30 minutes, some chunk can take just 10 seconds...
So, he mitigates such a nonuniformity by randomizing the composition of chunks of test functions.
As a result, for example, the integration test of Docker itself that had taken more than 80 minutes can be finished in 4 minutes, with 10 Docker Swarm-mode nodes.
This hack can be easily applied to CI of other software as well.
Build public private cloud using openstack
The document discusses building a public or private cloud using OpenStack. It begins with an introduction to cloud computing and OpenStack. OpenStack is an open source cloud platform that is scalable and used by many large companies. The document then covers use cases for OpenStack like building test environments, provides examples of OpenStack implementations at CERN and Rackspace, and discusses how the group has setup OpenStack and built a sample Rails application using OpenStack Swift for photo storage. It acknowledges the challenges of implementing OpenStack and hopes to continue using it to support building large scale web applications.
Immutable infrastructure with Docker and containers (GlueCon 2015)
"Never upgrade a server again. Never update your code. Instead, create new servers, and throw away the old ones!"
That's the idea of immutable servers, or immutable infrastructure. This makes many things easier: rollbacks (you can always bring back the old servers), A/B testing (put old and new servers side by side), security (use the latest and safest base system at each deploy), and more.
However, throwing in a bunch of new servers at each one-line CSS change is going to be complicated, not to mention costly.
Containers to the rescue! Creating container "golden images" is easy, fast, dare I say painless. Replacing your old containers with new ones is also easy to do; much easier than virtual machines, let alone physical ones.
In this talk, we'll quickly recap the pros (and cons) of immutable servers; then explain how to implement that pattern with containers. We will use Docker as an example, but the technique can easily be adapted to Rocket or even plain LXC containers.
Fundamentals of DevOps and CI/CD
The presentation about the fundamentals of DevOps workflow and CI/CD practices I presented at Centroida (https://centroida.ai/) as a back-end development intern.
Shorten Device Boot Time for Automotive IVI and Navigation Systems
Propose a practical approach of the mixture of
ARM hibernation (suspend to disk) and Linux
user-space checkpointing
– to shorten device boot time
Intro to OpenShift, MongoDB Atlas & Live Demo
Get the fundamentals on working with containers in the cloud. In this session, you will learn how to run and manage containers in production. We'll level set with a quick intro to Kubernetes and OpenShift, so you understand some basic terminology. From there, it's all live demo. We’ll spin up Java, MongoDB (including Atlas, the hosted DBaas), integrate code from Github, and make some shiny JSON spatial services. Finally, we’ll cover best practices in using containers when going to production with an application, and answer all of your questions.
D. Andreadis, Red Hat: Concepts and technical overview of Quarkus
Dimitris Andreadis, Director of Engineering and Manager of the Quarkus Team at Red Hat, discusses the History, Concepts and Technical Overview of Quarkus framework. The webinar was delivered on June 25, 2020
Real-World Docker: 10 Things We've Learned
Docker has taken the world of software by storm, offering the promise of a portable way to build and ship software - including software running in the cloud. The RightScale development team has been diving into Docker for several projects, and we'll share our lessons learned on using Docker for our cloud-based applications.
The power of dots
The document provides an introduction and overview of the Domino OSGi Tasklet Service (DOTS). DOTS allows developers to create tasklets outside of the Domino environment in Eclipse that can then run on a Domino server. The document outlines how to set up the DOTS development environment, create a simple "Hello World" tasklet, debug tasklets, deploy tasklets to the server, and offers tips for using annotations and progress monitoring in tasklets.
DevOps Fest 2020. immutable infrastructure as code. True story.
This document discusses the journey of transitioning infrastructure management at Namecheap to an immutable infrastructure as code model using tools like Terraform, Docker, and Jenkins. Key points include taking over a project from an outsourcing company, setting up immutable infrastructure with infrastructure as code, configuring CI/CD pipelines as code in Jenkins, and lessons learned around testing, chaos engineering, and encouraging team feedback. The overall goals were to make infrastructure hard to break, easy to repair, and easy to modify.
SFSCON23 - Rufai Omowunmi Balogun - SMODEX – a Python package for understandi...
SFSCON23 - Rufai Omowunmi Balogun - SMODEX – a Python package for understandi...South Tyrol Free Software Conference
The complexity of agricultural droughts requires a consistent, reliable, and systematic method for monitoring and reporting. Amongst the various indices used to monitor this phenomenon, the soil moisture anomaly has been proven to be a more reliable predictor. However, the datasets required for computing this index are often large and computationally demanding. To address this challenge, we have developed SMODEX, a Python package that enables scalable, fast, and open-source standard-compliant computation and visualization of soil moisture anomalies.
SMODEX simplifies the computation and visualization of time-series for soil moisture and soil moisture anomalies from high-dimensional climate datasets. It allows for quick and easy parallelization of the computation on a daily, weekly, and monthly timescale. Additionally, SMODEX implements a straightforward workflow for automating the use of FAIR (Findable, Accessible, Interoperable, and Reusable) principles in producing and sharing outputs by leveraging the open source STAC API. The package is extendible and provides information on how to contribute to the project, test suites, test coverage, and a use case for the South Tyrol region, all provided in the package repository. In the future, additional agricultural drought indices and indicators would be included to serve to even larger community of researchers, policy makers, and individual users.SFSCON23 - Roberto Innocenti - From the design to reality is here the Communi...
SFSCON23 - Roberto Innocenti - From the design to reality is here the Communi...South Tyrol Free Software Conference
The Open Hardware PowerPC Notebook designed around GNU/Linux will be showed at NOI Techpark. We had presented here its motherboard design in 2018. We will updates regarding last developments for u-boot AMD video drivers, re-design of heat pipes, and CE test certification process. We will give future availability milestones of this notebook and details regarding the GNU/Linux distributions or other OS that could runs on it.More Related Content
Similar to SFScon18 - Ivan Sieder - The price of moving into the cloud. More time for debugging!
Connections install in 45 mins
How long does it really take to install and configure IBM Connections - 99% of your time is taken up by waiting for things to install.
In this 45 minute presentation everything you need to know about installing and configuring your first connections install
Sai devops - the art of being specializing generalist
Devops aims to bring developers and operations teams together to collaborate more closely. As systems become more complex, the traditional separation of duties has caused issues with deployment, configuration, and monitoring. By integrating development and operations work, organizations can deploy code changes more rapidly and reliably while improving system performance, security, and availability. Effective devops processes include continuous integration, automated testing of infrastructure changes, configuration management, and monitoring systems in production.
Infrastructure as Code to Maintain your Sanity
This document provides guidance on maintaining sanity when using infrastructure as code (IaC). It discusses why IaC is used, compares developer and operations mindsets, and explains how DevOps helps. It emphasizes designing IaC declaratively using modules and planes of responsibility. Changes should be tested across environments before production. Automation and monitoring are key to reduce risk and ensure stability. Following these practices allows for more predictability, less stress, and improved uptime.
High Performance Sites with Drupal and Cache Control Module
This document discusses how to use the Cache Control module to improve performance on Drupal sites. It provides examples of three different sites: Jatkoaika.com, an ice hockey site with many anonymous users; Demi.fi, a community site with many authenticated users generating content; and Tekla Campus, an e-learning site using a CDN. Cache Control can significantly improve site speed by caching content in Varnish and loading personalized content asynchronously, but requires careful configuration and may need custom code to work optimally for different site types and user behaviors.
DUG'20: 05 - Very Early Experiences with a 0.5 PByte DAOS Testbed
Steffen Christgau, Supercomputing dept., Zuse Institute Berlin
Tobias Watermann, Supercomputing dept., Zuse Institute Berlin
Thomas Steinke, Supercomputing dept., Zuse Institute Berlin
DAOS User Group event, November 2020.
Using Docker in the Real World
Looking at how people, with current deployments, can start using docker with out having to replace anything. Also giving a migration path that allows testing the separate pieces and migrating over slowly without painting yourself into a corner. Also covering why you might want to do this and the problems it may help to solve.
Introduction to DevOps
DevOps aims to automate the process between software development and IT operations. This includes continuous integration, continuous delivery, and infrastructure management. The document discusses definitions of DevOps, tools for source control, continuous integration, deployment, testing, monitoring and containers/orchestration. It emphasizes creating automation to reduce errors and speed up development cycles. Automation should be implemented gradually by focusing on the most painful manual tasks each sprint.
Extensible dev secops pipelines with Jenkins, Docker, Terraform, and a kitche...
Extensible dev secops pipelines with Jenkins, Docker, Terraform, and a kitche...Richard Bullington-McGuire
Have you ever needed to wrestle a legacy application onto a modern, scalable cloud platform, while increasing security test coverage? Sometimes real applications are not easily stuffed into a Docker container and deployed in a container orchestration system. In this talk, Modus Create Principal Architect Richard Bullington-McGuire will show how to compose Jenkins, Docker, Terraform, Packer, Ansible, Packer, Vagrant, Gauntlt, OpenSCAP, the CIS Benchmark for Linux, AWS CodeDeploy, Auto Scaling Groups, Application Load Balancers, and other AWS services to create a performant and scalable solution for deploying applications. A local development environment using Vagrant mirrors the cloud deployment environment to minimize surprises upon deployment.Let me introduce you: DOTS
DOTS (Domino OSGi Tasklet Service) allows developers to create tasklets outside of the Notes client to perform background tasks on the Domino server. Tasklets can be run on a schedule or manually and outperform Java agents. To use DOTS, it must be installed on the Domino server and Eclipse is used for development. Tasklets are developed as OSGi bundles and can be deployed to the server through a jar file or update site. Logging, progress monitoring, and annotations help developers code efficient tasklets. Multiple profiles allow isolating tasklets from each other.
Java one 2015 - v1
This session investigates using the existing JVM shared cache optimization in the Docker and Cloud Foundry environments. Although this optimization achieves higher density and performance by default in other environments, more work is required to achieve these benefits in Docker and Cloud Foundry.
The presentation provides a blueprint for achieving higher density and performance in the cloud and covers • The unique characteristics of the Docker and Cloud Foundry environments that are a challenge • What needs to be done to enable the optimization • The experiments the speaker and his colleagues ran, and results measured
Parallelizing CI using Docker Swarm-Mode
Presented at Open Source Summit Japan (http://sched.co/AOmo)
- - -
Slowness of CI is a critical issue in software development, because it discourages engineers from writing tests, and hence deteriorates the quality of the product.
In this presentation, Akihiro Suda will talk about how to accelerate CI by executing test functions in parallel, across a Docker Swarm-mode cluster.
One of the major challenges was the nonuniformity of the makespan. e.g. some chunk of test functions can take 30 minutes, some chunk can take just 10 seconds...
So, he mitigates such a nonuniformity by randomizing the composition of chunks of test functions.
As a result, for example, the integration test of Docker itself that had taken more than 80 minutes can be finished in 4 minutes, with 10 Docker Swarm-mode nodes.
This hack can be easily applied to CI of other software as well.
Build public private cloud using openstack
The document discusses building a public or private cloud using OpenStack. It begins with an introduction to cloud computing and OpenStack. OpenStack is an open source cloud platform that is scalable and used by many large companies. The document then covers use cases for OpenStack like building test environments, provides examples of OpenStack implementations at CERN and Rackspace, and discusses how the group has setup OpenStack and built a sample Rails application using OpenStack Swift for photo storage. It acknowledges the challenges of implementing OpenStack and hopes to continue using it to support building large scale web applications.
Immutable infrastructure with Docker and containers (GlueCon 2015)
"Never upgrade a server again. Never update your code. Instead, create new servers, and throw away the old ones!"
That's the idea of immutable servers, or immutable infrastructure. This makes many things easier: rollbacks (you can always bring back the old servers), A/B testing (put old and new servers side by side), security (use the latest and safest base system at each deploy), and more.
However, throwing in a bunch of new servers at each one-line CSS change is going to be complicated, not to mention costly.
Containers to the rescue! Creating container "golden images" is easy, fast, dare I say painless. Replacing your old containers with new ones is also easy to do; much easier than virtual machines, let alone physical ones.
In this talk, we'll quickly recap the pros (and cons) of immutable servers; then explain how to implement that pattern with containers. We will use Docker as an example, but the technique can easily be adapted to Rocket or even plain LXC containers.
Fundamentals of DevOps and CI/CD
The presentation about the fundamentals of DevOps workflow and CI/CD practices I presented at Centroida (https://centroida.ai/) as a back-end development intern.
Shorten Device Boot Time for Automotive IVI and Navigation Systems
Propose a practical approach of the mixture of
ARM hibernation (suspend to disk) and Linux
user-space checkpointing
– to shorten device boot time
Intro to OpenShift, MongoDB Atlas & Live Demo
Get the fundamentals on working with containers in the cloud. In this session, you will learn how to run and manage containers in production. We'll level set with a quick intro to Kubernetes and OpenShift, so you understand some basic terminology. From there, it's all live demo. We’ll spin up Java, MongoDB (including Atlas, the hosted DBaas), integrate code from Github, and make some shiny JSON spatial services. Finally, we’ll cover best practices in using containers when going to production with an application, and answer all of your questions.
D. Andreadis, Red Hat: Concepts and technical overview of Quarkus
Dimitris Andreadis, Director of Engineering and Manager of the Quarkus Team at Red Hat, discusses the History, Concepts and Technical Overview of Quarkus framework. The webinar was delivered on June 25, 2020
Real-World Docker: 10 Things We've Learned
Docker has taken the world of software by storm, offering the promise of a portable way to build and ship software - including software running in the cloud. The RightScale development team has been diving into Docker for several projects, and we'll share our lessons learned on using Docker for our cloud-based applications.
The power of dots
The document provides an introduction and overview of the Domino OSGi Tasklet Service (DOTS). DOTS allows developers to create tasklets outside of the Domino environment in Eclipse that can then run on a Domino server. The document outlines how to set up the DOTS development environment, create a simple "Hello World" tasklet, debug tasklets, deploy tasklets to the server, and offers tips for using annotations and progress monitoring in tasklets.
DevOps Fest 2020. immutable infrastructure as code. True story.
This document discusses the journey of transitioning infrastructure management at Namecheap to an immutable infrastructure as code model using tools like Terraform, Docker, and Jenkins. Key points include taking over a project from an outsourcing company, setting up immutable infrastructure with infrastructure as code, configuring CI/CD pipelines as code in Jenkins, and lessons learned around testing, chaos engineering, and encouraging team feedback. The overall goals were to make infrastructure hard to break, easy to repair, and easy to modify.
Similar to SFScon18 - Ivan Sieder - The price of moving into the cloud. More time for debugging! (20)
Sai devops - the art of being specializing generalist
Sai devops - the art of being specializing generalist
High Performance Sites with Drupal and Cache Control Module
High Performance Sites with Drupal and Cache Control Module
DUG'20: 05 - Very Early Experiences with a 0.5 PByte DAOS Testbed
DUG'20: 05 - Very Early Experiences with a 0.5 PByte DAOS Testbed
Extensible dev secops pipelines with Jenkins, Docker, Terraform, and a kitche...
Extensible dev secops pipelines with Jenkins, Docker, Terraform, and a kitche...
Immutable infrastructure with Docker and containers (GlueCon 2015)
Immutable infrastructure with Docker and containers (GlueCon 2015)
Shorten Device Boot Time for Automotive IVI and Navigation Systems
Shorten Device Boot Time for Automotive IVI and Navigation Systems
D. Andreadis, Red Hat: Concepts and technical overview of Quarkus
D. Andreadis, Red Hat: Concepts and technical overview of Quarkus
DevOps Fest 2020. immutable infrastructure as code. True story.
DevOps Fest 2020. immutable infrastructure as code. True story.
More from South Tyrol Free Software Conference
SFSCON23 - Rufai Omowunmi Balogun - SMODEX – a Python package for understandi...
SFSCON23 - Rufai Omowunmi Balogun - SMODEX – a Python package for understandi...South Tyrol Free Software Conference
The complexity of agricultural droughts requires a consistent, reliable, and systematic method for monitoring and reporting. Amongst the various indices used to monitor this phenomenon, the soil moisture anomaly has been proven to be a more reliable predictor. However, the datasets required for computing this index are often large and computationally demanding. To address this challenge, we have developed SMODEX, a Python package that enables scalable, fast, and open-source standard-compliant computation and visualization of soil moisture anomalies.
SMODEX simplifies the computation and visualization of time-series for soil moisture and soil moisture anomalies from high-dimensional climate datasets. It allows for quick and easy parallelization of the computation on a daily, weekly, and monthly timescale. Additionally, SMODEX implements a straightforward workflow for automating the use of FAIR (Findable, Accessible, Interoperable, and Reusable) principles in producing and sharing outputs by leveraging the open source STAC API. The package is extendible and provides information on how to contribute to the project, test suites, test coverage, and a use case for the South Tyrol region, all provided in the package repository. In the future, additional agricultural drought indices and indicators would be included to serve to even larger community of researchers, policy makers, and individual users.SFSCON23 - Roberto Innocenti - From the design to reality is here the Communi...
SFSCON23 - Roberto Innocenti - From the design to reality is here the Communi...South Tyrol Free Software Conference
The Open Hardware PowerPC Notebook designed around GNU/Linux will be showed at NOI Techpark. We had presented here its motherboard design in 2018. We will updates regarding last developments for u-boot AMD video drivers, re-design of heat pipes, and CE test certification process. We will give future availability milestones of this notebook and details regarding the GNU/Linux distributions or other OS that could runs on it.SFSCON23 - Martin Rabanser - Real-time aeroplane tracking and the Open Data Hub
SFSCON23 - Martin Rabanser - Real-time aeroplane tracking and the Open Data HubSouth Tyrol Free Software Conference
RMBtec proposes using the Open Data Hub as the real-time data backbone for a start-up creating an aircraft tracking application. The Open Data Hub offers data providers visibility, infrastructure to publish data, documentation, analytics and support. It describes how aircraft position data captured by sensors could be preprocessed and sent to the Open Data Hub via MQTT, then streamed in real-time and stored in a data mart via transformers. The Open Data Hub provides an alternative to cloud services and has capabilities that could support publishing and consuming aircraft tracking data.SFSCON23 - Marianna d'Atri Enrico Zanardo - How can Blockchain technologies i...
SFSCON23 - Marianna d'Atri Enrico Zanardo - How can Blockchain technologies i...South Tyrol Free Software Conference
The transition from Web 2.0 to Web 3.0 has fueled the need for a secure and decentralized cloud storage solution for digital assets. Web 2.0 was characterized by centralized platforms where user data was under the control of companies. In contrast, Web 3.0 aims to empower individuals and foster a decentralized web that supports and benefits the Free Software and Open Data Communities.
Blockchain technologies facilitate seamless collaboration and interoperability among diverse stakeholders in the Free Software and Open Data communities. Developers can establish open and transparent ecosystems where data can be shared, verified, and integrated across multiple platforms.
Beez, with its own blockchain infrastructure, offers a secure and transparent platform for digital asset exchanges, bolstering transaction integrity and trust. By distributing data across a network of nodes, Beez ensures security and mitigates the risk of single points of failure. Users retain control over their data, safeguard their privacy, and can take advantage of the incentive mechanisms offered by blockchain networks.
During our presentation, we will explore the role of AI within Beez's ecosystem, facilitating accelerated data processing, correlation, and intelligent automation. AI unlocks valuable insights from blockchain data, and we will touch upon the use of Inductive Logic Programming (ILP) to enhance programming performance.
The integration of Blockchain and AI technologies holds great potential for advancing the safety and efficiency of the Open Data ecosystem. By combining decentralized data storage, trust-building mechanisms, and intelligent data processing, Beez is paving the way for a more secure, transparent, and user-centric digital landscape.SFSCON23 - Lucas Lasota - The Future of Connectivity, Open Internet and Human...
SFSCON23 - Lucas Lasota - The Future of Connectivity, Open Internet and Human...South Tyrol Free Software Conference
We are becoming more and more dependent on the Internet for our work, education, communication, personal relations and entertainment. Our digital devices conquered an unprecedented level of importance in our life.
However, we are facing a loss of control over our smartphones, tablets and other devices for internet connection. It's time to resolve monopolies and re-establish democratic control over the technology we most depend upon.
This talk will present the challenges end-users are facing to get more control over their devices and how Free Software is key for a consumer re-empowerement.
The talk will present real-life examples of policy demands against gatekeepers on digital markets, such as the struggle for Router Freedom in the last years and how Device Neutrality can serve as an important instrument for pushing forward end-user-oriented digital policies.SFSCON23 - Giovanni Giannotta - Intelligent Decision Support System for trace...
SFSCON23 - Giovanni Giannotta - Intelligent Decision Support System for trace...South Tyrol Free Software Conference
MOSH and MOAH are the abbreviation of two groups of chemical compounds found in mineral oils. “MOSH” stands for Mineral Oil Saturated Hydrocarbons. MOAH stands for Mineral Oil Aromatic Hydrocarbons. Both of them are under European deeply evaluation because there are two food contaminants. According to the current state of scientific knowledge, there is no sufficient toxicological evidence to prove a health risk to humans from saturated mineral oil fractions (MOSH). Meanwhile, MOAH are suspected to be carcinogenic (especially PAH-like compounds with 3-7 ring systems), therefore their levels in food should be reduced according to the ALARA-principle (as low as reasonably achievable). Gruppo FOS with CNR ( MOSH and MOAH are the abbreviation of two groups of chemical compounds found in mineral oils. “MOSH” stands for Mineral Oil Saturated Hydrocarbons. MOAH stands for Mineral Oil Aromatic Hydrocarbons. Both of them are under European deeply evaluation because there are two food contaminants. According to the current state of scientific knowledge, there is no sufficient toxicological evidence to prove a health risk to humans from saturated mineral oil fractions (MOSH). Meanwhile, MOAH are suspected to be carcinogenic (especially PAH-like compounds with 3-7 ring systems), therefore their levels in food should be reduced according to the ALARA-principle (as low as reasonably achievable). Gruppo FOS with CNR (Consiglio Nazionale delle Ricerche), Santagata 1907 and Enginius are searching the system for finding and trace their presence in the virgin and extra virgin olive oils by using open fingerprints methods, open hardware and open source blockchain and AI technologies.SFSCON23 - Elena Maines - Embracing CI/CD workflows for building ETL pipelines
SFSCON23 - Elena Maines - Embracing CI/CD workflows for building ETL pipelinesSouth Tyrol Free Software Conference
Up-to date measurements of surface meteorological variables are essential to monitor weather conditions, their spatio-temporal variability and the potential effects on a wide range of sectors and applications. Moreover, when included in continuous records of long historical observations spanning several decades, they become essential for assessing long-term climate variability and change locally and on a regional level.
Automated pipelines capable of retrieving and processing near-real time meteorological data satisfy the primary prerequisites towards the development and advancement of effective and operational climate services.
With a public and operational near real-time monitoring web platform in mind, we present automated pipelines to collect and process up-to-date daily temperature and precipitation records for Trentino South Tyrol (Italy) and surrounding areas, and to derive their spatially interpolated fields at sub-km scale. Our pipelines are composed by multiple steps including data download, sanity checks, reconstruction of missing daily records, integration into the historical archive, spatial interpolation and publication onto online FAIR catalogues as (openEO) “datacubes”. The different APIs, data formats and structure across the various data sources, and the need to merge the data onto harmonized meteorological layers, make this a typical case of the so-called Extract, Transform and Load (ETL) pipelines, and, in order to follow the principles of data reproducibility and Open Science, we embraced open-source automated workflow management through GitLab’s Continuous Integration / Continuous Development (CI/CD) capabilities.
CI/CD workflows greatly help the management of the relatively complex graphs of tasks required for our climate application, ensuring seamless orchestration with thorough flow monitoring, application logs, transactions rollbacks, and exception handling in general. Native pipeline-oriented software development also fosters a clean separation of roles among the tasks, and a more modular architecture. This effectively reduces barriers to collaborative development and paves the way for robust operational climate services for researchers and decision makers in the face of the changing climate.SFSCON23 - Christian Busse - Free Software and Open Science
The Open Science movement aims to increase the transparency, reproducibility and inclusiveness of academic research. One of its central goals is therefore to make research outputs broadly available, e.g., manuscripts (Open Access) or research data (Open Data). While software/code created in the course of scientific research is a key artifact of scientific research that is clear distinct from the latter two, it has until recently not received the same attention as manuscripts or data, although it follows its own set of paradigms.
In this talk I will present an overview on how the core concepts of Free Software and the FAIR (findable, accessible, interoperable, reuseable) Principles intersect, what this means for managing code as research output and recent initiatives on the European level that will provide support for these issues.
SFSCON23 - Charles H. Schulz - Why open digital infrastructure matters
SFSCON23 - Charles H. Schulz - Why open digital infrastructure mattersSouth Tyrol Free Software Conference
Software freedom can be defined in many ways but in legal terms it is squarely defined by a set of approved FSF and OSI software licenses. Yet everyone realizes that beyond these licenses the goal of software freedom and digital sovereignty cannot be achieved without the ability to master and create hardware components and systems - and beyond that, to rely on open digital infrastructure (servers, datacenters, and resources) . This talk will present the challenges around these topics and what we, collectively in Europe already do and can do to ensure our independence and our freedoms.SFSCON23 - Andrea Vianello - Achieving FAIRness with EDP-portal
This document discusses efforts to make environmental data from the Environmental Data Platform (EDP) more FAIR (Findable, Accessible, Interoperable, Reusable) compliant. It describes the components of EDP including data repositories, a metadata catalog, web portal, and tools. It outlines work done to improve metadata quality for humans and interoperability for machines through signposting. This includes adding DOIs, citations, and linked data/linkset JSON files. The document emphasizes that maintaining high quality metadata requires significant ongoing effort.
SFSCON23 - Thomas Aichner - How IoT and AI are revolutionizing Mass Customiza...
SFSCON23 - Thomas Aichner - How IoT and AI are revolutionizing Mass Customiza...South Tyrol Free Software Conference
The document discusses how artificial intelligence (AI) and the Internet of Things (IoT) are revolutionizing mass customization. Traditional mass customization allows customers to customize products online through selection of options. AI enables more intuitive customization by learning customer preferences and offering dynamic, individual recommendations. IoT connects devices to customize the usage experience based on a person's context and needs. The integration of these technologies has the potential to transform mass customization by enabling mood-based and natural language processing for customization as well as products designed through AI with minimal user input.SFSCON23 - Stefan Mutschlechner - Smart Werke Meran
Since 2020 Stadtwerke Meran have realized 5 Use cases:
- Control of the control cabinets of public lighting.
- Optimizing the service on Waste Press container.
- Bike Boxes
- Just Nature Project , temperature measuring over Lorawan
- Smart Lighting , communication with single light points over Lorwan.
SFSCON23 - Mirko Boehm - European regulators cast their eyes on maturing OSS ...
SFSCON23 - Mirko Boehm - European regulators cast their eyes on maturing OSS ...South Tyrol Free Software Conference
As open source software becomes the foundation to build digital products, to run the backbones of ICT infrastructure and to ensure digital sovereignty and cyber resilience, both the technology as well as the communities that develop it inevitably move into the focus of regulators. The European Union is advancing a number of policy initiatives that regulate liability, cyber security, data handling and AI applications in digital products, among others. This is a challenge for the still quite decentralised and globally operating open source community. How could the open source community participate in legislative processes, and what may be the potential impacts of the upcoming regulation on the open source development process and community dynamics?SFSCON23 - Marco Pavanelli - Monitoring the fleet of Sasa with free software
SFSCON23 - Marco Pavanelli - Monitoring the fleet of Sasa with free softwareSouth Tyrol Free Software Conference
The public transport in South Tyrol is going through a huge transformation: new investments, many new green vehicles and a brand new software. Transition will take time and how do we develop a fleet monitoring system to use during the transition without spending a fortune ? maybe with free software!SFSCON23 - Marco Cortella - KNOWAGE and AICS for 2030 agenda SDG goals monito...
SFSCON23 - Marco Cortella - KNOWAGE and AICS for 2030 agenda SDG goals monito...South Tyrol Free Software Conference
AICS is the Italian Agency for Development Cooperation that started operating in 2016 with the ambition of aligning Italy with the main European and international partners in the commitment to development. KNOWAGE Labs are developing for AICS a platform that is probably unique in the world and will allow both the Agency and the public to access all the major indicators on the UN Sustainable Development Goals provided by international sources (World Bank, WTO, ILO..) and easily compare them. The solution will allow analysis to start from 3 different touch points: the infographic of SDG goals, the advanced search criteria, and the virtual assistant. Then, a customized dashboard will be provided to the user, allowing to further expand the analysis by interacting with charts, maps, tables, etc. This talk will show the state of art of the solution, highlighting objectives and expected results of the project, but also the new developments of KNOWAGE related to AI.SFSCON23 - Lina Ceballos - Interoperable Europe Act - A real game changer
SFSCON23 - Lina Ceballos - Interoperable Europe Act - A real game changerSouth Tyrol Free Software Conference
Interoperability is a core element of the ongoing digitalisation of Europe. With the Interoperable Europe Act, the EU is aiming to create a dedicated legal framework for interoperability and to enhance cross-border digital public services across the European Union. This talk will give an overview of the state of play of this proposed regulation in the ongoing EU legislative process, some of its flaws, and the important role that Free Software and its community can play in it.SFSCON23 - Johannes Näder Linus Sehn - Let’s monitor implementation of Free S...
SFSCON23 - Johannes Näder Linus Sehn - Let’s monitor implementation of Free S...South Tyrol Free Software Conference
How to sharpen the demand for public code across Europe and monitor progress with TEDective
For six years, the Free Software Foundation Europe has been calling with a broad alliance for publicly funded software to be published as Free Software. This initiative has become a great success: Our demand "Public Money? Public Code!" has found its way into government strategy papers, party programs, as well as coalition treaties, and is being discussed in public administrations across Europe.
At the same time, we see less progress than expected and vendor lock ins remain a crucial issue. Digital sovereignty is redefined bypassing Free Software. There is openwashing in publicly funded companies, and government projects in favour of Free Software remain empty words. Public statistics on the procurement of Free Software are largely unavailable.
It is therefore no longer enough to promote the idea of "Public Money? Public Code!". We as the Free Software community should be even more vigilant than before – continuing to praise small steps in the right direction, but pointing out and criticising omissions and lack of implementation. We should become more like watchdogs.
In the talk we will look at some examples of lack of implementation of Free Software policies. We will discuss how we, as civil society, can identify such shortcomings and how to deal with them. We will present our initiative TEDective – a free-software solution that makes European public procurement data explorable for non-experts, aiming to provide you with a powerful tool to keep an eye on real progress towards "Public Money? Public Code!" across Europe.SFSCON23 - Gabriel Ku Wei Bin - Why Do We Need A Next Generation Internet
SFSCON23 - Gabriel Ku Wei Bin - Why Do We Need A Next Generation InternetSouth Tyrol Free Software Conference
The Internet today forms the backbone of the digitisation of our society and economy. As connectivity increases, the boundaries between the real and digital world get increasingly blurred. However, there has been an erosion of trust in the Internet following revelations about the exploitation of personal data, large-scale cybersecurity and data breaches, and growing awareness of the proliferation and impacts of online disinformation.
What can be done to improve the Internet as a platform for future generations? What initiatives are currently in place to build key technological blocks of an Internet that supports human-centric values, such as privacy, security, and inclusion, while reflecting the values and norms all citizens should enjoy in Europe?
This talk will explore why the current state of the internet must be re-imagined and re-engineered in order to support healthy societies, the existing European Commission initiative to work towards doing so, and the role of Free Software in accomplishing these goals.SFSCON23 - Edoardo Scepi - The Brand-New Version of IGis Maps
2023 saw the launch, after a long and well-structured revision and development process, all based on a fruitful collaboration between several departments of the Autonomous Province of Bolzano, most of the township in South Tyrol, Informatica Alto Adige (SIAG - Technical partner) and the Consortium of Municipalities of the Province of Bolzano, of the new version of the integrated geographic data management system IGis Maps. In use for years in South Tyrol, has in the Consortium one of its most enthusiastic contributors and supporters.
The very first version was released about eight years ago and its implementation was based on the idea of creating a multi-purpose GIS management system that could support different types of users, that was highly customizable, and, above all, that could be widely shared among the various management entities, both public and private, present within our territory.
After years of use and ad-hoc developments, we can finally present the new version of the IGis Maps system, which incorporates all the technical and technological improvements we realized the system needed.
It was not just a major update together with new functionalities combined inside the previous software structure, but a true re-engineering that led, among other things, to a new and more efficient user interface, a major advancement regarding the internal security, an optimization and improvement of the entire editing section as well as an optimization of the section regarding the automatic geo-processes.
A mobile version is currently under development to better support any field activities, for which a very powerful option will be included, the possibility of creating special work sessions in off-line mode so as to be able to operate even in areas without a proper cellular line network coverage.
Other very important peculiarities concern that the system is developed using a totally free software code and infrastructure, that a detailed documentation has been produced to ensure sustainability to any further future evolution, even in case of technical partner turnover, and finally, that by taking advantage of the high standards and levels of security access can be guaranteed to any type of user. From professional users, through dedicated access and qualifications or, using the ordinary SPID, to the private citizen.
We will show examples of how different types of users and stakeholders now permanently use the system for the management of a variety of tasks related to their activities, and how it was possible to customize IGis Maps to create visualization and data management contexts that best meet their needs.
We will also present a related project concerning the updating and the correction of the new technical basal cartography, built upon the new Basic Core specification, achieved through the automatic conversion implemented by the SIAG team starting from the previous National Core cartography. With the new IGis Maps it was possible to create an a
SFSCON23 - Davide Vernassa - Empowering Insights Unveiling the latest innova...
SFSCON23 - Davide Vernassa - Empowering Insights Unveiling the latest innova...South Tyrol Free Software Conference
KNOWAGE is the open source analytics and business intelligence suite made in Italy. KNOWAGE aims to provide company and organizations with analytical capabilities to exploit data to increase their efficiency and sustainability. Also thanks to the open source community support, the suite is constantly evolving combining the reliability of the most popular business intelligence solutions with the security and the transparency guaranteed by open source.
This talk will show the last year advancements and new features towards a more mobile, accessible and user-friendly product, focusing on the newly rewritten dashboarding tool.More from South Tyrol Free Software Conference (20)
SFSCON23 - Rufai Omowunmi Balogun - SMODEX – a Python package for understandi...
SFSCON23 - Rufai Omowunmi Balogun - SMODEX – a Python package for understandi...
SFSCON23 - Roberto Innocenti - From the design to reality is here the Communi...
SFSCON23 - Roberto Innocenti - From the design to reality is here the Communi...
SFSCON23 - Martin Rabanser - Real-time aeroplane tracking and the Open Data Hub
SFSCON23 - Martin Rabanser - Real-time aeroplane tracking and the Open Data Hub
SFSCON23 - Marianna d'Atri Enrico Zanardo - How can Blockchain technologies i...
SFSCON23 - Marianna d'Atri Enrico Zanardo - How can Blockchain technologies i...
SFSCON23 - Lucas Lasota - The Future of Connectivity, Open Internet and Human...
SFSCON23 - Lucas Lasota - The Future of Connectivity, Open Internet and Human...
SFSCON23 - Giovanni Giannotta - Intelligent Decision Support System for trace...
SFSCON23 - Giovanni Giannotta - Intelligent Decision Support System for trace...
SFSCON23 - Elena Maines - Embracing CI/CD workflows for building ETL pipelines
SFSCON23 - Elena Maines - Embracing CI/CD workflows for building ETL pipelines
SFSCON23 - Christian Busse - Free Software and Open Science
SFSCON23 - Christian Busse - Free Software and Open Science
SFSCON23 - Charles H. Schulz - Why open digital infrastructure matters
SFSCON23 - Charles H. Schulz - Why open digital infrastructure matters
SFSCON23 - Andrea Vianello - Achieving FAIRness with EDP-portal
SFSCON23 - Andrea Vianello - Achieving FAIRness with EDP-portal
SFSCON23 - Thomas Aichner - How IoT and AI are revolutionizing Mass Customiza...
SFSCON23 - Thomas Aichner - How IoT and AI are revolutionizing Mass Customiza...
SFSCON23 - Stefan Mutschlechner - Smart Werke Meran
SFSCON23 - Stefan Mutschlechner - Smart Werke Meran
SFSCON23 - Mirko Boehm - European regulators cast their eyes on maturing OSS ...
SFSCON23 - Mirko Boehm - European regulators cast their eyes on maturing OSS ...
SFSCON23 - Marco Pavanelli - Monitoring the fleet of Sasa with free software
SFSCON23 - Marco Pavanelli - Monitoring the fleet of Sasa with free software
SFSCON23 - Marco Cortella - KNOWAGE and AICS for 2030 agenda SDG goals monito...
SFSCON23 - Marco Cortella - KNOWAGE and AICS for 2030 agenda SDG goals monito...
SFSCON23 - Lina Ceballos - Interoperable Europe Act - A real game changer
SFSCON23 - Lina Ceballos - Interoperable Europe Act - A real game changer
SFSCON23 - Johannes Näder Linus Sehn - Let’s monitor implementation of Free S...
SFSCON23 - Johannes Näder Linus Sehn - Let’s monitor implementation of Free S...
SFSCON23 - Gabriel Ku Wei Bin - Why Do We Need A Next Generation Internet
SFSCON23 - Gabriel Ku Wei Bin - Why Do We Need A Next Generation Internet
SFSCON23 - Edoardo Scepi - The Brand-New Version of IGis Maps
SFSCON23 - Edoardo Scepi - The Brand-New Version of IGis Maps
SFSCON23 - Davide Vernassa - Empowering Insights Unveiling the latest innova...
SFSCON23 - Davide Vernassa - Empowering Insights Unveiling the latest innova...
Recently uploaded
Infrastructure Challenges in Scaling RAG with Custom AI models
Building Retrieval-Augmented Generation (RAG) systems with open-source and custom AI models is a complex task. This talk explores the challenges in productionizing RAG systems, including retrieval performance, response synthesis, and evaluation. We’ll discuss how to leverage open-source models like text embeddings, language models, and custom fine-tuned models to enhance RAG performance. Additionally, we’ll cover how BentoML can help orchestrate and scale these AI components efficiently, ensuring seamless deployment and management of RAG systems in the cloud.
Building Production Ready Search Pipelines with Spark and Milvus
Spark is the widely used ETL tool for processing, indexing and ingesting data to serving stack for search. Milvus is the production-ready open-source vector database. In this talk we will show how to use Spark to process unstructured data to extract vector representations, and push the vectors to Milvus vector database for search serving.
Full-RAG: A modern architecture for hyper-personalization
Mike Del Balso, CEO & Co-Founder at Tecton, presents "Full RAG," a novel approach to AI recommendation systems, aiming to push beyond the limitations of traditional models through a deep integration of contextual insights and real-time data, leveraging the Retrieval-Augmented Generation architecture. This talk will outline Full RAG's potential to significantly enhance personalization, address engineering challenges such as data management and model training, and introduce data enrichment with reranking as a key solution. Attendees will gain crucial insights into the importance of hyperpersonalization in AI, the capabilities of Full RAG for advanced personalization, and strategies for managing complex data integrations for deploying cutting-edge AI solutions.
みなさんこんにちはこれ何文字まで入るの？40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの？えこ...
ここ3000字までしか入らないけどタイトルの方がたくさん文字入ると思います。
June Patch Tuesday
Ivanti’s Patch Tuesday breakdown goes beyond patching your applications and brings you the intelligence and guidance needed to prioritize where to focus your attention first. Catch early analysis on our Ivanti blog, then join industry expert Chris Goettl for the Patch Tuesday Webinar Event. There we’ll do a deep dive into each of the bulletins and give guidance on the risks associated with the newly-identified vulnerabilities.
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...Edge AI and Vision Alliance
For the full video of this presentation, please visit: https://www.edge-ai-vision.com/2024/06/building-and-scaling-ai-applications-with-the-nx-ai-manager-a-presentation-from-network-optix/
Robin van Emden, Senior Director of Data Science at Network Optix, presents the “Building and Scaling AI Applications with the Nx AI Manager,” tutorial at the May 2024 Embedded Vision Summit.
In this presentation, van Emden covers the basics of scaling edge AI solutions using the Nx tool kit. He emphasizes the process of developing AI models and deploying them globally. He also showcases the conversion of AI models and the creation of effective edge AI pipelines, with a focus on pre-processing, model conversion, selecting the appropriate inference engine for the target hardware and post-processing.
van Emden shows how Nx can simplify the developer’s life and facilitate a rapid transition from concept to production-ready applications.He provides valuable insights into developing scalable and efficient edge AI solutions, with a strong focus on practical implementation.HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
Webinar Recording: https://www.panagenda.com/webinars/hcl-notes-und-domino-lizenzkostenreduzierung-in-der-welt-von-dlau/
DLAU und die Lizenzen nach dem CCB- und CCX-Modell sind für viele in der HCL-Community seit letztem Jahr ein heißes Thema. Als Notes- oder Domino-Kunde haben Sie vielleicht mit unerwartet hohen Benutzerzahlen und Lizenzgebühren zu kämpfen. Sie fragen sich vielleicht, wie diese neue Art der Lizenzierung funktioniert und welchen Nutzen sie Ihnen bringt. Vor allem wollen Sie sicherlich Ihr Budget einhalten und Kosten sparen, wo immer möglich. Das verstehen wir und wir möchten Ihnen dabei helfen!
Wir erklären Ihnen, wie Sie häufige Konfigurationsprobleme lösen können, die dazu führen können, dass mehr Benutzer gezählt werden als nötig, und wie Sie überflüssige oder ungenutzte Konten identifizieren und entfernen können, um Geld zu sparen. Es gibt auch einige Ansätze, die zu unnötigen Ausgaben führen können, z. B. wenn ein Personendokument anstelle eines Mail-Ins für geteilte Mailboxen verwendet wird. Wir zeigen Ihnen solche Fälle und deren Lösungen. Und natürlich erklären wir Ihnen das neue Lizenzmodell.
Nehmen Sie an diesem Webinar teil, bei dem HCL-Ambassador Marc Thomas und Gastredner Franz Walder Ihnen diese neue Welt näherbringen. Es vermittelt Ihnen die Tools und das Know-how, um den Überblick zu bewahren. Sie werden in der Lage sein, Ihre Kosten durch eine optimierte Domino-Konfiguration zu reduzieren und auch in Zukunft gering zu halten.
Diese Themen werden behandelt
- Reduzierung der Lizenzkosten durch Auffinden und Beheben von Fehlkonfigurationen und überflüssigen Konten
- Wie funktionieren CCB- und CCX-Lizenzen wirklich?
- Verstehen des DLAU-Tools und wie man es am besten nutzt
- Tipps für häufige Problembereiche, wie z. B. Team-Postfächer, Funktions-/Testbenutzer usw.
- Praxisbeispiele und Best Practices zum sofortigen Umsetzen
Video Streaming: Then, Now, and in the Future
In his public lecture, Christian Timmerer provides insights into the fascinating history of video streaming, starting from its humble beginnings before YouTube to the groundbreaking technologies that now dominate platforms like Netflix and ORF ON. Timmerer also presents provocative contributions of his own that have significantly influenced the industry. He concludes by looking at future challenges and invites the audience to join in a discussion.
Fueling AI with Great Data with Airbyte Webinar
This talk will focus on how to collect data from a variety of sources, leveraging this data for RAG and other GenAI use cases, and finally charting your course to productionalization.
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Discover how MongoDB Atlas and vector search technology can revolutionize your application's search capabilities. This comprehensive presentation covers:
* What is Vector Search?
* Importance and benefits of vector search
* Practical use cases across various industries
* Step-by-step implementation guide
* Live demos with code snippets
* Enhancing LLM capabilities with vector search
* Best practices and optimization strategies
Perfect for developers, AI enthusiasts, and tech leaders. Learn how to leverage MongoDB Atlas to deliver highly relevant, context-aware search results, transforming your data retrieval process. Stay ahead in tech innovation and maximize the potential of your applications.
#MongoDB #VectorSearch #AI #SemanticSearch #TechInnovation #DataScience #LLM #MachineLearning #SearchTechnology
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Unlocking Productivity: Leveraging the Potential of Copilot in Microsoft 365, a presentation by Christoforos Vlachos, Senior Solutions Manager – Modern Workplace, Uni Systems
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
ABSTRACT: A prima vista, un mattoncino Lego e la backdoor XZ potrebbero avere in comune il fatto di essere entrambi blocchi di costruzione, o dipendenze di progetti creativi e software. La realtà è che un mattoncino Lego e il caso della backdoor XZ hanno molto di più di tutto ciò in comune.
Partecipate alla presentazione per immergervi in una storia di interoperabilità, standard e formati aperti, per poi discutere del ruolo importante che i contributori hanno in una comunità open source sostenibile.
BIO: Sostenitrice del software libero e dei formati standard e aperti. È stata un membro attivo dei progetti Fedora e openSUSE e ha co-fondato l'Associazione LibreItalia dove è stata coinvolta in diversi eventi, migrazioni e formazione relativi a LibreOffice. In precedenza ha lavorato a migrazioni e corsi di formazione su LibreOffice per diverse amministrazioni pubbliche e privati. Da gennaio 2020 lavora in SUSE come Software Release Engineer per Uyuni e SUSE Manager e quando non segue la sua passione per i computer e per Geeko coltiva la sua curiosità per l'astronomia (da cui deriva il suo nickname deneb_alpha).
Generating privacy-protected synthetic data using Secludy and Milvus
During this demo, the founders of Secludy will demonstrate how their system utilizes Milvus to store and manipulate embeddings for generating privacy-protected synthetic data. Their approach not only maintains the confidentiality of the original data but also enhances the utility and scalability of LLMs under privacy constraints. Attendees, including machine learning engineers, data scientists, and data managers, will witness first-hand how Secludy's integration with Milvus empowers organizations to harness the power of LLMs securely and efficiently.
20240605 QFM017 Machine Intelligence Reading List May 2024
Everything I found interesting about machines behaving intelligently during May 2024
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for life science domain, where you retriever information from biomedical knowledge graphs using LLMs to increase the accuracy and performance of generated answers
Mind map of terminologies used in context of Generative AI
Mind map of common terms used in context of Generative AI.
Microsoft - Power Platform_G.Aspiotis.pdf
Revolutionizing Application Development
with AI-powered low-code, presentation by George Aspiotis, Sr. Partner Development Manager, Microsoft
Best 20 SEO Techniques To Improve Website Visibility In SERP
Boost your website's visibility with proven SEO techniques! Our latest blog dives into essential strategies to enhance your online presence, increase traffic, and rank higher on search engines. From keyword optimization to quality content creation, learn how to make your site stand out in the crowded digital landscape. Discover actionable tips and expert insights to elevate your SEO game.
Recently uploaded (20)
Infrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI models
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
Full-RAG: A modern architecture for hyper-personalization
Full-RAG: A modern architecture for hyper-personalization
みなさんこんにちはこれ何文字まで入るの？40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの？えこ...
みなさんこんにちはこれ何文字まで入るの？40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの？えこ...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Cosa hanno in comune un mattoncino Lego e la backdoor XZ?
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
Mind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AI
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
SFScon18 - Ivan Sieder - The price of moving into the cloud. More time for debugging!
- 1. Cloud-Tastic Learnings from moving into the cloud
- 2. Ivan Sieder Lead Engineer @ SiMedia.com @ivansieder Ifan, Aifan, Aiban, Aiven
- 6. Daniel Stori { turnoff.us } Thanks to Michael Tharrington
- 7. Daniel Stori { turnoff.us } Thanks to Michael Tharrington
- 12. Preparations
- 13. =>"
- 14. =>"
- 15. Let’s do it!
- 18. Plan ahead Which host operating system and version will your containers run on?
- 20. 14GB
- 26. Server-Sessions Avoid them, or use sticky sessions, or JWT?
- 33. Start small Don’t thrive for docker-compose at the beginning, start off by using single docker files and when everything is stable, go for compose.
- 34. Scaling Some apps might take longer to start, consider this when setting scaling limits (scale earlier, as it might take longer for the container to start)
- 35. Health Checks Some apps might take longer to start, consider setting higher timeouts to avoid unnecessary container recreations
- 36. Short-term pain Long-term gain It’s difficult to completely set up a cloud environment initially, but it provides a lot of benefits, even for “legacy” applications
- 37. Just do it! Don’t try to learn all about every part of a cloud provider, look up what you need, when you need it.
- 38. Less server management More software development
- 39. Thank you! ivan@sieder.xyz - twitter.com/ivansieder