Rex - Deployment and Configuration Management
•Download as ODP, PDF•
1 like•953 views
This document discusses problems with the current processes for deploying software to test and live servers. It takes a long time and is error-prone to manually deploy through many steps like stopping services, database backups, file upgrades, and more. Both development and operations teams need the same toolkit and to communicate better. The proposed solution is to use Rex, a remote execution and server orchestration tool that uses SSH to automate deployments. Rex allows defining server groups, tasks, and integrating with continuous integration to automate everything through a simple Perl-based system.
Report
Share
Report
Share
Recommended
Rex - Lightning Talk yapc.eu 2013
This document discusses problems with the current processes for deploying software to test and live servers. It takes a long time and is error-prone to manually install and update software across multiple servers using different scripts for each environment. This introduces risks when developers and operations teams do not have standardized processes. The document introduces Rex as a solution to automate server configuration, deployment, and management using a single tool that allows developers and operations to work from the same playbook through remote execution and orchestration of tasks across server groups.
From Test to Live with Rex
This document discusses Rex, a tool for automating server orchestration, configuration management, and deployments. Rex allows defining tasks in a Rexfile to provision and deploy virtual machines and hardware. It supports deploying applications via Git, package managers, or symlinks. Environments like development, test, and live can be managed. The philosophy is to get things done fast and reliably through automation and reproducibility.
Working Well Together: How to Keep High-end Game Development Teams Productive
This document discusses Guerrilla Games' development process for their game Killzone Shadow Fall. It describes how they use Perforce for version control and continuous integration. Key aspects of their process include having most developers work on the main trunk, extensive testing before and after code commits, labeling builds to sync safely to known good versions, and branching for frequent weekly releases while keeping the main branch for ongoing development. This approach allows for speed of iteration while maintaining control over the development cycle and releases.
JAZOON'13 - Nikita Salnikov-Tarnovski - Multiplatform Java application develo...
An Estonian startup called Plumbr is developing a Java agent that runs alongside applications to detect and solve performance problems like memory leaks. They aim to support Java on multiple platforms including Windows, Linux, Mac OS X and Solaris. Their goals include building an automated infrastructure for testing on all platforms. They use tools like Jenkins, BitBucket and Artifactory in their continuous integration and release processes which includes testing, building nightly versions, and releasing new versions.
Introduction to stress test
This slide talks about what is stress test and what tools can help to do stress test so far. After comparison, JMeter will be the easiest one to do stress test on the contemporary IoT protocols, such as MQTT, CoAP.
Phpmatsuri2013
This document discusses the slow speeds experienced when using Composer to install PHP dependencies from Japan due to latency to packagist.org. It proposes a solution of creating a Composer proxy in Japan called "composer-proxy.jp" to cache package information and speed up install times. Testing showed install times were 3x faster when using the proxy compared to direct access. Future work is discussed to add more caching and capabilities to the proxy.
PHP Deployment With SVN
Talk from the Dutch PHP Conference 2008 about deploying PHP with Subversion. Includes mention of a nabaztag
When Tools Attack
Even with the best intentions in mind, a tool or an automated process can be created and deployed with devastating results to your Perforce server instance. Learn from someone with years of experience dealing with rogue tools, hearts of gold, and hands of destruction on what to do and what to avoid when automating Perforce.
Recommended
Rex - Lightning Talk yapc.eu 2013
This document discusses problems with the current processes for deploying software to test and live servers. It takes a long time and is error-prone to manually install and update software across multiple servers using different scripts for each environment. This introduces risks when developers and operations teams do not have standardized processes. The document introduces Rex as a solution to automate server configuration, deployment, and management using a single tool that allows developers and operations to work from the same playbook through remote execution and orchestration of tasks across server groups.
From Test to Live with Rex
This document discusses Rex, a tool for automating server orchestration, configuration management, and deployments. Rex allows defining tasks in a Rexfile to provision and deploy virtual machines and hardware. It supports deploying applications via Git, package managers, or symlinks. Environments like development, test, and live can be managed. The philosophy is to get things done fast and reliably through automation and reproducibility.
Working Well Together: How to Keep High-end Game Development Teams Productive
This document discusses Guerrilla Games' development process for their game Killzone Shadow Fall. It describes how they use Perforce for version control and continuous integration. Key aspects of their process include having most developers work on the main trunk, extensive testing before and after code commits, labeling builds to sync safely to known good versions, and branching for frequent weekly releases while keeping the main branch for ongoing development. This approach allows for speed of iteration while maintaining control over the development cycle and releases.
JAZOON'13 - Nikita Salnikov-Tarnovski - Multiplatform Java application develo...
An Estonian startup called Plumbr is developing a Java agent that runs alongside applications to detect and solve performance problems like memory leaks. They aim to support Java on multiple platforms including Windows, Linux, Mac OS X and Solaris. Their goals include building an automated infrastructure for testing on all platforms. They use tools like Jenkins, BitBucket and Artifactory in their continuous integration and release processes which includes testing, building nightly versions, and releasing new versions.
Introduction to stress test
This slide talks about what is stress test and what tools can help to do stress test so far. After comparison, JMeter will be the easiest one to do stress test on the contemporary IoT protocols, such as MQTT, CoAP.
Phpmatsuri2013
This document discusses the slow speeds experienced when using Composer to install PHP dependencies from Japan due to latency to packagist.org. It proposes a solution of creating a Composer proxy in Japan called "composer-proxy.jp" to cache package information and speed up install times. Testing showed install times were 3x faster when using the proxy compared to direct access. Future work is discussed to add more caching and capabilities to the proxy.
PHP Deployment With SVN
Talk from the Dutch PHP Conference 2008 about deploying PHP with Subversion. Includes mention of a nabaztag
When Tools Attack
Even with the best intentions in mind, a tool or an automated process can be created and deployed with devastating results to your Perforce server instance. Learn from someone with years of experience dealing with rogue tools, hearts of gold, and hands of destruction on what to do and what to avoid when automating Perforce.
Cutting the pipe
This document discusses techniques for achieving sub-second iteration times when developing games, including optimizing pipeline latency through fast recompilation and reloading of resources. Individual files can be replaced and compiled quickly, and resources are separated from baking processes to allow fast iterations. Live reloading of Lua, C++ code, and shaders is enabled by treating them as normal resources and reloading the executable while maintaining game state. Fast compiles are achieved through profiling and incremental compiling.
Coroutines in Kotlin
This document provides an overview of Kotlin and coroutines. Kotlin is a statically typed language that runs on the JVM, Android and browsers. It features null safety, expressiveness, and full interoperability with Java. Coroutines allow writing asynchronous code that looks synchronous and avoid callback hell by running multiple async computations simultaneously using less memory than threads. Coroutines are lightweight and cooperative rather than preemptive like threads, and are managed by dispatchers instead of mapping to OS threads directly.
Developing imperfect software
It's summarization of the session at GDC2012 about how to prepare pipeline failure to prevent other forces breaking their works
Composer
Composer is a dependency manager for PHP that allows projects to declare their dependencies and automatically installs them. It downloads dependencies into a project, sets autoloading, and supports PSR-0 and PSR-4 autoloading standards. To use Composer, declare dependencies in a composer.json file using the "require" key and run composer install to download and install the dependencies.
JavaScript Task Runners - Gulp & Grunt
This document discusses JavaScript task runners Gulp and Grunt. It describes common web development tasks like compiling Sass/Less to CSS, concatenating and minifying JavaScript files. Task runners automate repetitive tasks and are also called build systems. Gulp is a streaming build system while Grunt uses configuration over code. Both are useful for modern front-end workflows involving preprocessors, package managers, and building/optimizing assets.
Fabric presentation
This document introduces Fabric, an automation tool written in Python that allows users to execute commands on remote servers. It provides an overview of what Fabric is, why it was created, its prerequisites, and how to get started using its core functionality through demos and examples. Key benefits highlighted are that Fabric allows automation with less code than shell scripts and mistakes than manual work, while also reducing the time needed to manage multiple servers. Alternatives like Ansible, Salt, Puppet and Chef are briefly discussed and why Fabric may be preferable for certain use cases.
PROCESS WARP
PROCESS WARP is a distributed processing system that allows applications to run in a virtual space made up of multiple connected nodes. This allows unlimited scaling of computing resources and the ability to migrate processes between nodes seamlessly. It aims to break down the distinction between standalone and cloud applications by allowing desktop programs to utilize remote resources and move freely between offline and online usage. The system uses a special virtual machine implementation with its own CPU and memory model to achieve this distributed processing without a centralized server. It has potential benefits for increasing performance, reducing costs, and providing flexibility in application deployment.
PMIx: Debuggers and Fabric Support
PMIx provides capabilities for debugging and tool integration with parallel applications by:
1) Co-locating debuggers and tools with application processes during launch.
2) Forwarding I/O between debuggers, tools, and applications.
3) Querying process and job information from resource managers and PMIx servers.
Ondřej Procházka - Deployment podle Devel.cz
This document describes a deployment pipeline for software projects. It lists several project names and their owners. It outlines the steps in the pipeline including using git for version control, installing dependencies with tools like NPM and Composer, building code with tools like Grunt and Gulp, running tests, tagging releases, and deploying code to servers for hosting. The final stages involve deploying the code to production servers, configuring reverse proxies and caching for performance.
How go makes us faster (May 2015)
This document summarizes a talk about how the Go programming language helps performance at MediaMath and how to make Go code perform well. It discusses how Go has helped MediaMath transition to a microservices architecture and how features like Go routines, channels, testing and tooling make Go productive. It also provides tips on optimizing Go code like avoiding garbage collection, using pprof, considering GOMAXPROCS, and being aware of limitations of interfaces and defers. While Go has drawbacks like its opinionated nature, the document argues it is a fast and productive language according to benchmarks and has been widely adopted at MediaMath.
Inner Symfony’s Daemons
This document discusses daemons and how to create them in PHP and Symfony. It begins with some background about the speaker and defines what a daemon is. It then outlines that daemons are useful for processes that run more frequently than every minute, like websockets or socket protocols. Typically daemons are created by forking processes or using OS tools like upstart scripts. The document demonstrates creating a simple looping daemon in PHP and discusses its issues, and then shows how to properly create daemons using forking or upstart scripts. It also introduces a Symfony bundle that provides an interface for creating daemonized console commands. In the end it notes some things to consider for long-running daemon
XPages build automation and testing
This document outlines an agenda for a presentation on testing and build automation for Domino applications. It includes demos of unit testing XPages applications using JUnit and mocking Domino classes, and continuous integration using Maven, headless Domino Designer, and Selenium testing driven by a Jenkins build server. Benefits discussed include more robust and maintainable code through testing, separation of code and data, and tools to automate local testing and continuous delivery processes.
Powerlang: a Vehicle for Lively Implementing Programming Languages
Powerlang is a framework for easily creating and implementing programming languages by providing tools for bootstrapping, debugging, compiling, and optimizing new languages. It includes a minimal virtual machine with primitives and garbage collection that allows for bit-by-bit reproducibility and small deployment size. Powerlang also enables debugging of incomplete language systems at both the high and low levels through simulation of remote execution.
Petrov Olexandr.Varnish and drupal.DrupalCamp Kyiv 2011
Varnish is a web application accelerator that caches backend responses and delivers responses from cache when possible to improve performance. It stores cache entries for each host and URL combination. Pressflow is a version of Drupal 6 with performance tweaks, allowing lazy session creation and no cookies for anonymous users. Varnish configuration is done through VCL, a C-like syntax language, and commands allow tuning, administration and viewing of caches and stats. Case studies show performance gains from using Varnish on both non-Drupal and Drupal websites.
Retrofitting Continuous Delivery
This document describes Alan's journey to implement continuous delivery practices at Betterment through a DevOps transformation in three phases:
Phase 1 focused on fixing issues with their initial infrastructure including slow builds, lack of automation, and fragile deployments. Phase 2 added practices like infrastructure as code and continuous integration to automate workflows.
Phase 3 aims to scale innovation by having product teams adopt DevOps practices from the start so new features are delivered continuously without slowing down development. The transformation progressed from fixing problems to empowering teams to move fast through automated delivery pipelines.
Bareon functional testing ci
The document describes the structure and workflow of the Bareon functional testing project. It discusses the Python APIs used to control services on the controller and slave nodes, as well as run functional tests in parallel across multiple slave nodes. Tests can validate ramdisk functionality alone or involve rebooting to a tenant image. Logs from the agent and tenant image are sent back to the controller. Tests are grouped and configured to share resources and test specific images, firmware, or nodes. Parallelism is achieved through running tests simultaneously across virtual or physical slave nodes managed by the controller.
.NET Core Blimey! Windows Platform User Group, Manchester
This document discusses .NET Core, a new open source, cross-platform version of .NET. It is not a new version of the .NET Framework, but rather a fork intended to be modular and optimized for cloud deployments. Key aspects include using NuGet for distribution, targeting multiple platforms like Linux and Mac, and using .NET Standard to define a common set of APIs across platforms. It aims to improve on Portable Class Libraries and make .NET more cross-platform.
Build a chatroom!
1. The document discusses building a chatroom web application using React and Firebase. It explains using the create-react-app command to initialize a React project called chatroom, then installing the Firebase package.
2. Details are provided about client-server architecture and the roles of frontend and backend development. The technologies that will be used are listed as React, HTML, and Firebase for the frontend and backend.
3. Instructions are given to run the React development server after creating the project and installing Firebase to begin building the chatroom application.
.NET Core in the Real World
This document provides an overview of .NET Core and discusses getting started, the dotnet command line interface, apps and libraries, current frustrations, converting existing code, building for both .NET 4.5 and .NET Core, and concludes with a thank you. It recommends installing the .NET Core SDK, updating Visual Studio, using the dotnet CLI for building even when using Visual Studio, understanding how console, web, and test projects target frameworks differently than libraries, and dealing with issues like unfinished Visual Studio tooling and lack of NuGet package support for some frameworks.
The development environment
This document provides instructions for setting up a development environment using LAMP (Linux, Apache, MySQL, PHP). It explains that a development environment is where software is developed and tested before being pushed to production. It then outlines the steps to install a Linux OS, Apache web server, PHP scripting language, MySQL database, and additional tools like CURL and GIT for development. It emphasizes configuring the development environment to match production and using virtual machines for testing before deployment.
Devops with Python by Yaniv Cohen DevopShift
This document discusses implementing DevOps with Python using Ansible. It provides an agenda for the presentation including discussing DevOps hotspots, infrastructure as code with Ansible, continuous integration/continuous delivery (CI/CD) using TravisCI and CircleCI, and an open discussion on monitoring and automated tests. It then covers problems commonly faced, how DevOps solves these problems, and the expected benefits of adopting a DevOps culture including standardized environments, infrastructure as code, automated delivery, monitoring, and improved collaboration. It provides an overview of Ansible concepts like inventories, ad-hoc commands, modules, playbooks, roles, and templates. It also demonstrates writing a custom Python module for Ansible and using it in a playbook. Finally, it
North east user group tour
This document summarizes an upcoming tour by Kevin Schroeder of Zend Technologies to discuss various topics including:
- An introduction to Kevin and what he does at Zend
- An overview of Zend products like Zend Framework and Zend Server
- A discussion of performance, scalability, and queuing in PHP applications
- A demonstration of using the Zend Server job queue to asynchronously process tasks
- Considerations for deploying PHP applications in different environments like development, testing, staging, and production
More Related Content
What's hot
Cutting the pipe
This document discusses techniques for achieving sub-second iteration times when developing games, including optimizing pipeline latency through fast recompilation and reloading of resources. Individual files can be replaced and compiled quickly, and resources are separated from baking processes to allow fast iterations. Live reloading of Lua, C++ code, and shaders is enabled by treating them as normal resources and reloading the executable while maintaining game state. Fast compiles are achieved through profiling and incremental compiling.
Coroutines in Kotlin
This document provides an overview of Kotlin and coroutines. Kotlin is a statically typed language that runs on the JVM, Android and browsers. It features null safety, expressiveness, and full interoperability with Java. Coroutines allow writing asynchronous code that looks synchronous and avoid callback hell by running multiple async computations simultaneously using less memory than threads. Coroutines are lightweight and cooperative rather than preemptive like threads, and are managed by dispatchers instead of mapping to OS threads directly.
Developing imperfect software
It's summarization of the session at GDC2012 about how to prepare pipeline failure to prevent other forces breaking their works
Composer
Composer is a dependency manager for PHP that allows projects to declare their dependencies and automatically installs them. It downloads dependencies into a project, sets autoloading, and supports PSR-0 and PSR-4 autoloading standards. To use Composer, declare dependencies in a composer.json file using the "require" key and run composer install to download and install the dependencies.
JavaScript Task Runners - Gulp & Grunt
This document discusses JavaScript task runners Gulp and Grunt. It describes common web development tasks like compiling Sass/Less to CSS, concatenating and minifying JavaScript files. Task runners automate repetitive tasks and are also called build systems. Gulp is a streaming build system while Grunt uses configuration over code. Both are useful for modern front-end workflows involving preprocessors, package managers, and building/optimizing assets.
Fabric presentation
This document introduces Fabric, an automation tool written in Python that allows users to execute commands on remote servers. It provides an overview of what Fabric is, why it was created, its prerequisites, and how to get started using its core functionality through demos and examples. Key benefits highlighted are that Fabric allows automation with less code than shell scripts and mistakes than manual work, while also reducing the time needed to manage multiple servers. Alternatives like Ansible, Salt, Puppet and Chef are briefly discussed and why Fabric may be preferable for certain use cases.
PROCESS WARP
PROCESS WARP is a distributed processing system that allows applications to run in a virtual space made up of multiple connected nodes. This allows unlimited scaling of computing resources and the ability to migrate processes between nodes seamlessly. It aims to break down the distinction between standalone and cloud applications by allowing desktop programs to utilize remote resources and move freely between offline and online usage. The system uses a special virtual machine implementation with its own CPU and memory model to achieve this distributed processing without a centralized server. It has potential benefits for increasing performance, reducing costs, and providing flexibility in application deployment.
PMIx: Debuggers and Fabric Support
PMIx provides capabilities for debugging and tool integration with parallel applications by:
1) Co-locating debuggers and tools with application processes during launch.
2) Forwarding I/O between debuggers, tools, and applications.
3) Querying process and job information from resource managers and PMIx servers.
Ondřej Procházka - Deployment podle Devel.cz
This document describes a deployment pipeline for software projects. It lists several project names and their owners. It outlines the steps in the pipeline including using git for version control, installing dependencies with tools like NPM and Composer, building code with tools like Grunt and Gulp, running tests, tagging releases, and deploying code to servers for hosting. The final stages involve deploying the code to production servers, configuring reverse proxies and caching for performance.
How go makes us faster (May 2015)
This document summarizes a talk about how the Go programming language helps performance at MediaMath and how to make Go code perform well. It discusses how Go has helped MediaMath transition to a microservices architecture and how features like Go routines, channels, testing and tooling make Go productive. It also provides tips on optimizing Go code like avoiding garbage collection, using pprof, considering GOMAXPROCS, and being aware of limitations of interfaces and defers. While Go has drawbacks like its opinionated nature, the document argues it is a fast and productive language according to benchmarks and has been widely adopted at MediaMath.
Inner Symfony’s Daemons
This document discusses daemons and how to create them in PHP and Symfony. It begins with some background about the speaker and defines what a daemon is. It then outlines that daemons are useful for processes that run more frequently than every minute, like websockets or socket protocols. Typically daemons are created by forking processes or using OS tools like upstart scripts. The document demonstrates creating a simple looping daemon in PHP and discusses its issues, and then shows how to properly create daemons using forking or upstart scripts. It also introduces a Symfony bundle that provides an interface for creating daemonized console commands. In the end it notes some things to consider for long-running daemon
XPages build automation and testing
This document outlines an agenda for a presentation on testing and build automation for Domino applications. It includes demos of unit testing XPages applications using JUnit and mocking Domino classes, and continuous integration using Maven, headless Domino Designer, and Selenium testing driven by a Jenkins build server. Benefits discussed include more robust and maintainable code through testing, separation of code and data, and tools to automate local testing and continuous delivery processes.
Powerlang: a Vehicle for Lively Implementing Programming Languages
Powerlang is a framework for easily creating and implementing programming languages by providing tools for bootstrapping, debugging, compiling, and optimizing new languages. It includes a minimal virtual machine with primitives and garbage collection that allows for bit-by-bit reproducibility and small deployment size. Powerlang also enables debugging of incomplete language systems at both the high and low levels through simulation of remote execution.
Petrov Olexandr.Varnish and drupal.DrupalCamp Kyiv 2011
Varnish is a web application accelerator that caches backend responses and delivers responses from cache when possible to improve performance. It stores cache entries for each host and URL combination. Pressflow is a version of Drupal 6 with performance tweaks, allowing lazy session creation and no cookies for anonymous users. Varnish configuration is done through VCL, a C-like syntax language, and commands allow tuning, administration and viewing of caches and stats. Case studies show performance gains from using Varnish on both non-Drupal and Drupal websites.
Retrofitting Continuous Delivery
This document describes Alan's journey to implement continuous delivery practices at Betterment through a DevOps transformation in three phases:
Phase 1 focused on fixing issues with their initial infrastructure including slow builds, lack of automation, and fragile deployments. Phase 2 added practices like infrastructure as code and continuous integration to automate workflows.
Phase 3 aims to scale innovation by having product teams adopt DevOps practices from the start so new features are delivered continuously without slowing down development. The transformation progressed from fixing problems to empowering teams to move fast through automated delivery pipelines.
Bareon functional testing ci
The document describes the structure and workflow of the Bareon functional testing project. It discusses the Python APIs used to control services on the controller and slave nodes, as well as run functional tests in parallel across multiple slave nodes. Tests can validate ramdisk functionality alone or involve rebooting to a tenant image. Logs from the agent and tenant image are sent back to the controller. Tests are grouped and configured to share resources and test specific images, firmware, or nodes. Parallelism is achieved through running tests simultaneously across virtual or physical slave nodes managed by the controller.
.NET Core Blimey! Windows Platform User Group, Manchester
This document discusses .NET Core, a new open source, cross-platform version of .NET. It is not a new version of the .NET Framework, but rather a fork intended to be modular and optimized for cloud deployments. Key aspects include using NuGet for distribution, targeting multiple platforms like Linux and Mac, and using .NET Standard to define a common set of APIs across platforms. It aims to improve on Portable Class Libraries and make .NET more cross-platform.
Build a chatroom!
1. The document discusses building a chatroom web application using React and Firebase. It explains using the create-react-app command to initialize a React project called chatroom, then installing the Firebase package.
2. Details are provided about client-server architecture and the roles of frontend and backend development. The technologies that will be used are listed as React, HTML, and Firebase for the frontend and backend.
3. Instructions are given to run the React development server after creating the project and installing Firebase to begin building the chatroom application.
.NET Core in the Real World
This document provides an overview of .NET Core and discusses getting started, the dotnet command line interface, apps and libraries, current frustrations, converting existing code, building for both .NET 4.5 and .NET Core, and concludes with a thank you. It recommends installing the .NET Core SDK, updating Visual Studio, using the dotnet CLI for building even when using Visual Studio, understanding how console, web, and test projects target frameworks differently than libraries, and dealing with issues like unfinished Visual Studio tooling and lack of NuGet package support for some frameworks.
What's hot (19)
Powerlang: a Vehicle for Lively Implementing Programming Languages
Powerlang: a Vehicle for Lively Implementing Programming Languages
Petrov Olexandr.Varnish and drupal.DrupalCamp Kyiv 2011
Petrov Olexandr.Varnish and drupal.DrupalCamp Kyiv 2011
.NET Core Blimey! Windows Platform User Group, Manchester
.NET Core Blimey! Windows Platform User Group, Manchester
Similar to Rex - Deployment and Configuration Management
The development environment
This document provides instructions for setting up a development environment using LAMP (Linux, Apache, MySQL, PHP). It explains that a development environment is where software is developed and tested before being pushed to production. It then outlines the steps to install a Linux OS, Apache web server, PHP scripting language, MySQL database, and additional tools like CURL and GIT for development. It emphasizes configuring the development environment to match production and using virtual machines for testing before deployment.
Devops with Python by Yaniv Cohen DevopShift
This document discusses implementing DevOps with Python using Ansible. It provides an agenda for the presentation including discussing DevOps hotspots, infrastructure as code with Ansible, continuous integration/continuous delivery (CI/CD) using TravisCI and CircleCI, and an open discussion on monitoring and automated tests. It then covers problems commonly faced, how DevOps solves these problems, and the expected benefits of adopting a DevOps culture including standardized environments, infrastructure as code, automated delivery, monitoring, and improved collaboration. It provides an overview of Ansible concepts like inventories, ad-hoc commands, modules, playbooks, roles, and templates. It also demonstrates writing a custom Python module for Ansible and using it in a playbook. Finally, it
North east user group tour
This document summarizes an upcoming tour by Kevin Schroeder of Zend Technologies to discuss various topics including:
- An introduction to Kevin and what he does at Zend
- An overview of Zend products like Zend Framework and Zend Server
- A discussion of performance, scalability, and queuing in PHP applications
- A demonstration of using the Zend Server job queue to asynchronously process tasks
- Considerations for deploying PHP applications in different environments like development, testing, staging, and production
DevOps and Chef improve your life
The document discusses the need for improved collaboration between developers and system administrators (sysadmins) to enable business objectives. It notes that developers focus on implementing new features quickly without considering operational impacts, while sysadmins aim to minimize risks by avoiding changes. This leads to delays in deployments and last-minute releases. The document recommends automating infrastructure provisioning and configuration using a tool like Chef to establish a common workflow and shared objectives between teams.
Capistrano
This document discusses how Capistrano can be used to automate deployments and other tasks across multiple servers. It provides examples of how Capistrano can be used for deploying code, updating databases, checking server health metrics, restarting services, and more. While originally designed for Ruby on Rails applications, Capistrano can be adapted for other languages and technologies as well by customizing the deployment recipes.
Achieving Full Stack DevOps at Colonial Life
In an ever more competitive marketplace, organizations have turned to Agile and DevOps practices to deliver software innovations to market more quickly and with high quality. Across industries, companies are making heavy investments in tools and process improvements around automated build, test, continuous integration and delivery, and release automation and orchestration. However, despite these investments, many organizations are still struggling to bring the necessary speed and quality to their software delivery. In many cases, this is because Agile and DevOps improvements have not been applied to the entire software stack and are often limited to application code delivery.
This webinar will explore the transformation that Colonial Life made in bringing DevOps to the entire software stack. Specifically, beyond automating and accelerating the validation and delivery of application code, this webinar will focus on the critical role that data and the database play in modern software delivery and the tools and processes that can bring the same automation to database code.
After this webinar, you will understand:
* What holds organizations back despite an Agile application development process
* The benefits of automating the validation and deployment of database changes
* A template for bringing DevOps to the entire software stack
Week 5
The document provides an introduction to programming concepts such as variables, data types, basic math operations, and order of operations. It explains how programs use variables to store and manipulate data in memory and demonstrates basic PHP code examples for printing output, performing math calculations, and assigning values to variables. The examples illustrate fundamental programming concepts like declaring variables, assigning values, and performing arithmetic operations in PHP.
Week 5
The document provides an introduction to programming concepts such as variables, data types, basic math operations, and order of operations. It explains how variables store and represent data in computer memory and how their values can be manipulated using assignment statements and basic math. The document also introduces potential issues around data type conversion and order of operations that programmers need to be aware of.
Jenkinsconf Presentation - Advance jenkins management with multiple projects.
Jenkinsconf Presentation - Advance jenkins management with multiple projects.
presented in jenkins user conference 2014 Israel
Django dev-env-my-way
The document discusses the author's approach to setting up a development environment for Django projects. It describes establishing a project layout with separate folders for source code, virtual environments, requirements files, and more. It also covers tools and practices for tasks like dependency management, testing, debugging, deployment, and overall software development philosophy.
Cl221
The document discusses migrating a Novell Open Enterprise Server from NetWare to Linux using Novell's migration tool. It provides an agenda for a lab demonstrating the migration, including an overview of the lab scenario, migration options, prerequisites for a successful consolidation, and steps for preparing, building the target server, and managing services on Open Enterprise Server Linux.
Docker and DevOps --- new IT culture
This document discusses how Docker and DevOps introduce a new IT culture. It provides an overview of Docker and containers, explaining how Docker allows packaging applications and dependencies into standardized units. It then discusses aspects of the DevOps methodology like configuration management, continuous integration, and maintaining consistent environments across development and production. The document argues that Docker streamlines processes like environment setup, updates, integration testing, and infrastructure changes in a DevOps workflow.
eZ Platform Cloud and eZ Launchpad: Don’t Host, Don’t Deploy, Don’t Install—J...
eZ Launchpad is a Docker-based tool that simplifies local development by automatically installing and configuring the necessary services for an eZ Platform project. It allows developers to focus on coding by handling infrastructure tasks. eZ Platform Cloud builds on this by offering a PaaS that hosts the application and provides a unified development workflow with automatic deployments on merge. It reduces DevOps efforts by 80% by eliminating the need for manual testing and deployment on separate environments. eZ Launchpad can also be configured to integrate with Platform.sh for automatic deployments of code merged to the main branch. This enables continuous delivery of features to production with immediate user testing on review environments.
eZ Platform Cloud and eZ Launchpad: Don’t Host, Don’t Deploy, Don’t Install—J...
eZ Launchpad is a Docker-based tool that simplifies local development by automatically installing and configuring the necessary services for an eZ Platform project. It allows developers to focus on coding by handling infrastructure tasks. eZ Platform Cloud builds on this by offering a PaaS that hosts the application and provides a unified development workflow with automatic deployments on merge. It reduces DevOps efforts by 80% by eliminating the need for manual testing and deployment on separate environments. eZ Launchpad can also be configured to integrate with Platform.sh for automatic deployments of code merged to the main branch. This enables continuous delivery of features to production with pull requests.
Version Management with CVS
The document discusses version control systems and Concurrent Versions System (CVS) in particular. It describes the goals of version management as record keeping and enabling collaboration between developers. It provides an overview of CVS terminology and functions, including how developers can commit changes to a repository and how conflicts are resolved. The document also notes that CVS is available on many platforms and is commonly used for open source projects.
Seven problems of Linux Containers
OpenVZ, which has turned 7 recently, is an implementation of lightweight virtualization technology for Linux, something which is also referred to as LXC or just containers. The talk gives an insight into 7 different problems with containers and how they were solved. While most of these problems and solutions belongs in the Linux kernel, kernel knowledge is not expected from the audience.
Seven problems of Linux containers
The document summarizes seven problems with Linux containers and provides solutions. It discusses issues like effective virtualization, sharing resources fairly, easy resource configuration, fast live migration of large containers, getting container features merged into the Linux kernel, and using a common file system. Solutions proposed include namespaces, cgroups, VSwap, network swap for migration, rewriting code for upstream acceptance, the CRIU tool, and using ploop for a modular file system backend.
Real-world Experiences in Scala
The document summarizes the author's journey from being a C# developer to adopting Scala. He was tired of Microsoft's ecosystem and wanted to use Linux. Scala met his criteria of being open source, cross-platform, functional, and modern. He used Scala with Play Framework and MongoDB to build systems for Tehran International Book Fair that had to handle high traffic. While one project failed initially due to server limitations, he was able to fix it and complete the projects successfully on a larger server. He is now happy with his Scala ecosystem.
Chef - Administration for programmers
This document discusses Opscode Chef, a systems integration framework that allows users to manage infrastructure as code. It provides concise summaries of key points about Chef:
1) Chef allows users to manage server configuration and infrastructure as code using resources, recipes, roles and other concepts defined in the Chef framework.
2) Infrastructure is defined as code that can be versioned, tested, and deployed to automatically configure servers.
3) The document discusses Chef concepts like nodes, environments, attributes and provides an example of using a cron resource to configure a scheduled task.
Cloud Orchestration is Broken
Running your app in the Cloud is all the rage, but our tools for managing and supporting complex environments lag behind our needs. If we truly want to embrace Infrastructure as a Service, then we must apply standard software development lessons such as: DRY, Versioning, Decomposition, Abstraction and more. Why haven't we taken these lessons to heart?
Similar to Rex - Deployment and Configuration Management (20)
Jenkinsconf Presentation - Advance jenkins management with multiple projects.
Jenkinsconf Presentation - Advance jenkins management with multiple projects.
eZ Platform Cloud and eZ Launchpad: Don’t Host, Don’t Deploy, Don’t Install—J...
eZ Platform Cloud and eZ Launchpad: Don’t Host, Don’t Deploy, Don’t Install—J...
eZ Platform Cloud and eZ Launchpad: Don’t Host, Don’t Deploy, Don’t Install—J...
eZ Platform Cloud and eZ Launchpad: Don’t Host, Don’t Deploy, Don’t Install—J...
More from inovex GmbH
lldb – Debugger auf Abwegen
lldb kann mehr als nur einfache Breakpoints oder po. In dem Vortrag zeigt Oliver Bayer, wie sich mit Hilfe von lldb Programmcode zur Ausführungszeit manipulieren lässt, ohne das hierfür der Sourcecode anzupassen ist. Sei es, damit Test- oder Debugcode nicht in die produktiv App gelangt, oder weil der Sourcecode für einen Teil der App nicht vorliegt.
Event: macoun, 04.10.2019
Speaker: Oliver Bayer, inovex
Mehr Tech-Vorträge: inovex.de/vortraege
Mehr Tech-Artikel: inovex.de/blog
Are you sure about that?! Uncertainty Quantification in AI
With the advent of Deep Learning (DL), the field of AI made a giant leap forward and it is nowadays applied in many industrial use-cases. Especially critical systems like autonomous driving, require that DL methods not only produce a prediction but also state the certainty about the prediction in order to assess risks and failure.
In my talk, I will give an introduction to different kinds of uncertainty, i.e. epistemic and aleatoric. To have a baseline for comparison, the classical method of Gaussian Processes for regression problems is presented. I then elaborate on different DL methods for uncertainty quantification like Quantile Regression, Monte-Carlo Dropout, and Deep Ensembles. The talk is concluded with a comparison of these techniques to Gaussian Processes and the current state of the art.
Speaker: Dr. Florian Wilhelm, Simon Bachstein, inovex
Event: PyCon/PyData Berlin 2019
Datum: 10.10.2019
Mehr Tech-Vorträge: inovex.de/vortraege
Mehr Tech-Artikel: inovex.de/blog
Why natural language is next step in the AI evolution
In 2010 ImageNet finally ended the AI winter and gave machines the sense of sight. Within the following years dramatic improvements in tasks such as image classification and object detection lead to innovations like face ID and autonomous driving. Recently, similar developments happened in the field of natural language. Using Attention mechanism and transformers tasks such as question answering and text summarization reached new benchmarks.
This talk will not only explain those, but point out how Transfer Learning and open source models such as Google Bert will open the field to new innovations in AI.
Speaker: Nico Kreiling, inovex
Event: AIxIA, 01.10.2019
Mehr Tech-Vorträge: inovex.de/vortraege
Mehr Tech-Artikel: inovex.de/blog
WWDC 2019 Recap
Die Worldwide Developers Conference (WWDC) ist eine von Apple jährlich durchgeführte Konferenz für Software-Entwickler (MacOS, iOS und WatchOS). Um die WWDC 2019 nochmal Revue passieren zu lassen, wurde beim Mobile Development Karlsruhe Meetup zu einer offenen Diskussionsrunde eingeladen. Die Slides fassen die für inovexler Philipp interessantesten Neuigkeiten der WWDC2019 zusammen und dienten beim Meetup als Diskussionsgrundlage.
Event: 9. Mobile Development Meetup (WWDC Edition)
Speaker: Philipp Wallrich, inovex
Datum: 17.06.2019
Mehr Tech-Vorträge: inovex.de/vortraege
Mehr Tech-Artikel: inovex.de/blog
Network Policies
Trust is good, control is better – A short story about Network Policies.
Abstract:
Probably everybody who uses Kubernetes in a productive environment with multiple users possibly has looked at policies. Often the operators of the cluster(s) just trust the policies but in some cases it might be useful to control if the policies actually have taken action and often there are just to many Policies in the cluster setup to manually test them all (and obviously you don’t want to do this). Testing the effectiveness of the Network Policies can be done in different approaches. In this talk we will show you the benefits and drawbacks of different approaches and what solution we finally chose. Also we will show you some other tools and how they complement our solution. As a takeaway you will get an overview of different testing strategies for policies, as well as understanding challenges in testing policies in general and the Kubernetes ecosystem.
Event: ContainerDays 2019
Datum: 26.06.2019
Speaker: Johannes M. Scheuermann, Maximilian Bischoff (beide inovex)
Mehr Tech-Vorträge: inovex.de/vortraege
Mehr Tech-Artikel: inovex.de/blog
Interpretable Machine Learning
Interpretierbarkeit von ML-Modellen hat die Zielsetzung, die Ursachen einer Prognose offenzulegen und eine daraus abgeleitete Entscheidung für einen Menschen nachvollziehbar zu erklären. Durch die Nachvollziehbarkeit von Prognosen lässt sich beispielsweise sicherstellen, dass deren Herleitung konsistent zum Domänenwissen eines Experten ist. Auch ein unfairer Bias lässt sich durch die Erklärung aussagekräftiger Beispiele identifizieren.
Prognosemodelle lassen sich grob in intrinsisch interpretierbare Modelle und nicht-interpretierbare (auch Blackbox-) Modelle unterscheiden. Intrinsisch interpretierbare Modelle sind dafür bekannt, dass sie für einen Menschen leicht nachvollziehbar sind. Ein typisches Beispiel für ein solches Modell ist der Entscheidungsbaum, dessen regelbasierter Entscheidungsprozess intuitiv und leicht zugänglich ist. Im Gegensatz dazu gelten Neuronale Netze als Blackbox-Modelle, deren Prognosen durch die komplexe Netzstruktur schwer nachvollziehbar sind.
In diesem Talk erläuterte Marcel Spitzer das Konzept von Interpretierbarkeit im Kontext von Machine Learning und stellte gängige Verfahren zur Interpretation von Modellen vor. Besonderen Fokus legte er dabei auf modellunabhängige Verfahren, die sich auch auf prognosestarke Blackbox-Modelle anwenden lassen.
Event: M3 Minds Mastering Machines
Speaker: Marcel Spitzer
Blog-Artikel: https://www.inovex.de/blog/machine-learning-interpretability/
Mehr Tech-Vorträge: inovex.de/vortraege
Mehr Tech-Artikel: inovex.de/blog
Jenkins X – CI/CD in wolkigen Umgebungen
Das Ökosystem rund um Kubernetes wächst täglich. Insbesondere cloud-native Continuous-Deployment-Strategien stehen Hoch im Kurs und werden in diversen Open-Source-Projekten vorangetrieben. In einer Reihe von Evalutionen nimmt inovex diese Tools genauer unter die Lupe - den Anfang macht Jenkins X.
Jenkins X wurde im März 2018 veröffentlicht. Das Konzept hinter dem Tool ist primär, bestehende Teillösungen (Helm, Skaffold, Prow, Tekton) einzusetzen, um sie abstrahiert in ein Kommandozeilen-Interface zu packen. Der Vortrag beschreibt sowohl die klassische Architektur als auch den "Severless"-Ansatz. Des weiteren werden das Kommandozeilen-Tool "jx", der allgemeine Entwicklungs-Workflow sowie diverse Features vorgestellt.
Bei unseren Tests im Rahmen der Evaluation sind uns einige Stolpersteine aufgefallen. Es sind vor allem die vielen eingesetzten Dritt-Tools, die den Betrieb und den Upkeep eines mit Jenkins X erstellten Clusters verkomplizieren. Als Fazit stellen wir Jenkins X im Mai 2019 ein "befriedigend" aus und beobachten gespannt, wie sich das Tool in den kommmenden Monaten und Jahren weiterentwickeln wird.
Event: Talk4Nerds, 29.04.2019
Speaker: Simon Kienzler, Johannes M. Scheuermann (beide inovex)
Mehr Tech-Vorträge: inovex.de/vortraege
Mehr Tech-Artikel: inovex.de/blog
AI auf Edge-Geraeten
Neben dem großen Machine-Learning-Trend in der Cloud zeichnet sich zunehmend die Tendenz ab, bestimmte Aufgaben direkt auf Edge-Geräten auszuführen. Wir erkunden die Vorteile von Auswertungen direkt an der Quelle der Daten und die damit verbundenen Herausforderungen. Denn die Rechenleistung der Cloud steht uns hier leider nicht zur Verfügung.
Zur Lösung stehen uns verschiedene Hardwareoptionen wie CPUs, GPUs, FPGAs oder spezielle ASICs und Frameworks zur Verfügung, die wir am Beispiel von einem Convolutional Neural Network evaluieren. Dabei gibt es praktische Tipps und Erfahrungen aus realen Projekten sowie anschauliche Demos auf verschiedenen Hardwareplattformen.
Vorkenntnisse:
Vorkenntnisse über tiefe neuronale Netze sind von Vorteil.
Lernziele:
- Verständnis über die Vorteile von AI auf Edge-Geräten und den damit verbundenen Herausforderungen.
- Wissen über die verschiedenen Hard- und Softwarelösungen erlangen, um diese in eigenen Projekten einzusetzen.
Event: building IoT, 03.04.2019
Speaker: Dominik Helleberg, inovex
Mehr Tech-Vorträge: inovex.de/vortraege
Mehr Blog-Artikel: inovex.de/blog
Prometheus on Kubernetes
This document discusses Prometheus on Kubernetes. It provides an overview of Prometheus and its ecosystem, including how it is used for service discovery on Kubernetes, collecting and storing metrics, ensuring high availability and scalability through sharding, and defining and alerting on service level agreements. It also covers instrumentation using exporters, the Prometheus query language PromQL, and components of the Prometheus ecosystem like Grafana and Alertmanager.
Deep Learning for Recommender Systems
Recommender systems support the decision making processes of customers with personalized suggestions. These widely used systems influence the daily life of almost everyone across domains like ecommerce, social media, and entertainment. However, the efficient generation of relevant recommendations in large-scale systems is a very complex task. In order to provide personalization, engines and algorithms need to capture users’ varying tastes and find mostly nonlinear dependencies between them and a multitude of items. Enormous data sparsity and ambitious real-time requirements further complicate this challenge. At the same time, deep learning has been proven to solve complex tasks like object or speech recognition where traditional machine learning failed or showed mediocre performance.
Join Marcel Kurovski to explore a use case for vehicle recommendations at mobile.de, Germany’s biggest online vehicle market. Marcel shares a novel regularization technique for the optimization criterion and evaluates it against various baselines. To achieve high scalability, he combines this method with strategies for efficient candidate generation based on user and item embeddings—providing a holistic solution for candidate generation and ranking.
The proposed approach outperforms collaborative filtering and hybrid collaborative-content-based filtering by 73% and 143% for MAP@5. It also scales well for millions of items and users returning recommendations in tens of milliseconds.
Event: O'Reilly Artificial Intelligence Conference, New York, 18.04.2019
Speaker: Marcel Kurovski, inovex GmbH
Mehr Tech-Vorträge: inovex.de/vortraege
Mehr Tech-Artikel: inovex.de/blog
Azure IoT Edge
In seinem Meetup Talk berichtete Maximilian von den aktuellen Problemen von Cloud Computing – insbesondere im Internet of Things – und wie diese durch Edge Computing mitigiert werden können. Er erklärte, wie eine generische Edge-Computing-Architektur aussehen kann und zeigte Anwendungsfälle, von denen manche auch schon in existierenden Produkten umgesetzt sind.
Im Anschluss stellte er Azure IoT Edge vor und erläuterte, wie es das bestehende IoT Framework von Microsoft erweitert sowie die Grundkonzepte, die IoT Edge bereitstellt. Auch die Probleme in dem noch jungen Produkt wurden angesprochen, aber auch die Vorteile und Features, die es liefert.
In der gemeinsamen Demo mit Eli haben dann beide Speaker die technischen Details von Azure IoT Edge gezeigt und demonstriert, beispielsweise wie Code automatisiert von einer CI/CD-Pipeline in Azure DevOps auf ein IoT-Gerät deployed werden kann.
Event: inovex Meetup, 12.03.& 19.03.2019
Speaker: Maximilian Bischoff, inovex
Mehr Tech-Vorträge: inovex.de/vortraege
Mehr Tech-Artikel: inovex.de/blog
Representation Learning von Zeitreihen
Es liegt in der Natur des Menschen das Unvorhersehbare vorherzusagen: Wetter, Aktienkurse, Krankheitsverläufe, die Reaktion eines Menschen. Neueste Deep Learning Ansätze sind in der Lage solche sequentielle Sachverhalte immer genauer zu prognostizieren, setzen aber auch immer größere Datenmengen und Rechenleistungen voraus, die sowohl in Forschung als auch in der Praxis häufig nicht vorliegen. Wie kann man gute Ergebnisse erreichen, wenn nur wenig Daten vorliegen?
Marisa Mohr stellte in ihrem Vortrag einen neuen und vielversprechenden informationstheoretischen Ansatz zum Feature Learning von sequentiellen Daten vor, der potenziell auch mit wenigen Daten auskommt. Dabei ging es speziell um ordinale Muster in Zeitreihen, wie sie beispielsweise als Veränderung von Emotionen im Gesprächsverlauf zu finden sind. Eine solche Entwicklung ist für Menschen in der Regel leicht zu erkennen. Chatbots hingegen können nicht intuitiv auf solche Emotionsverläufe reagieren, sondern müssen entsprechend programmiert werden.
Details:
Deep-Learning-Ansätze wie LSTMs, RNNs oder TCNs haben sich im Umgang mit sequentiellen Daten bewährt. Neuronale Netzwerke sind tief im technischen Sinn, weil sie mehrere (verborgene) Schichten besitzen, aber nicht weil sie ein tiefes Verständnis von Problemen entwickeln. In diesem Vortrag stellte Marisa einen symbolischen informationstheoretischen Ansatz des Representation Learnings von Zeitreihen vor und damit eine Möglichkeit, konzeptionelle Schichten zu konstruieren. Die Idee hinter der sogenannten Permutationsentropie besteht darin, anstelle der Werte einer Zeitreihe die Ordnungsrelation zwischen den Werten zu betrachten, und so auf das natürliche Auf und Ab des zugrundeliegenden dynamischen Systems zurückzugreifen.
Event: inovex Meetup: Das Unvorhersehbare vorhersagen: Zeitreihen und Chatbots, 26.03.2019
Speakerin: Marisa Mohr (inovex)
Mehr Tech-Vorträge: inovex.de/vortraege
Mehr Tech-Artikel: inovex.de/blog
Talk to me – Chatbots und digitale Assistenten
Menschliche Kommunikation folgt zwar einer ganzen Reihe von Regeln, diese lassen sich aber schwer formalisieren. Nicht zuletzt deshalb, weil in unseren Interaktionen immer auch eine Fülle von Welt- und implizitem Kontextwissen eine Rolle spielt. Rein regelbasierte Chatbots sind daher nicht nur äußert komplex in der Programmierung, sondern stoßen in vielen Anwendungsbereichen schnell an ihre Grenzen.
In diesem Vortrag gab Anna Weißhaar einen Überblick über die aktuellen Lösungen und Herausforderungen im Bereich digitale Assistenten. Der Fokus lag dabei auf Ansätzen, die Chatbots „chatty“ machen, sie also möglichst adäquat auf im Voraus unbekannte Nutzereingaben reagieren zu lassen.
Event: inovex Meetup: Das Unvorhersehbare vorhersagen: Zeitreihen und Chatbots, 26.03.2019
Speaker: Anna Weißhaar (inovex)
Mehr Tech-Vorträge: inovex.de/vortraege
Mehr Tech-Artikel: inovex.de/blog
Künstlich intelligent?
Nicht zuletzt durch die medienwirksame Erfolge des maschinellen Lernens durch DeepMind, OpenAI und Kollegen ist Künstliche Intelligenz im Moment wieder in aller Munde. Einerseits locken zahlreiche neue, vorher undenkbare Anwendungen wie die automatische Diagnose von Krankheiten, autonome Fahrzeuge und Drohnen, oder die automatische Übersetzung gesprochener Wörter. Andererseits warnen mahnenden Stimmen wird vor dem zunehmendem Einflussnahme der „Algorithmen“ auf fast alle Bereiche unseres Lebens sowie vor unerwünschten Folgen von sich verselbstständigenden Computern gewarnt. Einige träumen von – oder fürchten sich vor – der vermeintlich unausweichlichen Singularität, an der sich nichts weniger als das Schicksal der gesamten Menschheit entscheiden wird. Doch was verbirgt sich hinter dem Begriff Künstliche Intelligenz? Je nachdem, wen man fragt, erhält man unterschiedliche, bisweilen gegensätzliche Antworten. Dieser Vortrag stellt einige dieser Antworten vor und versucht sie (nicht nur) anhand von Beispielen aus Forschung und Anwendung einzuordnen.
Event: Business Analytics Day, 07.03.2019
Speaker: Dr. Matthias Richter, Dr. Stefan Igel (inovex)
Mehr Tech-Vorträge: inovex.de/vortraege
Mehr Tech-Artikel: inovex.de/blog
Dev + Ops = Go
In den letzten drei Jahren haben wir die Infrastruktur der Fernseh-Plattform waipu.tv gebaut. Dabei haben wir angefangen Tools für den Betrieb in Golang zu schreiben. Aus einigen der Tools wurden Core-Services, die auch die Last einer Fußball-WM-Übertragung locker wegstecken. Wir wollen euch zeigen, wie wir mit der selben Tool-Chain (Golang & Co) Betriebs-Probleme lösen und kritische Business-Applikationen entwickeln. Klassisch DevOps oder Golden Hammer?
Speaker: Christoph Petrausch, Igor Lankin (beide inovex)
Event: DevOpsConference, 04.12.2018
Mehr Tech-Vorträge: inovex.de/vortraege
Mehr Tech-Artikel: inovex.de/blog
Das Android Open Source Project
Das Android Open Source Project, kurz AOSP, ist das Betriebssystem, das auf den meisten heutigen und wahrscheinlich auch auf deinem Smartphone läuft. Es ist die Basis für das Android-App-Universum und wird von Millionen Nutzern und Entwicklern auf der Welt verwendet. Wegen der offenen Verfügbarkeit des Source Codes ist es auch die Basis für bekannte Custom ROMs wie LineageOS.
Der erste Teil des Talks gab eine Übersicht über die Architektur des Betriebssystems, das App-Ökosystem, den Hardware Abstraction Layer (HAL), die Sicherheitskonzepte und einige neue Betriebssystementwicklungen wie Project Treble in Android 8.0.
Der zweite Teil des Talks gab einen Einblick in den Quellcode und die Struktur des AOSP: Wie lädt man sich den Source Code herunter, wie baut man das AOSP für unterstützte Geräte und wie kann man die eigenen ROMs auf ein Smartphone flashen? Zum Spaß wurde auch noch in einige Implementierungsdetails von Android-App-API-Funktionen geblickt, die man als App Developer schon aufgerufen hat.
Speaker: Stefan Lengfeld, inovex
Event: inovex Meetup Köln, 23.10.2018
Mehr Tech-Vorträge: www.inovex.de/vortraege
Mehr Tech-Artikel: www.inovex.de/blog
Machine Learning Interpretability
This document discusses machine learning interpretability. It defines interpretation as giving explanations to humans for machine learning models and decisions. It notes that humans create, are affected by, and demand explanations for decision systems. The document outlines different techniques for model interpretability including intrinsically interpretable models, post-hoc interpretability techniques that provide explanations for black box models, and model-specific and model-agnostic techniques. It provides examples like partial dependence plots, individual conditional expectation, and local surrogate models. It recommends choosing techniques based on the recipient and purpose of explanations.
Performance evaluation of GANs in a semisupervised OCR use case
Online vehicle marketplaces are embracing artificial intelligence to ease the process of selling a vehicle on their platform. The tedious work of copying information from the vehicle registration document into some web form can be automated with the help of smart text-spotting systems, in which the seller takes a picture of the document, and the necessary information is extracted automatically.
Florian Wilhelm details the components of a text-spotting system, including the subtasks of object detection and optical character recognition (OCR). Florian elaborates on the challenges of OCR in documents with various distortions and artifacts, which rule out off-the-shelf products for this task. After offering an overview of semisupervised learning based on generative adversarial networks (GANs), Florian evaluates the performance gains of this method compared to supervised learning. More specifically, for a varying amount of labeled data, he compares the accuracy of a convolution neural network (CNN) to a GANthat uses additional unlabeled data during the training phase, showing that GANs significantly outperform classical CNNs in use cases with a lack of labeled data.
What you'll learn:
Understand how semisupervised learning with GANs works
Explore beneficial semisupervised methods based on GANs for use cases with a limited amount of labeled data
Gain insight into an interesting OCR use case of an online vehicle marketplace
Event: O'Reilly Artificial Intelligence Conference, London, 11.10.2018
Speaker: Dr. Florian Wilhelm
Mehr Tech-Vorträge: www.inovex.de/vortraege
Mehr Tech-Artikel: www.inovex.de/blog
People & Products – Lessons learned from the daily IT madness
IT im 21. Jahrhundert – What a time to be alive! Es gibt einen (unüberschaubaren) Zoo an Methoden und Produkten die uns so viel Freude an der Arbeit bereiten! Sie sind modern, weil sie neu sind. Sie fordern unser Können heraus, weil sie komplex sind. Sie lösen einige Probleme, die wir vorher nicht hatten. Jeder will sie verwenden, weil Google, Netflix & Co. sie propagieren und Hand auf’s Herz: Will nicht jeder gerne so arbeiten wie Google, Netflix & Co.? Aber macht das wirklich Sinn?
In diesem Vortrag blicken wir auf diverse Erkenntnisse aus dem Einsatz agiler Produktentwicklung, DevOps, Continuous Integration/Delivery, Infrastructure as Code, Immutable Infrastructure (bspw. Docker/Kubernetes), Application Logging und Service Monitoring.
Learning Goals:
- Wir müssen den Einsatz von Methoden und Tools an die Menschen ausrichten, die sie (weiter-)entwickeln und benutzen sollen.
- Manchmal lösen wir mit neuen Tools Probleme, die wir vorher nicht hatten.
- Die Suche nach einfachen Lösungen für komplexe Probleme ist essentiell, aber nicht immer einfach.
Event: Continuous Lifecycle, 15.11.2018
Speaker: Arnold Bechtoldt
Mehr Tech-Vorträge: www.inovex.de/vortraege
Mehr Tech-Artikel: www.inovex.de/blog
Infrastructure as (real) Code – Manage your K8s resources with Pulumi
Pulumi (pulumi.io) offers an open source platform to create/manage and deploy your infrastructure in realy programming languages like JavaScript/TypeScript, Go and Python. As Cloud platforms the major 3 cloud providers are supported and additionally you can also use Pulumi with OpenStack and Kubernetes to deploy your applications in the cloud.
In this talk we will take a look how Pulumi is different to traditional solutions like Terraform or the Cloud Provider specific solutions (e.g. CloudFormation). The main focus will be on deploying your services on top of Kubernetes. The talk will contain a little theory part about Pulumi, the rest of the talk is more focused on demos and practical parts. One focus of the talk is the difference of Pulumi to kubectl and helm (or to be precise how they complement each other.
As a takeaway of this talk you should understand the basics of Pulumi and know what are the differences to the traditional deployment tools.
Event: CNCF Meetup Hamburg & Stuttgart, 29.10.2018 & 07.11.2018
Speaker: Johannes M. Scheuermann, inovex
Mehr Tech-Vorträge: https://www.inovex.de/de/content-pool/vortraege/
Mehr Tech-Artikel: https://www.inovex.de/blog/
More from inovex GmbH (20)
Are you sure about that?! Uncertainty Quantification in AI
Are you sure about that?! Uncertainty Quantification in AI
Why natural language is next step in the AI evolution
Why natural language is next step in the AI evolution
Performance evaluation of GANs in a semisupervised OCR use case
Performance evaluation of GANs in a semisupervised OCR use case
People & Products – Lessons learned from the daily IT madness
People & Products – Lessons learned from the daily IT madness
Infrastructure as (real) Code – Manage your K8s resources with Pulumi
Infrastructure as (real) Code – Manage your K8s resources with Pulumi
Recently uploaded
AWS Cloud Cost Optimization Presentation.pptx
This presentation provides valuable insights into effective cost-saving techniques on AWS. Learn how to optimize your AWS resources by rightsizing, increasing elasticity, picking the right storage class, and choosing the best pricing model. Additionally, discover essential governance mechanisms to ensure continuous cost efficiency. Whether you are new to AWS or an experienced user, this presentation provides clear and practical tips to help you reduce your cloud costs and get the most out of your budget.
Digital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
Inconsistent user experience and siloed data, high costs, and changing customer expectations – Citizens Bank was experiencing these challenges while it was attempting to deliver a superior digital banking experience for its clients. Its core banking applications run on the mainframe and Citizens was using legacy utilities to get the critical mainframe data to feed customer-facing channels, like call centers, web, and mobile. Ultimately, this led to higher operating costs (MIPS), delayed response times, and longer time to market.
Ever-changing customer expectations demand more modern digital experiences, and the bank needed to find a solution that could provide real-time data to its customer channels with low latency and operating costs. Join this session to learn how Citizens is leveraging Precisely to replicate mainframe data to its customer channels and deliver on their “modern digital bank” experiences.
Introduction of Cybersecurity with OSS at Code Europe 2024
I develop the Ruby programming language, RubyGems, and Bundler, which are package managers for Ruby. Today, I will introduce how to enhance the security of your application using open-source software (OSS) examples from Ruby and RubyGems.
The first topic is CVE (Common Vulnerabilities and Exposures). I have published CVEs many times. But what exactly is a CVE? I'll provide a basic understanding of CVEs and explain how to detect and handle vulnerabilities in OSS.
Next, let's discuss package managers. Package managers play a critical role in the OSS ecosystem. I'll explain how to manage library dependencies in your application.
I'll share insights into how the Ruby and RubyGems core team works to keep our ecosystem safe. By the end of this talk, you'll have a better understanding of how to safeguard your code.
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift
Overview
Dive into the world of anomaly detection on edge devices with our comprehensive hands-on tutorial. This SlideShare presentation will guide you through the entire process, from data collection and model training to edge deployment and real-time monitoring. Perfect for those looking to implement robust anomaly detection systems on resource-constrained IoT/edge devices.
Key Topics Covered
1. Introduction to Anomaly Detection
- Understand the fundamentals of anomaly detection and its importance in identifying unusual behavior or failures in systems.
2. Understanding Edge (IoT)
- Learn about edge computing and IoT, and how they enable real-time data processing and decision-making at the source.
3. What is ArgoCD?
- Discover ArgoCD, a declarative, GitOps continuous delivery tool for Kubernetes, and its role in deploying applications on edge devices.
4. Deployment Using ArgoCD for Edge Devices
- Step-by-step guide on deploying anomaly detection models on edge devices using ArgoCD.
5. Introduction to Apache Kafka and S3
- Explore Apache Kafka for real-time data streaming and Amazon S3 for scalable storage solutions.
6. Viewing Kafka Messages in the Data Lake
- Learn how to view and analyze Kafka messages stored in a data lake for better insights.
7. What is Prometheus?
- Get to know Prometheus, an open-source monitoring and alerting toolkit, and its application in monitoring edge devices.
8. Monitoring Application Metrics with Prometheus
- Detailed instructions on setting up Prometheus to monitor the performance and health of your anomaly detection system.
9. What is Camel K?
- Introduction to Camel K, a lightweight integration framework built on Apache Camel, designed for Kubernetes.
10. Configuring Camel K Integrations for Data Pipelines
- Learn how to configure Camel K for seamless data pipeline integrations in your anomaly detection workflow.
11. What is a Jupyter Notebook?
- Overview of Jupyter Notebooks, an open-source web application for creating and sharing documents with live code, equations, visualizations, and narrative text.
12. Jupyter Notebooks with Code Examples
- Hands-on examples and code snippets in Jupyter Notebooks to help you implement and test anomaly detection models.
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
A Mix Chart displays historical data of numbers in a graphical or tabular form. The Kalyan Rajdhani Mix Chart specifically shows the results of a sequence of numbers over different periods.
Main news related to the CCS TSI 2023 (2023/1695)
An English 🇬🇧 translation of a presentation to the speech I gave about the main changes brought by CCS TSI 2023 at the biggest Czech conference on Communications and signalling systems on Railways, which was held in Clarion Hotel Olomouc from 7th to 9th November 2023 (konferenceszt.cz). Attended by around 500 participants and 200 on-line followers.
The original Czech 🇨🇿 version of the presentation can be found here: https://www.slideshare.net/slideshow/hlavni-novinky-souvisejici-s-ccs-tsi-2023-2023-1695/269688092 .
The videorecording (in Czech) from the presentation is available here: https://youtu.be/WzjJWm4IyPk?si=SImb06tuXGb30BEH .
Generating privacy-protected synthetic data using Secludy and Milvus
During this demo, the founders of Secludy will demonstrate how their system utilizes Milvus to store and manipulate embeddings for generating privacy-protected synthetic data. Their approach not only maintains the confidentiality of the original data but also enhances the utility and scalability of LLMs under privacy constraints. Attendees, including machine learning engineers, data scientists, and data managers, will witness first-hand how Secludy's integration with Milvus empowers organizations to harness the power of LLMs securely and efficiently.
Taking AI to the Next Level in Manufacturing.pdf
Read Taking AI to the Next Level in Manufacturing to gain insights on AI adoption in the manufacturing industry, such as:
1. How quickly AI is being implemented in manufacturing.
2. Which barriers stand in the way of AI adoption.
3. How data quality and governance form the backbone of AI.
4. Organizational processes and structures that may inhibit effective AI adoption.
6. Ideas and approaches to help build your organization's AI strategy.
TrustArc Webinar - 2024 Global Privacy Survey
How does your privacy program stack up against your peers? What challenges are privacy teams tackling and prioritizing in 2024?
In the fifth annual Global Privacy Benchmarks Survey, we asked over 1,800 global privacy professionals and business executives to share their perspectives on the current state of privacy inside and outside of their organizations. This year’s report focused on emerging areas of importance for privacy and compliance professionals, including considerations and implications of Artificial Intelligence (AI) technologies, building brand trust, and different approaches for achieving higher privacy competence scores.
See how organizational priorities and strategic approaches to data security and privacy are evolving around the globe.
This webinar will review:
- The top 10 privacy insights from the fifth annual Global Privacy Benchmarks Survey
- The top challenges for privacy leaders, practitioners, and organizations in 2024
- Key themes to consider in developing and maintaining your privacy program
Best 20 SEO Techniques To Improve Website Visibility In SERP
Boost your website's visibility with proven SEO techniques! Our latest blog dives into essential strategies to enhance your online presence, increase traffic, and rank higher on search engines. From keyword optimization to quality content creation, learn how to make your site stand out in the crowded digital landscape. Discover actionable tips and expert insights to elevate your SEO game.
Programming Foundation Models with DSPy - Meetup Slides
Prompting language models is hard, while programming language models is easy. In this talk, I will discuss the state-of-the-art framework DSPy for programming foundation models with its powerful optimizers and runtime constraint system.
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
Skybuffer AI, built on the robust SAP Business Technology Platform (SAP BTP), is the latest and most advanced version of our AI development, reaffirming our commitment to delivering top-tier AI solutions. Skybuffer AI harnesses all the innovative capabilities of the SAP BTP in the AI domain, from Conversational AI to cutting-edge Generative AI and Retrieval-Augmented Generation (RAG). It also helps SAP customers safeguard their investments into SAP Conversational AI and ensure a seamless, one-click transition to SAP Business AI.
With Skybuffer AI, various AI models can be integrated into a single communication channel such as Microsoft Teams. This integration empowers business users with insights drawn from SAP backend systems, enterprise documents, and the expansive knowledge of Generative AI. And the best part of it is that it is all managed through our intuitive no-code Action Server interface, requiring no extensive coding knowledge and making the advanced AI accessible to more users.
June Patch Tuesday
Ivanti’s Patch Tuesday breakdown goes beyond patching your applications and brings you the intelligence and guidance needed to prioritize where to focus your attention first. Catch early analysis on our Ivanti blog, then join industry expert Chris Goettl for the Patch Tuesday Webinar Event. There we’ll do a deep dive into each of the bulletins and give guidance on the risks associated with the newly-identified vulnerabilities.
5th LF Energy Power Grid Model Meet-up Slides
5th Power Grid Model Meet-up
It is with great pleasure that we extend to you an invitation to the 5th Power Grid Model Meet-up, scheduled for 6th June 2024. This event will adopt a hybrid format, allowing participants to join us either through an online Mircosoft Teams session or in person at TU/e located at Den Dolech 2, Eindhoven, Netherlands. The meet-up will be hosted by Eindhoven University of Technology (TU/e), a research university specializing in engineering science & technology.
Power Grid Model
The global energy transition is placing new and unprecedented demands on Distribution System Operators (DSOs). Alongside upgrades to grid capacity, processes such as digitization, capacity optimization, and congestion management are becoming vital for delivering reliable services.
Power Grid Model is an open source project from Linux Foundation Energy and provides a calculation engine that is increasingly essential for DSOs. It offers a standards-based foundation enabling real-time power systems analysis, simulations of electrical power grids, and sophisticated what-if analysis. In addition, it enables in-depth studies and analysis of the electrical power grid’s behavior and performance. This comprehensive model incorporates essential factors such as power generation capacity, electrical losses, voltage levels, power flows, and system stability.
Power Grid Model is currently being applied in a wide variety of use cases, including grid planning, expansion, reliability, and congestion studies. It can also help in analyzing the impact of renewable energy integration, assessing the effects of disturbances or faults, and developing strategies for grid control and optimization.
What to expect
For the upcoming meetup we are organizing, we have an exciting lineup of activities planned:
-Insightful presentations covering two practical applications of the Power Grid Model.
-An update on the latest advancements in Power Grid -Model technology during the first and second quarters of 2024.
-An interactive brainstorming session to discuss and propose new feature requests.
-An opportunity to connect with fellow Power Grid Model enthusiasts and users.
Presentation of the OECD Artificial Intelligence Review of Germany
Consult the full report at https://www.oecd.org/digital/oecd-artificial-intelligence-review-of-germany-609808d6-en.htm
Digital Marketing Trends in 2024 | Guide for Staying Ahead
https://www.wask.co/ebooks/digital-marketing-trends-in-2024
Feeling lost in the digital marketing whirlwind of 2024? Technology is changing, consumer habits are evolving, and staying ahead of the curve feels like a never-ending pursuit. This e-book is your compass. Dive into actionable insights to handle the complexities of modern marketing. From hyper-personalization to the power of user-generated content, learn how to build long-term relationships with your audience and unlock the secrets to success in the ever-shifting digital landscape.
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for life science domain, where you retriever information from biomedical knowledge graphs using LLMs to increase the accuracy and performance of generated answers
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
Webinar Recording: https://www.panagenda.com/webinars/hcl-notes-und-domino-lizenzkostenreduzierung-in-der-welt-von-dlau/
DLAU und die Lizenzen nach dem CCB- und CCX-Modell sind für viele in der HCL-Community seit letztem Jahr ein heißes Thema. Als Notes- oder Domino-Kunde haben Sie vielleicht mit unerwartet hohen Benutzerzahlen und Lizenzgebühren zu kämpfen. Sie fragen sich vielleicht, wie diese neue Art der Lizenzierung funktioniert und welchen Nutzen sie Ihnen bringt. Vor allem wollen Sie sicherlich Ihr Budget einhalten und Kosten sparen, wo immer möglich. Das verstehen wir und wir möchten Ihnen dabei helfen!
Wir erklären Ihnen, wie Sie häufige Konfigurationsprobleme lösen können, die dazu führen können, dass mehr Benutzer gezählt werden als nötig, und wie Sie überflüssige oder ungenutzte Konten identifizieren und entfernen können, um Geld zu sparen. Es gibt auch einige Ansätze, die zu unnötigen Ausgaben führen können, z. B. wenn ein Personendokument anstelle eines Mail-Ins für geteilte Mailboxen verwendet wird. Wir zeigen Ihnen solche Fälle und deren Lösungen. Und natürlich erklären wir Ihnen das neue Lizenzmodell.
Nehmen Sie an diesem Webinar teil, bei dem HCL-Ambassador Marc Thomas und Gastredner Franz Walder Ihnen diese neue Welt näherbringen. Es vermittelt Ihnen die Tools und das Know-how, um den Überblick zu bewahren. Sie werden in der Lage sein, Ihre Kosten durch eine optimierte Domino-Konfiguration zu reduzieren und auch in Zukunft gering zu halten.
Diese Themen werden behandelt
- Reduzierung der Lizenzkosten durch Auffinden und Beheben von Fehlkonfigurationen und überflüssigen Konten
- Wie funktionieren CCB- und CCX-Lizenzen wirklich?
- Verstehen des DLAU-Tools und wie man es am besten nutzt
- Tipps für häufige Problembereiche, wie z. B. Team-Postfächer, Funktions-/Testbenutzer usw.
- Praxisbeispiele und Best Practices zum sofortigen Umsetzen
FREE A4 Cyber Security Awareness Posters-Social Engineering part 3
Free A4 downloadable and printable Cyber Security, Social Engineering Safety and security Training Posters . Promote security awareness in the home or workplace. Lock them Out From training providers datahops.com
Recently uploaded (20)
Digital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
Digital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying Ahead
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
FREE A4 Cyber Security Awareness Posters-Social Engineering part 3
FREE A4 Cyber Security Awareness Posters-Social Engineering part 3
Rex - Deployment and Configuration Management
- 2. The Problem ● Live-Server – Deployed by: Ops – OS: CentOS – Deployed with: ● Human Hands ● Custom Scripts – Developed by Ops
- 3. The Problem ● Test-Server – Deployed by: Dev – OS: Ubuntu – Deployed with: Custom Scripts ● Developed by Dev
- 4. The Problem ● New Release ● Pages and Pages of installation/update instructions – stop services – database backup – upgrade DB schema – upgrade files here – upgrade some other files there – again, upgrade DB schema – ...
- 5. The Problem ● Takes very long ● Error-Prone – Oops, i've forgot step 21 – Hm, there was an error with step 17 ● Colleague is on vacation
- 6. How to fix it? ● Ops and Dev needs at one point the same toolkit. ● Ops and Dev needs to talk with each other ● Fail early – Test machines must have the same configuration and deployment procedure as live machines.
- 7. Enters (R)?ex ● Remote Execution ● Server-Orchestration tool ● Ad-Hoc management ● Uses SSH – no special agent needed ● Simply Perl
- 8. Installation ● cpanm Rex ● Use the repositories ● http://rexify.org/get/
- 9. The Start ● Make = Makefile ● Rex = Rexfile ● It's Perl
- 10. Authentication
- 11. Server Groups
- 12. Tasks