StackiFest16: What's Next in Stacki - Mason Katz StackIQ
1. Stacki aims to simplify server provisioning and management by keeping servers under a certain threshold and staying out of the way with tools for deployment, networking, and storage configuration.
2. Upcoming releases will focus on improvements to networking including IPv6 support, a new API, simplifying carts into pallet images, and expanding remote management capabilities to additional hardware.
3. Stacki supports multiple Linux distributions and aims to expand support for operating systems like Ubuntu while encouraging community development and contributions.
Salesforce at Stacki Atlanta Meetup February 2016StackIQ
Dave Peterson's presentation on how Salesforce uses Stacki and Chef to provision and manage thousands of servers. Stacki Atlanta kickoff Meetup on 2/23/16 at the Microsoft Innovation Center. Dave is a Lead Systems Engineer at Salesforce.
Introduction to Stacki at Atlanta Meetup February 2016StackIQ
An introduction to Stacki-the fastest bare metal Linux server provisioning tool from the Stacki Atlanta kickoff meetup on 2/23/16 at the Microsoft Innovation Center. Greg Bruno is the VP Engineering at StackIQ.
This document provides an overview of IT automation using Ansible. It discusses using Ansible to automate tasks across multiple servers like installing packages and copying files without needing to login to each server individually. It also covers Ansible concepts like playbooks, variables, modules, and vault for securely storing passwords. Playbooks allow defining automation jobs as code that can be run on multiple servers simultaneously in a consistent and repeatable way.
StackiFest16: What's Next in Stacki - Mason Katz StackIQ
1. Stacki aims to simplify server provisioning and management by keeping servers under a certain threshold and staying out of the way with tools for deployment, networking, and storage configuration.
2. Upcoming releases will focus on improvements to networking including IPv6 support, a new API, simplifying carts into pallet images, and expanding remote management capabilities to additional hardware.
3. Stacki supports multiple Linux distributions and aims to expand support for operating systems like Ubuntu while encouraging community development and contributions.
Salesforce at Stacki Atlanta Meetup February 2016StackIQ
Dave Peterson's presentation on how Salesforce uses Stacki and Chef to provision and manage thousands of servers. Stacki Atlanta kickoff Meetup on 2/23/16 at the Microsoft Innovation Center. Dave is a Lead Systems Engineer at Salesforce.
Introduction to Stacki at Atlanta Meetup February 2016StackIQ
An introduction to Stacki-the fastest bare metal Linux server provisioning tool from the Stacki Atlanta kickoff meetup on 2/23/16 at the Microsoft Innovation Center. Greg Bruno is the VP Engineering at StackIQ.
This document provides an overview of IT automation using Ansible. It discusses using Ansible to automate tasks across multiple servers like installing packages and copying files without needing to login to each server individually. It also covers Ansible concepts like playbooks, variables, modules, and vault for securely storing passwords. Playbooks allow defining automation jobs as code that can be run on multiple servers simultaneously in a consistent and repeatable way.
Arnold Bechtoldt, Inovex GmbH Linux systems engineer - Configuration Manageme...SaltStack
Arnold gave this presentation at the Secure Linux Admin Conference in Berlin Germany. He provides an overview of what configuration management systems do, explains the fundamentals of SaltStack and provides a look inside.
The document provides tips for optimizing various aspects of a website including the front end, application and database, web server, and miscellaneous topics. It recommends techniques such as minimizing HTTP requests, leveraging caching, optimizing databases and queries, offloading processing, and load balancing between web servers to improve page loading speeds and site performance. The overall goal is to analyze bottlenecks and apply solutions such as file compression, caching, and leveraging CDNs or reverse proxies to make websites faster and more scalable.
Vagrant, Ansible, and OpenStack on your laptopLorin Hochstein
The document discusses using Ansible and Vagrant together to easily test and deploy OpenStack. Ansible allows writing idempotent infrastructure scripts, while Vagrant allows testing them by booting reproducible virtual machines. The document provides an example of using Ansible plays to install NTP and using Vagrant to define VMs for an OpenStack controller and compute node.
Application construction is great with Ansible, using it for docker helps fight complexity, improves maintainability. And playbooks are portable from docker to cloud.
Title: Ansible, best practices.
Ansible has taken a prominent place in the configmanagement world. By now many people involved in DevOps have taken a look at it, or done a first project with it. Now it is time to step back and look at quality and craftmanship. Bas Meijer, Ansible ambassador, will talk about Ansible best practices, and will show tips, tricks and examples based on several projects.
About the speaker
Bas is a systems engineer and software developer and wasted decades on latenight hacking. He is currently helping out 2 enterprises with continuous delivery and devops.
Apache Traffic Server (ATS) is a fast, scalable HTTP caching proxy server. It allows plugins to be written using Lua, a lightweight scripting language. This provides advantages over writing plugins in C/C++, including easier development, testing, and ability to leverage Lua features. The presentation discusses using Lua with ATS, including exposing ATS APIs as Lua functions, implementing plugins, testing plugins, and security considerations like input validation and sandboxing. Future work may include exposing more ATS APIs and providing input validation libraries.
Herd your chickens: Ansible for DB2 configuration managementFrederik Engelen
This document provides an overview of using Ansible for configuration management and summarizes a presentation on using it to manage DB2 configurations. It describes how Ansible uses inventory files and variables to define environments and target hosts, playbooks to automate configuration tasks, and modules to implement specific changes. The key benefits of Ansible noted are that it is agentless, uses simple text files for definitions, and has a low learning curve compared to other configuration management tools.
Chef Provisioning a Chef Server Cluster - ChefConf 2015Chef
This talk is an exploration of how to build Chef Server 12 clusters with Chef Provisioning, including premium features like Chef Reporting and Chef Analytics. I will cover several new capabilities and tools in the Chef ecosystem that makes it easier than ever before to build and manage scalable Chef Server clusters.
https://youtu.be/HUQA1Ikm5Iw
DATABASE AUTOMATION with Thousands of database, monitoring and backupSaewoong Lee
This is my presentation document at AnsibleFest 2018 in Austin, Texas.
This topic is ‘Database Automation with thousands of database, monitoring and backup’.
In this document I want to tell you database automation using Ansible.
So I expect to give more confidence to infra engineer like me.
SaltConf14 - Forrest Alvarez, Choice Hotels - Salt Formulas and StatesSaltStack
This session will expand your knowledge of cutting-edge techniques for creating Salt states and formulas. Users will obtain a thorough understanding of how states interact with pillars, as well as map.jinja files. We'll discuss how to make formulas OS agnostic and show how the usage of external pillars combined with a map file can result in formulas that are easy to explain, easy to learn, and easy to update.
This document contains information about the sys/net/sec admin Yashar Esmaildokht, including their contact information and websites. It then provides a brief overview of the open-source automation tool Ansible, describing its main features and uses for configuration management, application deployment, and cloud provisioning. Requirements and versions of Ansible are listed. The document concludes with examples of Ansible concepts including playbooks, tasks, modules, variables, and host inventory organization.
SaltConf14 - Oz Akan, Rackspace - Deploying OpenStack Marconi with SaltStackSaltStack
This talk will demonstrate how to use Salt Mine leveraging Salt grains to create several environments (parallel universes) that decide how to run the same Salt formulas with different outcomes. "Roles” will be defined in an OpenStack Marconi (queuing as a service) deployment and a few formulas will be shared to demonstrate the concept.
Cobbler - Fast and reliable multi-OS provisioningRUDDER
In a lot of companies, machine deployment is a delicate subject: every administrator has his own recipe, using CD-ROMs, static binary images deployed via the network, peer delegation ...
However, one solution makes the consensus when it comes to automated mass deployments ( except in the Cloud ): PXE boot. The main cons are that the deployment and the management of such a service is a pain, and every OS has its own installation automation system.
This is where Cobbler saves the day: it enables a painless and reliably to create a PXE service, usable on either virtual or physical machines, while beeing the most agnostic possible towards the target OSes and its preconfiguration system (preseed, kickstart, sysprep, ...) while offering the possibility to handle lots of configuration parameters in a modular fashion (network, partitionning, user accounts, configuration management agent...)
This conference aims to introduce the audience to the general concepts of Cobbler, and some scenarios where it would be a useful solution.
Ansible : what's ansible & use case by REXSaewoong Lee
The document discusses using Ansible to upgrade MySQL from version 3.10 to 3.12 across 1000 servers. It provides steps to create backups and run upgrade scripts on each server using Ansible playbooks and bash scripts in a loop. It also asks how to make the deployment easier, safer and more comfortable. Later sections explain Ansible concepts like installation, modules, playbooks, tags, inventory, variables and demonstrate usage through examples.
Foreman Discovery is the Foreman project's solution to Metal as a Service. It can discover, register, and provision bare metal systems without knowing anything about them beforehand. Now, with the latest version of Discovery, you're able to boot hosts using the Discovery image directly instead of relying on DHCP and PXE, by mounting the ISO or burning to a CD-ROM or USB stick. In this talk, we'll do a quick introduction to Discovery, before going on to cover the new PXEless features.
This document provides an overview of Ansible including why it is useful, how it compares to other configuration management tools, basic knowledge required, and steps for getting started with Ansible such as setting up the control node, configuring Ansible, using ad-hoc commands, and creating a playbook. Ansible is an agentless automation tool that uses YAML files and modules to configure systems. It has a simple syntax and supports both Linux and Windows systems.
Salt conf 2014-installing-openstack-using-saltstack-v02Yazz Atlas
OpenStack is an open source implementation of cloud computing, potentially at very large scale. However, it has many moving parts and is complex to operate. SaltStack appears to provide scalable and secure orchestration for OpenStack. But like all powerful solutions to complex problems, a great deal of the useful know-how has to be discovered by actual practice and hard-won experience. This session will share the inside knowledge gained through practical experience. This is not a howto install OpenStack.
An Express Guide ~ Zabbix for IT Monitoring Abhishek Kumar
Zabbix is an open source infrastructure monitoring solution. It has two main parts - the Zabbix server and client.
The document provides step-by-step instructions to install and configure Zabbix on a Linux server. This includes installing prerequisites like NTP, PHP, MySQL, compiling and installing the Zabbix server and client, configuring the database, web interface, and more. Finally, it discusses initial configuration steps after installation like securing login credentials.
This document provides an introduction and overview of Ansible automation from physical to NetSecDevOps. It discusses how Ansible provides simple yet powerful agentless deployment of applications and management of configurations. It is human-readable automation that allows entire teams to use and contribute. Ansible has cross-platform support without agents and uses OpenSSH, WinRM, APIs or Netconf. More than 1650 modules are included to automate tasks across clouds, virtualization, containers, networks, notifications and more. Playbooks ensure perfect application description and version control. Dynamic inventories capture servers regardless of infrastructure. Ansible allows automation from development to operations.
This document discusses Ansible, an open-source automation tool. It provides an overview of Ansible's capabilities including configuration management, orchestration, deployment and more. It also summarizes Ansible Tower which adds centralized control, RBAC, and other features to Ansible. Examples are given of using Ansible playbooks to automate tasks like installing and configuring Apache on Linux hosts and using Ansible modules to configure network devices.
Introduction to Stacki - World's fastest Linux server provisioning ToolSuresh Paulraj
Stacki is an open source tool for provisioning and managing Linux servers at scale. It provides fast, reliable provisioning of servers from bare metal to a fully configured system. PayPal uses Stacki to manage their Hadoop infrastructure, which includes over 3,000 nodes spread across multiple datacenters. Stacki automates tasks like disk formatting, partitioning, OS installation, and integration with other tools to quickly provision new servers. It helped PayPal reduce provisioning time from hours to just 14 minutes for 288 servers.
Joe Kaiser, System Engineer at StackIQ at the Seattle Scalability Meetup on April 27, 2016
This presentation was followed by a demo of Kubernetes on Stacki
Arnold Bechtoldt, Inovex GmbH Linux systems engineer - Configuration Manageme...SaltStack
Arnold gave this presentation at the Secure Linux Admin Conference in Berlin Germany. He provides an overview of what configuration management systems do, explains the fundamentals of SaltStack and provides a look inside.
The document provides tips for optimizing various aspects of a website including the front end, application and database, web server, and miscellaneous topics. It recommends techniques such as minimizing HTTP requests, leveraging caching, optimizing databases and queries, offloading processing, and load balancing between web servers to improve page loading speeds and site performance. The overall goal is to analyze bottlenecks and apply solutions such as file compression, caching, and leveraging CDNs or reverse proxies to make websites faster and more scalable.
Vagrant, Ansible, and OpenStack on your laptopLorin Hochstein
The document discusses using Ansible and Vagrant together to easily test and deploy OpenStack. Ansible allows writing idempotent infrastructure scripts, while Vagrant allows testing them by booting reproducible virtual machines. The document provides an example of using Ansible plays to install NTP and using Vagrant to define VMs for an OpenStack controller and compute node.
Application construction is great with Ansible, using it for docker helps fight complexity, improves maintainability. And playbooks are portable from docker to cloud.
Title: Ansible, best practices.
Ansible has taken a prominent place in the configmanagement world. By now many people involved in DevOps have taken a look at it, or done a first project with it. Now it is time to step back and look at quality and craftmanship. Bas Meijer, Ansible ambassador, will talk about Ansible best practices, and will show tips, tricks and examples based on several projects.
About the speaker
Bas is a systems engineer and software developer and wasted decades on latenight hacking. He is currently helping out 2 enterprises with continuous delivery and devops.
Apache Traffic Server (ATS) is a fast, scalable HTTP caching proxy server. It allows plugins to be written using Lua, a lightweight scripting language. This provides advantages over writing plugins in C/C++, including easier development, testing, and ability to leverage Lua features. The presentation discusses using Lua with ATS, including exposing ATS APIs as Lua functions, implementing plugins, testing plugins, and security considerations like input validation and sandboxing. Future work may include exposing more ATS APIs and providing input validation libraries.
Herd your chickens: Ansible for DB2 configuration managementFrederik Engelen
This document provides an overview of using Ansible for configuration management and summarizes a presentation on using it to manage DB2 configurations. It describes how Ansible uses inventory files and variables to define environments and target hosts, playbooks to automate configuration tasks, and modules to implement specific changes. The key benefits of Ansible noted are that it is agentless, uses simple text files for definitions, and has a low learning curve compared to other configuration management tools.
Chef Provisioning a Chef Server Cluster - ChefConf 2015Chef
This talk is an exploration of how to build Chef Server 12 clusters with Chef Provisioning, including premium features like Chef Reporting and Chef Analytics. I will cover several new capabilities and tools in the Chef ecosystem that makes it easier than ever before to build and manage scalable Chef Server clusters.
https://youtu.be/HUQA1Ikm5Iw
DATABASE AUTOMATION with Thousands of database, monitoring and backupSaewoong Lee
This is my presentation document at AnsibleFest 2018 in Austin, Texas.
This topic is ‘Database Automation with thousands of database, monitoring and backup’.
In this document I want to tell you database automation using Ansible.
So I expect to give more confidence to infra engineer like me.
SaltConf14 - Forrest Alvarez, Choice Hotels - Salt Formulas and StatesSaltStack
This session will expand your knowledge of cutting-edge techniques for creating Salt states and formulas. Users will obtain a thorough understanding of how states interact with pillars, as well as map.jinja files. We'll discuss how to make formulas OS agnostic and show how the usage of external pillars combined with a map file can result in formulas that are easy to explain, easy to learn, and easy to update.
This document contains information about the sys/net/sec admin Yashar Esmaildokht, including their contact information and websites. It then provides a brief overview of the open-source automation tool Ansible, describing its main features and uses for configuration management, application deployment, and cloud provisioning. Requirements and versions of Ansible are listed. The document concludes with examples of Ansible concepts including playbooks, tasks, modules, variables, and host inventory organization.
SaltConf14 - Oz Akan, Rackspace - Deploying OpenStack Marconi with SaltStackSaltStack
This talk will demonstrate how to use Salt Mine leveraging Salt grains to create several environments (parallel universes) that decide how to run the same Salt formulas with different outcomes. "Roles” will be defined in an OpenStack Marconi (queuing as a service) deployment and a few formulas will be shared to demonstrate the concept.
Cobbler - Fast and reliable multi-OS provisioningRUDDER
In a lot of companies, machine deployment is a delicate subject: every administrator has his own recipe, using CD-ROMs, static binary images deployed via the network, peer delegation ...
However, one solution makes the consensus when it comes to automated mass deployments ( except in the Cloud ): PXE boot. The main cons are that the deployment and the management of such a service is a pain, and every OS has its own installation automation system.
This is where Cobbler saves the day: it enables a painless and reliably to create a PXE service, usable on either virtual or physical machines, while beeing the most agnostic possible towards the target OSes and its preconfiguration system (preseed, kickstart, sysprep, ...) while offering the possibility to handle lots of configuration parameters in a modular fashion (network, partitionning, user accounts, configuration management agent...)
This conference aims to introduce the audience to the general concepts of Cobbler, and some scenarios where it would be a useful solution.
Ansible : what's ansible & use case by REXSaewoong Lee
The document discusses using Ansible to upgrade MySQL from version 3.10 to 3.12 across 1000 servers. It provides steps to create backups and run upgrade scripts on each server using Ansible playbooks and bash scripts in a loop. It also asks how to make the deployment easier, safer and more comfortable. Later sections explain Ansible concepts like installation, modules, playbooks, tags, inventory, variables and demonstrate usage through examples.
Foreman Discovery is the Foreman project's solution to Metal as a Service. It can discover, register, and provision bare metal systems without knowing anything about them beforehand. Now, with the latest version of Discovery, you're able to boot hosts using the Discovery image directly instead of relying on DHCP and PXE, by mounting the ISO or burning to a CD-ROM or USB stick. In this talk, we'll do a quick introduction to Discovery, before going on to cover the new PXEless features.
This document provides an overview of Ansible including why it is useful, how it compares to other configuration management tools, basic knowledge required, and steps for getting started with Ansible such as setting up the control node, configuring Ansible, using ad-hoc commands, and creating a playbook. Ansible is an agentless automation tool that uses YAML files and modules to configure systems. It has a simple syntax and supports both Linux and Windows systems.
Salt conf 2014-installing-openstack-using-saltstack-v02Yazz Atlas
OpenStack is an open source implementation of cloud computing, potentially at very large scale. However, it has many moving parts and is complex to operate. SaltStack appears to provide scalable and secure orchestration for OpenStack. But like all powerful solutions to complex problems, a great deal of the useful know-how has to be discovered by actual practice and hard-won experience. This session will share the inside knowledge gained through practical experience. This is not a howto install OpenStack.
An Express Guide ~ Zabbix for IT Monitoring Abhishek Kumar
Zabbix is an open source infrastructure monitoring solution. It has two main parts - the Zabbix server and client.
The document provides step-by-step instructions to install and configure Zabbix on a Linux server. This includes installing prerequisites like NTP, PHP, MySQL, compiling and installing the Zabbix server and client, configuring the database, web interface, and more. Finally, it discusses initial configuration steps after installation like securing login credentials.
This document provides an introduction and overview of Ansible automation from physical to NetSecDevOps. It discusses how Ansible provides simple yet powerful agentless deployment of applications and management of configurations. It is human-readable automation that allows entire teams to use and contribute. Ansible has cross-platform support without agents and uses OpenSSH, WinRM, APIs or Netconf. More than 1650 modules are included to automate tasks across clouds, virtualization, containers, networks, notifications and more. Playbooks ensure perfect application description and version control. Dynamic inventories capture servers regardless of infrastructure. Ansible allows automation from development to operations.
This document discusses Ansible, an open-source automation tool. It provides an overview of Ansible's capabilities including configuration management, orchestration, deployment and more. It also summarizes Ansible Tower which adds centralized control, RBAC, and other features to Ansible. Examples are given of using Ansible playbooks to automate tasks like installing and configuring Apache on Linux hosts and using Ansible modules to configure network devices.
Introduction to Stacki - World's fastest Linux server provisioning ToolSuresh Paulraj
Stacki is an open source tool for provisioning and managing Linux servers at scale. It provides fast, reliable provisioning of servers from bare metal to a fully configured system. PayPal uses Stacki to manage their Hadoop infrastructure, which includes over 3,000 nodes spread across multiple datacenters. Stacki automates tasks like disk formatting, partitioning, OS installation, and integration with other tools to quickly provision new servers. It helped PayPal reduce provisioning time from hours to just 14 minutes for 288 servers.
Joe Kaiser, System Engineer at StackIQ at the Seattle Scalability Meetup on April 27, 2016
This presentation was followed by a demo of Kubernetes on Stacki
DCSF19 Transforming a 15+ Year Old Semiconductor Manufacturing EnvironmentDocker, Inc.
Jeanie Schwenk, Jireh Semiconductor
Jireh Semiconductor bought the Hillsboro fab and its contents including the manufacturing tools, servers, and software running the fab. The previous company had been winding down for years so server and software upgrades had not been on the radar for some time. In 2011 Jireh became the proud owner of the building, the tools, and its legacy software running on servers that weren’t even made any more.
That's when I started my adventure with Jireh in September 2016 with a charter to modernize the applications running the manufacturing facility process and move them into VMs with no impact to manufacturing. That led me down a path of exploration and questions. “What’s the goal?”
The goal wasn't to move to VMs. It was to become independent of the aging PA-RISC architecture, bring forward the ~230 java 1.4.2 applications (10-15 years old), scale to allow increased the load on the software and hardware in order to ramp the factory output to numbers never seen previously. And do it without manufacturing downtime.
The solution included a transition from waterfall and silo development to agile scrum. Rather than simply migrating to VMs, it became obvious the lynch pin for a successful software transition with the required uptime, flexibility, and scalability was Docker Enterprise.
Join me for this session where I'll talk about my journey modernizing 15+ year old applications and infrastructure at Jireh.
Introduction to Infrastructure as Code & Automation / Introduction to ChefNathen Harvey
The document provides an introduction to infrastructure as code using Chef. It begins with an introduction by Nathen Harvey and outlines the sys admin journey from manually managing servers to using automation and policy-driven configuration management. It then discusses how infrastructure as code with Chef allows treating infrastructure like code by programmatically provisioning and configuring components. The document demonstrates configuring resources like packages, services, files and more using Chef.
This document discusses Linux server provisioning using Stacki. Stacki is a tool that automates the provisioning of Linux servers at scale from bare metal to a fully configured system. It addresses the exponential complexity of managing large clusters as more servers are added. Stacki handles all aspects of server provisioning from OS installation to configuration of networking, storage, software and more. It provides a fully automated, repeatable process to quickly deploy and manage servers.
Fargate is a compute engine for Amazon ECS that allows you to run containers without having to manage servers or clusters. With Fargate, you no longer have to provision, configure, and scale clusters of virtual machines to run containers. You simply specify your container resource requirements and Fargate provisions and scales infrastructure for you. Fargate handles the underlying container instance management and scaling seamlessly in the background.
Fargate is a compute engine for containers that allows you to run and scale containerized applications without having to manage servers or clusters. With Fargate, you no longer have to provision, configure, and scale clusters of virtual machines to run containers. You simply specify your containerized application, and Fargate provisions the infrastructure and ensures the containers have compute capacity. Fargate automatically handles tasks like cluster management, node provisioning and replacement, load balancing, scaling and application health monitoring. This allows developers to focus on building applications rather than managing the underlying infrastructure.
AWS Fargate makes running containerized workloads on AWS easier than ever before. This session will provide a technical background for using Fargate with your existing containerized services, including best practices for building images, configuring task definitions, task networking, secrets management, and monitoring.
Autoscaling OpenStack Natively with Heat, Ceilometer and LBaaSShixiong Shang
Autoscaling OpenStack Natively with Heat, Ceilometer and LBaaS workshop I delivered at OpenStack Vancouver Summit (May, 2015) jointly with Jason and Sharmin from Cisco System.
More details can be found at https://github.com/grimmtheory/autoscale
Midwest php 2013 deploying php on paas- why & howdotCloud
Deploying PHP applications to Platform as a Service (PaaS) can provide several benefits over traditional hosting methods. PaaS allows developers to quickly deploy new environments for testing code changes. It also handles tasks like optimizing stacks, upgrading software, and providing comprehensive routing. PaaS aims to make deployment as simple as uploading code and eliminates the need to manually configure servers. While there is an initial learning curve to using PaaS tools and reworking some applications, it can improve the development to production workflow and allow applications to easily scale on demand.
Switch as a Server - PuppetConf 2014 - Leslie CarrCumulus Networks
Leslie Carr is an operations engineer at Cumulus Networks, which develops Cumulus Linux, a Debian-based network operating system that allows network switches to be managed like servers. Cumulus Linux uses ONIE to boot and install the OS image over the network in a manner similar to how a server OS is installed using PXE. It supports zero-touch provisioning (ZTP) using scripts to automate configuration of networking services like Puppet. Ifupdown2 is Cumulus Linux's network interface manager that handles dependencies and allows incremental configuration changes with minimal disruption.
As a Service: Cloud Foundry on OpenStack - Lessons LearntAnimesh Singh
According to OpenStack users survey, Cloud Foundry is the 2nd most popular workload on OpenStack. You want to deploy Cloud Foundry on OpenStack or already have. What's next?
Cloud Foundry continues to evolve with revolutionary changes, e.g move from bosh-micro to bosh-init, using the new eCPI, move to Diego etc.
Same with OpenStack, e.g changes from Keystone v2 to v3, from Liberty to Mitaka, network plugins changes etc. Both IaaS and PaaS layers are changing frequently. How do you do in-place updates/upgrades/operational tasks without impacting user experience at both the layers?
In this talk will discuss our lessons learnt operating hybrid Cloud Foundry deployments on top of OpenStack over the last two years and how we used underlying technologies to seamlessly operate them
Cloud providers like Amazon or Goggle have great user experience to create and manage PaaS and IaaS services. But is it possible to reproduce same experience and flexibility locally, in on premise datacenter? This talk describes success story of creation private cloud based on DC/OS cluster. It is used to host and share different services like hadoop or kafka for development teams, dynamically manage services and resource pools with GKE integration.
Stupid Boot Tricks: using ipxe and chef to get to boot management blissmacslide
Jason Cook discusses his experience setting up boot infrastructure for Fastly's caching clusters. He outlines how they moved from using existing tools like Cobbler and Razor to building their own solution called Donner using iPXE to boot machines over HTTP. Donner uses Chef to store machine metadata and configuration which allows the boot process to install operating systems, configure networking, and run Chef on first boot to provision machines.
This document provides a summary of Samkumar Gandi's experience and qualifications. He has over 8 years of experience in Linux system administration, application server management, and virtualization. He is proficient in technologies like Apache, JBoss, Tomcat, MySQL, Oracle, and cloud platforms. He has worked on projects involving server setup, maintenance, performance tuning, security, and incident/problem management. He is certified in Red Hat technologies and holds qualifications like Bachelor of Technology in Computer Science.
ChinaNetCloud - Cloud Operations for Gaming - Tencent July 2014ChinaNetCloud
The document discusses how cloud computing and DevOps technologies can be used to automate the provisioning and deployment of internet servers and game services. It describes a two-phase approach involving 1) automatically provisioning virtual machines and infrastructure using tools like Docker, Chef and cloud APIs and 2) deploying code and configurations using configuration management, deployment automation and version control. The approach aims to provide fast, flexible provisioning and deployment across development, test and production environments.
This document contains slides from a presentation about Puppet, an open source configuration management tool. It discusses Puppet's architecture, components like Facter, Hiera and MCollective, and how Puppet can be used to automate infrastructure configuration and deployment. It also promotes joining the Puppet community, taking training courses, and encourages questions.
Similar to StackiFest 16: Stacki Overview- Anoop Rajendra (20)
Installing a Cluster of Raspberry Pis with Stacki AceStackIQ
To fully utilize the power of Raspberry Pis, StackIQ ported Stacki to support the inexpensive single-board computers, creating Stacki Ace: an open-source bare-metal installer for Raspberry Pis.
With the release of Stacki 4.0 comes more improvements in Stacki Ace. The avalanche installer has been added for parallel installation and 20MB images instead of 2GB images are now used to install the backend nodes increasing the installation speed immensely.
This is Greg Bruno's presentation from his webinar on how to create a cluster of Raspberry Pis with Stacki Ace.
Presentation by StackIQ's Director of Open Source Engineering, Joe Kaiser, at StackiFest 2017.
Step 1 of every Hadoop vendor’s documentation reads something like this: “First install a cluster.” Without a consistent group of installed machines, a Hadoop installation is prone to failure. Open source Stacki installs machines to a ping and a prompt enabling the consistency and configuration required for a functioning Hadoop installation.
StackIQ released a new open source Hortonworks bridge pallet to enable the installation of Hortonworks through the Ambari appliance at the beginning of 2017. In this presentation, Joe will show you how to set-up Stacki, the HDP Bridge pallet, Ambari, and then install Hadoop on a running cluster.
Teradata uses Stacki for automated bare-metal provisioning and configuration management of its database servers. Some key points:
- Stacki allows Teradata to provision servers consistently at scale for testing, manufacturing, and customer environments in a standardized way.
- Previously Teradata used customized SUSE DVDs which became outdated, inconsistent, and did not scale well. Stacki addresses these challenges through its stackable software components approach.
- Teradata combines different "pallets" and "carts" in Stacki to create customized software stacks for different server types and roles like database servers, Hadoop servers, and Aster servers.
- Stacki is integrated into Teradata's continuous integration/deployment
Installing a Cluster of Raspberry Pis with Stacki AceStackIQ
Presentation by StackIQ's VP Engineering/Co-Founder, Greg Bruno, at StackiFest 2017.
The Raspberry Pi was originally developed by the Raspberry Pi Foundation to promote the teaching of basic computer science in schools and developing countries. And although these little single-board computers have done just that, they have the ability to do so much more when paired with the correct tools. That’s why StackIQ ported Stacki (their original bare metal x86_64 server installer) to support Raspberry Pis, creating Stacki Ace: an open-source bare-metal installer for Raspberry Pis.
Stacki has released version 4.0 with new features including complete REST API version 2, support for SLES 11 and 12, NetApp storage configuration, OS abstraction to support backend nodes running Ubuntu or SLES, and an open source Kubernetes pallet version 2. Stacki Ace version 1 has also been released which allows Stacki to run on Raspberry Pi and ARM architectures. Future planned developments include REST API version 3, UX updates integrating the REST API and adding user accounts, and support for MicroOS/CaaSP and non-RHEL frontends like SUSE.
Automation of your OpenStack Infrastructure with StackiStackIQ
This document discusses CloudLabs' focus on rack scale reference platforms and integrated solutions. It provides an overview of CloudLabs' investments in rack solutions including CORD, OPNFV, OCP, and Intel RSA architectures. It also summarizes Stacki for baremetal provisioning, OpenStack-Ansible for OpenStack deployment, and CloudLabs' benchmarking framework for validating solutions from baremetal to rack scale.
This document discusses bare metal servers in data centers. Bare metal servers are at an innovative crossroads as containers gain popularity. The Stacki community has grown near linearly to over 150 members managing over 1 million paying customers across more than 2,500 bare metal nodes under Stacki management software.
Provisioning Heterogenous Bare Metal with StackiStackIQ
Justin Senseney of NIST's presentation from StackiFest 2017.
Stacki was used to upgrade a high-performance computing (HPC) cluster at the National Institute of Standards and Technology (NIST) in Gaithersburg, Maryland. NIST is the United States’ federal metrology institute, performing research and creating standards for measurements and technology, including materials, data, and cyber-security. A 1,200 node CentOS5 Maui/Torque cluster was upgraded to CentOS7 with a Slurm queuing system. At the same time, hundreds of servers were removed and added to this cluster. This presentation will show the application of Stacki to this HPC cluster and contrast previous methods used for provisioning. Stacki carts and pallets are used to provision role-based servers, including GPU, high-memory, and multiple login servers. Ideas are proposed to allow us to extend this application to managing multiple clusters. Any mention of commercial products within this presentation, including Stacki, is for information purposes; it does not imply recommendation or endorsement by NIST.
Stacki DC Meetup (11/30/16)
Presenter: Justin Senseney- Senior Computer Scientist, NIST
Description:Stacki was used to upgrade a high performance computing (HPC) cluster at the National Institute of Standards and Technology (NIST) in Gaithersburg, MD. A 1,200 node CentOS5 Maui/Torque cluster was upgraded to CentOS7 with a slurm queuing system. This presentation will show the application of Stacki to this HPC cluster and contrast previous methods used for provisioning. Stacki carts and pallets are used to provision role-based servers. Ideas are presented that would make it easier for multiple clusters to be managed. Any mention of commercial products, including Stacki, within this presentation is for information only; it does not imply recommendation or endorsement by NIST.
Public vs. Private Cloud Performance by FlexStackIQ
This document discusses using Ansible to automate benchmarking of OpenStack clouds. It describes using OpenStack-Ansible to deploy OpenStack, Ansible roles to run benchmarks, and parsing tasks to analyze benchmark results. Benchmarking tasks test performance using tools like Passmark, stress, mprime, and reboot tests. Results are fetched to a control host and system logs are collected. The experience of using Ansible for automation and repeatable benchmarking is positive due to its ease of use, flexibility, and ability to reduce manual work. Future enhancements could expand benchmark coverage and contribute to community benchmarking projects.
StackiFest16: Automation for Event-Driven Infrastructure - Dave Boucha StackIQ
This document provides an overview of SaltStack's event-driven infrastructure and common Salt architectures. It introduces the core Salt components of the salt-master, salt-minion, and salt-ssh. Typical layouts involve salt-minions communicating with a central salt-master over ZeroMQ or SSH. The document also briefly outlines some advanced Salt features like the event bus, beacons, reactors and engines before closing with contact information.
This document outlines a lab session on Phase 1 projects. It discusses what systems and tools are available, what is missing, how CoreOS and Ubuntu are set up, and that there will be a workshop and demo before concluding the session.
Private clouds are gaining popularity over public clouds as they provide more security, reliability, customizability and control over data. A private cloud allows for on-demand scalability and dedicated servers. It is expected that private cloud use will grow to almost 50% of companies in the next two years, compared to only 15% using public clouds primarily. Companies primarily use private clouds for application development, data storage, and core business applications.
There are some things in Stacki that you can only do with Remove commands. This tutorial takes you over the most common remove commands and offers an overview of how they work.
Download Stacki: www.stacki.com
Open source software has emerged as the driving force of technology innovation, from cloud and Big Data to social media and mobile.
Download Stacki, open source bare metal installer, at www.stacki.com
Stacki, our new open source bare metal installer, is really fast. So fast that it lets Sysadmins get to the more important tasks. Download it at www.stacki.com
Stacki: Automate with Spreadsheets (Tutorial)StackIQ
Stacki can use CSV-formatted spreadsheets to automate server configuration. These few slides give you a preview on how to do it. Stay tuned for the comprehensive tutorial coming soon. www.stacki.com
UI5con 2024 - Bring Your Own Design SystemPeter Muessig
How do you combine the OpenUI5/SAPUI5 programming model with a design system that makes its controls available as Web Components? Since OpenUI5/SAPUI5 1.120, the framework supports the integration of any Web Components. This makes it possible, for example, to natively embed own Web Components of your design system which are created with Stencil. The integration embeds the Web Components in a way that they can be used naturally in XMLViews, like with standard UI5 controls, and can be bound with data binding. Learn how you can also make use of the Web Components base class in OpenUI5/SAPUI5 to also integrate your Web Components and get inspired by the solution to generate a custom UI5 library providing the Web Components control wrappers for the native ones.
A Study of Variable-Role-based Feature Enrichment in Neural Models of CodeAftab Hussain
Understanding variable roles in code has been found to be helpful by students
in learning programming -- could variable roles help deep neural models in
performing coding tasks? We do an exploratory study.
- These are slides of the talk given at InteNSE'23: The 1st International Workshop on Interpretability and Robustness in Neural Software Engineering, co-located with the 45th International Conference on Software Engineering, ICSE 2023, Melbourne Australia
Mobile App Development Company In Noida | Drona InfotechDrona Infotech
Drona Infotech is a premier mobile app development company in Noida, providing cutting-edge solutions for businesses.
Visit Us For : https://www.dronainfotech.com/mobile-application-development/
What is Master Data Management by PiLog Groupaymanquadri279
PiLog Group's Master Data Record Manager (MDRM) is a sophisticated enterprise solution designed to ensure data accuracy, consistency, and governance across various business functions. MDRM integrates advanced data management technologies to cleanse, classify, and standardize master data, thereby enhancing data quality and operational efficiency.
Neo4j - Product Vision and Knowledge Graphs - GraphSummit ParisNeo4j
Dr. Jesús Barrasa, Head of Solutions Architecture for EMEA, Neo4j
Découvrez les dernières innovations de Neo4j, et notamment les dernières intégrations cloud et les améliorations produits qui font de Neo4j un choix essentiel pour les développeurs qui créent des applications avec des données interconnectées et de l’IA générative.
Atelier - Innover avec l’IA Générative et les graphes de connaissancesNeo4j
Atelier - Innover avec l’IA Générative et les graphes de connaissances
Allez au-delà du battage médiatique autour de l’IA et découvrez des techniques pratiques pour utiliser l’IA de manière responsable à travers les données de votre organisation. Explorez comment utiliser les graphes de connaissances pour augmenter la précision, la transparence et la capacité d’explication dans les systèmes d’IA générative. Vous partirez avec une expérience pratique combinant les relations entre les données et les LLM pour apporter du contexte spécifique à votre domaine et améliorer votre raisonnement.
Amenez votre ordinateur portable et nous vous guiderons sur la mise en place de votre propre pile d’IA générative, en vous fournissant des exemples pratiques et codés pour démarrer en quelques minutes.
Flutter is a popular open source, cross-platform framework developed by Google. In this webinar we'll explore Flutter and its architecture, delve into the Flutter Embedder and Flutter’s Dart language, discover how to leverage Flutter for embedded device development, learn about Automotive Grade Linux (AGL) and its consortium and understand the rationale behind AGL's choice of Flutter for next-gen IVI systems. Don’t miss this opportunity to discover whether Flutter is right for your project.
SMS API Integration in Saudi Arabia| Best SMS API ServiceYara Milbes
Discover the benefits and implementation of SMS API integration in the UAE and Middle East. This comprehensive guide covers the importance of SMS messaging APIs, the advantages of bulk SMS APIs, and real-world case studies. Learn how CEQUENS, a leader in communication solutions, can help your business enhance customer engagement and streamline operations with innovative CPaaS, reliable SMS APIs, and omnichannel solutions, including WhatsApp Business. Perfect for businesses seeking to optimize their communication strategies in the digital age.
Artificia Intellicence and XPath Extension FunctionsOctavian Nadolu
The purpose of this presentation is to provide an overview of how you can use AI from XSLT, XQuery, Schematron, or XML Refactoring operations, the potential benefits of using AI, and some of the challenges we face.
Most important New features of Oracle 23c for DBAs and Developers. You can get more idea from my youtube channel video from https://youtu.be/XvL5WtaC20A
Neo4j - Product Vision and Knowledge Graphs - GraphSummit ParisNeo4j
Dr. Jesús Barrasa, Head of Solutions Architecture for EMEA, Neo4j
Découvrez les dernières innovations de Neo4j, et notamment les dernières intégrations cloud et les améliorations produits qui font de Neo4j un choix essentiel pour les développeurs qui créent des applications avec des données interconnectées et de l’IA générative.
When it is all about ERP solutions, companies typically meet their needs with common ERP solutions like SAP, Oracle, and Microsoft Dynamics. These big players have demonstrated that ERP systems can be either simple or highly comprehensive. This remains true today, but there are new factors to consider, including a promising new contender in the market that’s Odoo. This blog compares Odoo ERP with traditional ERP systems and explains why many companies now see Odoo ERP as the best choice.
What are ERP Systems?
An ERP, or Enterprise Resource Planning, system provides your company with valuable information to help you make better decisions and boost your ROI. You should choose an ERP system based on your company’s specific needs. For instance, if you run a manufacturing or retail business, you will need an ERP system that efficiently manages inventory. A consulting firm, on the other hand, would benefit from an ERP system that enhances daily operations. Similarly, eCommerce stores would select an ERP system tailored to their needs.
Because different businesses have different requirements, ERP system functionalities can vary. Among the various ERP systems available, Odoo ERP is considered one of the best in the ERp market with more than 12 million global users today.
Odoo is an open-source ERP system initially designed for small to medium-sized businesses but now suitable for a wide range of companies. Odoo offers a scalable and configurable point-of-sale management solution and allows you to create customised modules for specific industries. Odoo is gaining more popularity because it is built in a way that allows easy customisation, has a user-friendly interface, and is affordable. Here, you will cover the main differences and get to know why Odoo is gaining attention despite the many other ERP systems available in the market.
Measures in SQL (SIGMOD 2024, Santiago, Chile)Julian Hyde
SQL has attained widespread adoption, but Business Intelligence tools still use their own higher level languages based upon a multidimensional paradigm. Composable calculations are what is missing from SQL, and we propose a new kind of column, called a measure, that attaches a calculation to a table. Like regular tables, tables with measures are composable and closed when used in queries.
SQL-with-measures has the power, conciseness and reusability of multidimensional languages but retains SQL semantics. Measure invocations can be expanded in place to simple, clear SQL.
To define the evaluation semantics for measures, we introduce context-sensitive expressions (a way to evaluate multidimensional expressions that is consistent with existing SQL semantics), a concept called evaluation context, and several operations for setting and modifying the evaluation context.
A talk at SIGMOD, June 9–15, 2024, Santiago, Chile
Authors: Julian Hyde (Google) and John Fremlin (Google)
https://doi.org/10.1145/3626246.3653374
2. Open Source Stack Installer
Stacki is a very fast and ultra reliable Linux server provisioning tool … at scale. !
With zero prerequisites for taking systems from bare metal to a ping and prompt. !
4. History
§ Roots in Open Source!
§ Started life as the Rocks Project at UCSD!
§ Started in May ’00.!
§ 6 month project going on ~16 years!
§ Roots in the HPC world!
6. Problem
§ OS Provisioning
§ Disk Configuration
§ Disk Controller Configuration
§ Disk Partitioning
§ Network Configuration
§ Services configuration
§ Application Deployment
§ Life-cycle management of the cluster
Server Provisioning
7. Problem – Contd. …
Datacenter Provisioning
§ Server Provisioning
§ Heterogeneous Hardware
§ Complex Network Configuration
§ Bonding
§ Bridging
§ VLANs
§ Combinations of the above
13. From Bare Metal Up
Take complete control of the Stack
§ Modified CentOS Installer!
§ Parallel package sharing installer!
§ Database to keep persistent data about the System!
§ Command Line to interact with Stacki!
§ Dynamic Kickstart File Generation!
14. Frontend Services
Services to build backend nodes
§ DHCP – MAC to IP address Mapping
§ TFTP – Serve out PXE files, Installation Kernel, and RAM Disk
§ Apache – Serve Kickstart files
§ DNS (optional)
Services to access backend nodes
§ SSH key management
§ Parallel execution shell
!!
15. Stacki Positioning
DevOps / Configuration Tool
DHCP /
DNS / TFTP
NetworkDiskOS
In-house
developed
deployment
tools
- Disk Array Controller Configuration
- Disk Partitioning Configuration
16. Download and Boot the ISO
Go to www.stacki.com and download the
ISO
◦ It’s 1.2 GB
◦ “stacki” pallet plus stripped down CentOS
6.7
Boot the ISO on the host that will be your
frontend
!!
29. Adding Hosts
Method 2: Host Configuration Spreadsheet
Advantages
§ Complete control of Hostname, IP address, and network assignments!
§ Easy to make changes!
§ Fits very well with existing datacenter management processes.!
Disadvantages!
§ A little tedious the first time around!
§ Requires prior knowledge of!
§ MAC addresses,!
§ IP address assignments!
§ Physical location of machines (Rack & Position)!
35. Advanced Networking
Advanced Network Configuration
§ Bonded interfaces!
§ VLANs!
§ Bridging!
§ Any combo of the above!
Multiple Subnets
§ Build a single cluster from hosts in multiple subnets!
§ Manage hosts in multiple datacenters!
!
!!
39. Disk Partitioning
§ Sensible Default Disk partitioning
§ Support for multiple disks
§ Support for file system options and mount options
§ Support for Software RAID configuration
§ Disk Partitioning through spreadsheets
§ # stack load storage partition
42. Pallets
Software Entity
§ Contains RPMS!
§ Contains Configuration in the form of XML!
§ Used for installation and configuration of an Application!
§ Can be applied during Frontend installation or after the fact.!
§ Each pallet functionally equal to a YUM repo with extra configuration!
Example: Cloudera Pallet
§ Contains RPMS required to install the Cloudera Distribution of Hadoop!
§ Contains scripts to configure and starts CDH!
43. Example: Stacki with Cloudera Pallet
Check namenodes are
empty!
Format/start HDFS!
Create all directories!
Create all metastores!
Start services (Hbase, Hive,
Oozie, Sqoop, Impala, etc)!
Deploy client configuration! Configure database!
Setup/assign monitors
(activity, services, and host)!
Test database connections!
Validate/resolve hostnames!Consistent host timezones!
No bad kernel versions
running!
(CDH) version consistency!
Java version consistency!
Daemons versions
consistency!
Mgmt Agents versions
consistency!
Host specification/SSH
ports!
MUCH MORE …!
DHCP Server/Client setup! TFTP/PXE configuration!
Server OS installation!
Node OS Install!
RAID configuration!
Boot configuration!
System/data disk
partitioning!
Monitoring system setup
and config!
Lights Out/IPMI setup!
User accounts added and
synced!
SSH keys on all hosts!
Network node configuration!
Config Mgmt install and
configuration!
Route configuration!OS upgrades/updates!
Site specific software and
configuration!
Host specification/SSH
ports!
Security!
Firewall setup!Cluster Mgmt utility! Database install and config!
Multiple network config!Package installation! MUCH MORE …!
App Config!
Site Config!
HW Install!
Without Stacki!
Stacki w/ Hadoop Pallet!
44. Carts
Site Specific Pallets
§ Contains site-specific RPM!
§ Contains site-specific configurations!
§ Structurally and Functionally equivalent to a Pallet!
!
Example: Client Cart
§ Contains RPMS to install DevOps tools!
§ Contains custom post-install scripts to configure DevOps tools!
§ Contains custom post-install scripts to run DevOps tools to bring system up to requisite
configuration.!
45. Boxes
Logical Entity
§ Loose collection of Pallets and Carts!
§ One-to-Many mapping to Backend Hosts!
OS Pallet!
Cloudera Pallet!
Stacki Pallet!
Pallets! Carts!
PayPal Cart!
Ansible Cart!
Boxes!
RedHat Pallet!
Stacki Pallet!
PayPal Cart!
Application!
RedHat Pallet!
Cloudera Pallet!
Ansible Cart!
OS Pallet!
Stacki Pallet!
PayPal Cart!
Default!
47. Multiple Distributions
Default Distribution
§ Based on stripped down CentOS 6.7 or 7.2
§ Used to build backend nodes
Multiple Distributions on Frontend
◦ E.g., RHEL 6.x based distribution, CentOS 6.7, etc.
Backend Nodes ó Distribution Mapping
§ Any Node can be mapped to any distribution!
!!