This document discusses building CloudStack infrastructure at scale. It covers the design phase including understanding workloads and bottlenecks. It discusses redundancy and resilience when designing the CloudStack and MySQL components. Automation is also covered including using tools like Chef and Puppet for infrastructure builds. The document provides examples of automating management VM configuration and host deployment using shell scripts. It also discusses utilizing the CloudStack API to automate infrastructure builds.
Local Dev on Virtual Machines - Vagrant, VirtualBox and AnsibleJeff Geerling
Developing web applications and websites locally can be troublesome if you use pre-built server packages like WAMP or MAMP, or an install tool to get Java or Ruby on your computer. Develop using modern best practices by using Vagrant, VirtualBox and Ansible to manage your development environments!
Deploying VMware vCloud Hybrid Service with Puppet - PuppetConf 2013Puppet
"Deploying VMware vCloud Hybrid Service with Puppet" by Nan Liu, Sr. Systems Engineer, VMware Inc.
Speaker Presentation: This session will provide an overview of the challenges of deploying and managing VMware vCloud Hybrid service with Puppet. VMware vCloud Hybrid service automation not only require configuration management of operating systems, but also configuration management of several VMware products through their APIs: * VMware vCenter (vSphere API) * VMware vCloud Network and Security (vShield API) * VMware vCloud Director (vCloud API).
Speaker Bio: Nan is a Sr. Systems Engineer at VMware focused on developing automation solutions for VMware vCloud Hybrid service (vCHS). Previously, he worked as a technical evangelist and professional service engineer at Puppet Labs developing and promoting DevOps solutions for partners and customers. He also has background managing SaaS service in the healthcare industry.
Service Delivery Assembly Line with Vagrant, Packer, and AnsibleIsaac Christoffersen
Leverage Packer, Vagrant, and Ansible as part of a service delivery pipeline. Streamline your continuous delivery process while also targeting multiple cloud providers.
Local Dev on Virtual Machines - Vagrant, VirtualBox and AnsibleJeff Geerling
Developing web applications and websites locally can be troublesome if you use pre-built server packages like WAMP or MAMP, or an install tool to get Java or Ruby on your computer. Develop using modern best practices by using Vagrant, VirtualBox and Ansible to manage your development environments!
Deploying VMware vCloud Hybrid Service with Puppet - PuppetConf 2013Puppet
"Deploying VMware vCloud Hybrid Service with Puppet" by Nan Liu, Sr. Systems Engineer, VMware Inc.
Speaker Presentation: This session will provide an overview of the challenges of deploying and managing VMware vCloud Hybrid service with Puppet. VMware vCloud Hybrid service automation not only require configuration management of operating systems, but also configuration management of several VMware products through their APIs: * VMware vCenter (vSphere API) * VMware vCloud Network and Security (vShield API) * VMware vCloud Director (vCloud API).
Speaker Bio: Nan is a Sr. Systems Engineer at VMware focused on developing automation solutions for VMware vCloud Hybrid service (vCHS). Previously, he worked as a technical evangelist and professional service engineer at Puppet Labs developing and promoting DevOps solutions for partners and customers. He also has background managing SaaS service in the healthcare industry.
Service Delivery Assembly Line with Vagrant, Packer, and AnsibleIsaac Christoffersen
Leverage Packer, Vagrant, and Ansible as part of a service delivery pipeline. Streamline your continuous delivery process while also targeting multiple cloud providers.
Vagrant is a well-known tool for creating development environments in a simple and consistent way. Since we adopted in our organization we experienced several benefits: lower project setup times, better shared knowledge among team members, less wtf moments ;-)
In this session I'd like to share our experience, including but not limited to:
- advanced vagrantfile configuration
- vm configuration tips for dev environment: performance, debug, tuning
- our wtf moments
- puphet/phansilbe: hot or not?
- tips for sharing a box
Yesterday I gave presentation on Ansible and it was successful . It give basic understanding of playbook and an example implementation of jboss application from scratch
Ansible is an open source automation platform, written in Python, that can be used for configuration-management, application deployment, cloud provisioning, ad-hoc task-execution, multinode orchestration and so on. This talk is an introduction to Ansible for beginners, including tips like how to use containers to mimic multiple machines while iteratively automating some tasks or testing.
An Ensemble Core with Docker - Solving a Real Pain in the PaaS Erik Osterman
Docker by itself is only an engine powering containers. You need a containership to run it in production. CoreOS is a purpose-built containership that powers Docker conatiners, however, without higher-level orchestration managing hundreds or thousands of containers is not manageable. Ensemble is the answer for running containers at scale on top of CoreOS.
Chef Provisioning a Chef Server Cluster - ChefConf 2015Chef
This talk is an exploration of how to build Chef Server 12 clusters with Chef Provisioning, including premium features like Chef Reporting and Chef Analytics. I will cover several new capabilities and tools in the Chef ecosystem that makes it easier than ever before to build and manage scalable Chef Server clusters.
https://youtu.be/HUQA1Ikm5Iw
Puppet is ideal for abstracting away the configurations of machines. In the time since puppet arrived on the scene, IaaS has started to creep into the mainstream. Now instead of just managing the configuration in the machine, the machine state itself can be configured, and even broken out to manage the configuration of all the deployed instances in a datacenter. We'll explore delving into using Apache CloudStack to do so, but we'll talk about the applicable other platforms as well.
David Nalley
Committer/PMC member, Apache CloudStack
David is a recovering sysadmin who spent a year in operations before starting to work on cloudy things. He's currently employed by Citrix in the Open Source Business Office to spend his time working on Apache CloudStack. In addition to CloudStack he's been involved in a number of other open source projects, including Zenoss and the Fedora Project.
Splitting your source code into separate modules and importing them into the current namespace is the standard way of coding for the backend. Until recently this has not been possible in the frontend because of the time it would have taken to synchronously load all required assets.
Tools like Webpack and JSPM allow exactly that and much more. This talk is going to give you an overview over the two and show why you should stop putting everything into the global namespace.
Vagrant is a well-known tool for creating development environments in a simple and consistent way. Since we adopted in our organization we experienced several benefits: lower project setup times, better shared knowledge among team members, less wtf moments ;-)
In this session I'd like to share our experience, including but not limited to:
- advanced vagrantfile configuration
- vm configuration tips for dev environment: performance, debug, tuning
- our wtf moments
- puphet/phansilbe: hot or not?
- tips for sharing a box
Yesterday I gave presentation on Ansible and it was successful . It give basic understanding of playbook and an example implementation of jboss application from scratch
Ansible is an open source automation platform, written in Python, that can be used for configuration-management, application deployment, cloud provisioning, ad-hoc task-execution, multinode orchestration and so on. This talk is an introduction to Ansible for beginners, including tips like how to use containers to mimic multiple machines while iteratively automating some tasks or testing.
An Ensemble Core with Docker - Solving a Real Pain in the PaaS Erik Osterman
Docker by itself is only an engine powering containers. You need a containership to run it in production. CoreOS is a purpose-built containership that powers Docker conatiners, however, without higher-level orchestration managing hundreds or thousands of containers is not manageable. Ensemble is the answer for running containers at scale on top of CoreOS.
Chef Provisioning a Chef Server Cluster - ChefConf 2015Chef
This talk is an exploration of how to build Chef Server 12 clusters with Chef Provisioning, including premium features like Chef Reporting and Chef Analytics. I will cover several new capabilities and tools in the Chef ecosystem that makes it easier than ever before to build and manage scalable Chef Server clusters.
https://youtu.be/HUQA1Ikm5Iw
Puppet is ideal for abstracting away the configurations of machines. In the time since puppet arrived on the scene, IaaS has started to creep into the mainstream. Now instead of just managing the configuration in the machine, the machine state itself can be configured, and even broken out to manage the configuration of all the deployed instances in a datacenter. We'll explore delving into using Apache CloudStack to do so, but we'll talk about the applicable other platforms as well.
David Nalley
Committer/PMC member, Apache CloudStack
David is a recovering sysadmin who spent a year in operations before starting to work on cloudy things. He's currently employed by Citrix in the Open Source Business Office to spend his time working on Apache CloudStack. In addition to CloudStack he's been involved in a number of other open source projects, including Zenoss and the Fedora Project.
Splitting your source code into separate modules and importing them into the current namespace is the standard way of coding for the backend. Until recently this has not been possible in the frontend because of the time it would have taken to synchronously load all required assets.
Tools like Webpack and JSPM allow exactly that and much more. This talk is going to give you an overview over the two and show why you should stop putting everything into the global namespace.
How we used ruby to build locaweb's cloud (http://presentations.pothix.com/ru...Willian Molinari
**The slides are not correctly rendered. The HTML/Javascript version is here: http://presentations.pothix.com/rubyconf2013/**
This presentation shows what we have done with Ruby to create Locaweb's cloud computing product.
in LATVIAN language: Viens no galvenajiem datubāzes administratora uzdevumiem ir veikt datubāzes backup un prast no tā atjaunot datubāzi. Mysql bezmaksas versija nepiedāvā datubāzes administratoram ļoti daudz izvēles. Sava prezentācija es pastāstīšu par šādiem rīkiem:
-- MySQLdump
-- Percona XtraBackup
-- Mysql enterprise backup (MEB)
--Un citiem rīkiem kas palīdz man veikt db backup
Atmosphere Conference 2015: Taming the Modern DatacenterPROIDEA
Speaker: Seth Vargo
Language: English
Today we are plagued by hundreds of choices when architecting a modern data center. Should our machines be virtual or physical? Should we use containers or Docker? Should we use a public cloud provider or a private cloud provider? Which configuration management tool is best to use? What about IaaS, PaaS, and SaaS? It would be manageable if these were binary choices; however, we often find ourselves in a hybrid environment.
As more operations choices are added to your data center, whether through company acquisitions, a growing development team, or general technical debt, managing complexity between legacy and new systems becomes a nightmare. Yet the end goal is still the same — safely deploy your application to your infrastructure. We need to tame our data centers by managing change across systems, enforcing policies, and by establishing a workflow for both developers and operations engineers to build in a collaborative environment.
This talk will discuss the problems faced in the modern data center, and how a set of innovative open source tooling can be used to tame the rising complexity curve. Join me on an adventure with Vagrant, Consul, and Terraform as we take your data center from chaos to control.
Visit our website: http://atmosphere-conference.com/
How to create a secured cloudera clusterTiago Simões
This presentation, it’s for everyone that is curious with Big Data and does have the know how to start learning...
With this, you will be able to create quickly a Kerberos secured Cloudera Cluster.
DB proxy server test: run tests on tens of virtual machines with Jenkins, Vag...Timofey Turenko
The presentation describes CI environment for our product - Maxscale - database proxy server. To test such product we need a setup that consists of tens of machines: locally hosted virtual machines as well as machines from different clouds. All our Jenkins jobs are implemented in the form of Jenkins Job Builder code. Presentations also tells about our tool to manage virtual machines (wrapper over Vagrant)- MDBCI.
Salesforce at Stacki Atlanta Meetup February 2016StackIQ
Dave Peterson's presentation on how Salesforce uses Stacki and Chef to provision and manage thousands of servers. Stacki Atlanta kickoff Meetup on 2/23/16 at the Microsoft Innovation Center. Dave is a Lead Systems Engineer at Salesforce.
Wordpress y Docker, de desarrollo a produccionSysdig
Docker esta revolucionando cómo desplegamos nuestras aplicaciones. Desde el entorno de desarrollo hasta la puesta en producción.
Veremos las ventajas que nos aporta Docker para el desarrollo en WordPress, las herramientas y procesos desde el punto de vista de un desarrollador.
A la hora de mover nuestra aplicación WordPress a producción, presentaremos los retos que presenta y las ventajas que aportan herramientas de orquestación como Kubernetes.
Tanto si eres un desarrollador como si también tienes que gestionar los sistemas que alojan tu WordPress, saldrás de esta charla queriendo poner todos tus WordPress en contenedores.
CloudStack provides versatile authentication methods to ensure secure access and identity management. This talk explores key authentication mechanisms within CloudStack, including LDAP, SAML, OAuth2, API keys, etc. LDAP integration enables centralized user authentication, while SAML facilitates single sign-on (SSO) across various services. OAuth2 ensures secure authorization for third-party applications, and API keys offer programmatic access to resources. Additionally, CloudStack supports Two-Factor Authentication for an extra layer of security, enhancing user verification through multiple verification steps.
-----------------------------------------
The CloudStack India User Group 2024 took place in Hyderabad on 23rd February. The conference, arranged by a group of volunteers from the Apache CloudStack Community, saw multiple sessions held about the cloud orchestration platform and its latest advancements.
In this session, Kiran gives a talk about the rich ecosystem of tools (cmk, CAPC, Terraform, Ansible, Packer, csbench, mbx), that support Cloudstack.
Find out how the various tools work and how easy it is to integrate with Apache CloudStack.
This session provides a great way to speed up CloudStack adoption and improve performance by saving valuable time.
-----------------------------------------
The CloudStack India User Group 2024 took place in Hyderabad on 23rd February. The conference, arranged by a group of volunteers from the Apache CloudStack Community, saw multiple sessions held about the cloud orchestration platform and its latest advancements.
Elevating Cloud Infrastructure with Object Storage, DRS, VM Scheduling, and D...ShapeBlue
In this session, Vishesh Jindal and Jithin Raju give a demonstration on Apache CloudStack's 4.19 marquee features - Object Storage, DRS, VM schedule & DRaaS.
-----------------------------------------
The CloudStack India User Group 2024 took place in Hyderabad on 23rd February. The conference, arranged by a group of volunteers from the Apache CloudStack Community, saw multiple sessions held about the cloud orchestration platform and its latest advancements.
VM Migration from VMware to CloudStack and KVM – Suresh Anaparti, ShapeBlueShapeBlue
The support for migrating VMware instances, and importing KVM instances to a CloudStack-managed KVM environment has been added to CloudStack 4.19.
In this talk, Suresh provides the details about the import/migration process in CloudStack along with a demo, and discusses the future improvements.
-----------------------------------------
The CloudStack India User Group 2024 took place in Hyderabad on 23rd February. The conference, arranged by a group of volunteers from the Apache CloudStack Community, saw multiple sessions held about the cloud orchestration platform and its latest advancements.
How We Grew Up with CloudStack and its Journey – Dilip Singh, DataHubShapeBlue
In this session, Senior IT Manager at DataHub Nepal, Dilip Singh, shares how DataHub grew up with CloudStack and details the journey the company had with the cloud orchestration platform.
-----------------------------------------
The CloudStack India User Group 2024 took place in Hyderabad on 23rd February. The conference, arranged by a group of volunteers from the Apache CloudStack Community, saw multiple sessions held about the cloud orchestration platform and its latest advancements.
What’s New in CloudStack 4.19, Abhishek Kumar, Release Manager Apache CloudSt...ShapeBlue
This session gives a brief introduction to the new and exciting feature in the latest CloudStack LTS release, ie, 4.19.0. The discussion includes the details on the timeline of the CloudStack 4.19.0 release, overview of some of the marquee, new feature of the release – Object storage framework, KVM ingestion, Hypervisor agnostic simple DRS, CAPC aware CKS, OAuth2, DRaaS with Multi zone disaster recovery, etc and a summary of improvements added since the previous major LTS release of the CloudStack, ie, 4.18.0.
-----------------------------------------
The CloudStack India User Group 2024 took place in Hyderabad on 23rd February. The conference, arranged by a group of volunteers from the Apache CloudStack Community, saw multiple sessions held about the cloud orchestration platform and its latest advancements.
CloudStack 101: The Best Way to Build Your Private Cloud – Rohit Yadav, VP Ap...ShapeBlue
Apache CloudStack is an open-source software designed to deploy and manage large networks of virtual machines, as a highly available, highly scalable Infrastructure as a Service (IaaS) cloud computing platform. This talk gives an introduction to the technology, its architecture, its history and community.
-----------------------------------------
The CloudStack India User Group 2024 took place in Hyderabad on 23rd February. The conference, arranged by a group of volunteers from the Apache CloudStack Community, saw multiple sessions held about the cloud orchestration platform and its latest advancements.
How We Use CloudStack to Provide Managed Hosting - Swen Brüseke - proIOShapeBlue
Swen shows how proIO utilize Cloudstack to provide customers with managed hosting solutions and versatile public and private cloud solutions, mainly based on open-source software.
-----------------------------------------
The CloudStack Collaboration Conference 2023 took place on 23-24th November. The conference, arranged by a group of volunteers from the Apache CloudStack Community, took place in the voco hotel, in Porte de Clichy, Paris. It hosted over 350 attendees, with 47 speakers holding technical talks, user stories, new features and integrations presentations and more.
In cloud computing environments, VMs require fast access to resources like storage and networking. The hardware that the VMs access is implemented in software and/or by passing through a dedicated hardware device. Software-based solutions consume extra CPU cycles, thus resulting in poor performance. Also, these require to expose a device-model to the guest, thus increasing the attack surface. Conversely, hardware passthrough provides better performance and security but can be expensive in terms of the number of physical resources, since each device is dedicated to a single VM. This talk focuses on how Vates is working on sharing hardware resources among VMs by relying on dedicated processors named Data Processing Units (DPU). More precisely, Vates work on offloading Xen hypervisor of storage emulation by relying on Kalray K200 DPU PCIe controllers, a hardware accelerator based on MPPA architecture.
-----------------------------------------
The CloudStack Collaboration Conference 2023 took place on 23-24th November. The conference, arranged by a group of volunteers from the Apache CloudStack Community, took place in the voco hotel, in Porte de Clichy, Paris. It hosted over 350 attendees, with 47 speakers holding technical talks, user stories, new features and integrations presentations and more.
Zero to Cloud Hero: Crafting a Private Cloud from Scratch with XCP-ng, Xen Or...ShapeBlue
Dive into the seamless integration of the Vates stack as the foundation for your CloudStack deployment. In this workshop, you’ll witness the power and simplicity of XCP-ng and Xen Orchestra. From a blank slate to a fully operational private cloud, Olivier guides you through each pivotal step. Learn how to streamline your cloud setup process and unlock the potential of a private cloud infrastructure that’s both efficient and easy to manage. Watch to discover how to transform bare metal into a cloud powerhouse in mere minutes.
-----------------------------------------
The CloudStack Collaboration Conference 2023 took place on 23-24th November. The conference, arranged by a group of volunteers from the Apache CloudStack Community, took place in the voco hotel, in Porte de Clichy, Paris. It hosted over 350 attendees, with 47 speakers holding technical talks, user stories, new features and integrations presentations and more.
KVM Security Groups Under the Hood - Wido den Hollander - Your.OnlineShapeBlue
They are just a few clicks in the UI or a single API call, but how do security groups work at KVM hypervisor level? How do they filter traffic and what else do they do in addition to firewalling? What Anti-Spoofing policies are implemented by the security groups?
In this talk, Wido dives into the specifics of the security groups on the KVM hypervisor for both IPv4 and IPv6.
-----------------------------------------
The CloudStack Collaboration Conference 2023 took place on 23-24th November. The conference, arranged by a group of volunteers from the Apache CloudStack Community, took place in the voco hotel, in Porte de Clichy, Paris. It hosted over 350 attendees, with 47 speakers holding technical talks, user stories, new features and integrations presentations and more.
How to Re-use Old Hardware with CloudStack. Saving Money and the Environment ...ShapeBlue
CloudStack allows you to use older hardware for a longer time in your cloud environment. By using older hardware for a longer time you can save money and the environment by not producing new hardware.
-----------------------------------------
The CloudStack Collaboration Conference 2023 took place on 23-24th November. The conference, arranged by a group of volunteers from the Apache CloudStack Community, took place in the voco hotel, in Porte de Clichy, Paris. It hosted over 350 attendees, with 47 speakers holding technical talks, user stories, new features and integrations presentations and more.
Use Existing Assets to Build a Powerful In-house Cloud Solution - Magali Perv...ShapeBlue
How to minimize the impact when it’s time to implement a cloud solution for automating internal workloads and delivering efficient solutions? Magali, Joffrey, and Grégoire present a case study of a successful hardware reuse project, including key metrics: Business objectives, Performance objectives and Financial objectives.
-----------------------------------------
The CloudStack Collaboration Conference 2023 took place on 23-24th November. The conference, arranged by a group of volunteers from the Apache CloudStack Community, took place in the voco hotel, in Porte de Clichy, Paris. It hosted over 350 attendees, with 47 speakers holding technical talks, user stories, new features and integrations presentations and more.
Import Export Virtual Machine for KVM Hypervisor - Ayush Pandey - University ...ShapeBlue
Ayush talks about his contribution as a GSoC Contributor, for implementing the Import-Export Instances feature for the KVM Hypervisor.
-----------------------------------------
The CloudStack Collaboration Conference 2023 took place on 23-24th November. The conference, arranged by a group of volunteers from the Apache CloudStack Community, took place in the voco hotel, in Porte de Clichy, Paris. It hosted over 350 attendees, with 47 speakers holding technical talks, user stories, new features and integrations presentations and more.
DRaaS using Snapshot copy and destination selection (DRaaS) - Alexandre Matti...ShapeBlue
Apache CloudStack 4.19 introduces the capability for end-users to copy their root disk or volume snapshots to one (or more) ACS Zones without operator intervention. In this talk, Alex shows how this simple yet powerful new feature enables for end-users to control where their data resides and for operators to provide low-cost and robust DRaaS to their customers.
-----------------------------------------
The CloudStack Collaboration Conference 2023 took place on 23-24th November. The conference, arranged by a group of volunteers from the Apache CloudStack Community, took place in the voco hotel, in Porte de Clichy, Paris. It hosted over 350 attendees, with 47 speakers holding technical talks, user stories, new features and integrations presentations and more.
A discussion on the common failures when using CloudStack taking instance deployment as an example. The session includes 15 specific failure scenarios, their causes, and possible mitigation steps.
-----------------------------------------
The CloudStack Collaboration Conference 2023 took place on 23-24th November. The conference, arranged by a group of volunteers from the Apache CloudStack Community, took place in the voco hotel, in Porte de Clichy, Paris. It hosted over 350 attendees, with 47 speakers holding technical talks, user stories, new features and integrations presentations and more.
Elevating Privacy and Security in CloudStack - Boris Stoyanov - ShapeBlueShapeBlue
In an increasingly interconnected digital landscape, safeguarding data privacy and ensuring robust security measures are paramount. CloudStack offers a dynamic ecosystem for deploying and managing cloud resources. However, to fully harness its potential, it is crucial to address privacy and security concerns effectively.
This presentation explores the realm of possibilities and demonstrates how CloudStack can enhance the privacy and security of your cloud deployments. Boris examines practical approaches to protect sensitive data, fortify communications, and secure your infra against emerging threats. Join us on a journey to discover how CloudStack can be your trusted ally in the quest for a more secure and private cloud environment.
-----------------------------------------
The CloudStack Collaboration Conference 2023 took place on 23-24th November. The conference, arranged by a group of volunteers from the Apache CloudStack Community, took place in the voco hotel, in Porte de Clichy, Paris. It hosted over 350 attendees, with 47 speakers holding technical talks, user stories, new features and integrations presentations and more.
Transitioning from VMware vCloud to Apache CloudStack: A Path to Profitabilit...ShapeBlue
In this session, Marco explores the potential of migrating from VMware vCloud to Apache CloudStack with KVM. VMware vCloud Suite is a robust cloud infrastructure and management solution that combines vSphere and vRealize Suite, providing automation and operations capabilities for traditional and modern infrastructure and apps. However, the transition to Apache CloudStack can offer enhanced profitability and competitiveness.
Marco delves into the benefits of Apache CloudStack, including its cost-effectiveness and open-source nature, and discusses how a gradual migration from VMware vCloud can reduce ownership costs, increase profitability, and enhance competitiveness. He also covers the practical steps and considerations in planning and executing this transition effectively.
-----------------------------------------
The CloudStack Collaboration Conference 2023 took place on 23-24th November. The conference, arranged by a group of volunteers from the Apache CloudStack Community, took place in the voco hotel, in Porte de Clichy, Paris. It hosted over 350 attendees, with 47 speakers holding technical talks, user stories, new features and integrations presentations and more.
Vishesh has been working on the feature hypervisor-agnostic DRS in Cloudstack. He briefly overviews the implementation and discusses the algorithms currently available and how they can improve resource allocation and workload balancing in virtualized environments. Additionally, Vishesh showcases a live demo of hypervisor agnostic DRS in action, highlighting its capabilities and effectiveness.
-----------------------------------------
The CloudStack Collaboration Conference 2023 took place on 23-24th November. The conference, arranged by a group of volunteers from the Apache CloudStack Community, took place in the voco hotel, in Porte de Clichy, Paris. It hosted over 350 attendees, with 47 speakers holding technical talks, user stories, new features and integrations presentations and more.
What’s New in CloudStack 4.19 - Abhishek Kumar - ShapeBlueShapeBlue
This session gives a brief introduction of the new and exciting feature in the latest (upcoming) CloudStack LTS release, ie, 4.19.0. The discussion includes the details on the timeline of the CloudStack 4.19.0 release, overview of some of the marquee, new feature of the release – Object storage framework, KVM ingestion, Hypervisor agnostic simple DRS, CAPC aware CKS, OAuth2, DRaaS with Multi zone disaster recovery, etc and a summary of improvements added since the previous major LTS release of the CloudStack, ie, 4.18.0.
-----------------------------------------
The CloudStack Collaboration Conference 2023 took place on 23-24th November. The conference, arranged by a group of volunteers from the Apache CloudStack Community, took place in the voco hotel, in Porte de Clichy, Paris. It hosted over 350 attendees, with 47 speakers holding technical talks, user stories, new features and integrations presentations and more.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
Keynote at DIGIT West Expo, Glasgow on 29 May 2024.
Cheryl Hung, ochery.com
Sr Director, Infrastructure Ecosystem, Arm.
The key trends across hardware, cloud and open-source; exploring how these areas are likely to mature and develop over the short and long-term, and then considering how organisations can position themselves to adapt and thrive.
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
10. Redundancy & Resilience
CloudStack Management Server
Very easy to set up additional management servers
Load balancing required to give high availabilty
www.shapeblue.com
11. Redundancy & Resilience
MySQL
Master / Slave is ‘standard’
Alternatives include
MySQL Proxy (Mirroring)
Galera Cluster
MMM
www.shapeblue.com
12. Redundancy & Resilience
Load
Load
Balancer
Balancer
MySQL MySQL MySQL
CS Man CS Man
Galera
www.shapeblue.com
13. Redundancy & Resilience
DC1 DC2
F5 F5
CS Man CS Man CS Man CS Man
F5 F5
MySQL MySQL MySQL MySQL MySQL MySQL
Galera Galera
www.shapeblue.com
14. Redundancy & Resilience
Server ‘pairs’
MySQL masters and slaves
CS Man & MySQL master
vCenter & MS SQL server
Any other redundant servers i.e. DNS
www.shapeblue.com
15. Redundancy & Resilience
Laws of probability….
Same failure probability as raid 0
If management server OR MySQL
master fails – downtime for the
whole management system.
www.shapeblue.com
16. Automation
Automation of the
infrastructure build
www.shapeblue.com
17. Automation
Uses:
Why automate
Automation tools
Examples
Configuring management VMs
Build a CloudStack 4.0 management server
Deployment of hosts
Configuration of CloudStack (through API)
www.shapeblue.com
21. Automation
Example:
Base Build of Management
Servers using Shell Scripting
www.shapeblue.com
22. Automation – Management VM Configuration
Create Deployment VM
Download CSV & Make it executable,
CentOS (Minimal) + hostconfig script run it.
wget
www.shapeblue.com
26. Automation – Management VM Configuration
# if vm management use this one NETMASK4=255.255.255.248
if [ "$SecondaryNICNetwork" == “Mgmt" ]; then GATEWAY4=10.141.163.1
echo "ADDRESS0=10.128.9.9 ADDRESS5=213.212.69.0
NETMASK0=255.255.255.255 NETMASK5=255.255.255.0
GATEWAY0=10.14.16.1 GATEWAY5=10.141.163.1" > /etc/sysconfig/network-
ADDRESS1=10.128.3.13 scripts/route-eth1
NETMASK1=255.255.255.255 fi
GATEWAY1=10.14.16.1
ADDRESS2=64.238.199.202
NETMASK2=255.255.255.255
GATEWAY2=10.141.163.1
ADDRESS3=213.212.65.202
NETMASK3=255.255.255.255
GATEWAY3=10.141.163.1
ADDRESS4=213.212.68.168
www.shapeblue.com
28. Automation – CS4 Management Server
Create Deployment VM Set static IP address Download the script,
CentOS (Minimal) + and ensure it has an make it executable,
wget FQDN run it.
www.shapeblue.com
29. Automation – CS4 Management Server
#!/bin/bash chkconfig ntpd on
chkconfig mysqld on
setenforce permissive chkconfig nfs on
sed -i "/SELINUX=/ cSELINUX=permissive" /etc/selinux/config chkconfig rpcbind on
echo " service ntpd restart
[cloudstack] service mysqld restart
name=cloudstack service rpcbind start
baseurl=http://cloudstack.apt-get.eu/rhel/4.0/ service nfs start
enabled=1
gpgcheck=0" > /etc/yum.repos.d/cloudstack.repo /usr/bin/mysqladmin -u root password 'password'
yum update -y cloud-setup-databases cloud:cloud@localhost --deploy-
yum install ntp cloud-client mysql-server -y as=root:password
sed -i -e '/datadir/ ainnodb_rollback_on_timeout=1' -e '/datadir/ cloud-setup-management
ainnodb_lock_wait_timeout=600' -e '/datadir/
amax_connections=350' -e '/datadir/ alog-bin=mysql-bin' -e
"/datadir/ abinlog-format = 'ROW'" /etc/my.cnf
www.shapeblue.com
30. Automation
Example:
Host deployment server build
using shell scipting
www.shapeblue.com
31. Automation – Host Deployment
Create Deployment VM Download to VM Hypervisor Download build script,
installation media (inc. make it executable,
CentOS (Minimal) + wget XenServer Updates) run it.
www.shapeblue.com
32. Automation – Host Deployment
Deployment server (VM)
The script downloads, builds and configures:
DHCP
PXE (TFTP)
HTTP server
Script writes the scripts needed to for PXE boot of XenServer &
ESXi hosts
Script also writes the answer files and post installation scripts to
configure XenServer and ESXi hosts
www.shapeblue.com
41. Automation – The API
What is the API
The API is the real engine of CloudStack
The web GUI is simply making API calls
Port 8096 by default
www.shapeblue.com
42. Automation – The API
Using the API
CloudStack GUI
Browser
Word, Excel
Using Firebug/IE Developer Tools with CloudStack
www.shapeblue.com
43. Automation – The API
API commands directly through a browser
Immediate response
www.shapeblue.com
44. Automation – The API
API calls from a Word document or Excel spread sheet
www.shapeblue.com
45. Automation – The API
Using Firebug / IE Developer Tools
IE press F12 or ‘view developer tools’
Firefox install Firebug add-on
www.shapeblue.com
47. Automation – The API
Global Settings
http://csman:8096/client/api?command=updateConfiguration&name=vmware.management.portgroup&value=svc-
console
http://csman:8096/client/api?command=updateConfiguration&name=allow.user.create.projects&value=false
http://csman:8096/client/api?command=updateConfiguration&name=allow.public.user.templates&value=false
http://csman:8096/client/api?command=updateConfiguration&name=apply.allocation.algorithm.to.pods&value=true
http://csman:8096/client/api?command=updateConfiguration&name=cpu.overprovisioning.factor&value=2
http://csman:8096/client/api?command=updateConfiguration&name=vm.allocation.algorithm&value=random
www.shapeblue.com
48. Automation – The API
Getting information
http://csman1:8096/client/api?command=listServiceOfferings
http://csman1:8096/client/api?command=listTemplates&templatefilter=featur
ed
www.shapeblue.com
49. Automation – The API
Deploying an instance
Base command:
http://csman1:8096/client/api?command=deployVirtualMachine
The required options:
The Service Offering and Template IDs
&serviceofferingid=XXX
&templateid=XXX
&zoneid=XXX
&domainid=XXX
&account=XXX
Optional options:
&displayname=xxx
www.shapeblue.com
50. Automation – The API
Deploying an instance
http://csman1:8096/client/api?command=deployVirtualMachine&serviceofferingi
d=XXX&templateid=XXX
Can be used to create a large number of instances very quickly
www.shapeblue.com
51. Documentation
A word on documentation
www.shapeblue.com
52. Documentation
Dull, boring, tedious, slow – Crucial.
Write what you’re going to do
Follow what you wrote
Update it
With redundant servers; follow it again
With scripts ‘snapshot’ and start again
www.shapeblue.com
53. Any Questions ?
Paul Angus
paul.angus@shapeblue.com
Twitter: @ShapeBlue
www.shapeblue.com
www.shapeblue.com
End of day So we’ll start gentlyHopefully something for everyonePlease bear with me if seems obvious to you.Bear with my english accent and phrases/terminologyBasics and more advanced ideasPaul AngusEngineering and Science degreesCloudStack 2.13
Design Phase – some tips from experienceRedundancy & resilience – again some thoughts on building redundancy and resilience into the infrastructureAutomation – some examples of automation in the building of a cs architecture.Finanally a ‘word’ on documentation.
Storage, networking, overall architects technical and managerialEverything is interconnected and feels like everything relies on everything elseSomeone chipping in can be invaluable – particularly if they have past experience.
One that gets everyone:Switchsupports 4096 VLANs - but not at the same time.Gotchas…[add more]
Private clouds – you have your current usage to judgePublic clouds harder to predict – is guided by offerings.
Performance and / or capacityStorageNetworkNetwork (to storage) is often the limiting factor as jump to 10 Gbe is large(Although LACP in XenServer 6.1 and ESXi 5.1 will help to mitigate this)Not much point being able to run VMs per host if only 1Gb/s link Not much point to 256GB RAM with a single quad core processor unless a specific workload.
A few words on designing the infrastructure to maximise uptime.
I’ll look at the major CloudStack management elements – CSMan MySQLAnd then look at considerations if you’ve virtualised your management farm
CSMan internally, worth having a second management server as a ‘hot spare’Otherwise you’re going to need to load balance your connections to them.
Master / Slave is the ‘supported’ configuration, manual switchover not idealbut in a opensource environment anything goes.Some alternatives..
Example of active/active load balanced elements
Really cool setup – trader media group >autotraderThey can suffer the loss of an entire datacenterUserightscale to burst to amazon.
As well as what you have; ‘where’ you have it is importantRedundant pairs – DNS ServersWant anti-affinity (two MySQL servers)Want Affinity CSMan and MySQL Master
Similar to RAID 0In similar 2 hosts – if split the double the probability of loss of systemWLB / DRS rules or switch off WLB/DRS
Look at:Advantages of automationTools – from behemoth infrastructures to the simplest of toolsHost deployment, configuring management vms and configuration of cloudstack+ a couple of odds and ends
How do we achieve that…>
Aim to remove as much human error as possibleSame time speed deployment up.Running a script is also quicker than typing and far more repeatableKick a ‘load’ of scripts off at the same time
Automation can come in multiple formsChef & Puppet – enterprise grade automation – works for in-house use (required infrastructure makes it less useful for SIs)KickStart and Python – enables to learn one language and stick to it, requires the interpreter to be installed, but Python is Shell scripts don’t have to be fancy – have to learn awk & sed – have to learn the different languages.API calls
Simple example using BASH scripting.A management farm with a reasonable level of redundancy can easily have more than a dozen servers.The particular installation that this example is based on was a multi-tiered network with three interfaces on each vm plus static routes, but one of the networks I worked on had 7 tiers and used proxy servers to reach the internet-a lot of typing and to configure it all
We actually tend to combine these steps and create a VM template with these baked in.But essentially this is all we’d do
We have a single CSV with all the networking information.The actual one this is based on had 3 interfaces in each VM
Script itself:Ask for the hostname thenRead values from the csv usinggrep and awk based on hostname
Write theifcfg-ethx files, ntp and network files.
In this case there were routes which changed depending on which network the ‘secondary’ interface was connected to...takes out human error
Req: static IP and fdqnPure management server (no nfs or kvm)Separate scripts to add nfs and kvm(thanks to Wido who built the repo)
Again BASH scripting to build the server, however the configuring of hypervisors requires other scripting languagesInckickstart for ESXi
Use a management VM created by previous scriptRepeat with new script to configure the server
Write configuration file. Conscious decision to limit the number of files required.Self contained (requires hypervisor installation files)Look at some elements of the file >
After yum install of DHCP, suselinux and httpSee that script writes files rather than importing / downloading themAdds complexity in script because of escape characters
This section writes the default file for pxe bootingThis section is just shows the ESXi option XenServer or XCP as wellCould have a different script for each host, but then need to generate a new file for each host to tie it to its mac address.Simpler to add a line in the final CSV
Xenserver answer fileNote escape characters for quotes, but variables come from earlier in full script
CSV file for hosts
Note escape characters \\Weird stuff because of Xen XE command syntaxESXi has the ESXCli and vicfg commands
Xen updates are usually painful
In word or excel click on link in documentationImagine a spread sheet of the required storage with the final command built at the endWe don’t tend to fully automate this as ‘press-and-go’ because we want to keep an eye on what’s actually happeningThrough the GUI itself
Cheat for finding out what the cloudstackgui is actually up to
See the call in the to the API and the resulting responseCan we used to ‘see how the gui does it’
Example of global settings(still need to restart the management server)
Can retrieve information using the guiOtherwise only available through database
Example of deploying a virtual machine
Paste into browser and keep pressing refreshSpin up 150 hosts to stress test an environment
Take your pickOnly way to remember what you did,only way for others to replicateRun scripts from scratch impossible to update code and separately make changes