Download as PDF, PPTX
Uploaded byShapeBlue
What’s New and What’s Upcoming in Apache CloudStack, Giles Sirett, ShapeBlue
The document outlines the recent and upcoming features of Apache CloudStack, detailing new releases such as version 4.19 with 315 improvements and an upcoming 4.20 version with multi-architecture support and various enhancements. Key features include VMware to KVM migration, Distributed Resource Scheduler (DRS), VNF appliance support, and cloud object storage. Additionally, the 4.20 release is set to introduce features like shared filesystems, VMware NSX support, and dynamic/static routing capabilities.
More Related Content
Similar to What’s New and What’s Upcoming in Apache CloudStack, Giles Sirett, ShapeBlue
What’s New and What’s Upcoming in Apache CloudStack, Giles Sirett, ShapeBlue
- 1. Apache CloudStack What's Newand What's Upcoming in Apache CloudStack Giles Sirett
- 2. Who am I •PMC Member & committer Apache CloudStack • Chair & Founder, CloudStack European User Group • CEO & Founder, ShapeBlue • Physicist, recovering software engineer, sailor, hiker
- 3. 2024 Recent Releases ReleaseInformation Release Date/ 2024 Type 4.19.0.0 2 February LTS 4.19.0.1 4 April Security 4.18.1.1 4 April Security 4.18.2.0 25 April Maintenance 4.18.2.1 5 July Security 4.19.0.2 5 July Security 4.18.2.2 19 July Security 4.19.1.0 19 July Maintenance 4.18.2.3 Aug 6 Security 4.19.1.1 Aug 6 Security 4.20.0.0 In code freeze LTS
- 4. Apache CloudStack 4.19 ReleaseInformation • Released 2 Feb 2024 • 315 new features, improvements and bug fixes • 26 new features • 4.19 is an LTS release • EOL. Aug 2025
- 5. VMware to KVMMigration
- 6. Apache CloudStack 4.19 VMwareto KVM Migration
- 7. Apache CloudStack 4.19 VMwareto KVM Migration • Converts VMware Instances, including disks, networks and configurations to KVM • Admin only feature • Can migrate • existing CloudStack VMware Instances • VMware VMs from an external vCenter Datacenter • Uses virt-v2v to convert the Instance disks • Migration of Linux Instances can be performed when running • For Windows, the Instances need to be stopped • Scalability/performance improvements in 4.19.1
- 8. Apache CloudStack 4.19 VMwareto KVM Migration Destination KVM Hosts Linux Distribution Supported Versions Alma Linux 8, 9 Red Hat Enterprise Linux 8, 9 Rocky Linux 8, 9 Ubuntu 22.04 LTS Destination Host limitations: • For Ubuntu Hosts only: When installing virt-v2v, it does not install nbdkit which is required in the conversion of VMWare vCenter guests: • apt install nbdkit • For Windows Guest Only: Importing Windows Guest VMs from vSphere requires installing the virtio drivers on the hypervisor hosts for the virt-v2v conversion: • dnf install virtio-win (RHEL) • apt install virtio-win (Ubuntu)
- 9.
- 10. Apache CloudStack 4.19 KVMImport • Import external KVM Instances from: • Remote KVM host • QCOW2 from Shared or Local Storage • Unmanaged Instances on KVM/CloudStack hosts • Simple UI • Likely to be used as batch tool (API/ Cloudmonkey) • Allows the use of CloudStack as a KVM management layer
- 11.
- 12.
- 13. • DRS automaticallymoves Instances between Hosts • Can be set globally or per Cluster basis • Hypervisor agnostic • Supports two algorithms: Balanced & Condensed Apache CloudStack 4.19 CloudStack DRS
- 14. Apache CloudStack 4.19 CloudStackDRS Balanced Algorithm • Balances the load across hosts in a cluster • Higher power consumption • In case of a host failure, minimal impact on running Instances • Ideal for production environments • Less likely to cause contention issues
- 15. Apache CloudStack 4.19 CloudStackDRS Condensed Algorithm • Reduces the number of hosts in use • Lower power consumption • In case of a host failure, likely greater impact on running Instances • Ideal for staging/testing environments • More likely to cause contention issues
- 16.
- 17.
- 18. Apache CloudStack 4.19 VNFAppliance Support Classic Network Appliance Network Function Virtualization CDN WAN Acceleration Firewall Load Balancing IDS/IPS VoIP VPN Router Fragmented non-commodity hardware Physical installation and setup per site Constrain Innovation and Evolution High Capex/Opex VNF VNF VNF VNF Software Functions Standard Servers and Switches Network Function Provided in Software (VNFs) Vendor agnostic Run on Standard Hardware and Switches Opex/Capex Saving and Better Time-to-Market Opportunity for CSP’s
- 19. CloudStack VNF ApplianceSupport Use Cases • CSP’s selling “branded” network components • SD WAN • Load Balancing for High Availability • Virtual Firewalls for Enhanced Security • WAN Optimization for Improved Network Performance • IDS/IPS for Intrusion Detection and Prevention • VoIP and VPN for Secure Communications
- 20. Apache CloudStack 4.19 VNFAppliance Support • Allows users to deploy and configure 3rd party VNF appliances in their CloudStack environment • Configures required network interfaces • Configures network rules for access to the Appliance admin console • Based on VNF Templates created by admin • Usage recorded for billing by CSP • Support API and UI Set up and Deployment
- 21. Apache CloudStack 4.19 VNFAppliances Support Template NIC Management • Management • WAN • LANs Template VNF Details Used to add firewall rules and display VNF details to the Users: • User credentials • Service port and protocol • Vendor and Maintainer • VNF Version • Others
- 22.
- 23. Apache CloudStack 4.19 CloudStackObject Storage Object Store Provider MinIO CEPH CloudStack Object Storage Framework CloudStack UI/API
- 24. Apache CloudStack 4.19 CloudStackObject Store • Object storage framework • Currently provider for MIN.IO, Ceph in progress, simulator for testing • UI browser for managing the data. • Admin specifies the object storage provider(s) • The underlying object-storage provider is responsible for flexible storage management, multi-site replication, security, and backup • Supports features: bucket quota, encryption, versioning, object lock and bucket policy (public, private)
- 25. Apache CloudStack 4.19 CloudStackObject Store
- 26.
- 27. Apache CloudStack 4.19 CloudStackSnapshot Copy Recuring Snapshot Copying existing Snapshot Creating new Snapshot
- 28.
- 29. • Schedule basedrunning of routine Instance tasks • Start • Stop • Reboot • An Instance can have multiple schedules Apache CloudStack 4.19 Scheduled Instance Lifecycle Operations
- 30.
- 31. Apache CloudStack 4.19 OAuth2Authentication • OAuth2 framework • Currently plugins for Currently Google and GitHub • Easy to configure
- 32. Apache CloudStack 4.19 Notcovered today • Configurable SNAT IP for VR • Granular Storage Management • Safe ACS Shutdown Feature • Dashboard redesign for non-root accounts and projects • CAPC aware CKS • support for vSphere 8.0.0 • Domain migration (Move sum domains between domains) • HPE Primera, Pure Flasharray Support • Dynamic secondary storage selection • KVM Host HA for StorPool
- 33. Apache CloudStack 4.19 Resources •Source release • https://cloudstack.apache.org/downloads/ • Documentation • https://docs.cloudstack.apache.org/en/4.19.0.0/ • Convenience Packages • https://download.cloudstack.org/ • https://www.shapeblue.com/cloudstack-packages/ • Contribute • https://github.com/apache/cloudstack
- 34. Apache CloudStack 4.20 ReleaseInformation • Code freeze 10/9/2024 • 4.20.0 release expected October 2024 • LTS release • EOL c. April 2026 • My count: 31 new features
- 35. ARM64 Support andMulti Architecture Zones
- 36. • When creatingan Instance, Users can now choose between x86_64 and ARM64 Architectures • Architecture type is specified when creating: • Templates • ISO’s • Kubernetes Versions • CloudStack Clusters now have an assigned Architecture type • A zone can support both types simultaneously Apache CloudStack 4.20 ARM64 Support and Multi Architecture Zones
- 37. Apache CloudStack 4.20 ARM64Support and Multi Architecture Zones
- 38.
- 39. • Users cancreate a file share for consumption in other Instances (think EFS) • CloudStack orchestrates the creation of an underlying Instance, volume, etc. Apache CloudStack 4.20 Shared FileSystems
- 40. • Framework architectureallows use of any file share provider. Currently provider for NFS (XFX or EXT4) hosted on CloudStack Instance • Users Userdata/ udev to deploy/manage Fileshare provider • FileSystem object give access & mount information • 11 New API’s, including: • CreateFileShare • ListFileShare Apache CloudStack 4.20 Shared FileSystems
- 41.
- 42. • New NetworkElement plugin (similar to plugin for Tungsten Fabric) for NSX 4 • Configured at Zone level (isolation method) • Offloads network operations from VR to NSX: Apache CloudStack 4.20 Vmware NSX Support
- 43. • Virtual PrivateClouds (VPCs), • Isolated Networks • Kubernetes Service • Supports: • Routing between VPC network tiers (NSX segments) • Access Lists (ACLs) between VPC tiers and "public" network (TCP, UDP, ICMP) both as global egress rules and “public” IP specific ingress rules. • ACLs between VPC network tiers (TCP, UDP, ICMP) • Port Forwarding between “public” networks and VPC network tiers • External load balancing – between VPCs network tiers and “public” networks • Internal load balancing – between VPC network tiers • Password injection, UserData and SSH Keys • External, Internal DNS • DHCP • Kubernetes host orchestration (with limited support for CKS on VPCs) Apache CloudStack 4.20 Vmware NSX Support
- 44.
- 45. • Management Interfacefor CloudStack Usage Service • Allows: • Search/Browse of usage data • Usage generation • Purge • Export Apache CloudStack 4.20 Usage Management UI
- 46.
- 47. • Allows usersto consume CloudStack events • Use-cases: • notifications • data synchronization • workflow automation • custom integrations • real-time data processing Apache CloudStack 4.20 CloudStack Webhooks
- 48. Apache CloudStack 4.20 CloudStackWebhooks • Admin accounts can choose scope • No event further filtering at this stage • Requires the parser to select the right events
- 49. Implicit hardware basedHost tags
- 50. • Host tagsnow automatically populated by agent.properties file • Agent properties file can be created during physical host deployment (via Ansible,etc) • Can be used for • Different Hardware types • GPU, • gpu type, • SSD, • raid type • network card type • Different workloads • cpu-intensive application, • memory-intensive application, • windows Instances Apache CloudStack 4.20 Implicit hardware based Host tags
- 51. • Explicit tags:The host tags managed by CloudStack API/UI • Implicit tags: The host tags managed by agent.properties • How-to: add to agent.properties, restart cloudstack-agent host.tags=cpu-32,memory- 250,gpu-type,nvme-ssd Apache CloudStack 4.20 Implicit hardware based Host tags
- 52.
- 53. • Extensible limitsbased on tagging for Compute & Storage Service Offerings • Can be User, Account, domain level • Configured with 2 global settings • Then tags added to Service Offerings Apache CloudStack 4.20 Granular Resource limits
- 54. Apache CloudStack 4.20 GranularResource limits • New “Tagged Limits” then appear at Account, Domain or Global levels
- 55.
- 56. • Backup andRecovery Framework • Simple NAS based Backup provider (in addition to Veeam, Dell and Backroll) • Object Storage Framework • CEPH RGW Provider (in addition to Min.IO) Apache CloudStack 4.20 New Framework providers
- 57. Dynamic & Staticrouting
- 58. Shared networks • VMsuse direct IPs (public or internal) • Operators configure gateway on upstream router • Can only added by ROOT admin • VR provides Dhcp/Dns/Userdata Isolated networks and VPC • Can be created by regular users. • VMs use private IPs. VMs are not directly accessible • VMs can be accessed via Static NAT, LB, PF, VPN, etc • VR as Source NAT gateway (performance !) Apache CloudStack 4.20 Dynamic & static routing
- 59. ROUTED isolated networkand ROUTED VPC: • Can be created by regular users. • VMs are directly accessible • DNAT/Lb/PF/VPN are not needed • VR as gateway (not Source NAT!) • Low overload • High throughput (2-2.5X gain) Apache CloudStack 4.20 Dynamic & static routing
- 60. • Challenge: Gateway(upstream router) and CloudStack VR must know how to forward the packets • from VMs to outside • from outside to VMs Routing mode What operators need to do Static Operators have to add routes for each network manually in gateway (upstream router) Dynamic Operators configure dynamic BGP in gateway (upstream router) The routes will be automatically advertised to routers (upstream and virtual) via BGP Apache CloudStack 4.20 Dynamic & static routing
- 61. Apache CloudStack 4.20 Dynamic& static routing
- 62. Apache CloudStack 4.20 Dynamic& static routing
- 63. Apache CloudStack 4.20 Dynamic& static routing
- 64.