Download to read offline
Uploaded byNilesh Gule
Autoscaling containers with event driven workloads
The document provides an overview of autoscaling containers with event-driven workloads, particularly using Kubernetes and KEDA. It outlines prerequisites, scaling options, and a tech demo setup involving RabbitMQ for message consumption and producer services. Additionally, it highlights KEDA's capabilities as a lightweight component that extends Kubernetes with event-driven features and lists various supported auto scalers.
More Related Content
Similar to Autoscaling containers with event driven workloads
![[BDD 2025 - Artificial Intelligence] AI for the Underdogs: Innovation for Sma...](https://cdn.slidesharecdn.com/ss_thumbnails/ai-aifortheunderdogsinnovationforsmallbusinesses-251124030839-72a599a4-thumbnail.jpg?width=640&height=640&fit=bounds)
![[BDD 2025 - Full-Stack Development] The Modern Stack: Building Web & AI Appli...](https://cdn.slidesharecdn.com/ss_thumbnails/fs-themodernstackbuildingwebaiapplicationswithserverless-251124030844-388cf04f-thumbnail.jpg?width=640&height=640&fit=bounds)
Autoscaling containers with event driven workloads
- 1.
- 2. $whoami { “name” : “NileshGule”, “website” : “https://www.HandsOnArchitect.com", “github” : “https://GitHub.com/NileshGule" “twitter” : “@nileshgule”, “linkedin” : “https://www.linkedin.com/in/nileshgule”, “likes” : “Technical Evangelism, Cricket”, “co-organizer” : “Azure Singapore UG” } https://bit.ly/AzureSingaporeSessions
- 4. AGENDA ▸ Scaling optionswith Kubernetes ▸ KEDA overview ▸ TechTalks demo with RabbitMQ ▸ Autoscaling with KEDA ▸ KEDA Architecture 4
- 5. @nileshgule Pre-requisites Self contained applicationwith all its dependencies Docker Dockerhub / private container registry Repository for storing container images Container Registry Orchestrates containers Self healing Service discovery Scaling Kubernetes Managed Kubernetes service on Azure Native integration with other Azure services like Azure Active Directory (AAD), Azure Container registry (ACR), Azure Container Instances (ACI), Azure Monitor etc. Azure Kubernetes Service (AKS)
- 6. @nileshgule Kubernetes Scaling Options HorizontalPod Autoscaler (HPA) Cluster Autoscaler Manual scaling
- 7.
- 8. @nileshgule TechTalks Producer setup https://github.com/NileshGule/pd-tech-fest-2019 Techtalks producer .Net Core API 2 replicas Exposed as Kubernetes service using LoadBalancer
- 9. @nileshgule TechTalks Consumer setup https://github.com/NileshGule/pd-tech-fest-2019 Techtalks consumer .Net Core exe Not exposed outside Kubernetes cluster Consumes configured number of messages in a batch
- 10. @nileshgule RabbitMQ setup https://github.com/NileshGule/pd-tech-fest-2019 RabbitMQ deployedusing Helm chart Exposed as Kubernetes service
- 11. @nileshgule TechTalks Demo setup 1000 (configurable) messages Batchof 50 (configurable) messages https://github.com/NileshGule/pd-tech-fest-2019 rabbitmq-producer rabbitmq-consumers
- 12. @nileshgule TechTalks Demo –Kubernetes deployment https://github.com/NileshGule/pd-tech-fest-2019 Manifest files describe Deployment and Service Helm charts to deploy third-party apps / services Octant / Lens – visualize k8s cluster Kubectl to deploy Manifest Postman to generate workload rabbitmq-producer rabbitmq-consumer
- 13.
- 14.
- 15.
- 16.
- 17. @nileshgule How KEDA works? KEDAmoves from the CNCF Sandbox to become an incubating project | Cloud Native Computing Foundation
- 18. @nileshgule apiVersion: keda.k8s.io/v1alpha1 kind: ScaledObject metadata: name:rabbitmq-consumer-scaled-object namespace: default labels: deploymentName: rabbitmq-consumer-deployment spec: scaleTargetRef: deploymentName: rabbitmq-consumer pollingInterval: 5 # Optional. Default: 30 seconds minReplicaCount: 1 # Optional. Default: 0 maxReplicaCount: 30 # Optional. Default: 100 triggers: - type: rabbitmq metadata: queueName: hello queueLength : ‘5’ authenticationRef: name: trigger-auth-rabbitmq-host
- 19.
- 20.
- 21. Azure Blob Storage AzureEvent Hub Azure Log Analytics Azure Service Bus Queues and Topics Azure Storage Queues ActiveMQ Artemis Kafka Prometheus RabbitMQ Redis Streams Redis Lists Liiklus NATS Huawei Cloudeye AWS CloudWatch AWS Kinesis Stream AWS Simple Queue Service GCP PubSub MSSQL MySQL PostgreSQL Cassandra MongoDB Azure functions https://keda.sh/docs/2.5/scalers/
- 22. Summary Single purpose lightweightcomponent Any Kubernetes cluster (1.16+) Extends Kubernetes with event driven capabilities No overwriting or duplication of existing functionalities Maps an event source to Deployment, StatefulSet, Custom Resource or Job for scaling Flexible and safe to run alongside any other Kubernetes framework or application Support 45+ auto scalers out of the box 23
- 23.
- 24. @nileshgule Play with Docker Playwith Kubernetes Linux Academy learning paths
- 25. @nileshgule KEDA AKS cluster-autoscalar Horizontal podautoscale Knative docs OpenFaaS Apache OpenWhisk https://azure.microsoft.com/mediahandler/files/resourcefiles/kubernetes-learning- path/Kubernetes%20Learning%20Path%20version%201.0.pdf
- 26.
- 27.
- 28. Source Code &slide deck Tech Talks • https://github.com/NileshGule/pd-tech-fest-2019 • Azure Developer Community demo setup https://speakerdeck.com/nileshgule/ https://www.slideshare.net/nileshgule/
- 29. Nilesh Gule ARCHITECT |MICROSOFT MVP “Code with Passion and Strive for Excellence” nileshgule @nileshgule Nilesh Gule NileshGule www.handsonarchitect.com https://bit.ly/youtube-nileshgule
- 30.