SlideShare a Scribd company logo
1 of 13
AGL Solar Exchange
Enabling Kubernetes & Service Mesh
Who we are
Michael Stevenson
Digital Developer AGL Energy :
• Data Ingestion Pipeline for battery telemetry data
• DRED (Demand Response Enabled Device)
• Containerization of AGL Solar Exchange platform
2
AGL Solar Exchange – Peer To Peer (P2P)
Australian based technology consultancy
currently partnered with AGL to enable
container orchestration.
As one of Australia’s biggest energy
providers, we believe we can make the
biggest change.
Melchi Salins
Engineer :
• Cloud Platforms
• Containerization
• Microservices
What are we talking about today?
• What is AGL Solar Exchange
• Application Architecture
• Why Kubernetes?
• Key challenges faced
• Service Mesh
• Demo
Footer | Date (Format: X Month 2017) 3
AGL Solar Exchange – Peer To Peer (P2P)
What is AGL Solar Exchange
A new solar trading platform trial, designed to give Victorians a way to
• trade to save on their electricity bills
• help others save on theirs
• reward households who have gone solar
Users with a solar system can
• sell solar tokens on AGL Solar Exchange
Users without a solar system can participate by:
• buy solar tokens from a participating sellers to earn
potential savings on their AGL electricity bill
• or choose to reward others for going solar
4
AGL Solar Exchange – Peer To Peer (P2P)
Application Architecture
Multiuser containerised prototype application:
Containers: front end (angular), backend api’s (python), workers (python / go - cron / adhoc)
AWS:
EC2 Docker / RDS postgresql
django / python / go / angular / azure blob storage (via master / slave ingestion
app)
log stash / log spout / data dog / sentry.io
bastion hosts / vpn / terrafaorm / circle ci / git hub
Kubernetes:
services / pods / ingresses / jobs (cron / adhoc) / ssl termination / load balancers /
fluent bit
/ elastic search / helm
5
AGL Solar Exchange – Peer To Peer (P2P)
Why Kubernetes
• Disaster recovery – multi region deployment of Kubernetes cluster
• Scalability – cpu / memory / custom metrics
• Cloud Portability
– how realistic is this
– its possible with careful planning of application architecture
• AGL has a large Azure cloud footprint
– first step in the move back to Azure
• Evaluate containerisation technologies vs serverless and other current cloud architecture patters
6
AGL Solar Exchange – Peer To Peer (P2P)
Challenges faced
• Team was new to both Kubernetes / docker / and AWS covered a lot in a short period
• How we came up to speed
‘learn Kubernetes in 3 hours’ a life saver
Managed vs Unmanaged Kubernetes headache or amazing learning tool
Not having access to the managed service meant that we really had to get our hands dirty
• Debugging the application in Kubernetes
viewing logs from pods
bashing into a docker container, an invaluable skill
• Current application not written with Kubernetes in mind
• Challenges surrounding the tightly coupled nature of the existing application
• Strong focus is required round architecture patterns used in code deployed in containers 7
AGL Solar Exchange – Peer To Peer (P2P)
Consul Connect as a
Service Mesh
9Footer | September 2018)
What’s next?
• Services seldom live in isolation
• Security connectivity between applications is
paramount to any enterprise
• Transitioning into the cloud brings focus on
Services and not on Hosts
• Enabling cloud agnostic capability
10Footer | September 2018)
What to take into consideration
Battle
Tested
Kubernetes Security Light
weight &
easy to use
Enterprise Support Extensibility Multi Cloud Capability
11Footer | September 2018)
Consul
Consul is a distributed service mesh to
connect, secure, and configure services
across any runtime platform and public or
private cloud
Consul is a stable Enterprise ready Service
Mesh that
12Footer | September 2018)
Consul Native Support for Kubernetes
Kubernetes Service resources and
recognized and automatically imported
into Consul and is made available to
services not running in Kubernetes
Consul Connect automatically injects Envoy sidecar
to any Pod in an easy annotation driven manner.
Envoy is a feature rich & extremely performant
proxy
13Footer | September 2018)
Demo
https://www.youtube.com/watch?v=wzRU6FwXlG4

More Related Content

What's hot

Three Ways InfluxDB Enables You to Use Time Series Data Across Your Entire En...
Three Ways InfluxDB Enables You to Use Time Series Data Across Your Entire En...Three Ways InfluxDB Enables You to Use Time Series Data Across Your Entire En...
Three Ways InfluxDB Enables You to Use Time Series Data Across Your Entire En...
InfluxData
 
Tensorflow London 13: Barbara Fusinska 'Hassle Free, Scalable, Machine Learni...
Tensorflow London 13: Barbara Fusinska 'Hassle Free, Scalable, Machine Learni...Tensorflow London 13: Barbara Fusinska 'Hassle Free, Scalable, Machine Learni...
Tensorflow London 13: Barbara Fusinska 'Hassle Free, Scalable, Machine Learni...
Seldon
 

What's hot (20)

Three Ways InfluxDB Enables You to Use Time Series Data Across Your Entire En...
Three Ways InfluxDB Enables You to Use Time Series Data Across Your Entire En...Three Ways InfluxDB Enables You to Use Time Series Data Across Your Entire En...
Three Ways InfluxDB Enables You to Use Time Series Data Across Your Entire En...
 
Scality Holberton Interview Training
Scality Holberton Interview TrainingScality Holberton Interview Training
Scality Holberton Interview Training
 
Storage os kubernetes clusters need persistent data
Storage os   kubernetes clusters need persistent dataStorage os   kubernetes clusters need persistent data
Storage os kubernetes clusters need persistent data
 
stackconf 2021 | Stretching the Service Mesh Beyond the Clouds
stackconf 2021 | Stretching the Service Mesh Beyond the Cloudsstackconf 2021 | Stretching the Service Mesh Beyond the Clouds
stackconf 2021 | Stretching the Service Mesh Beyond the Clouds
 
AWS re:Invent 2016 - Scality's Open Source AWS S3 Server
AWS re:Invent 2016 - Scality's Open Source AWS S3 ServerAWS re:Invent 2016 - Scality's Open Source AWS S3 Server
AWS re:Invent 2016 - Scality's Open Source AWS S3 Server
 
Scality S3 Server: Node js Meetup Presentation
Scality S3 Server: Node js Meetup PresentationScality S3 Server: Node js Meetup Presentation
Scality S3 Server: Node js Meetup Presentation
 
Kublr for cloud and managed service providers
Kublr for cloud and managed service providersKublr for cloud and managed service providers
Kublr for cloud and managed service providers
 
Kubernetes on DC/OS
Kubernetes on DC/OSKubernetes on DC/OS
Kubernetes on DC/OS
 
The Future of Energy - Decentral energy distribution in a digital world
The Future of Energy - Decentral energy distribution in a digital worldThe Future of Energy - Decentral energy distribution in a digital world
The Future of Energy - Decentral energy distribution in a digital world
 
A quick introduction to AKS
A quick introduction to AKSA quick introduction to AKS
A quick introduction to AKS
 
Open Source Clouds: Be The Change...
Open Source Clouds: Be The Change...Open Source Clouds: Be The Change...
Open Source Clouds: Be The Change...
 
Tu non puoi passare! Policy compliance con OPA Gatekeeper | Niccolò Raspa
Tu non puoi passare! Policy compliance con OPA Gatekeeper | Niccolò RaspaTu non puoi passare! Policy compliance con OPA Gatekeeper | Niccolò Raspa
Tu non puoi passare! Policy compliance con OPA Gatekeeper | Niccolò Raspa
 
Deploy prometheus on kubernetes
Deploy prometheus on kubernetesDeploy prometheus on kubernetes
Deploy prometheus on kubernetes
 
Acd19 kubertes cluster at scale on aws at intuit
Acd19 kubertes cluster at scale on aws at intuitAcd19 kubertes cluster at scale on aws at intuit
Acd19 kubertes cluster at scale on aws at intuit
 
Rehosting apps between k8s clusters and automating deployment using crane c...
Rehosting apps between k8s clusters and automating deployment using crane   c...Rehosting apps between k8s clusters and automating deployment using crane   c...
Rehosting apps between k8s clusters and automating deployment using crane c...
 
KEDA Overview
KEDA OverviewKEDA Overview
KEDA Overview
 
The service mesh management plane
The service mesh management planeThe service mesh management plane
The service mesh management plane
 
How we manage thousands of clusters with minimal effort
How we manage thousands of clusters with minimal effortHow we manage thousands of clusters with minimal effort
How we manage thousands of clusters with minimal effort
 
Tensorflow London 13: Barbara Fusinska 'Hassle Free, Scalable, Machine Learni...
Tensorflow London 13: Barbara Fusinska 'Hassle Free, Scalable, Machine Learni...Tensorflow London 13: Barbara Fusinska 'Hassle Free, Scalable, Machine Learni...
Tensorflow London 13: Barbara Fusinska 'Hassle Free, Scalable, Machine Learni...
 
Building Modern Platforms on Microsoft Azure by Steef-Jan Wiggers
Building Modern Platforms on Microsoft Azure by Steef-Jan WiggersBuilding Modern Platforms on Microsoft Azure by Steef-Jan Wiggers
Building Modern Platforms on Microsoft Azure by Steef-Jan Wiggers
 

Similar to Consul connect

Similar to Consul connect (20)

Introduction of Kubernetes - Trang Nguyen
Introduction of Kubernetes - Trang NguyenIntroduction of Kubernetes - Trang Nguyen
Introduction of Kubernetes - Trang Nguyen
 
Kubernetes: https://youtu.be/KnjnQj-FvfQ
Kubernetes: https://youtu.be/KnjnQj-FvfQKubernetes: https://youtu.be/KnjnQj-FvfQ
Kubernetes: https://youtu.be/KnjnQj-FvfQ
 
Overcoming Regulatory & Compliance Hurdles with Hybrid Cloud EKS and Weave Gi...
Overcoming Regulatory & Compliance Hurdles with Hybrid Cloud EKS and Weave Gi...Overcoming Regulatory & Compliance Hurdles with Hybrid Cloud EKS and Weave Gi...
Overcoming Regulatory & Compliance Hurdles with Hybrid Cloud EKS and Weave Gi...
 
Modern big data and machine learning in the era of cloud, docker and kubernetes
Modern big data and machine learning in the era of cloud, docker and kubernetesModern big data and machine learning in the era of cloud, docker and kubernetes
Modern big data and machine learning in the era of cloud, docker and kubernetes
 
Making Cloud Native CI_CD Services.pdf
Making Cloud Native CI_CD Services.pdfMaking Cloud Native CI_CD Services.pdf
Making Cloud Native CI_CD Services.pdf
 
Running containers in production, the ING story
Running containers in production, the ING storyRunning containers in production, the ING story
Running containers in production, the ING story
 
Unlocking the Power of Cloud Native with kubernetes
Unlocking the Power of Cloud Native with kubernetesUnlocking the Power of Cloud Native with kubernetes
Unlocking the Power of Cloud Native with kubernetes
 
AWS in Practice
AWS in PracticeAWS in Practice
AWS in Practice
 
Power of Choice in Docker EE 2.0 - Anoop - Docker - CC18
Power of Choice in Docker EE 2.0 - Anoop - Docker - CC18Power of Choice in Docker EE 2.0 - Anoop - Docker - CC18
Power of Choice in Docker EE 2.0 - Anoop - Docker - CC18
 
Kubernetes Docker Container Implementation Ppt PowerPoint Presentation Slide ...
Kubernetes Docker Container Implementation Ppt PowerPoint Presentation Slide ...Kubernetes Docker Container Implementation Ppt PowerPoint Presentation Slide ...
Kubernetes Docker Container Implementation Ppt PowerPoint Presentation Slide ...
 
Kubernetes Community Growth and Use Case
Kubernetes Community Growth and Use CaseKubernetes Community Growth and Use Case
Kubernetes Community Growth and Use Case
 
Cloud computing benefits
Cloud computing benefitsCloud computing benefits
Cloud computing benefits
 
Driving Digital Transformation With Containers And Kubernetes Complete Deck
Driving Digital Transformation With Containers And Kubernetes Complete DeckDriving Digital Transformation With Containers And Kubernetes Complete Deck
Driving Digital Transformation With Containers And Kubernetes Complete Deck
 
Introduction to containers, k8s, Microservices & Cloud Native
Introduction to containers, k8s, Microservices & Cloud NativeIntroduction to containers, k8s, Microservices & Cloud Native
Introduction to containers, k8s, Microservices & Cloud Native
 
Microservices Architecture with AWS @ AnyMind Group
Microservices Architecture with AWS @ AnyMind GroupMicroservices Architecture with AWS @ AnyMind Group
Microservices Architecture with AWS @ AnyMind Group
 
AnyMind Group Tech Talk - Microservices architecture with AWS
AnyMind Group Tech Talk - Microservices architecture with AWSAnyMind Group Tech Talk - Microservices architecture with AWS
AnyMind Group Tech Talk - Microservices architecture with AWS
 
Self-Service Supercomputing
Self-Service SupercomputingSelf-Service Supercomputing
Self-Service Supercomputing
 
How Kubernetes helps Devops
How Kubernetes helps DevopsHow Kubernetes helps Devops
How Kubernetes helps Devops
 
Kubernetes is all you need
Kubernetes is all you needKubernetes is all you need
Kubernetes is all you need
 
Agile integration: Decomposing the monolith
Agile integration: Decomposing the monolithAgile integration: Decomposing the monolith
Agile integration: Decomposing the monolith
 

Recently uploaded

Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 

Recently uploaded (20)

The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsTop 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 

Consul connect

  • 1. AGL Solar Exchange Enabling Kubernetes & Service Mesh
  • 2. Who we are Michael Stevenson Digital Developer AGL Energy : • Data Ingestion Pipeline for battery telemetry data • DRED (Demand Response Enabled Device) • Containerization of AGL Solar Exchange platform 2 AGL Solar Exchange – Peer To Peer (P2P) Australian based technology consultancy currently partnered with AGL to enable container orchestration. As one of Australia’s biggest energy providers, we believe we can make the biggest change. Melchi Salins Engineer : • Cloud Platforms • Containerization • Microservices
  • 3. What are we talking about today? • What is AGL Solar Exchange • Application Architecture • Why Kubernetes? • Key challenges faced • Service Mesh • Demo Footer | Date (Format: X Month 2017) 3 AGL Solar Exchange – Peer To Peer (P2P)
  • 4. What is AGL Solar Exchange A new solar trading platform trial, designed to give Victorians a way to • trade to save on their electricity bills • help others save on theirs • reward households who have gone solar Users with a solar system can • sell solar tokens on AGL Solar Exchange Users without a solar system can participate by: • buy solar tokens from a participating sellers to earn potential savings on their AGL electricity bill • or choose to reward others for going solar 4 AGL Solar Exchange – Peer To Peer (P2P)
  • 5. Application Architecture Multiuser containerised prototype application: Containers: front end (angular), backend api’s (python), workers (python / go - cron / adhoc) AWS: EC2 Docker / RDS postgresql django / python / go / angular / azure blob storage (via master / slave ingestion app) log stash / log spout / data dog / sentry.io bastion hosts / vpn / terrafaorm / circle ci / git hub Kubernetes: services / pods / ingresses / jobs (cron / adhoc) / ssl termination / load balancers / fluent bit / elastic search / helm 5 AGL Solar Exchange – Peer To Peer (P2P)
  • 6. Why Kubernetes • Disaster recovery – multi region deployment of Kubernetes cluster • Scalability – cpu / memory / custom metrics • Cloud Portability – how realistic is this – its possible with careful planning of application architecture • AGL has a large Azure cloud footprint – first step in the move back to Azure • Evaluate containerisation technologies vs serverless and other current cloud architecture patters 6 AGL Solar Exchange – Peer To Peer (P2P)
  • 7. Challenges faced • Team was new to both Kubernetes / docker / and AWS covered a lot in a short period • How we came up to speed ‘learn Kubernetes in 3 hours’ a life saver Managed vs Unmanaged Kubernetes headache or amazing learning tool Not having access to the managed service meant that we really had to get our hands dirty • Debugging the application in Kubernetes viewing logs from pods bashing into a docker container, an invaluable skill • Current application not written with Kubernetes in mind • Challenges surrounding the tightly coupled nature of the existing application • Strong focus is required round architecture patterns used in code deployed in containers 7 AGL Solar Exchange – Peer To Peer (P2P)
  • 8. Consul Connect as a Service Mesh
  • 9. 9Footer | September 2018) What’s next? • Services seldom live in isolation • Security connectivity between applications is paramount to any enterprise • Transitioning into the cloud brings focus on Services and not on Hosts • Enabling cloud agnostic capability
  • 10. 10Footer | September 2018) What to take into consideration Battle Tested Kubernetes Security Light weight & easy to use Enterprise Support Extensibility Multi Cloud Capability
  • 11. 11Footer | September 2018) Consul Consul is a distributed service mesh to connect, secure, and configure services across any runtime platform and public or private cloud Consul is a stable Enterprise ready Service Mesh that
  • 12. 12Footer | September 2018) Consul Native Support for Kubernetes Kubernetes Service resources and recognized and automatically imported into Consul and is made available to services not running in Kubernetes Consul Connect automatically injects Envoy sidecar to any Pod in an easy annotation driven manner. Envoy is a feature rich & extremely performant proxy
  • 13. 13Footer | September 2018) Demo https://www.youtube.com/watch?v=wzRU6FwXlG4