SlideShare a Scribd company logo
1 of 28
Download to read offline
WEBINAR
Drive operational
efficiency through
cloud optimisation
Introduction
CLOUD OPTIMISATION
● Welcome
● Who we are
● What you will learn
○ How we approach cloud architecture and deployments
○ TCO and ROI considerations
○ 3 techniques for good cloud hygiene
○ 3 tips reducing your bill
How we approach cloud
architecture
CLOUD OPTIMISATION
Every project is different...
CLOUD OPTIMISATION
1 2 4 53
1 2 4 53
1 2 4 53
1 2 4 53
1 2 4 53
Project objectives / scope
Architecture
Time
Budget $$
Security
...
Problem (Start with the customer!)
● Understand the context
● What are the project objectives
Solution (Architecture)
● Operational excellence
● Security
● Reliability
● Performance efficiency
● Cost
Total cost of ownership
● Do we need to build for now or the future?
● How do we view the performance of existing investments?
Approach to cloud architecture
CLOUD OPTIMISATION
Start with the customer!
● Understand the context
● What are the project objectives
Architecture
● Operational excellence
● Security
● Reliability
● Performance efficiency
● Cost
Total cost of ownership
● Investment decisions: do we need to build for now or the future?
Approach to cloud architecture
CLOUD OPTIMISATION
Total Cost of Ownership (TCO)
CLOUD OPTIMISATION
Scenario
As a result of COVID-19, there has been an increase in demand for our signature fidget
spinner product and there is an opportunity to create a digital version.
Our innovation team has created a web-based product that allows school-aged
children to distract each other during recess, addressing a key pain point for parents
working from home.
Mission
Compare TCO of internal ECS platform build with a Beanstalk (PaaS) deployment to
release this new app to market.
Example TCO: Internal Platform v PaaS
CLOUD OPTIMISATION
Assumptions
● Cost of delay of $5k a week
● $1k per day engineer labour cost
● 5% monthly growth in usage
Model over 3 year investment period
Example TCO: Internal Platform v PaaS
CLOUD OPTIMISATION
Example TCO: Internal Platform v PaaS
CLOUD OPTIMISATION
Internal Platform
● 8 weeks to create an initial platform (2 developers)
● 2 days a month of maintenance (tuning, tools etc.)
● $500 monthly AWS bill (assume flat costs)
PaaS
● 1 week to setup initial platform (2 developers)
● ½ day a month of platform maintenance
● $1.5k monthly AWS bill
● 5% monthly growth in bill as new workloads
Example TCO: Internal Platform v PaaS
CLOUD OPTIMISATION
Lessons
CLOUD OPTIMISATION
● Operational economics vary significantly on key decisions
● Understanding CD3 and initial build costs
● Understand ongoing maintenance
Platforms often take years to yield a return on investment (ROI)
Fundamental techniques
For basic cloud hygiene
CLOUD OPTIMISATION
Landing zones are a way for customers
to rapidly set up a secure account
structure and workload environment
based on best practices, without
compromising on security and
governance.
CLOUD OPTIMISATION
#1 Setting up your landing zone
Source: https://aws.amazon.com/solutions/implementations/aws-landing-zone/
CLOUD OPTIMISATION
#2 Tagging resources
Tags are one of the key ways to
organise, group and manage resources
within your cloud environment.
Source: https://docs.aws.amazon.com/awsaccountbilling/latest/aboutv2/cost-alloc-tags.html
CLOUD OPTIMISATION
Why tag resources?
Cost Management
● Visibility
● Accountability
● Target costs and measure more effectively
Automation
● Prevent orphaned / unmanaged resources
● Automate common activities for resources
of certain types and tag
Security, Governance & Compliance
● Apply general security or other policies to
resources with
Source: https://docs.aws.amazon.com/awsaccountbilling/latest/aboutv2/cost-alloc-tags.html
Cost saving techniques
Reduce your bill now!
CLOUD OPTIMISATION
CLOUD OPTIMISATION
#3 Shutdown environments
when not in use
Non-prod environments often account
for the greater portion of cloud bills.
Save up to 70% of our cloud bill by
turning them off when not in use.
#3 Shut down non-prod environments
when not in use
CLOUD OPTIMISATION
Challenges
● Impact to development team
● It optimises in broad strokes, not
granular
● Load balancing groups!
● What time(zone) is the server in?
How to do it
● Tag your resources
● Schedule / on-demand shutdowns
● SlackOps
● On first build of the day
Tools
● https://github.com/srbartlett/ec2-blackout
● https://github.com/nib-health-funds/hamm
ertime
CLOUD OPTIMISATION
#4 Use spot instances
Cloud providers have a large capacity of
unused servers that are able to be used
at a fraction of their listed price.
Save up to 80% or 90% of your bill.
Source: https://cloud.google.com/preemptible-vms
Why it’s good
● Save up to 80 or 90% on cloud bills
How to do it
● Great for offline / non-critical
workloads
○ non-prod environments
○ Batch processing
○ Ad-hoc
#4 Use spot instances (cloud spare capacity)
CLOUD OPTIMISATION
Tools
● Autospotting
Challenges
● Workloads need to be carefully
selected
● Handling instance removal
CLOUD OPTIMISATION
#5 Terminate untagged resources
Resources that do not confirm to your tagging (or other) policies can be terminated
to prevent cost leaks.
Why it’s good
● Enforces good hygiene
● Enables compliance & governance
● Reduces accidental costs
How to do it
● Tagging
● Configuration policies
● Automation
#5 Terminate untagged resources
CLOUD OPTIMISATION
Challenges
● Production 😱!
● Communicating to teams
CLOUD OPTIMISATION
#6 Automate with Infrastructure as Code (IaC)
DevOps practices such as continuous
integration (CI) and IaC ensures you get
the most out of your cloud optimisation
efforts.
Why it’s good
● Faster
● Safer
● Reliable
How to do it
● Tools:
○ Cloudformation
○ Terraform
○ Ansible/Puppet/Chef
○ Lots!
#6 Automate with Infrastructure as Code
CLOUD OPTIMISATION
Levels of maturity
● ClickOps
● CLI/API instead of console
● Scripts
● IaC tools
● Source control
● Only run it in a pipeline
Recap
CLOUD OPTIMISATION
Summary
CLOUD OPTIMISATION
● Cloud architecture and best practices is contextual
● Think about your TCO
● Landing Zone and Tagging (form the basis)
● Cost techniques
○ Shutdown environments
○ Use spot instances
○ Terminate non-conforming resources
● Use DevOps practices such as IaC
dius.com.au
Thank you!
dius.tech/slack
w. dius.com.au/blog
e. info@dius.com.au

More Related Content

More from DiUS

More from DiUS (15)

GameDay - Achieving resilience through Chaos Engineering
GameDay - Achieving resilience through Chaos EngineeringGameDay - Achieving resilience through Chaos Engineering
GameDay - Achieving resilience through Chaos Engineering
 
The case for consumer-driven contracts
The case for consumer-driven contractsThe case for consumer-driven contracts
The case for consumer-driven contracts
 
Deploy with Confidence using Pact Go!
Deploy with Confidence using Pact Go!Deploy with Confidence using Pact Go!
Deploy with Confidence using Pact Go!
 
Crafting Quality Software
Crafting Quality SoftwareCrafting Quality Software
Crafting Quality Software
 
Metrics on the front, data in the back
Metrics on the front, data in the backMetrics on the front, data in the back
Metrics on the front, data in the back
 
Antifragility and testing for distributed systems failure
Antifragility and testing for distributed systems failureAntifragility and testing for distributed systems failure
Antifragility and testing for distributed systems failure
 
DIY IoT Backend
DIY IoT BackendDIY IoT Backend
DIY IoT Backend
 
How to Build Hardware Lean
How to Build Hardware LeanHow to Build Hardware Lean
How to Build Hardware Lean
 
Behaviour Change and Coaching: What we can learn from BJ Fogg
Behaviour Change and Coaching: What we can learn from BJ FoggBehaviour Change and Coaching: What we can learn from BJ Fogg
Behaviour Change and Coaching: What we can learn from BJ Fogg
 
Power in Agile Teams
Power in Agile Teams Power in Agile Teams
Power in Agile Teams
 
The Diversity Dilemma: Attracting and Retaining Talented Women in Technology-...
The Diversity Dilemma: Attracting and Retaining Talented Women in Technology-...The Diversity Dilemma: Attracting and Retaining Talented Women in Technology-...
The Diversity Dilemma: Attracting and Retaining Talented Women in Technology-...
 
Rise of the machines: Continuous Delivery at SEEK - YOW! Night Summary Slides
Rise of the machines: Continuous Delivery at SEEK - YOW! Night Summary SlidesRise of the machines: Continuous Delivery at SEEK - YOW! Night Summary Slides
Rise of the machines: Continuous Delivery at SEEK - YOW! Night Summary Slides
 
AWS Summit Melbourne 2014 | The Path to Business Agility for Vodafone: How Am...
AWS Summit Melbourne 2014 | The Path to Business Agility for Vodafone: How Am...AWS Summit Melbourne 2014 | The Path to Business Agility for Vodafone: How Am...
AWS Summit Melbourne 2014 | The Path to Business Agility for Vodafone: How Am...
 
Agile Australia 2014 | A light saber for your disruptive tool belt: the Busin...
Agile Australia 2014 | A light saber for your disruptive tool belt: the Busin...Agile Australia 2014 | A light saber for your disruptive tool belt: the Busin...
Agile Australia 2014 | A light saber for your disruptive tool belt: the Busin...
 
Agile Australia 2014 | UX: How to measure more than a gut feel by Amir Ansari
Agile Australia 2014 | UX: How to measure more than a gut feel by Amir AnsariAgile Australia 2014 | UX: How to measure more than a gut feel by Amir Ansari
Agile Australia 2014 | UX: How to measure more than a gut feel by Amir Ansari
 

Recently uploaded

Structuring Teams and Portfolios for Success
Structuring Teams and Portfolios for SuccessStructuring Teams and Portfolios for Success
Structuring Teams and Portfolios for Success
UXDXConf
 

Recently uploaded (20)

Google I/O Extended 2024 Warsaw
Google I/O Extended 2024 WarsawGoogle I/O Extended 2024 Warsaw
Google I/O Extended 2024 Warsaw
 
Strategic AI Integration in Engineering Teams
Strategic AI Integration in Engineering TeamsStrategic AI Integration in Engineering Teams
Strategic AI Integration in Engineering Teams
 
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdfIntroduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
Introduction to FDO and How It works Applications _ Richard at FIDO Alliance.pdf
 
Powerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara LaskowskaPowerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara Laskowska
 
Optimizing NoSQL Performance Through Observability
Optimizing NoSQL Performance Through ObservabilityOptimizing NoSQL Performance Through Observability
Optimizing NoSQL Performance Through Observability
 
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
Choosing the Right FDO Deployment Model for Your Application _ Geoffrey at In...
 
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptxUnpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
 
Top 10 Symfony Development Companies 2024
Top 10 Symfony Development Companies 2024Top 10 Symfony Development Companies 2024
Top 10 Symfony Development Companies 2024
 
Structuring Teams and Portfolios for Success
Structuring Teams and Portfolios for SuccessStructuring Teams and Portfolios for Success
Structuring Teams and Portfolios for Success
 
Syngulon - Selection technology May 2024.pdf
Syngulon - Selection technology May 2024.pdfSyngulon - Selection technology May 2024.pdf
Syngulon - Selection technology May 2024.pdf
 
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
Measures in SQL (a talk at SF Distributed Systems meetup, 2024-05-22)
 
ECS 2024 Teams Premium - Pretty Secure
ECS 2024   Teams Premium - Pretty SecureECS 2024   Teams Premium - Pretty Secure
ECS 2024 Teams Premium - Pretty Secure
 
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...
TEST BANK For, Information Technology Project Management 9th Edition Kathy Sc...
 
Demystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John StaveleyDemystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John Staveley
 
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdfLinux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
 
A Business-Centric Approach to Design System Strategy
A Business-Centric Approach to Design System StrategyA Business-Centric Approach to Design System Strategy
A Business-Centric Approach to Design System Strategy
 
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
Secure Zero Touch enabled Edge compute with Dell NativeEdge via FDO _ Brad at...
 
10 Differences between Sales Cloud and CPQ, Blanka Doktorová
10 Differences between Sales Cloud and CPQ, Blanka Doktorová10 Differences between Sales Cloud and CPQ, Blanka Doktorová
10 Differences between Sales Cloud and CPQ, Blanka Doktorová
 
AI revolution and Salesforce, Jiří Karpíšek
AI revolution and Salesforce, Jiří KarpíšekAI revolution and Salesforce, Jiří Karpíšek
AI revolution and Salesforce, Jiří Karpíšek
 
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...
FDO for Camera, Sensor and Networking Device – Commercial Solutions from VinC...
 

Drive operational efficiency through cloud optimisation

  • 2. Introduction CLOUD OPTIMISATION ● Welcome ● Who we are ● What you will learn ○ How we approach cloud architecture and deployments ○ TCO and ROI considerations ○ 3 techniques for good cloud hygiene ○ 3 tips reducing your bill
  • 3. How we approach cloud architecture CLOUD OPTIMISATION
  • 4. Every project is different... CLOUD OPTIMISATION 1 2 4 53 1 2 4 53 1 2 4 53 1 2 4 53 1 2 4 53 Project objectives / scope Architecture Time Budget $$ Security ...
  • 5. Problem (Start with the customer!) ● Understand the context ● What are the project objectives Solution (Architecture) ● Operational excellence ● Security ● Reliability ● Performance efficiency ● Cost Total cost of ownership ● Do we need to build for now or the future? ● How do we view the performance of existing investments? Approach to cloud architecture CLOUD OPTIMISATION
  • 6. Start with the customer! ● Understand the context ● What are the project objectives Architecture ● Operational excellence ● Security ● Reliability ● Performance efficiency ● Cost Total cost of ownership ● Investment decisions: do we need to build for now or the future? Approach to cloud architecture CLOUD OPTIMISATION
  • 7. Total Cost of Ownership (TCO) CLOUD OPTIMISATION
  • 8. Scenario As a result of COVID-19, there has been an increase in demand for our signature fidget spinner product and there is an opportunity to create a digital version. Our innovation team has created a web-based product that allows school-aged children to distract each other during recess, addressing a key pain point for parents working from home. Mission Compare TCO of internal ECS platform build with a Beanstalk (PaaS) deployment to release this new app to market. Example TCO: Internal Platform v PaaS CLOUD OPTIMISATION
  • 9. Assumptions ● Cost of delay of $5k a week ● $1k per day engineer labour cost ● 5% monthly growth in usage Model over 3 year investment period Example TCO: Internal Platform v PaaS CLOUD OPTIMISATION
  • 10. Example TCO: Internal Platform v PaaS CLOUD OPTIMISATION Internal Platform ● 8 weeks to create an initial platform (2 developers) ● 2 days a month of maintenance (tuning, tools etc.) ● $500 monthly AWS bill (assume flat costs) PaaS ● 1 week to setup initial platform (2 developers) ● ½ day a month of platform maintenance ● $1.5k monthly AWS bill ● 5% monthly growth in bill as new workloads
  • 11. Example TCO: Internal Platform v PaaS CLOUD OPTIMISATION
  • 12. Lessons CLOUD OPTIMISATION ● Operational economics vary significantly on key decisions ● Understanding CD3 and initial build costs ● Understand ongoing maintenance Platforms often take years to yield a return on investment (ROI)
  • 13. Fundamental techniques For basic cloud hygiene CLOUD OPTIMISATION
  • 14. Landing zones are a way for customers to rapidly set up a secure account structure and workload environment based on best practices, without compromising on security and governance. CLOUD OPTIMISATION #1 Setting up your landing zone Source: https://aws.amazon.com/solutions/implementations/aws-landing-zone/
  • 15. CLOUD OPTIMISATION #2 Tagging resources Tags are one of the key ways to organise, group and manage resources within your cloud environment. Source: https://docs.aws.amazon.com/awsaccountbilling/latest/aboutv2/cost-alloc-tags.html
  • 16. CLOUD OPTIMISATION Why tag resources? Cost Management ● Visibility ● Accountability ● Target costs and measure more effectively Automation ● Prevent orphaned / unmanaged resources ● Automate common activities for resources of certain types and tag Security, Governance & Compliance ● Apply general security or other policies to resources with Source: https://docs.aws.amazon.com/awsaccountbilling/latest/aboutv2/cost-alloc-tags.html
  • 17. Cost saving techniques Reduce your bill now! CLOUD OPTIMISATION
  • 18. CLOUD OPTIMISATION #3 Shutdown environments when not in use Non-prod environments often account for the greater portion of cloud bills. Save up to 70% of our cloud bill by turning them off when not in use.
  • 19. #3 Shut down non-prod environments when not in use CLOUD OPTIMISATION Challenges ● Impact to development team ● It optimises in broad strokes, not granular ● Load balancing groups! ● What time(zone) is the server in? How to do it ● Tag your resources ● Schedule / on-demand shutdowns ● SlackOps ● On first build of the day Tools ● https://github.com/srbartlett/ec2-blackout ● https://github.com/nib-health-funds/hamm ertime
  • 20. CLOUD OPTIMISATION #4 Use spot instances Cloud providers have a large capacity of unused servers that are able to be used at a fraction of their listed price. Save up to 80% or 90% of your bill. Source: https://cloud.google.com/preemptible-vms
  • 21. Why it’s good ● Save up to 80 or 90% on cloud bills How to do it ● Great for offline / non-critical workloads ○ non-prod environments ○ Batch processing ○ Ad-hoc #4 Use spot instances (cloud spare capacity) CLOUD OPTIMISATION Tools ● Autospotting Challenges ● Workloads need to be carefully selected ● Handling instance removal
  • 22. CLOUD OPTIMISATION #5 Terminate untagged resources Resources that do not confirm to your tagging (or other) policies can be terminated to prevent cost leaks.
  • 23. Why it’s good ● Enforces good hygiene ● Enables compliance & governance ● Reduces accidental costs How to do it ● Tagging ● Configuration policies ● Automation #5 Terminate untagged resources CLOUD OPTIMISATION Challenges ● Production 😱! ● Communicating to teams
  • 24. CLOUD OPTIMISATION #6 Automate with Infrastructure as Code (IaC) DevOps practices such as continuous integration (CI) and IaC ensures you get the most out of your cloud optimisation efforts.
  • 25. Why it’s good ● Faster ● Safer ● Reliable How to do it ● Tools: ○ Cloudformation ○ Terraform ○ Ansible/Puppet/Chef ○ Lots! #6 Automate with Infrastructure as Code CLOUD OPTIMISATION Levels of maturity ● ClickOps ● CLI/API instead of console ● Scripts ● IaC tools ● Source control ● Only run it in a pipeline
  • 27. Summary CLOUD OPTIMISATION ● Cloud architecture and best practices is contextual ● Think about your TCO ● Landing Zone and Tagging (form the basis) ● Cost techniques ○ Shutdown environments ○ Use spot instances ○ Terminate non-conforming resources ● Use DevOps practices such as IaC