SlideShare a Scribd company logo
1 of 25
Download to read offline
Cloud Cost Optimization
#whoami: yogesh sharma
• Cloud Architect @ Tata Consultancy
Services
• Overall 10+ years of experience, 5+ years
of experience in Cloud, DevOps
• ML and Data Enthusiast
• AWS Community Builder Program
(First Batch)
• 3x AWS Certifications
• Technical Speaker and Blogger
• Owner of https://multicloudwarrior.com/
https://www.linkedin.com/in/sharma-yogesh/
What to expect
• Cloud Cost Optimization- What, Why
• Pillars for Cost Optimization
• Cost Optimization Process
• Checklist
• Latest Trends
• Q&A
We all love Cloud and its Services…
AWS is for builders
You build it,
You run it,
You optimize it
But are we fully aware about Cloud Financials
Are we spending too much on unnecessary
stuff knowingly/unknowingly?
Pay for what you use
But how would you ensure that you pay
what you actually need?
Bill Formula:
Spend = Usage * Rate
Cloud Cost Optimization
Managing costs is a challenge for organizations using public cloud
services but also an opportunity to drive efficient consumption of IT.
Pillars for Cost Optimization
Pillars for Cost Optimization
Right-sizing Elasticity Pricing Models
Storage Classes Measure and Mechanisms Designing for Cost
Right-sizing
m4.4xlarge
$1.72 per hour
1. Provision 2. Check Metrics
(CPU, RAM, Network)
4. Review Performance 5. Save
m4.large
$0.215 per
hour
3. Right-Size
86%
Saving
Elasticity
• Scale up and down to meet
capacity requirements
based upon CPU, RAM,
network etc.
• Automatically turn
nonproduction off outside
of working hoursThink about:
•AWS Auto Scaling and EC2 Fleet
•AWS Instance Scheduler
•AWS CloudWatch
Auto-scalingpolicies
Pricing Models
On- Demand
Pay-for-compute capacity
by the second with no
long-term commitments
Savings Plans & Reserved
Instances
Make a commitment and receive a
significant discount off compute
Spot Instances
Spare AWS EC2 Capacity at
saving up to 90%
off On-Demand prices
Spiky workloads to
Define needs
Committed &
steady-state usage
Fault-tolerant, flexible,
stateless workloads
If your bid > spot price  get an instance
If your bid < spot price  instance is terminated
Storage Classes
Amazon S3 Amazon GlacierInfrequent Access
HOT WARM COLD
Provisioned IOPS
SSD (io1)
General Purpose
SSD (gp2)
Throughput Optimized
HDD (st1)
Cold HDD (io1)
Measure and Mechanisms
Designing for Cost
Consolidated Billing
Using AWS Organization
Go Serverless Unused Elastic IPs
ContainerizationCloudFront Managed RDS
Cost Optimization Process
Cost Optimization Process
Biggest Strength- Architecture Flexibility
Main goal- Avoid unnecessary stuff
Unnecessary
Resources
Idling
Resources
Repetitive
Work
Measure: Monitor your workloads
Set up metrics to defines success and track progress
“What KPI makes sense for this workload?”
% Instances turned off daily
%instances right sized
%RI Utilization
Monitor AWS Resources Set Alarms Monitor Custom Metrics
View Graphs and Statistics Monitor & React to
Resource Changes
Measure- AWS Billing/Cost Dashboard
• Use AWS Billing and Cost
Management Dashboard
• Set up your monthly AWS
budget
• Dive deep with AWS Cost
Explorer
Also checkout-
https://calculator.s3.amazonaws.com/index.html
https://calculator.aws/
https://aws.amazon.com/economics/
Measure: Cost Explorer
Use Cost Explorer Personalized
Recommendations and decide to go with
Reserved Instances Category-
Standard, Convertible and Scheduled RIs
Architecture- Using AWS Organizations
Consolidated Billing
Consolidated Billingalso enables various
discounts- like Volume discounts
Architecture- Establish Tagging Strategy
Using tags to establish visibility & chargebacks
What’s in a Tag
Resource Allocation
Search, filter & categorize
Cost Allocation
Reports & chargebacks
Automation
Autoscaling & Scheduling
Control & Compliance
Restricted resource access
through IAM
Checklist
• Turn off unused instances- Use instance start and stop
• Delete unused/orphan volumes
• Stop paying for Idle EC2 and RDS instances and Redshift Clusters
• Understand and forecast your costs using AWS Cost Explorer and AWS Budget
• Use consolidated billing to avail volume discount across accounts
• Turn on/off whole architecture setups Using AWS CloudFormation, Terraform
• Automate Everything- Automate your instance start/stop cycle
• Choose EC2 Spot Instances
• Use Compute Savings Plan
• Use Reserved Instances
• Embrace latest trends and learn from Industry
– Adopt Micro-service architecture
– Modernize applications to make use of provider managed services when these are more cost-
effective.
– Consider Serverless architecture- no idle capacity
– Adopt Containerization
• Containers with EC2-Spot, Fargate with Spot
– Enable S3-Intelligent Tiering- Apply Life cycle transitioning on S3 Objects
Latest Trends- Launched in re:Invent 2020
• New for AWS Lambda – 1ms Billing Granularity Adds Cost Savings
https://aws.amazon.com/blogs/aws/new-for-aws-lambda-1ms-billing-
granularity-adds-cost-savings/
• New – Amazon EBS gp3 Volume Lets You Provision Performance Apart
From Capacity
https://aws.amazon.com/blogs/aws/new-amazon-ebs-gp3-volume-lets-
you-provision-performance-separate-from-capacity-and-offers-20-lower-
price/
It lets customers independently increase IOPS and throughput without
having to provision additional block storage capacity, paying only for the
resources they need.
Thank you!

More Related Content

What's hot

AWS Webinar Series - Cost Optimisation Levers, Tools, and Strategies
AWS Webinar Series - Cost Optimisation Levers, Tools, and StrategiesAWS Webinar Series - Cost Optimisation Levers, Tools, and Strategies
AWS Webinar Series - Cost Optimisation Levers, Tools, and StrategiesAmazon Web Services
 
AWS Cloud Cost Optimization
AWS Cloud Cost OptimizationAWS Cloud Cost Optimization
AWS Cloud Cost OptimizationYogesh Sharma
 
Top 5 Ways to Optimize for Cost Efficiency with the Cloud
Top 5 Ways to Optimize for Cost Efficiency with the CloudTop 5 Ways to Optimize for Cost Efficiency with the Cloud
Top 5 Ways to Optimize for Cost Efficiency with the CloudAmazon Web Services
 
AWS Initiate Day Dublin 2019 – Cost Optimization on AWS
AWS Initiate Day Dublin 2019 – Cost Optimization on AWSAWS Initiate Day Dublin 2019 – Cost Optimization on AWS
AWS Initiate Day Dublin 2019 – Cost Optimization on AWSAmazon Web Services
 
Optimizing Total Cost of Ownership for the AWS Cloud
Optimizing Total Cost of Ownership for the AWS CloudOptimizing Total Cost of Ownership for the AWS Cloud
Optimizing Total Cost of Ownership for the AWS CloudAmazon Web Services
 
"Introduction to FinOps" – Greg VanderWel at Chicago AWS user group
"Introduction to FinOps" – Greg VanderWel at Chicago AWS user group"Introduction to FinOps" – Greg VanderWel at Chicago AWS user group
"Introduction to FinOps" – Greg VanderWel at Chicago AWS user groupAWS Chicago
 
Introduction to AWS Cost Management
Introduction to AWS Cost ManagementIntroduction to AWS Cost Management
Introduction to AWS Cost ManagementAmazon Web Services
 
AWS 비용 효율화를 고려한 Reserved Instance + Savings Plan 옵션 - 박윤 어카운트 매니저 :: AWS Game...
AWS 비용 효율화를 고려한 Reserved Instance + Savings Plan 옵션 - 박윤 어카운트 매니저 :: AWS Game...AWS 비용 효율화를 고려한 Reserved Instance + Savings Plan 옵션 - 박윤 어카운트 매니저 :: AWS Game...
AWS 비용 효율화를 고려한 Reserved Instance + Savings Plan 옵션 - 박윤 어카운트 매니저 :: AWS Game...Amazon Web Services Korea
 
AWS Cloud Adoption Framework and Workshops
AWS Cloud Adoption Framework and WorkshopsAWS Cloud Adoption Framework and Workshops
AWS Cloud Adoption Framework and WorkshopsTom Laszewski
 
FinOps at REA – Innovation in Finance & Operations
FinOps at REA – Innovation in Finance & OperationsFinOps at REA – Innovation in Finance & Operations
FinOps at REA – Innovation in Finance & OperationsAmazon Web Services
 
Building the business case for AWS
Building the business case for AWSBuilding the business case for AWS
Building the business case for AWSAmazon Web Services
 

What's hot (20)

Cost Optimization on AWS
Cost Optimization on AWSCost Optimization on AWS
Cost Optimization on AWS
 
AWS Cost Optimisation Solutions
AWS Cost Optimisation SolutionsAWS Cost Optimisation Solutions
AWS Cost Optimisation Solutions
 
AWS Webinar Series - Cost Optimisation Levers, Tools, and Strategies
AWS Webinar Series - Cost Optimisation Levers, Tools, and StrategiesAWS Webinar Series - Cost Optimisation Levers, Tools, and Strategies
AWS Webinar Series - Cost Optimisation Levers, Tools, and Strategies
 
Cost optimization on AWS
Cost optimization on AWSCost optimization on AWS
Cost optimization on AWS
 
Cost Optimization on AWS
Cost Optimization on AWSCost Optimization on AWS
Cost Optimization on AWS
 
AWS Cloud Cost Optimization
AWS Cloud Cost OptimizationAWS Cloud Cost Optimization
AWS Cloud Cost Optimization
 
Top 5 Ways to Optimize for Cost Efficiency with the Cloud
Top 5 Ways to Optimize for Cost Efficiency with the CloudTop 5 Ways to Optimize for Cost Efficiency with the Cloud
Top 5 Ways to Optimize for Cost Efficiency with the Cloud
 
AWS Cost Optimization in 5 Perspective
AWS Cost Optimization in 5 PerspectiveAWS Cost Optimization in 5 Perspective
AWS Cost Optimization in 5 Perspective
 
AWS Initiate Day Dublin 2019 – Cost Optimization on AWS
AWS Initiate Day Dublin 2019 – Cost Optimization on AWSAWS Initiate Day Dublin 2019 – Cost Optimization on AWS
AWS Initiate Day Dublin 2019 – Cost Optimization on AWS
 
Optimizing Total Cost of Ownership for the AWS Cloud
Optimizing Total Cost of Ownership for the AWS CloudOptimizing Total Cost of Ownership for the AWS Cloud
Optimizing Total Cost of Ownership for the AWS Cloud
 
Cost Optimization on AWS
Cost Optimization on AWSCost Optimization on AWS
Cost Optimization on AWS
 
AWS Migration Planning Roadmap
AWS Migration Planning RoadmapAWS Migration Planning Roadmap
AWS Migration Planning Roadmap
 
"Introduction to FinOps" – Greg VanderWel at Chicago AWS user group
"Introduction to FinOps" – Greg VanderWel at Chicago AWS user group"Introduction to FinOps" – Greg VanderWel at Chicago AWS user group
"Introduction to FinOps" – Greg VanderWel at Chicago AWS user group
 
Cloud Economics
Cloud EconomicsCloud Economics
Cloud Economics
 
Introduction to AWS Cost Management
Introduction to AWS Cost ManagementIntroduction to AWS Cost Management
Introduction to AWS Cost Management
 
Partnering with AWS
Partnering with AWSPartnering with AWS
Partnering with AWS
 
AWS 비용 효율화를 고려한 Reserved Instance + Savings Plan 옵션 - 박윤 어카운트 매니저 :: AWS Game...
AWS 비용 효율화를 고려한 Reserved Instance + Savings Plan 옵션 - 박윤 어카운트 매니저 :: AWS Game...AWS 비용 효율화를 고려한 Reserved Instance + Savings Plan 옵션 - 박윤 어카운트 매니저 :: AWS Game...
AWS 비용 효율화를 고려한 Reserved Instance + Savings Plan 옵션 - 박윤 어카운트 매니저 :: AWS Game...
 
AWS Cloud Adoption Framework and Workshops
AWS Cloud Adoption Framework and WorkshopsAWS Cloud Adoption Framework and Workshops
AWS Cloud Adoption Framework and Workshops
 
FinOps at REA – Innovation in Finance & Operations
FinOps at REA – Innovation in Finance & OperationsFinOps at REA – Innovation in Finance & Operations
FinOps at REA – Innovation in Finance & Operations
 
Building the business case for AWS
Building the business case for AWSBuilding the business case for AWS
Building the business case for AWS
 

Similar to AWS Cloud cost optimization

AWS Summit Tel Aviv - Enterprise Track - Cost Optimization & TCO
AWS Summit Tel Aviv - Enterprise Track - Cost Optimization & TCOAWS Summit Tel Aviv - Enterprise Track - Cost Optimization & TCO
AWS Summit Tel Aviv - Enterprise Track - Cost Optimization & TCOAmazon Web Services
 
Start Up Austin 2017: Don't Overspend! Cost Optimization Best Practices to Re...
Start Up Austin 2017: Don't Overspend! Cost Optimization Best Practices to Re...Start Up Austin 2017: Don't Overspend! Cost Optimization Best Practices to Re...
Start Up Austin 2017: Don't Overspend! Cost Optimization Best Practices to Re...Amazon Web Services
 
AWS Cloud Cost Optimization
AWS Cloud Cost OptimizationAWS Cloud Cost Optimization
AWS Cloud Cost OptimizationTonyStark452635
 
Cloud Economics: The Financial Case for Cloud Migration
Cloud Economics: The Financial Case for Cloud MigrationCloud Economics: The Financial Case for Cloud Migration
Cloud Economics: The Financial Case for Cloud MigrationAmazon Web Services
 
Running Lean Architectures: How to Optimize for Cost Efficiency
Running Lean Architectures: How to Optimize for Cost Efficiency Running Lean Architectures: How to Optimize for Cost Efficiency
Running Lean Architectures: How to Optimize for Cost Efficiency Amazon Web Services
 
Cost Optimization Best Practices: Rotem Yosef
Cost Optimization Best Practices: Rotem Yosef Cost Optimization Best Practices: Rotem Yosef
Cost Optimization Best Practices: Rotem Yosef Amazon Web Services
 
Cloud Economics; How to Quantify the Benefits of Moving to the Cloud - Transf...
Cloud Economics; How to Quantify the Benefits of Moving to the Cloud - Transf...Cloud Economics; How to Quantify the Benefits of Moving to the Cloud - Transf...
Cloud Economics; How to Quantify the Benefits of Moving to the Cloud - Transf...Amazon Web Services
 
AWS re:Invent re:Cap - 비용 최적화 - 모범사례와 아키텍처 설계 심화편 - 이원일
AWS re:Invent re:Cap - 비용 최적화 - 모범사례와 아키텍처 설계 심화편 - 이원일AWS re:Invent re:Cap - 비용 최적화 - 모범사례와 아키텍처 설계 심화편 - 이원일
AWS re:Invent re:Cap - 비용 최적화 - 모범사례와 아키텍처 설계 심화편 - 이원일Amazon Web Services Korea
 
How to Reduce your Spend on AWS
How to Reduce your Spend on AWSHow to Reduce your Spend on AWS
How to Reduce your Spend on AWSJoseph K. Ziegler
 
AWS Summit Sydney 2014 | Moving to the Cloud. What does it Mean to your Business
AWS Summit Sydney 2014 | Moving to the Cloud. What does it Mean to your BusinessAWS Summit Sydney 2014 | Moving to the Cloud. What does it Mean to your Business
AWS Summit Sydney 2014 | Moving to the Cloud. What does it Mean to your BusinessAmazon Web Services
 
Cost optimization at scale toronto v3
Cost optimization at scale toronto v3Cost optimization at scale toronto v3
Cost optimization at scale toronto v3Amazon Web Services
 
AWS Summit Auckland 2014 | Moving to the Cloud. What does it Mean to your Bus...
AWS Summit Auckland 2014 | Moving to the Cloud. What does it Mean to your Bus...AWS Summit Auckland 2014 | Moving to the Cloud. What does it Mean to your Bus...
AWS Summit Auckland 2014 | Moving to the Cloud. What does it Mean to your Bus...Amazon Web Services
 
Advanced Topics - Session 3 - Optimizing AWS Applications
Advanced Topics - Session 3 - Optimizing AWS ApplicationsAdvanced Topics - Session 3 - Optimizing AWS Applications
Advanced Topics - Session 3 - Optimizing AWS ApplicationsAmazon Web Services
 
AWS APAC Webinar Series: How to Reduce Your Spend on AWS
AWS APAC Webinar Series: How to Reduce Your Spend on AWSAWS APAC Webinar Series: How to Reduce Your Spend on AWS
AWS APAC Webinar Series: How to Reduce Your Spend on AWSAmazon Web Services
 
AWS re:Invent 2016: Cost Optimization at Scale (ENT209)
AWS re:Invent 2016: Cost Optimization at Scale (ENT209)AWS re:Invent 2016: Cost Optimization at Scale (ENT209)
AWS re:Invent 2016: Cost Optimization at Scale (ENT209)Amazon Web Services
 
Achieving Your Department Objectives: Providing Better Citizen Services at Lo...
Achieving Your Department Objectives: Providing Better Citizen Services at Lo...Achieving Your Department Objectives: Providing Better Citizen Services at Lo...
Achieving Your Department Objectives: Providing Better Citizen Services at Lo...Amazon Web Services
 

Similar to AWS Cloud cost optimization (20)

AWS Summit Tel Aviv - Enterprise Track - Cost Optimization & TCO
AWS Summit Tel Aviv - Enterprise Track - Cost Optimization & TCOAWS Summit Tel Aviv - Enterprise Track - Cost Optimization & TCO
AWS Summit Tel Aviv - Enterprise Track - Cost Optimization & TCO
 
Cloudonomics
CloudonomicsCloudonomics
Cloudonomics
 
Cost Optimization at Scale
Cost Optimization at ScaleCost Optimization at Scale
Cost Optimization at Scale
 
Start Up Austin 2017: Don't Overspend! Cost Optimization Best Practices to Re...
Start Up Austin 2017: Don't Overspend! Cost Optimization Best Practices to Re...Start Up Austin 2017: Don't Overspend! Cost Optimization Best Practices to Re...
Start Up Austin 2017: Don't Overspend! Cost Optimization Best Practices to Re...
 
AWS Cloud Cost Optimization
AWS Cloud Cost OptimizationAWS Cloud Cost Optimization
AWS Cloud Cost Optimization
 
Cloud Economics: The Financial Case for Cloud Migration
Cloud Economics: The Financial Case for Cloud MigrationCloud Economics: The Financial Case for Cloud Migration
Cloud Economics: The Financial Case for Cloud Migration
 
Running Lean Architectures: How to Optimize for Cost Efficiency
Running Lean Architectures: How to Optimize for Cost Efficiency Running Lean Architectures: How to Optimize for Cost Efficiency
Running Lean Architectures: How to Optimize for Cost Efficiency
 
Cost Optimization Best Practices: Rotem Yosef
Cost Optimization Best Practices: Rotem Yosef Cost Optimization Best Practices: Rotem Yosef
Cost Optimization Best Practices: Rotem Yosef
 
Optimize Cost Efficiency on AWS
Optimize Cost Efficiency on AWSOptimize Cost Efficiency on AWS
Optimize Cost Efficiency on AWS
 
Cloud Economics; How to Quantify the Benefits of Moving to the Cloud - Transf...
Cloud Economics; How to Quantify the Benefits of Moving to the Cloud - Transf...Cloud Economics; How to Quantify the Benefits of Moving to the Cloud - Transf...
Cloud Economics; How to Quantify the Benefits of Moving to the Cloud - Transf...
 
Cost Optimization at Scale
Cost Optimization at ScaleCost Optimization at Scale
Cost Optimization at Scale
 
AWS re:Invent re:Cap - 비용 최적화 - 모범사례와 아키텍처 설계 심화편 - 이원일
AWS re:Invent re:Cap - 비용 최적화 - 모범사례와 아키텍처 설계 심화편 - 이원일AWS re:Invent re:Cap - 비용 최적화 - 모범사례와 아키텍처 설계 심화편 - 이원일
AWS re:Invent re:Cap - 비용 최적화 - 모범사례와 아키텍처 설계 심화편 - 이원일
 
How to Reduce your Spend on AWS
How to Reduce your Spend on AWSHow to Reduce your Spend on AWS
How to Reduce your Spend on AWS
 
AWS Summit Sydney 2014 | Moving to the Cloud. What does it Mean to your Business
AWS Summit Sydney 2014 | Moving to the Cloud. What does it Mean to your BusinessAWS Summit Sydney 2014 | Moving to the Cloud. What does it Mean to your Business
AWS Summit Sydney 2014 | Moving to the Cloud. What does it Mean to your Business
 
Cost optimization at scale toronto v3
Cost optimization at scale toronto v3Cost optimization at scale toronto v3
Cost optimization at scale toronto v3
 
AWS Summit Auckland 2014 | Moving to the Cloud. What does it Mean to your Bus...
AWS Summit Auckland 2014 | Moving to the Cloud. What does it Mean to your Bus...AWS Summit Auckland 2014 | Moving to the Cloud. What does it Mean to your Bus...
AWS Summit Auckland 2014 | Moving to the Cloud. What does it Mean to your Bus...
 
Advanced Topics - Session 3 - Optimizing AWS Applications
Advanced Topics - Session 3 - Optimizing AWS ApplicationsAdvanced Topics - Session 3 - Optimizing AWS Applications
Advanced Topics - Session 3 - Optimizing AWS Applications
 
AWS APAC Webinar Series: How to Reduce Your Spend on AWS
AWS APAC Webinar Series: How to Reduce Your Spend on AWSAWS APAC Webinar Series: How to Reduce Your Spend on AWS
AWS APAC Webinar Series: How to Reduce Your Spend on AWS
 
AWS re:Invent 2016: Cost Optimization at Scale (ENT209)
AWS re:Invent 2016: Cost Optimization at Scale (ENT209)AWS re:Invent 2016: Cost Optimization at Scale (ENT209)
AWS re:Invent 2016: Cost Optimization at Scale (ENT209)
 
Achieving Your Department Objectives: Providing Better Citizen Services at Lo...
Achieving Your Department Objectives: Providing Better Citizen Services at Lo...Achieving Your Department Objectives: Providing Better Citizen Services at Lo...
Achieving Your Department Objectives: Providing Better Citizen Services at Lo...
 

More from Yogesh Sharma

Accelerating Innovation Using Serverless Datalake (Lightning Talk)
Accelerating Innovation Using Serverless Datalake (Lightning Talk)Accelerating Innovation Using Serverless Datalake (Lightning Talk)
Accelerating Innovation Using Serverless Datalake (Lightning Talk)Yogesh Sharma
 
Accelerating innovation using serverless data lake
Accelerating innovation using serverless data lakeAccelerating innovation using serverless data lake
Accelerating innovation using serverless data lakeYogesh Sharma
 
Data Engg Conf Sydney - intelligent and scalable real-time data pipeline usin...
Data Engg Conf Sydney - intelligent and scalable real-time data pipeline usin...Data Engg Conf Sydney - intelligent and scalable real-time data pipeline usin...
Data Engg Conf Sydney - intelligent and scalable real-time data pipeline usin...Yogesh Sharma
 
Intelligent serverless-streaming-pipeline-using-kinesis-fargate-cfn
Intelligent serverless-streaming-pipeline-using-kinesis-fargate-cfnIntelligent serverless-streaming-pipeline-using-kinesis-fargate-cfn
Intelligent serverless-streaming-pipeline-using-kinesis-fargate-cfnYogesh Sharma
 
Aws certification roadmap yogesh-sharma
Aws certification roadmap   yogesh-sharmaAws certification roadmap   yogesh-sharma
Aws certification roadmap yogesh-sharmaYogesh Sharma
 
AWS Community Day Bay Area 2020- Intelligent Scalable and Serverless Real-tim...
AWS Community Day Bay Area 2020- Intelligent Scalable and Serverless Real-tim...AWS Community Day Bay Area 2020- Intelligent Scalable and Serverless Real-tim...
AWS Community Day Bay Area 2020- Intelligent Scalable and Serverless Real-tim...Yogesh Sharma
 

More from Yogesh Sharma (6)

Accelerating Innovation Using Serverless Datalake (Lightning Talk)
Accelerating Innovation Using Serverless Datalake (Lightning Talk)Accelerating Innovation Using Serverless Datalake (Lightning Talk)
Accelerating Innovation Using Serverless Datalake (Lightning Talk)
 
Accelerating innovation using serverless data lake
Accelerating innovation using serverless data lakeAccelerating innovation using serverless data lake
Accelerating innovation using serverless data lake
 
Data Engg Conf Sydney - intelligent and scalable real-time data pipeline usin...
Data Engg Conf Sydney - intelligent and scalable real-time data pipeline usin...Data Engg Conf Sydney - intelligent and scalable real-time data pipeline usin...
Data Engg Conf Sydney - intelligent and scalable real-time data pipeline usin...
 
Intelligent serverless-streaming-pipeline-using-kinesis-fargate-cfn
Intelligent serverless-streaming-pipeline-using-kinesis-fargate-cfnIntelligent serverless-streaming-pipeline-using-kinesis-fargate-cfn
Intelligent serverless-streaming-pipeline-using-kinesis-fargate-cfn
 
Aws certification roadmap yogesh-sharma
Aws certification roadmap   yogesh-sharmaAws certification roadmap   yogesh-sharma
Aws certification roadmap yogesh-sharma
 
AWS Community Day Bay Area 2020- Intelligent Scalable and Serverless Real-tim...
AWS Community Day Bay Area 2020- Intelligent Scalable and Serverless Real-tim...AWS Community Day Bay Area 2020- Intelligent Scalable and Serverless Real-tim...
AWS Community Day Bay Area 2020- Intelligent Scalable and Serverless Real-tim...
 

Recently uploaded

The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxLoriGlavin3
 
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...Scott Andery
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Alkin Tezuysal
 
Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Hiroshi SHIBATA
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersRaghuram Pandurangan
 
Assure Ecommerce and Retail Operations Uptime with ThousandEyes
Assure Ecommerce and Retail Operations Uptime with ThousandEyesAssure Ecommerce and Retail Operations Uptime with ThousandEyes
Assure Ecommerce and Retail Operations Uptime with ThousandEyesThousandEyes
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsNathaniel Shimoni
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfMounikaPolabathina
 
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...AliaaTarek5
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfSo einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfpanagenda
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...Wes McKinney
 
Manual 508 Accessibility Compliance Audit
Manual 508 Accessibility Compliance AuditManual 508 Accessibility Compliance Audit
Manual 508 Accessibility Compliance AuditSkynet Technologies
 
A Framework for Development in the AI Age
A Framework for Development in the AI AgeA Framework for Development in the AI Age
A Framework for Development in the AI AgeCprime
 
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...panagenda
 
Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Farhan Tariq
 
Scale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterScale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterMydbops
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesKari Kakkonen
 

Recently uploaded (20)

The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptx
 
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...
 
Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information Developers
 
Assure Ecommerce and Retail Operations Uptime with ThousandEyes
Assure Ecommerce and Retail Operations Uptime with ThousandEyesAssure Ecommerce and Retail Operations Uptime with ThousandEyes
Assure Ecommerce and Retail Operations Uptime with ThousandEyes
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directions
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdf
 
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
(How to Program) Paul Deitel, Harvey Deitel-Java How to Program, Early Object...
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdfSo einfach geht modernes Roaming fuer Notes und Nomad.pdf
So einfach geht modernes Roaming fuer Notes und Nomad.pdf
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
 
Manual 508 Accessibility Compliance Audit
Manual 508 Accessibility Compliance AuditManual 508 Accessibility Compliance Audit
Manual 508 Accessibility Compliance Audit
 
A Framework for Development in the AI Age
A Framework for Development in the AI AgeA Framework for Development in the AI Age
A Framework for Development in the AI Age
 
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
 
Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...
 
Scale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterScale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL Router
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examples
 

AWS Cloud cost optimization

  • 2. #whoami: yogesh sharma • Cloud Architect @ Tata Consultancy Services • Overall 10+ years of experience, 5+ years of experience in Cloud, DevOps • ML and Data Enthusiast • AWS Community Builder Program (First Batch) • 3x AWS Certifications • Technical Speaker and Blogger • Owner of https://multicloudwarrior.com/ https://www.linkedin.com/in/sharma-yogesh/
  • 3. What to expect • Cloud Cost Optimization- What, Why • Pillars for Cost Optimization • Cost Optimization Process • Checklist • Latest Trends • Q&A
  • 4. We all love Cloud and its Services… AWS is for builders You build it, You run it, You optimize it
  • 5. But are we fully aware about Cloud Financials Are we spending too much on unnecessary stuff knowingly/unknowingly?
  • 6. Pay for what you use But how would you ensure that you pay what you actually need? Bill Formula: Spend = Usage * Rate
  • 7. Cloud Cost Optimization Managing costs is a challenge for organizations using public cloud services but also an opportunity to drive efficient consumption of IT.
  • 8. Pillars for Cost Optimization
  • 9. Pillars for Cost Optimization Right-sizing Elasticity Pricing Models Storage Classes Measure and Mechanisms Designing for Cost
  • 10. Right-sizing m4.4xlarge $1.72 per hour 1. Provision 2. Check Metrics (CPU, RAM, Network) 4. Review Performance 5. Save m4.large $0.215 per hour 3. Right-Size 86% Saving
  • 11. Elasticity • Scale up and down to meet capacity requirements based upon CPU, RAM, network etc. • Automatically turn nonproduction off outside of working hoursThink about: •AWS Auto Scaling and EC2 Fleet •AWS Instance Scheduler •AWS CloudWatch Auto-scalingpolicies
  • 12. Pricing Models On- Demand Pay-for-compute capacity by the second with no long-term commitments Savings Plans & Reserved Instances Make a commitment and receive a significant discount off compute Spot Instances Spare AWS EC2 Capacity at saving up to 90% off On-Demand prices Spiky workloads to Define needs Committed & steady-state usage Fault-tolerant, flexible, stateless workloads If your bid > spot price  get an instance If your bid < spot price  instance is terminated
  • 13. Storage Classes Amazon S3 Amazon GlacierInfrequent Access HOT WARM COLD Provisioned IOPS SSD (io1) General Purpose SSD (gp2) Throughput Optimized HDD (st1) Cold HDD (io1)
  • 15. Designing for Cost Consolidated Billing Using AWS Organization Go Serverless Unused Elastic IPs ContainerizationCloudFront Managed RDS
  • 17. Cost Optimization Process Biggest Strength- Architecture Flexibility Main goal- Avoid unnecessary stuff Unnecessary Resources Idling Resources Repetitive Work
  • 18. Measure: Monitor your workloads Set up metrics to defines success and track progress “What KPI makes sense for this workload?” % Instances turned off daily %instances right sized %RI Utilization Monitor AWS Resources Set Alarms Monitor Custom Metrics View Graphs and Statistics Monitor & React to Resource Changes
  • 19. Measure- AWS Billing/Cost Dashboard • Use AWS Billing and Cost Management Dashboard • Set up your monthly AWS budget • Dive deep with AWS Cost Explorer Also checkout- https://calculator.s3.amazonaws.com/index.html https://calculator.aws/ https://aws.amazon.com/economics/
  • 20. Measure: Cost Explorer Use Cost Explorer Personalized Recommendations and decide to go with Reserved Instances Category- Standard, Convertible and Scheduled RIs
  • 21. Architecture- Using AWS Organizations Consolidated Billing Consolidated Billingalso enables various discounts- like Volume discounts
  • 22. Architecture- Establish Tagging Strategy Using tags to establish visibility & chargebacks What’s in a Tag Resource Allocation Search, filter & categorize Cost Allocation Reports & chargebacks Automation Autoscaling & Scheduling Control & Compliance Restricted resource access through IAM
  • 23. Checklist • Turn off unused instances- Use instance start and stop • Delete unused/orphan volumes • Stop paying for Idle EC2 and RDS instances and Redshift Clusters • Understand and forecast your costs using AWS Cost Explorer and AWS Budget • Use consolidated billing to avail volume discount across accounts • Turn on/off whole architecture setups Using AWS CloudFormation, Terraform • Automate Everything- Automate your instance start/stop cycle • Choose EC2 Spot Instances • Use Compute Savings Plan • Use Reserved Instances • Embrace latest trends and learn from Industry – Adopt Micro-service architecture – Modernize applications to make use of provider managed services when these are more cost- effective. – Consider Serverless architecture- no idle capacity – Adopt Containerization • Containers with EC2-Spot, Fargate with Spot – Enable S3-Intelligent Tiering- Apply Life cycle transitioning on S3 Objects
  • 24. Latest Trends- Launched in re:Invent 2020 • New for AWS Lambda – 1ms Billing Granularity Adds Cost Savings https://aws.amazon.com/blogs/aws/new-for-aws-lambda-1ms-billing- granularity-adds-cost-savings/ • New – Amazon EBS gp3 Volume Lets You Provision Performance Apart From Capacity https://aws.amazon.com/blogs/aws/new-amazon-ebs-gp3-volume-lets- you-provision-performance-separate-from-capacity-and-offers-20-lower- price/ It lets customers independently increase IOPS and throughput without having to provision additional block storage capacity, paying only for the resources they need.