Savings on scale - Spot Instances with Autospotter
•
0 likes•179 views
Cost efficiency is an important aspect for companies of all sizes and levels of maturity, where it can become a competitive advantage. Especially on large organizations composed of hundreds of teams, it is hard to enforce initiatives that require buy-in and significant implementation effort from the various teams that often have other priorities. In this session you will see how you can implement a cost savings initiative that provides multiple easy to use options for running at the lowest possible cost, that can be leveraged at scale with the least amount of buy-in and configuration effort from the teams. The session will explore topics such as resource tagging, centralized reserved instance purchases, automated instance terminations outside office hours and automated use of the spot market with minimal configuration changes to existing environments.
Recommended
More Related Content
What's hot
What's hot (19)
Similar to Savings on scale - Spot Instances with Autospotter
Similar to Savings on scale - Spot Instances with Autospotter (20)
More from AWS Germany
More from AWS Germany (20)
Recently uploaded
Recently uploaded (20)
Savings on scale - Spot Instances with Autospotter
- 1. Cost Efficiency at Scale Cristian Măgherușan-Stanciu @magheru_san Principal SRE at HERE Technologies AWS Pop-up Loft, Oct 2018
- 2. We are making sense of the world through the lens of location HERE Technologies through the lens of location © 2018 HERE Technologies2
- 3. On Demand Economy 9.5 B ARRobotics Quantum Computing Megacities Artificial Intelligence Sustainability Neural Networks Data Analytics Location Location Location Location Location Location Location Location Location Location Location Location © 2018 HERE Technologies3
- 4. HERE Technologies in Numbers © 2018 HERE Technologies4 We are HERE | November 20174 200 Countries mapped 4of5 In-car navigation systems in Europe and North America use HERE maps 30+ Years of experience transforming location technology 8,000+Employees in 56 countries focused on delivering the world’s best map and location technologies HERE Maps on board of 100Mvehicles and counting 3D data points per second per car 700,000 collecting data for our maps 400 HERE cars 28TB map data collected perday
- 5. Powered through the lens of location HERE Technologies © 2018 HERE Technologies5 by AWS
- 6. HERE Technologies and AWS We run all our backends in the AWS cloud • 100s of teams maintaining 450+ AWS accounts • Mainly EC2, S3 & RDS • 10000s of EC2 instances in 1000s of AutoScaling groups • 10s of PB of data in S3 © 2018 HERE Technologies6 Photo by unknown author, licensed under CC BY-SA
- 7. Our AWS spending is significant, even small savings matter a lot HERE Technologies and AWS © 2018 HERE Technologies7
- 8. Cost control measures Multiple layers implemented over time • Enterprise Discount Program • Centralized Reserved Instance purchases • Scheduled terminations and AutoScaling based on load • Spot market automation © 2018 HERE Technologies8 Image source https://www.bakingo.com/p/party-cake/3-tier-vanilla-cake- part0157vani
- 9. Enterprise Discount Program Fixed percentage applied on the final bills • Long-term contract with AWS • Applies as long as our spending is more than X yearly • ‘Hands-free’ for the product teams © 2018 HERE Technologies9 Photo by unknown author licensed under CC BY
- 10. Reserved Instances We purchase RIs periodically • Trying to maximize coverage while reducing waste • Allocating RIs on the fly to whoever needs them • Savings in the 40-50% range • ‘Hands-free’ for the product teams • Started with EC2, now expanding to other services © 2018 HERE Technologies10
- 11. Scheduled terminations and AutoScaling based on load Shut down development environments when not in use And use AutoScaling policies for those that should run 24/7 • Each team defines its on/off schedules as tags set on their EC2 instances • Lambda functions take action based on these tags © 2018 HERE Technologies11 Shut down over the week-end Shut down in the evening Turn on in the morning This saves about 70%
- 12. Spot Market Automation We automatically switch our AutoScaling Groups to spot instances using the AutoSpotting tool • Controlled by tags set on AutoScaling groups, such as ‘spot-enabled=true’ • Lambda function that continuously replaces nodes in enabled groups with identical spot instances • AutoScaling will revert to on-demand (often covered by RIs) on spot terminations or when scaling out © 2018 HERE Technologies12
- 13. Lessons learned Keep it simple and painless to the product teams They always have something of higher priority than cost savings • Try to create ‘hands-free’, opt-out or trivial to use solutions • Provide examples and clear documentation if they need to take any action • Try not to cause significant impact on their work © 2018 HERE Technologies13
- 14. Future Plans Extend the RI purchasing program • Purchase RIs for other services: RDS, ElastiCache, CloudFront, etc. Expand the AutoSpotting rollout • Switch it to opt-out mode on all Development AWS accounts • Work with selected product teams to set it up on Production © 2018 HERE Technologies14
- 15. AutoSpotting Demo © 2018 HERE Technologies15
Editor's Notes
- In summary, we are HERE and we are making sense of the world through the lens of location We help people achieve better outcomes – whether it’s: A driver moving to their destination safely A municipality managing its infrastructure smartly A business optimizing its fleet of assets
- We are deeply driven by how we can improve the future. And that future has many opportunities and challenges: By 2050 we will have close to 10 billion people on this planet At least 50 megacities (each with more than 10 million, some up to 40 million, inhabitants) ”Virtual roads” are needed so that drones can glide through the system Questions on how best sustain our resources “Aging population”. Machines will have to teach machines. Robotics will rise What technology to make sense of the enormous amounts of data that we collect every day? One thing is certain: Location is very important for tackling these problems
- Over the next few slides I’ll talk about how we are using AWS at HERE Technologies
- We have a significant footprint on AWS, maintained by our hundreds of product teams Each product team maintains its own AWS accounts (usually one for dev and another for prod.) We have a few teams that ensure compliance throughout the fleet (security, availability, cost control etc.) But ultimately each team is responsible for its own infrastructure, budget, priorities and can choose the AWS services it needs
- At our scale we spend a lot of money on AWS I can’t give exact numbers but the figure is in the millions monthly Even small percentages of cost reductions here and there can make a significant difference We often see that a few hours of optimization work could cover someone’s salary
- We implemented a number of measures over the years, I will go over them over the next slides We prefer to implement them centrally and make them available to the teams with minimal effort, sometimes the teams can just take advantage of them, but for some they need to take some action and configure them on their infrastructure.
- Basically our sourcing team contacted AWS and agreed on some discount if we keep paying as much as we do over the next few years Requires no work from the product teams
- We are continuously analyzing our usage and trying to cover as much as possible of the stable capacity We use AWS Organizations and we can purchase RIs in one account of the smallest instance types . They can apply for any product team that and are automatically merged to cover larger instance types Usually allocated to Production environments where the baseline capacity tends to be relatively steady In the diagram you can see how much coverage we got to one of our production environments over a period of two weeks
- That’s how a typical developer calendar looks like, not much happens before 9AM and after 6 PM Development environments see no traffic at night or over the week-end We can save some 70% of the total cost if we hibernate or shut them down when idle For AutoScaling you can also set time-based policies For EC2 we use a tool called CloudCustodian
- We use an open source project which I started in my spare time a couple of years ago, called AutoSpotting We have it installed in each of our accounts since June, the product teams just need to use it by tagging their ASGs That’s how it looked after enabling it in one of our Production environments, we also benefit from the RI coverage
- We noticed the adoption rate of the instance scheduling and AutSpotting is very low, even though it just takes minutes to set them up. So we will need to find ways to make them ‘hands-free’ or run them by default.
- AutoSpotting supports running in opt-out mode, in which it can perform the replacement action on all the groups from the AWS account, unless blacklisted by tagging or protected from termination/scale-in.