SlideShare a Scribd company logo
1 of 32
Download to read offline
Constraint Driven Infrastructure
Scale and tune to save money
Volodymyr Tsap
Highload FWdays 2017
Volodymyr Tsap
CTO at SHALB
Constraint Driven Infrastructure
About Me
15 years supporting Linux for
money
10 years Enterprise Java
Applications and SDK’s
support
8 years as a CTO in own
company
Saving on Hardware
Starting Startup
Select the Platform
Platform Dependent Proc
Extremely low price
OS/Hypervisor lock out
Orchestration freedom
Don’t waste your time on
$ calculations
Dedicated Server PaaS
Flexible PasYG price
Does not require any
system administration
Failover by design
Cloud Provider
Price could be managed
by resource freeing
Unlimited scaling
Rapid env. deployment
using platform tools
Bare Metal
Hardware Sample on AWS
Dev:
m4.2xlarge 8vCPU(11863PM) / 32GB / 500 GB Storage
Prod:
m4.xlarge 4vCPU(5931PM**) / 16GB / 100 GB Storage
10 % Change in daily snapshot
2 Elastic IP
1.5 Tb traffic
$648 / Month*
27.4PM/$
* https://calculator.s3.amazonaws.com/index.html
**https://www.cpubenchmark.net/cpu.php?cpu=Intel+Xeon+E5-2676+v3+%40+2.40GHz
EC2 Spot + RDS on AWS
RDS(save up to 42% by upfront year payment):
db.t2.medium (2СPU(2)4GB) = 48,96 $
db.m4.large (2CPU(6.5) 8GB) = 252$
Spot instances (6 hours):
m4.2xlarge = 187.2
m4.xlarge = 93.6
EBS
$0.10 per 600G = 60$
$514-641 / Month*
34PM/$
* https://calculator.s3.amazonaws.com/index.html
* https://www.cpubenchmark.net/cpu.php?cpu=Intel+Xeon+E5-2676+v3+%40+2.40GHz
PaaS Heroku Dyno
Performance-l 14GB CPU 46x(PM9073) $500/mo
Or
10x Standard-2x 1GB CPU 2-8X $50/mo
$500 / Month*
18PM/$
0,65xAWS* https://devcenter.heroku.com/articles/dyno-types#available-dyno-types
*https://www.quora.com/How-powerful-is-one-Heroku-dyno-Is-it-roughly-equivalent-to-an-EC2-Sm
all-instance
Enterprise Server
Config on OVH.com
Intel 2x Xeon E5-2630v3(PM18649) / 128GB
Hardware Raid 2x2TB + 2x480GB SSD
500 Mbps guaranteed bandwidth
5 TB* Remote Backup storage
VMware ESXi supported
* https://www.ovh.ie/dedicated_servers/enterprise/
$333 / Month*
56PM/$
2xAWS
2 x Soft-Raid Servers
Config for OVH.com
2 servers same hardware:
Intel Xeon E3-1270v6(11324PM) / 64GB
SoftRaid 2x2TB
500 Mbps bandwidth
1 TB* Remote Backup storage
$282 Month
80.3PM/$
3xAWS
2 x Desktop Hardware
Dev and Prod dedicated each:
AX60-SSD
AMD Ryzen 7 1700X (14651PM) / 64 GB
2 x 500 GB SSD
Guaranteed bandwidth 1 Gbit/s-Port
$70 Month
2 TB Backup Storage - $ 12
$152 Month
192.7PM/$
7xAWS
Hardware price needs to
be taken into account
DailyDaily
Cloud Saving
by Scaling?
Daily
Daily load sample for corporate mail system
Daily load sample for E-commerce platform
Daily load sample for news website
Daily load sample for PaaS Provider
Scaling can save your
money only if workload
is not planar
Saving Money on
Software
Operating
system
Points to check
Filesystem - ext4, xfs, noatime
Memory - disable swap/swappiness
Network - tcp r/wmem, buffers
Process - limits, open files
Prepare ready images no
post-installation provisioning
Compile - it could save 10-20%
Distro Selection
Lifecycle
RHEL/CentOS - 10 years
Ubuntu LTS - 5 years
Debian ~ 3 years
Gentoo - rolling release
Upgrade
CentOS - pain
Ubuntu/Debian - ok
Gentoo - pain/ok
Packages Available
RHEL/CentOS repo - 6000
Ubuntu Universe - 23,000
Debian - 23,000
Gentoo - 19,692
OpenStack, K8, Swarm:
CentOS/Ubuntu - Good
Debian - Normal
Lyfecycle
Packages AvailableLyfecycle
Upgrade procedure Platform Support
Virtualization
Containerization
Points to check
Free and popular: KVM, Xen, Docker,
ESXi*
Live migration support
Hosted OS requirements
For licensed features fill the top of
hardware limits
HCL could be bypassed
Orchestration
Points to check
Deployment Simplicity
Manageability
Scalability
Suitable for stateful and stateless
apps
Networking and multi-site support
Databases
Points to check
Choose the DB by the planned
workload
Check the CAP Theorem
Fault tolerance and recovery speed
Use profilers and query monitoring
Buffers and pools has significant
impact
How much it cost
to support an
infrastructure
Price depends on
Number of instance types and roles
Quality of automation
Incident response/resolution time
Number request for env. changes
Mad man coefficient
Prod & Dev at same server
$250 / Month
2-3 Servers, Failover, Basic
Roles
$500-800 /
Month
Multi DC, IaaC, CI/CD,
Orchestration
$1.2k-3k / Month
K8/OS 3k-4k / Month
Geo Distributed Orchestration,
Hybrid Clouds, Dedicated Ops
$4k-6k / Month
+$100 per in. type
Saved money spend on people!
Thank you!
Volodymyr Tsap
Co-founder/CTO at SHALB.com
Email: voa@shalb.com
Skype: volodymyr.tsap
Linkedin: voatsap
Facebook: volodymyr.tsap

More Related Content

What's hot

RedisConf17 - Home Depot - Turbo charging existing applications with Redis
RedisConf17 - Home Depot - Turbo charging existing applications with RedisRedisConf17 - Home Depot - Turbo charging existing applications with Redis
RedisConf17 - Home Depot - Turbo charging existing applications with Redis
Redis Labs
 
Voldemort on Solid State Drives
Voldemort on Solid State DrivesVoldemort on Solid State Drives
Voldemort on Solid State Drives
Vinoth Chandar
 
RedisConf17 - Redis Labs - Implementing Real-time Machine Learning with Redis-ML
RedisConf17 - Redis Labs - Implementing Real-time Machine Learning with Redis-MLRedisConf17 - Redis Labs - Implementing Real-time Machine Learning with Redis-ML
RedisConf17 - Redis Labs - Implementing Real-time Machine Learning with Redis-ML
Redis Labs
 

What's hot (20)

RedisConf17 - Home Depot - Turbo charging existing applications with Redis
RedisConf17 - Home Depot - Turbo charging existing applications with RedisRedisConf17 - Home Depot - Turbo charging existing applications with Redis
RedisConf17 - Home Depot - Turbo charging existing applications with Redis
 
HBaseCon 2015: HBase Operations in a Flurry
HBaseCon 2015: HBase Operations in a FlurryHBaseCon 2015: HBase Operations in a Flurry
HBaseCon 2015: HBase Operations in a Flurry
 
25 snowflake
25 snowflake25 snowflake
25 snowflake
 
IMC Summit 2016 Innovation - Derek Nelson - PipelineDB: The Streaming-SQL Dat...
IMC Summit 2016 Innovation - Derek Nelson - PipelineDB: The Streaming-SQL Dat...IMC Summit 2016 Innovation - Derek Nelson - PipelineDB: The Streaming-SQL Dat...
IMC Summit 2016 Innovation - Derek Nelson - PipelineDB: The Streaming-SQL Dat...
 
HBaseCon2017 Splice Machine as a Service: Multi-tenant HBase using DCOS (Meso...
HBaseCon2017 Splice Machine as a Service: Multi-tenant HBase using DCOS (Meso...HBaseCon2017 Splice Machine as a Service: Multi-tenant HBase using DCOS (Meso...
HBaseCon2017 Splice Machine as a Service: Multi-tenant HBase using DCOS (Meso...
 
IMC Summit 2016 Breakout - Brian Bulkowski - NVMe, Storage Class Memory and O...
IMC Summit 2016 Breakout - Brian Bulkowski - NVMe, Storage Class Memory and O...IMC Summit 2016 Breakout - Brian Bulkowski - NVMe, Storage Class Memory and O...
IMC Summit 2016 Breakout - Brian Bulkowski - NVMe, Storage Class Memory and O...
 
Scylla Summit 2018: Meshify - A Case Study, or Petshop Seamonsters
Scylla Summit 2018: Meshify - A Case Study, or Petshop SeamonstersScylla Summit 2018: Meshify - A Case Study, or Petshop Seamonsters
Scylla Summit 2018: Meshify - A Case Study, or Petshop Seamonsters
 
HBaseCon 2015: Optimizing HBase for the Cloud in Microsoft Azure HDInsight
HBaseCon 2015: Optimizing HBase for the Cloud in Microsoft Azure HDInsightHBaseCon 2015: Optimizing HBase for the Cloud in Microsoft Azure HDInsight
HBaseCon 2015: Optimizing HBase for the Cloud in Microsoft Azure HDInsight
 
Seastar Summit 2019 Keynote
Seastar Summit 2019 KeynoteSeastar Summit 2019 Keynote
Seastar Summit 2019 Keynote
 
High availability system cache and queue - Write behind
High availability system cache and queue - Write behindHigh availability system cache and queue - Write behind
High availability system cache and queue - Write behind
 
Cassandra Community Webinar: CMB - An Open Message Bus for the Cloud
Cassandra Community Webinar: CMB - An Open Message Bus for the CloudCassandra Community Webinar: CMB - An Open Message Bus for the Cloud
Cassandra Community Webinar: CMB - An Open Message Bus for the Cloud
 
mParticle's Journey to Scylla from Cassandra
mParticle's Journey to Scylla from CassandramParticle's Journey to Scylla from Cassandra
mParticle's Journey to Scylla from Cassandra
 
Scylla Summit 2018: Keeping Your Latency SLAs No Matter What!
Scylla Summit 2018: Keeping Your Latency SLAs No Matter What!Scylla Summit 2018: Keeping Your Latency SLAs No Matter What!
Scylla Summit 2018: Keeping Your Latency SLAs No Matter What!
 
Voldemort on Solid State Drives
Voldemort on Solid State DrivesVoldemort on Solid State Drives
Voldemort on Solid State Drives
 
ScyllaDB @ Apache BigData, may 2016
ScyllaDB @ Apache BigData, may 2016ScyllaDB @ Apache BigData, may 2016
ScyllaDB @ Apache BigData, may 2016
 
HBaseCon 2015: State of HBase Docs and How to Contribute
HBaseCon 2015: State of HBase Docs and How to ContributeHBaseCon 2015: State of HBase Docs and How to Contribute
HBaseCon 2015: State of HBase Docs and How to Contribute
 
Apache HBase, Accelerated: In-Memory Flush and Compaction
Apache HBase, Accelerated: In-Memory Flush and Compaction Apache HBase, Accelerated: In-Memory Flush and Compaction
Apache HBase, Accelerated: In-Memory Flush and Compaction
 
Back to the future with C++ and Seastar
Back to the future with C++ and SeastarBack to the future with C++ and Seastar
Back to the future with C++ and Seastar
 
RedisConf17 - Redis Labs - Implementing Real-time Machine Learning with Redis-ML
RedisConf17 - Redis Labs - Implementing Real-time Machine Learning with Redis-MLRedisConf17 - Redis Labs - Implementing Real-time Machine Learning with Redis-ML
RedisConf17 - Redis Labs - Implementing Real-time Machine Learning with Redis-ML
 
SQream DB - Bigger Data On GPUs: Approaches, Challenges, Successes
SQream DB - Bigger Data On GPUs: Approaches, Challenges, SuccessesSQream DB - Bigger Data On GPUs: Approaches, Challenges, Successes
SQream DB - Bigger Data On GPUs: Approaches, Challenges, Successes
 

Similar to Володимир Цап "Constraint driven infrastructure - scale or tune?"

Ceph Day LA: Building your own disaster? The safe way to make Ceph storage re...
Ceph Day LA: Building your own disaster? The safe way to make Ceph storage re...Ceph Day LA: Building your own disaster? The safe way to make Ceph storage re...
Ceph Day LA: Building your own disaster? The safe way to make Ceph storage re...
Ceph Community
 
EQR Reporting: Rails + Amazon EC2
EQR Reporting:  Rails + Amazon EC2EQR Reporting:  Rails + Amazon EC2
EQR Reporting: Rails + Amazon EC2
jeperkins4
 
Storage essentials (by Merlin Ran)
Storage essentials (by Merlin Ran)Storage essentials (by Merlin Ran)
Storage essentials (by Merlin Ran)
gigix1980
 
20150704 benchmark and user experience in sahara weiting
20150704 benchmark and user experience in sahara weiting20150704 benchmark and user experience in sahara weiting
20150704 benchmark and user experience in sahara weiting
Wei Ting Chen
 
Ceph Day Berlin: Building Your Own Disaster? The Safe Way to Make Ceph Storag...
Ceph Day Berlin: Building Your Own Disaster? The Safe Way to Make Ceph Storag...Ceph Day Berlin: Building Your Own Disaster? The Safe Way to Make Ceph Storag...
Ceph Day Berlin: Building Your Own Disaster? The Safe Way to Make Ceph Storag...
Ceph Community
 
Best Practices For Virtualised Share Point T02 Brendan Law Nathan Mercer
Best Practices For Virtualised Share Point T02 Brendan Law Nathan MercerBest Practices For Virtualised Share Point T02 Brendan Law Nathan Mercer
Best Practices For Virtualised Share Point T02 Brendan Law Nathan Mercer
Flamer
 
Infrastructure Considerations : Design : "webops"
Infrastructure Considerations : Design : "webops"Infrastructure Considerations : Design : "webops"
Infrastructure Considerations : Design : "webops"
Piyush Kumar
 

Similar to Володимир Цап "Constraint driven infrastructure - scale or tune?" (20)

Ceph Day Shanghai - Hyper Converged PLCloud with Ceph
Ceph Day Shanghai - Hyper Converged PLCloud with Ceph Ceph Day Shanghai - Hyper Converged PLCloud with Ceph
Ceph Day Shanghai - Hyper Converged PLCloud with Ceph
 
Oracle Exec Summary 7000 Unified Storage
Oracle Exec Summary 7000 Unified StorageOracle Exec Summary 7000 Unified Storage
Oracle Exec Summary 7000 Unified Storage
 
App Deployment on Cloud
App Deployment on CloudApp Deployment on Cloud
App Deployment on Cloud
 
Accelerate Your OpenStack Deployment Presented by SolidFire and Red Hat
Accelerate Your OpenStack Deployment Presented by SolidFire and Red HatAccelerate Your OpenStack Deployment Presented by SolidFire and Red Hat
Accelerate Your OpenStack Deployment Presented by SolidFire and Red Hat
 
Private cloud with z enterprise
Private cloud with z enterprisePrivate cloud with z enterprise
Private cloud with z enterprise
 
Ceph Day Amsterdam 2015 - Building your own disaster? The safe way to make C...
Ceph Day Amsterdam 2015 - Building your own disaster?  The safe way to make C...Ceph Day Amsterdam 2015 - Building your own disaster?  The safe way to make C...
Ceph Day Amsterdam 2015 - Building your own disaster? The safe way to make C...
 
Nagios Conference 2011 - Daniel Wittenberg - Scaling Nagios At A Giant Insur...
Nagios Conference 2011 - Daniel Wittenberg -  Scaling Nagios At A Giant Insur...Nagios Conference 2011 - Daniel Wittenberg -  Scaling Nagios At A Giant Insur...
Nagios Conference 2011 - Daniel Wittenberg - Scaling Nagios At A Giant Insur...
 
Del 1
Del 1Del 1
Del 1
 
Nagios Conference 2012 - Dan Wittenberg - Case Study: Scaling Nagios Core at ...
Nagios Conference 2012 - Dan Wittenberg - Case Study: Scaling Nagios Core at ...Nagios Conference 2012 - Dan Wittenberg - Case Study: Scaling Nagios Core at ...
Nagios Conference 2012 - Dan Wittenberg - Case Study: Scaling Nagios Core at ...
 
Ceph Day LA: Building your own disaster? The safe way to make Ceph storage re...
Ceph Day LA: Building your own disaster? The safe way to make Ceph storage re...Ceph Day LA: Building your own disaster? The safe way to make Ceph storage re...
Ceph Day LA: Building your own disaster? The safe way to make Ceph storage re...
 
WebSphere App Server vs JBoss vs WebLogic vs Tomcat (InterConnect 2016)
WebSphere App Server vs JBoss vs WebLogic vs Tomcat (InterConnect 2016)WebSphere App Server vs JBoss vs WebLogic vs Tomcat (InterConnect 2016)
WebSphere App Server vs JBoss vs WebLogic vs Tomcat (InterConnect 2016)
 
EQR Reporting: Rails + Amazon EC2
EQR Reporting:  Rails + Amazon EC2EQR Reporting:  Rails + Amazon EC2
EQR Reporting: Rails + Amazon EC2
 
Sullego Product Overview
Sullego Product OverviewSullego Product Overview
Sullego Product Overview
 
Storage essentials (by Merlin Ran)
Storage essentials (by Merlin Ran)Storage essentials (by Merlin Ran)
Storage essentials (by Merlin Ran)
 
20150704 benchmark and user experience in sahara weiting
20150704 benchmark and user experience in sahara weiting20150704 benchmark and user experience in sahara weiting
20150704 benchmark and user experience in sahara weiting
 
The Application-Centric Cloud: Why the Network Still Matters
The Application-Centric Cloud:  Why the Network Still MattersThe Application-Centric Cloud:  Why the Network Still Matters
The Application-Centric Cloud: Why the Network Still Matters
 
Ceph Day Berlin: Building Your Own Disaster? The Safe Way to Make Ceph Storag...
Ceph Day Berlin: Building Your Own Disaster? The Safe Way to Make Ceph Storag...Ceph Day Berlin: Building Your Own Disaster? The Safe Way to Make Ceph Storag...
Ceph Day Berlin: Building Your Own Disaster? The Safe Way to Make Ceph Storag...
 
Best Practices For Virtualised Share Point T02 Brendan Law Nathan Mercer
Best Practices For Virtualised Share Point T02 Brendan Law Nathan MercerBest Practices For Virtualised Share Point T02 Brendan Law Nathan Mercer
Best Practices For Virtualised Share Point T02 Brendan Law Nathan Mercer
 
PROSE
PROSEPROSE
PROSE
 
Infrastructure Considerations : Design : "webops"
Infrastructure Considerations : Design : "webops"Infrastructure Considerations : Design : "webops"
Infrastructure Considerations : Design : "webops"
 

More from Fwdays

More from Fwdays (20)

"How Preply reduced ML model development time from 1 month to 1 day",Yevhen Y...
"How Preply reduced ML model development time from 1 month to 1 day",Yevhen Y..."How Preply reduced ML model development time from 1 month to 1 day",Yevhen Y...
"How Preply reduced ML model development time from 1 month to 1 day",Yevhen Y...
 
"GenAI Apps: Our Journey from Ideas to Production Excellence",Danil Topchii
"GenAI Apps: Our Journey from Ideas to Production Excellence",Danil Topchii"GenAI Apps: Our Journey from Ideas to Production Excellence",Danil Topchii
"GenAI Apps: Our Journey from Ideas to Production Excellence",Danil Topchii
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
 
"What is a RAG system and how to build it",Dmytro Spodarets
"What is a RAG system and how to build it",Dmytro Spodarets"What is a RAG system and how to build it",Dmytro Spodarets
"What is a RAG system and how to build it",Dmytro Spodarets
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
"Distributed graphs and microservices in Prom.ua", Maksym Kindritskyi
"Distributed graphs and microservices in Prom.ua",  Maksym Kindritskyi"Distributed graphs and microservices in Prom.ua",  Maksym Kindritskyi
"Distributed graphs and microservices in Prom.ua", Maksym Kindritskyi
 
"Rethinking the existing data loading and processing process as an ETL exampl...
"Rethinking the existing data loading and processing process as an ETL exampl..."Rethinking the existing data loading and processing process as an ETL exampl...
"Rethinking the existing data loading and processing process as an ETL exampl...
 
"How Ukrainian IT specialist can go on vacation abroad without crossing the T...
"How Ukrainian IT specialist can go on vacation abroad without crossing the T..."How Ukrainian IT specialist can go on vacation abroad without crossing the T...
"How Ukrainian IT specialist can go on vacation abroad without crossing the T...
 
"The Strength of Being Vulnerable: the experience from CIA, Tesla and Uber", ...
"The Strength of Being Vulnerable: the experience from CIA, Tesla and Uber", ..."The Strength of Being Vulnerable: the experience from CIA, Tesla and Uber", ...
"The Strength of Being Vulnerable: the experience from CIA, Tesla and Uber", ...
 
"[QUICK TALK] Radical candor: how to achieve results faster thanks to a cultu...
"[QUICK TALK] Radical candor: how to achieve results faster thanks to a cultu..."[QUICK TALK] Radical candor: how to achieve results faster thanks to a cultu...
"[QUICK TALK] Radical candor: how to achieve results faster thanks to a cultu...
 
"[QUICK TALK] PDP Plan, the only one door to raise your salary and boost care...
"[QUICK TALK] PDP Plan, the only one door to raise your salary and boost care..."[QUICK TALK] PDP Plan, the only one door to raise your salary and boost care...
"[QUICK TALK] PDP Plan, the only one door to raise your salary and boost care...
 
"4 horsemen of the apocalypse of working relationships (+ antidotes to them)"...
"4 horsemen of the apocalypse of working relationships (+ antidotes to them)"..."4 horsemen of the apocalypse of working relationships (+ antidotes to them)"...
"4 horsemen of the apocalypse of working relationships (+ antidotes to them)"...
 
"Reconnecting with Purpose: Rediscovering Job Interest after Burnout", Anast...
"Reconnecting with Purpose: Rediscovering Job Interest after Burnout",  Anast..."Reconnecting with Purpose: Rediscovering Job Interest after Burnout",  Anast...
"Reconnecting with Purpose: Rediscovering Job Interest after Burnout", Anast...
 
"Mentoring 101: How to effectively invest experience in the success of others...
"Mentoring 101: How to effectively invest experience in the success of others..."Mentoring 101: How to effectively invest experience in the success of others...
"Mentoring 101: How to effectively invest experience in the success of others...
 
"Mission (im) possible: How to get an offer in 2024?", Oleksandra Myronova
"Mission (im) possible: How to get an offer in 2024?",  Oleksandra Myronova"Mission (im) possible: How to get an offer in 2024?",  Oleksandra Myronova
"Mission (im) possible: How to get an offer in 2024?", Oleksandra Myronova
 
"Why have we learned how to package products, but not how to 'package ourselv...
"Why have we learned how to package products, but not how to 'package ourselv..."Why have we learned how to package products, but not how to 'package ourselv...
"Why have we learned how to package products, but not how to 'package ourselv...
 
"How to tame the dragon, or leadership with imposter syndrome", Oleksandr Zin...
"How to tame the dragon, or leadership with imposter syndrome", Oleksandr Zin..."How to tame the dragon, or leadership with imposter syndrome", Oleksandr Zin...
"How to tame the dragon, or leadership with imposter syndrome", Oleksandr Zin...
 

Recently uploaded

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Victor Rentea
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Recently uploaded (20)

DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptx
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 

Володимир Цап "Constraint driven infrastructure - scale or tune?"

  • 1. Constraint Driven Infrastructure Scale and tune to save money Volodymyr Tsap Highload FWdays 2017 Volodymyr Tsap CTO at SHALB Constraint Driven Infrastructure
  • 2. About Me 15 years supporting Linux for money 10 years Enterprise Java Applications and SDK’s support 8 years as a CTO in own company
  • 5. Platform Dependent Proc Extremely low price OS/Hypervisor lock out Orchestration freedom Don’t waste your time on $ calculations Dedicated Server PaaS Flexible PasYG price Does not require any system administration Failover by design Cloud Provider Price could be managed by resource freeing Unlimited scaling Rapid env. deployment using platform tools Bare Metal
  • 6. Hardware Sample on AWS Dev: m4.2xlarge 8vCPU(11863PM) / 32GB / 500 GB Storage Prod: m4.xlarge 4vCPU(5931PM**) / 16GB / 100 GB Storage 10 % Change in daily snapshot 2 Elastic IP 1.5 Tb traffic $648 / Month* 27.4PM/$ * https://calculator.s3.amazonaws.com/index.html **https://www.cpubenchmark.net/cpu.php?cpu=Intel+Xeon+E5-2676+v3+%40+2.40GHz
  • 7. EC2 Spot + RDS on AWS RDS(save up to 42% by upfront year payment): db.t2.medium (2СPU(2)4GB) = 48,96 $ db.m4.large (2CPU(6.5) 8GB) = 252$ Spot instances (6 hours): m4.2xlarge = 187.2 m4.xlarge = 93.6 EBS $0.10 per 600G = 60$ $514-641 / Month* 34PM/$ * https://calculator.s3.amazonaws.com/index.html * https://www.cpubenchmark.net/cpu.php?cpu=Intel+Xeon+E5-2676+v3+%40+2.40GHz
  • 8. PaaS Heroku Dyno Performance-l 14GB CPU 46x(PM9073) $500/mo Or 10x Standard-2x 1GB CPU 2-8X $50/mo $500 / Month* 18PM/$ 0,65xAWS* https://devcenter.heroku.com/articles/dyno-types#available-dyno-types *https://www.quora.com/How-powerful-is-one-Heroku-dyno-Is-it-roughly-equivalent-to-an-EC2-Sm all-instance
  • 9. Enterprise Server Config on OVH.com Intel 2x Xeon E5-2630v3(PM18649) / 128GB Hardware Raid 2x2TB + 2x480GB SSD 500 Mbps guaranteed bandwidth 5 TB* Remote Backup storage VMware ESXi supported * https://www.ovh.ie/dedicated_servers/enterprise/ $333 / Month* 56PM/$ 2xAWS
  • 10. 2 x Soft-Raid Servers Config for OVH.com 2 servers same hardware: Intel Xeon E3-1270v6(11324PM) / 64GB SoftRaid 2x2TB 500 Mbps bandwidth 1 TB* Remote Backup storage $282 Month 80.3PM/$ 3xAWS
  • 11. 2 x Desktop Hardware Dev and Prod dedicated each: AX60-SSD AMD Ryzen 7 1700X (14651PM) / 64 GB 2 x 500 GB SSD Guaranteed bandwidth 1 Gbit/s-Port $70 Month 2 TB Backup Storage - $ 12 $152 Month 192.7PM/$ 7xAWS
  • 12. Hardware price needs to be taken into account DailyDaily
  • 14. Daily load sample for corporate mail system
  • 15. Daily load sample for E-commerce platform
  • 16. Daily load sample for news website
  • 17. Daily load sample for PaaS Provider
  • 18. Scaling can save your money only if workload is not planar
  • 20. Operating system Points to check Filesystem - ext4, xfs, noatime Memory - disable swap/swappiness Network - tcp r/wmem, buffers Process - limits, open files Prepare ready images no post-installation provisioning Compile - it could save 10-20%
  • 21. Distro Selection Lifecycle RHEL/CentOS - 10 years Ubuntu LTS - 5 years Debian ~ 3 years Gentoo - rolling release Upgrade CentOS - pain Ubuntu/Debian - ok Gentoo - pain/ok Packages Available RHEL/CentOS repo - 6000 Ubuntu Universe - 23,000 Debian - 23,000 Gentoo - 19,692 OpenStack, K8, Swarm: CentOS/Ubuntu - Good Debian - Normal Lyfecycle Packages AvailableLyfecycle Upgrade procedure Platform Support
  • 22. Virtualization Containerization Points to check Free and popular: KVM, Xen, Docker, ESXi* Live migration support Hosted OS requirements For licensed features fill the top of hardware limits HCL could be bypassed
  • 23. Orchestration Points to check Deployment Simplicity Manageability Scalability Suitable for stateful and stateless apps Networking and multi-site support
  • 24. Databases Points to check Choose the DB by the planned workload Check the CAP Theorem Fault tolerance and recovery speed Use profilers and query monitoring Buffers and pools has significant impact
  • 25. How much it cost to support an infrastructure
  • 26. Price depends on Number of instance types and roles Quality of automation Incident response/resolution time Number request for env. changes Mad man coefficient
  • 27. Prod & Dev at same server $250 / Month
  • 28. 2-3 Servers, Failover, Basic Roles $500-800 / Month
  • 29. Multi DC, IaaC, CI/CD, Orchestration $1.2k-3k / Month K8/OS 3k-4k / Month
  • 30. Geo Distributed Orchestration, Hybrid Clouds, Dedicated Ops $4k-6k / Month +$100 per in. type
  • 31. Saved money spend on people!
  • 32. Thank you! Volodymyr Tsap Co-founder/CTO at SHALB.com Email: voa@shalb.com Skype: volodymyr.tsap Linkedin: voatsap Facebook: volodymyr.tsap