It is expected that 75% of all databases will run in the cloud by 2022. In the meanwhile we noticed that we have exactly the same performance issues with databases in the cloud as we had 20 years ago on premises. In those days we carefully had to select the resources. But today with SSDs, fast network connectivity,etc the careful selection of resources is less important. On the opposite, in the cloud, we need again to check the resources assigned very carefully to control cost and performances.
2. Who we are
28.05.2020 Page 2Back to the future
The Company
>Founded in 2010
>More than 70 specialists
>Specialized in the Middleware Infrastructure
> The invisible part of IT
>Customers in Switzerland and all over Europe
Our Offer
>Consulting
>Service Level Agreements (SLA)
>Trainings
>License Management
3. About me
28.05.2020 Page 3Back to the future
Hervé Schweitzer
CTO
Principal consultant
+41 79 963 43 67
herve.schweitzer[at]dbi-services.com
PGConf.EU
@herveschweitzer
herve-schweitzer
6. 28.05.2020Back to the future Page 6
Introduction
My vision
That's my vision, it don't mean that is the future or your vision
I will not speak about what is cool in the Cloud
But about what you have to take care !
7. 28.05.2020Back to the future Page 7
Introduction
My vision
Why Cloud adoption accelerate ?
DevOps
Why ?
> It best fit with the Cloud
> They want to test and move quickly in production
But
> Brings chaos in the migration to the Cloud
> New standard are not carefully evaluated
8. 28.05.2020Back to the future Page 8
Introduction
Future
On-Premises database Revenue will continue to decrease
By 2022, 75% of all databases will be deployed or migrated to the cloud
Source : https://www.gartner.com/en/newsroom/press-releases/2019-07-01-gartner-says-the-future-of-the-database-market-is-the
9. 28.05.2020 Page 9Back to the future
1
2
3
4
5
6
History
> Storage disk
> Memory
> CPU
> Network
10. 28.05.2020Back to the future Page 10
History
Storage disk
Cost of 1 GB in 1980 ?
Cost of 1 GB in 2000 ?
Cost of 1 GB in 2014 ?
Cost of 1 TB in 2014 ?
Cost of 1 TB in 2020 ?
cost = 10 -0.2502(year-1980)+6.304
1980 2000 2020
1,000,000 $
10 $
0,04 $
40 $
10 $
11. 28.05.2020Back to the future Page 11
History
Memory
Cost of 1 MB in 1980 ?
Cost of 1 MB in 2000 ?
Cost of 1 MB in 2020 ?
1980 2000 2020
0.01 $
6480 $
1 $
12. 28.05.2020Back to the future Page 12
History
CPU
When appear the first Multi-core processor ?
Clock speed in 1980 ?
Clock speed in 2000 ?
Clock speed in 2020 ? 6
1000
5000
0
1000
2000
3000
4000
5000
6000
1980 2000 2020
Year
2004
6 MHz
1 GHz
5 GHz
13. 28.05.2020Back to the future Page 13
History
Network
Network speed in 1980 ? 10Mb/s
Network speed in 2000 ? 1Gb/s
But what about Internet
Network speed in 1990 ? 1.2 Kb/s
Network speed in 2000 ? 56 Kb/s
Network speed in 2010 ? 4 Mb/s
Network speed in 2020 ? 2 Gb/s 0 0 4
2000
0
500
1000
1500
2000
2500
1990 2000 2010 2020
Year
14. 28.05.2020 Page 14Back to the future
1
2
3
4
5
6
On-premise 20 years ago
> Infrastructure management
> Team management
> Outcome
15. 28.05.2020Back to the future Page 15
On-premise 20 years ago
Infrastructure management
Investment for an application
>Take care on detailed resource usage
> Hardware is expensive
>Server (application, database, etc..)
> Detailed configuration (CPU, memory)
>Disk configurations
> Local attached disk storage with
> Many controller
> Many disks to get the required IOPS
>Network
> Only 100Mb was available end of 90's
> Data traffic had to evaluate carefully
Application 2Application 1 Application 3
16. 28.05.2020Back to the future Page 16
On-premise 20 years ago
Team management
Vertical stack Model with dedicated teams for each application
Application
Team 1
Application
Team 3
Application
Team 2
17. 28.05.2020Back to the future Page 17
On-premise 20 years ago
Outcome
Results of the infrastructure ?
>Many hardware provider (HP, IBM, SUN, etc..)
>Many different server models (small, medium and big servers)
>Many different locally attached storage solution
>Many operating systems ( HPUX, AIX, SUN Solaris, etc..)
>Lots of ethernet cable connected between the switches (spaghetti)
Handing and management
>Many specialist was required
>Many partner was involved
>Complex infrastructure to manage and maintain
> Upgrade of hardware
> Patching
18. 28.05.2020 Page 18Back to the future
1
2
3
4
5
6
On-premise today
> Infrastructure management
> Team management
> Outcome
19. 28.05.2020Back to the future Page 19
On-premise today
Infrastructure management
Careful selection is less important today
>Big disks with fast answers time available (SSD, Flash)
>Multicore processor (up to 24 cores)
>NVMe card are very fast
>2Gb/s network available
However take care on proprietary software licensing model
>Oracle and MSSQL Server are based on the number of core CPU
>SAP HANA is based on amount of memory
>etc...
20. 28.05.2020Back to the future Page 20
On-premise today
Team Management
OS team
Database team
Network team
Storage team
Horizontal stack Model with dedicated teams for each stack
21. 28.05.2020Back to the future Page 21
On-premise today
Outcome
Infrastructure standards are available for all stacks
>Machine
>Operating Systems
>Network
>Storage
>Database
>Application Server
>etc….
With Regular or Automatic patching for some of them
>Operating Systems
>Database
22. 28.05.2020 Page 22Back to the future
1
2
3
4
5
6
Cloud infrastructure today
> Back to the Future
> Infrastructure management
> Team management
> Outcome
23. 28.05.2020Back to the future Page 23
Cloud Infrastructure today
Back to the future
Same issues as 20 years agoSame issues as 20 years ago
24. 28.05.2020Back to the future Page 24
Cloud Infrastructure today
Infrastructure management
Resource Management
>Take care on detailed resource usage
> Price is based on consumption !
>Server configuration (application, database, etc..)
> detailed configuration (CPU, memory) AWS
You can reduce the number of
CPUs manually to be license compliant…
…You still pay for the shape’s CPUs
25. 28.05.2020Back to the future Page 25
Cloud Infrastructure today
Infrastructure management
Disk configuration
> Cloud disks are based on IOPS
> Attach more disks to get the required performance
> Better use 2*400GB disks instead of one of 800GB
26. 28.05.2020Back to the future Page 26
Cloud Infrastructure today
Infrastructure management
Network configuration
> Upload are free, but download must be managed carefully
> It exist different network configuration (DirectConnect at AWS)
> Detailed configuration of the buffer size will enhance the performance
Network roundtrip
>Again At least 60ms are required for a roundtrip connection to the USA
>10ms for approximately 1000km
27. 28.05.2020Back to the future Page 27
Cloud Infrastructure today
Infrastructure management
Example with different BLOB buffer size
>Application server is located On-Premise
>Test 1 : Read from a 60 Mb BLOB (binary large object) from a database located On-Premise
>Test 2 : Read from a 60 Mb BLOB (binary large object) from a database in the Cloud
BLOB Buffer
(bytes)
Test 1 : time(s)
from On-Premise
Test 2 : time(s)
from Cloud
Delta % Delta in seconds
8192 6 14.4 140% 8.4s
16384 4.5 14.1 131% 9.6s
32768 4.2 13.8 128% 9.6s
131072 2.6 6.6 153% 4s
524288 1.2 3.1 158% 1.9s
1048576 0.7 2.0 185% 1.3s
2097152 0.6 1.5 150% 0.9s
28. 28.05.2020Back to the future Page 28
Cloud Infrastructure today
Team management
Vertical stack Model with dedicated teams for each application
Application Team 1
29. 28.05.2020Back to the future Page 29
Cloud Infrastructure today
Outcome
Results of the infrastructure ?
>Many Cloud provider (AWS, Oracle, Azure, Google, etc…)
>Many different server images (small, medium and big)
>Many different disk IO performance models
>Many Operating systems
>Many Cloud accounts with different security rules
Handing and management
>Many Specialist are required to manage the different Cloud providers
>Many Partner are involved
>Complex infrastructure to manage and maintain
> Upgrade of Hardware (as each service use the own images, also consequence from the DevOps growing)
> Patching (could be automated, but as many different source are used it is complex to implement it.
30. 28.05.2020 Page 30Back to the future
1
2
3
4
5
6
Recommendations
> Overview
> Landing Zone
> Landing Zone for Networking (AWS)
> Microsoft Azure
> Oracle OCI
31. 28.05.2020Back to the future Page 31
Recommendation
Overview
Define standards
>Before deploying many Cloud Infra over many Cloud accounts
Dedicated team
>All requests must be centralized and must apply these standards
>Must be trained and have the knowledge of the used technologies
Full Cloud Application infrastructure
>Otherwise you will have to manage with performance issues between On-Premise and the Cloud
Network
>Try to minimize network traffic between the clients and the Cloud Infrastructure
32. 28.05.2020Back to the future Page 32
Recommendation
Landing Zone
What is a Landing Zone ?
>Is not a service
>Is a solution to helps quickly set up a secure environment based on best practices
>Include the core components of your Cloud Infrastructure
>It should be well thought out and strategized
Standardize
Accounts
or Tenancy
Identity
and access
management
Security Networking Automation
33. 28.05.2020Back to the future Page 33
Recommendation
Landing Zone for Networking(AWS)
Infrastructure Account
Application Account
Subnets sharing
TGW
S2S VPN
DMZ
IGW
Pub Sub
Pub Sub
Priv Sub
Priv Sub
Internet
Subnets sharing
Application Account
SBX
Subnet 1
Subnet 2
APP
Subnet 3
Subnet 4
NGW
NGW
VPC/VCN/VNet
34. 28.05.2020Back to the future Page 34
Recommendation
Microsoft Azure
Source :
Azure-Contoso
35. 28.05.2020Back to the future Page 35
Recommendation
Oracle OCI
Source: Oracle
Compartment : Networkinfra
>Network infrastructure managed by Network Admins
>Resources: VCN, Security lists, Internet gateways, DRG's
Compartment : Dev, Test, Prod Network
>compartment to easily write policy about the network usage
>Resources: Subnets, Databases, Storage (if shared)
Compartment : Projects
>Resources used by a particular team or project
>Resources : Compute Instances, Databases, Block Volumes, etc
>One per team that needs it's own environment
36. Any questions?
Please do ask!
We would love to boost
your IT-Infrastructure
How about you?
Zürich
Basel
Delémont
Nyon
Bern
28.05.2020 Page 36Back to the future