© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
, !
Amazon EC2
AWS
DevOps Engineer
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
1. EC2 Compute overview
2. AWS Nitro (Hypervisor, SSD, Security)
3. Amazon EC2 (Intel, AMD, Graviton)
4. Amazon EC2 (HPC/TRN/INF)
5.
Agenda
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EC2
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Elastic Compute Cloud (EC2)
A W S ,
Amazon EC2
•
• ,
•
• ARM | X86 | AMD
• OS : Linux | Windows | MAC
• Packaged | Custom | Community AMIs
• : On-Demand, RI, Spot, Savings Plans
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
M
T
C
R
( I/O) I
D
GPU P
G
Elastic Block Store (EBS)
Elastic Fabric Adapter
Elastic Inference
Elastic Graphics
Linux, Unix, Windows,
macOS
(AWS Graviton, Intel, AMD)
( 4.5 GHz)
( 24 TiB)
(HDD NVMe)
(GPU ,FPGA & ASIC)
( 800 Gbps)
(Nano 112xlarge)
https://aws.amazon.com/ko/ec2/instance-types/
600+
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EC2
General purpose
Compute optimized
Memory optimized
Storage optimized
Mac T4g T3 T3a M6g M6i M6a A1
C7g C6i C6a Hpc6a
R6g R6a R6i X2g X2iezn
High
Memory
z1d
P4 G5 DL1 Trn1 Inf1 F1 VT1
I4g I41 D3 H1
M1 R7g
M7g
Hpc6id
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EC2
(Size)
(Generation)
C 5 d . 2xlarge
•
• ( , ,..)
•
•
•
• d : NVMe SSD
• e :
• n :
• z : CPU
• i : Intel
• a : AMD
• g : AWS Graviton
• Mac :
•
• T-shirt
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
2 0 1 7 2 0 1 8 2 0 1 9 2 0 2 0
2 0 1 6
2 0 1 5
2 0 1 4
2 0 1 3
2 0 1 2
2 0 1 1
2 0 1 0 2 0 2 1
ENHANC ED
NETWOR K I N G
NITRO
SYSTEM
X EN
ENHANC ED
STOR AG E
GRAVITON
NIT RO SSD
INFERENTIA
GRAV IT ON2
Amazon EC2
2 0 2 3
2 0 2 2
Trainium
Inf2
Nitro 시스템 도입 이후
인스턴스 개수 및 성능 비약적 개선
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
?
.
+
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EC2
,
/ 72%,
90%
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Nitro
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Nitro
,
• , ,
Amazon EC2 Nitro
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Nitro
,
• , ,
Amazon EC2 Nitro
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Nitro v5
• 2x
• DRAM 50%
• PCIe 2
• 60% PPS
• 30%
• 40%
AWS Nitro
C7gn
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S P E C I N T 2 0 1 7
AWS Vendor
A
Vendor
B
M E M C A C H E D
AWS Vendor
A
Vendor
B
N G I N X
W E B S E R V I N G
R E D I S
-15%
-22%
-8%
-16%
-11%
-27%
AWS Vendor
A
Vendor
B
AWS Vendor
A
Vendor
B
Nitro
A M A ZO N E C 2 1 5 %
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Nitro
Nitro Cards Nitro Nitro
CPU
VPC
Amazon Elastic Block Store
(Amazon EBS)
Nitro SSDs
System Controller
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
200 Gbps
400 Gbps
800 Gbps
2021
50 Gbps
2019
25 Gbps
2013 2015
2011
2008
2006
AWS Nitro
100 Gbps
1600 Gbps
High scale workloads
Network optimized
Baseline
Trn1
Trn1n
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
6 EC2-
EBS
2
, Telco
EC2 EBS
80Gbps EBS
,
200Gbps
200Gbps
NEW
C6i, M6i, and R6i
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Nitro SSD
Nitro
AES-256
AWS Nitro
I/O
60%
AWS SSD
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Intel
Amazon EC2 X86
• 3 Intel Xeon Scalable (Ice Lake)
• 128 vCPU, 1TiB , 75Gbps
• 30TiB AWS Nitro SSD NVMe
• I3 30%
• I/O 60%
• Microsoft SQL Server, Oracle ,NoSQL
•
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Graviton 2, 3
Amazon EC2
• 64 CPU , 256Gb 100Gbps
• I3 40%
• TB 44%
• , NoSQL ,
•
• 32 CPU , 192Gb 50Gbps
• I3en 45%
• TB 15%
• , ,
Graviton 2
Graviton 2
• IOS(SSD) EBS M7g, R7g, C7gn ( )
Graviton 3
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EC2
(Intel, AMD, AWS Graviton)
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AMD EPYC
processors
Intel Xeon
scalable processors
AWS Graviton
processors Mac Instances
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
350 Amazon EC2
Intel
AWS
Ice Lake
1 6 A W S
NEW NEW NEW
M6i(d)n C6i(d)n R6i(d)n
• 3 Intel Xeon Scalable
•
NEW
R7iz
• 4 Intel Xeon Scalable
•
•
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
3 Intel Xeon Scalable NVMe EC2
Amazon EC2 C6i(d)n, M6i(d)n R6i(d)n
NEW
• 7.6TB NVMe SSD
• C5d, M5d R5d 15%
• 2 20%
TME(Total Memory Encryption)
•
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EC2 R7iz
4 Intel Xeon Scalable
NEW
• 128 vCPU, 1TiB
• 2.6 vCPU
• 20%
• DDR5
• 2.4
• 4 Intel Xeon
• EDA(Electronic Design Automation),
, ,
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AMD
X 8 6 1 0 %
Amazon EC2
AMD
AMD
C6A
M6A R6A
NEW NEW NEW
• 3 AMD EPYC
• 2.5
• 2 EBS
10%
M5a/R5a 35%
C5a 15%
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Graviton2
40%
Linux
AWS ISV
x86
40%
256 DRAM
Graviton2
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
DDR4 50%
DDR5
CPU
60%
Graviton2
25%
2
AWS Graviton3
✓ ML 3x
Graviton3
NEW
DDR5
C7g
NEW
Graviton Nitro v5
ARM EC2 ,
AI/ML
C7gn
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Graviton AWS
G R A V I T O N
Amazon
DocumentDB
Amazon
Aurora
Amazon RDS Amazon
ElastiCache
Amazon
MemoryDB
Amazon
Neptune
Amazon
OpenSearch
Service
Amazon
EMR
Analytics Compute and containers
AWS
Lambda
AWS
Fargate
AWS Elastic
Beanstalk
Amazon Elastic
Kubernetes
Service (EKS)
Amazon Elastic
Container
Service (ECS)
AI/ML
Amazon
SageMaker
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Graviton
G R A V I T O N 2 , 3 T C O
20% 40%
AWS Graviton ,
40%
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EC2
(HPC/TRN/INF)
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon FSx
for Lustre
AWS ParallelCluster
AWS Batch
HPC
H P C
, HPC
Graviton3E EFA
2023
AMD CPU
Elastic Fabric Adapter
+100 Gbps networking
NEW NEW
3 CPU SSD
NEW
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
x86
FEA(Finite Element Analysis)
HPC 2.2
200Gbps
Amazon EC2 Hpc6id
Amazon EC2 HPC
HPC
,
,
FEA
1TB 15.2TB NVMe
HPC 2
Elastic Fabric Adapter
NEW
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
200Gbps
Nitro v5
2
EFA 25%
HPC
HPC
Amazon EC2 Hpc7g
Amazon EC2 HPC
AWS ParallelCluster
AWS
Hpc7g
Graviton 3E
x86
CFD
60%
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
M L
TRN1/TRN1n
AWS TRAINIUM
Training ( )
P4DE
NVIDIA A100
TENSOR CORE
Inference( )
INF2
AWS INFERENTIA
NEW
NEW
NEW 4
1/10
Trainium Inferentia
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EC2 Trn1/Trn1n
NEW
• 16 Trainium Accelerator
(512GiB HBM2 , 800Gbps(Trn1), 1600Gbps(Trn1n)
8TB NVMe )
• Amazon EC2
• Trainium
Amazon EC2 UltraCluster
• GPU 50%
• , , ,
• PyTorch, Tensor Flow
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EC2 Inf2
NEW
• 100B
• Inf1 4 10
• 12 Inferentia2
• 384GB HBM2e
• 192GB/s
• PyTorch TensorFlow
• GPU 45%
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
(EC2 )
• (200Gbps)6
• M, R, C , , 200Gbps
• EBS ( 80Gbps), PPS 2
• Nitro v5
• , 60% PPS, 30%
• 40% , c7gn( )
• AWS Graviton 3
• Graviton 3
• c7g, c7gn( )
• HPC
• Hpc7g(Graviton HPC )
• Hpc6id( Xeon Scalable )
• /
• TRN1/TRN1n
• INF2
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
➢ hc99.kim@samsung.com
➢ skycube99@gmail.com
DevOps Engineer, 13
➢ Mobile TVPlus, Samsung Podcast 4
2012 AWS
Kubernetes
Terraform
Serverless (Fargate, AuroraDB)
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
배경
EKS + EC2(x86)
3 ,
Container : Alpine Linux
APM : Datadog
Application : Java8 / Spring
CI/CD : GitHub, GitAction
Image Repository : AWS ECR
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ARM (Apple M1, AWS Graviton )
ESG
CPU,
EC2
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
어떻게 문제를 해결 하였는지
. (EC2)
3 Graviton
Managed Service EC2 .
Graviton arm .
Application EC2 x86 arm
?
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Graviton
POD
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
>
1) S/W AMD/ARM
• awscli2
ARM/AMD
• ARM/AMD S/W
• Yum/apt Linux
CPU
ANSIBLE
멀티플랫폼 이미지빌드 트러블슈팅
호환성 확인
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
> (1/3)
2)
x86 ARM
.
k8S DEPLOMENT
CPU Arch
.
Docker hub
MULTI PLATFORM .
DOCKER BUILDX !
DOCKER BUILDX
.
!
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
> (2/3)
2)
x86 arm arch
?
!
QEMU emulator !
QEMU
CPU .
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
> (3/3)
3)
ECR MULTI .
URL CPU .
x86 arm .
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
> (1/4)
4) - 1
STG
pod
!
• pod CPU 100%
• pod
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
> (2/4)
4) – 1
ALPINE LINUX
1
JDK ALPINE LINUX
.
2
JDK ALPINE
JAVA
ALPINE LINUX APK
JDK
!
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
> (3/4)
4) – N
ALPINE LINUX JDK
.
!
•
• JDK FIX ARM64 .
• ALPINE LINUX Debian LINUX ( )
• JAVA ( )
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
> (4/4)
4) –
100
pod
APM DATADOG
Datadog Agent
POD
.
K8S POD
Dependency .
.
!
POD
DATADOG
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
API
.
APPLICATION
ARM .
15%
CLASS 15%
.
인스턴스 타입 인스턴스 비용($)
교체 전 C5.2xlarge $0.34
교체 후 C7g.2xlarge $0.29
절감 비율 15%
* US WEST Oregon
응답속도 개선
P50 5.6%
P75 4.5%
P90 48.2%
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
향후
Graviton
Managed Service Graviton
JAVA17 . ?
JDK ARM64
JAVA
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
감사합니다.

AWS Summit Seoul 2023 | 가격은 저렴, 성능은 최대로! 확 달라진 Amazon EC2 알아보기

  • 1.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved.
  • 2.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. , ! Amazon EC2 AWS DevOps Engineer
  • 3.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. 1. EC2 Compute overview 2. AWS Nitro (Hypervisor, SSD, Security) 3. Amazon EC2 (Intel, AMD, Graviton) 4. Amazon EC2 (HPC/TRN/INF) 5. Agenda
  • 4.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon EC2
  • 5.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Amazon Elastic Compute Cloud (EC2) A W S , Amazon EC2 • • , • • ARM | X86 | AMD • OS : Linux | Windows | MAC • Packaged | Custom | Community AMIs • : On-Demand, RI, Spot, Savings Plans
  • 6.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. M T C R ( I/O) I D GPU P G Elastic Block Store (EBS) Elastic Fabric Adapter Elastic Inference Elastic Graphics Linux, Unix, Windows, macOS (AWS Graviton, Intel, AMD) ( 4.5 GHz) ( 24 TiB) (HDD NVMe) (GPU ,FPGA & ASIC) ( 800 Gbps) (Nano 112xlarge) https://aws.amazon.com/ko/ec2/instance-types/ 600+
  • 7.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Amazon EC2 General purpose Compute optimized Memory optimized Storage optimized Mac T4g T3 T3a M6g M6i M6a A1 C7g C6i C6a Hpc6a R6g R6a R6i X2g X2iezn High Memory z1d P4 G5 DL1 Trn1 Inf1 F1 VT1 I4g I41 D3 H1 M1 R7g M7g Hpc6id
  • 8.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Amazon EC2 (Size) (Generation) C 5 d . 2xlarge • • ( , ,..) • • • • d : NVMe SSD • e : • n : • z : CPU • i : Intel • a : AMD • g : AWS Graviton • Mac : • • T-shirt
  • 9.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. 2 0 1 7 2 0 1 8 2 0 1 9 2 0 2 0 2 0 1 6 2 0 1 5 2 0 1 4 2 0 1 3 2 0 1 2 2 0 1 1 2 0 1 0 2 0 2 1 ENHANC ED NETWOR K I N G NITRO SYSTEM X EN ENHANC ED STOR AG E GRAVITON NIT RO SSD INFERENTIA GRAV IT ON2 Amazon EC2 2 0 2 3 2 0 2 2 Trainium Inf2 Nitro 시스템 도입 이후 인스턴스 개수 및 성능 비약적 개선
  • 10.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. ? . +
  • 11.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Amazon EC2 , / 72%, 90%
  • 12.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS Nitro
  • 13.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. AWS Nitro , • , , Amazon EC2 Nitro
  • 14.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. AWS Nitro , • , , Amazon EC2 Nitro
  • 15.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. AWS Nitro v5 • 2x • DRAM 50% • PCIe 2 • 60% PPS • 30% • 40% AWS Nitro C7gn
  • 16.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. S P E C I N T 2 0 1 7 AWS Vendor A Vendor B M E M C A C H E D AWS Vendor A Vendor B N G I N X W E B S E R V I N G R E D I S -15% -22% -8% -16% -11% -27% AWS Vendor A Vendor B AWS Vendor A Vendor B Nitro A M A ZO N E C 2 1 5 %
  • 17.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. AWS Nitro Nitro Cards Nitro Nitro CPU VPC Amazon Elastic Block Store (Amazon EBS) Nitro SSDs System Controller
  • 18.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. 200 Gbps 400 Gbps 800 Gbps 2021 50 Gbps 2019 25 Gbps 2013 2015 2011 2008 2006 AWS Nitro 100 Gbps 1600 Gbps High scale workloads Network optimized Baseline Trn1 Trn1n
  • 19.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. 6 EC2- EBS 2 , Telco EC2 EBS 80Gbps EBS , 200Gbps 200Gbps NEW C6i, M6i, and R6i
  • 20.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. AWS Nitro SSD Nitro AES-256 AWS Nitro I/O 60% AWS SSD
  • 21.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Intel Amazon EC2 X86 • 3 Intel Xeon Scalable (Ice Lake) • 128 vCPU, 1TiB , 75Gbps • 30TiB AWS Nitro SSD NVMe • I3 30% • I/O 60% • Microsoft SQL Server, Oracle ,NoSQL •
  • 22.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. AWS Graviton 2, 3 Amazon EC2 • 64 CPU , 256Gb 100Gbps • I3 40% • TB 44% • , NoSQL , • • 32 CPU , 192Gb 50Gbps • I3en 45% • TB 15% • , , Graviton 2 Graviton 2 • IOS(SSD) EBS M7g, R7g, C7gn ( ) Graviton 3
  • 23.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon EC2 (Intel, AMD, AWS Graviton)
  • 24.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. AMD EPYC processors Intel Xeon scalable processors AWS Graviton processors Mac Instances
  • 25.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. 350 Amazon EC2 Intel AWS Ice Lake 1 6 A W S NEW NEW NEW M6i(d)n C6i(d)n R6i(d)n • 3 Intel Xeon Scalable • NEW R7iz • 4 Intel Xeon Scalable • •
  • 26.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. 3 Intel Xeon Scalable NVMe EC2 Amazon EC2 C6i(d)n, M6i(d)n R6i(d)n NEW • 7.6TB NVMe SSD • C5d, M5d R5d 15% • 2 20% TME(Total Memory Encryption) •
  • 27.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Amazon EC2 R7iz 4 Intel Xeon Scalable NEW • 128 vCPU, 1TiB • 2.6 vCPU • 20% • DDR5 • 2.4 • 4 Intel Xeon • EDA(Electronic Design Automation), , ,
  • 28.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. AMD X 8 6 1 0 % Amazon EC2 AMD AMD C6A M6A R6A NEW NEW NEW • 3 AMD EPYC • 2.5 • 2 EBS 10% M5a/R5a 35% C5a 15%
  • 29.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. AWS Graviton2 40% Linux AWS ISV x86 40% 256 DRAM Graviton2
  • 30.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. DDR4 50% DDR5 CPU 60% Graviton2 25% 2 AWS Graviton3 ✓ ML 3x Graviton3 NEW DDR5 C7g NEW Graviton Nitro v5 ARM EC2 , AI/ML C7gn
  • 31.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Graviton AWS G R A V I T O N Amazon DocumentDB Amazon Aurora Amazon RDS Amazon ElastiCache Amazon MemoryDB Amazon Neptune Amazon OpenSearch Service Amazon EMR Analytics Compute and containers AWS Lambda AWS Fargate AWS Elastic Beanstalk Amazon Elastic Kubernetes Service (EKS) Amazon Elastic Container Service (ECS) AI/ML Amazon SageMaker
  • 32.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. AWS Graviton G R A V I T O N 2 , 3 T C O 20% 40% AWS Graviton , 40%
  • 33.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon EC2 (HPC/TRN/INF)
  • 34.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Amazon FSx for Lustre AWS ParallelCluster AWS Batch HPC H P C , HPC Graviton3E EFA 2023 AMD CPU Elastic Fabric Adapter +100 Gbps networking NEW NEW 3 CPU SSD NEW
  • 35.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. x86 FEA(Finite Element Analysis) HPC 2.2 200Gbps Amazon EC2 Hpc6id Amazon EC2 HPC HPC , , FEA 1TB 15.2TB NVMe HPC 2 Elastic Fabric Adapter NEW
  • 36.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. 200Gbps Nitro v5 2 EFA 25% HPC HPC Amazon EC2 Hpc7g Amazon EC2 HPC AWS ParallelCluster AWS Hpc7g Graviton 3E x86 CFD 60%
  • 37.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. M L TRN1/TRN1n AWS TRAINIUM Training ( ) P4DE NVIDIA A100 TENSOR CORE Inference( ) INF2 AWS INFERENTIA NEW NEW NEW 4 1/10 Trainium Inferentia
  • 38.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Amazon EC2 Trn1/Trn1n NEW • 16 Trainium Accelerator (512GiB HBM2 , 800Gbps(Trn1), 1600Gbps(Trn1n) 8TB NVMe ) • Amazon EC2 • Trainium Amazon EC2 UltraCluster • GPU 50% • , , , • PyTorch, Tensor Flow
  • 39.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Amazon EC2 Inf2 NEW • 100B • Inf1 4 10 • 12 Inferentia2 • 384GB HBM2e • 192GB/s • PyTorch TensorFlow • GPU 45%
  • 40.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. (EC2 ) • (200Gbps)6 • M, R, C , , 200Gbps • EBS ( 80Gbps), PPS 2 • Nitro v5 • , 60% PPS, 30% • 40% , c7gn( ) • AWS Graviton 3 • Graviton 3 • c7g, c7gn( ) • HPC • Hpc7g(Graviton HPC ) • Hpc6id( Xeon Scalable ) • / • TRN1/TRN1n • INF2
  • 41.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  • 42.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. ➢ hc99.kim@samsung.com ➢ skycube99@gmail.com DevOps Engineer, 13 ➢ Mobile TVPlus, Samsung Podcast 4 2012 AWS Kubernetes Terraform Serverless (Fargate, AuroraDB)
  • 43.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. 배경 EKS + EC2(x86) 3 , Container : Alpine Linux APM : Datadog Application : Java8 / Spring CI/CD : GitHub, GitAction Image Repository : AWS ECR
  • 44.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. ARM (Apple M1, AWS Graviton ) ESG CPU, EC2
  • 45.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. 어떻게 문제를 해결 하였는지 . (EC2) 3 Graviton Managed Service EC2 . Graviton arm . Application EC2 x86 arm ?
  • 46.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. Graviton POD
  • 47.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. > 1) S/W AMD/ARM • awscli2 ARM/AMD • ARM/AMD S/W • Yum/apt Linux CPU ANSIBLE 멀티플랫폼 이미지빌드 트러블슈팅 호환성 확인
  • 48.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. > (1/3) 2) x86 ARM . k8S DEPLOMENT CPU Arch . Docker hub MULTI PLATFORM . DOCKER BUILDX ! DOCKER BUILDX . !
  • 49.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. > (2/3) 2) x86 arm arch ? ! QEMU emulator ! QEMU CPU .
  • 50.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. > (3/3) 3) ECR MULTI . URL CPU . x86 arm .
  • 51.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. > (1/4) 4) - 1 STG pod ! • pod CPU 100% • pod
  • 52.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. > (2/4) 4) – 1 ALPINE LINUX 1 JDK ALPINE LINUX . 2 JDK ALPINE JAVA ALPINE LINUX APK JDK !
  • 53.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. > (3/4) 4) – N ALPINE LINUX JDK . ! • • JDK FIX ARM64 . • ALPINE LINUX Debian LINUX ( ) • JAVA ( )
  • 54.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. > (4/4) 4) – 100 pod APM DATADOG Datadog Agent POD . K8S POD Dependency . . ! POD DATADOG
  • 55.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. API . APPLICATION ARM . 15% CLASS 15% . 인스턴스 타입 인스턴스 비용($) 교체 전 C5.2xlarge $0.34 교체 후 C7g.2xlarge $0.29 절감 비율 15% * US WEST Oregon 응답속도 개선 P50 5.6% P75 4.5% P90 48.2%
  • 56.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. 향후 Graviton Managed Service Graviton JAVA17 . ? JDK ARM64 JAVA
  • 57.
    © 2023, AmazonWeb Services, Inc. or its affiliates. All rights reserved. © 2023, Amazon Web Services, Inc. or its affiliates. All rights reserved. 감사합니다.