Automating EC2 operations
2021-11-20 22:40 - 23:00 (JST)
Masaru Ogura (Japan)
‒ Serverworks Co., Ltd.
‒ JAWS-UG Sapporo / Morning Meeting
‒ APN ALL AWS Certifications Engineer
‒ AWS Community Builder
AWS Cloud
VPC
Public subnet
Corporate
data center
VPS (Virtual Private Server)
(CentOS 5 / WordPress)
Internet
Replication Server Target
TCP 443
TCP 443
TCP 1500
AWS API (Replication Configration)
Data replication
(encrypted)
CloudEndure Migration
AWS Cloud
VPC
Public subnet
Amazon Linux 2
(WordPress)
CentOS 5
(WordPress)
Amazon CloudFront
ACM
Systems Manager
CloudWatch
AWS Backup
AWS Lambda
Amazon SNS
(HTTPS)
(HTTP)
AWS Cloud
VPC
Public subnet
Amazon Linux 2
(WordPress)
CentOS 5
(WordPress)
Amazon CloudFront
ACM
Systems Manager
CloudWatch
AWS Backup
AWS Lambda
Amazon SNS
(HTTPS)
(HTTP)
Automating
‒ Auto Backup
‒ Auto Patching
‒ Auto Recovery
Auto Backup
AWS Backup
‒ Scheduled backup (AMI)
AWS Cloud
VPC
Public subnet
Amazon Linux 2
(WordPress)
CentOS 5
(WordPress)
Amazon CloudFront
ACM
Systems Manager
CloudWatch
AWS Backup
AWS Lambda
Amazon SNS
Get AMI once a day
Auto Patching
AWS Systems Manager
‒ Patch Manager
‒ Scheduled patching
AWS Cloud
VPC
Public subnet
Amazon Linux 2
(WordPress)
CentOS 5
(WordPress)
Amazon CloudFront
ACM
Systems Manager
(Patch Manager)
CloudWatch
AWS Backup
AWS Lambda
Amazon SNS
Scheduled patching
Auto Recovery (part 1)
Amazon CloudWatch alarms
‒ Check metrics
‒ StatusCheckFailed_System (HW)
AWS Cloud
VPC
Public subnet
Amazon Linux 2
(WordPress)
CentOS 5
(WordPress)
Amazon CloudFront
ACM
Systems Manager
CloudWatch alarm
AWS Backup
AWS Lambda
Amazon SNS
Check StatusCheck
metrics
AWS Cloud
VPC
Public subnet
Amazon Linux 2
(WordPress)
CentOS 5
(WordPress)
Amazon CloudFront
ACM
Systems Manager
CloudWatch alarm
AWS Backup
AWS Lambda
Amazon SNS
If the alarm goes up,
restart EC2.
Auto Recovery (part 2)
Amazon CloudWatch
‒ Process Monitoring
(with procstat plugin)
‒ httpd, mysqld
AWS Cloud
VPC
Public subnet
Amazon Linux 2
(WordPress)
CentOS 5
(WordPress)
Amazon CloudFront
ACM
Systems Manager
(Run Command)
CloudWatch alarm
AWS Backup
Check Process
number metrics
AWS Lambda
Amazon SNS
AWS Cloud
VPC
Public subnet
Amazon Linux 2
(WordPress)
CentOS 5
(WordPress)
Amazon CloudFront
ACM
Systems Manager
(Run Command)
CloudWatch alarm
AWS Backup
Notify SNS
AWS Lambda
Amazon SNS
AWS Cloud
VPC
Public subnet
Amazon Linux 2
(WordPress)
CentOS 5
(WordPress)
Amazon CloudFront
ACM
Systems Manager
(Run Command)
CloudWatch alarm
AWS Backup
Execute lambda
from SNS
AWS Lambda
Amazon SNS
AWS Cloud
VPC
Public subnet
Amazon Linux 2
(WordPress)
CentOS 5
(WordPress)
Amazon CloudFront
ACM
Systems Manager
(Run Command)
CloudWatch alarm
AWS Backup
Execute Run Command
from Lambda
AWS Lambda
Amazon SNS
AWS Cloud
VPC
Public subnet
Amazon Linux 2
(WordPress)
CentOS 5
(WordPress)
Amazon CloudFront
ACM
Systems Manager
(Run Command)
CloudWatch alarm
AWS Backup
Start httpd or
mysqld process
AWS Lambda
Amazon SNS
Summary
‒ Automation makes operation easier.
‒ Automation allows you to use your free
time for other things.
‒ Let's automate the operation!
20211120 Automating EC2 operations / EC2運用の自動化

20211120 Automating EC2 operations / EC2運用の自動化

  • 1.
  • 2.
    Masaru Ogura (Japan) ‒Serverworks Co., Ltd. ‒ JAWS-UG Sapporo / Morning Meeting ‒ APN ALL AWS Certifications Engineer ‒ AWS Community Builder
  • 3.
    AWS Cloud VPC Public subnet Corporate datacenter VPS (Virtual Private Server) (CentOS 5 / WordPress) Internet Replication Server Target TCP 443 TCP 443 TCP 1500 AWS API (Replication Configration) Data replication (encrypted) CloudEndure Migration
  • 4.
    AWS Cloud VPC Public subnet AmazonLinux 2 (WordPress) CentOS 5 (WordPress) Amazon CloudFront ACM Systems Manager CloudWatch AWS Backup AWS Lambda Amazon SNS (HTTPS) (HTTP)
  • 5.
    AWS Cloud VPC Public subnet AmazonLinux 2 (WordPress) CentOS 5 (WordPress) Amazon CloudFront ACM Systems Manager CloudWatch AWS Backup AWS Lambda Amazon SNS (HTTPS) (HTTP)
  • 6.
    Automating ‒ Auto Backup ‒Auto Patching ‒ Auto Recovery
  • 7.
    Auto Backup AWS Backup ‒Scheduled backup (AMI)
  • 8.
    AWS Cloud VPC Public subnet AmazonLinux 2 (WordPress) CentOS 5 (WordPress) Amazon CloudFront ACM Systems Manager CloudWatch AWS Backup AWS Lambda Amazon SNS Get AMI once a day
  • 9.
    Auto Patching AWS SystemsManager ‒ Patch Manager ‒ Scheduled patching
  • 10.
    AWS Cloud VPC Public subnet AmazonLinux 2 (WordPress) CentOS 5 (WordPress) Amazon CloudFront ACM Systems Manager (Patch Manager) CloudWatch AWS Backup AWS Lambda Amazon SNS Scheduled patching
  • 11.
    Auto Recovery (part1) Amazon CloudWatch alarms ‒ Check metrics ‒ StatusCheckFailed_System (HW)
  • 12.
    AWS Cloud VPC Public subnet AmazonLinux 2 (WordPress) CentOS 5 (WordPress) Amazon CloudFront ACM Systems Manager CloudWatch alarm AWS Backup AWS Lambda Amazon SNS Check StatusCheck metrics
  • 13.
    AWS Cloud VPC Public subnet AmazonLinux 2 (WordPress) CentOS 5 (WordPress) Amazon CloudFront ACM Systems Manager CloudWatch alarm AWS Backup AWS Lambda Amazon SNS If the alarm goes up, restart EC2.
  • 14.
    Auto Recovery (part2) Amazon CloudWatch ‒ Process Monitoring (with procstat plugin) ‒ httpd, mysqld
  • 16.
    AWS Cloud VPC Public subnet AmazonLinux 2 (WordPress) CentOS 5 (WordPress) Amazon CloudFront ACM Systems Manager (Run Command) CloudWatch alarm AWS Backup Check Process number metrics AWS Lambda Amazon SNS
  • 17.
    AWS Cloud VPC Public subnet AmazonLinux 2 (WordPress) CentOS 5 (WordPress) Amazon CloudFront ACM Systems Manager (Run Command) CloudWatch alarm AWS Backup Notify SNS AWS Lambda Amazon SNS
  • 18.
    AWS Cloud VPC Public subnet AmazonLinux 2 (WordPress) CentOS 5 (WordPress) Amazon CloudFront ACM Systems Manager (Run Command) CloudWatch alarm AWS Backup Execute lambda from SNS AWS Lambda Amazon SNS
  • 19.
    AWS Cloud VPC Public subnet AmazonLinux 2 (WordPress) CentOS 5 (WordPress) Amazon CloudFront ACM Systems Manager (Run Command) CloudWatch alarm AWS Backup Execute Run Command from Lambda AWS Lambda Amazon SNS
  • 20.
    AWS Cloud VPC Public subnet AmazonLinux 2 (WordPress) CentOS 5 (WordPress) Amazon CloudFront ACM Systems Manager (Run Command) CloudWatch alarm AWS Backup Start httpd or mysqld process AWS Lambda Amazon SNS
  • 21.
    Summary ‒ Automation makesoperation easier. ‒ Automation allows you to use your free time for other things. ‒ Let's automate the operation!