Amazon EC2 Container Service Deep dive

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

1
Amazon EC2 Container Service
Deep dive
Ryosuke Iwanaga
Solutions Architect, Amazon Web Services Japan

2
Agenda
• ContainerとDevOps
• Case studies
– Sony: Batch jobs
• Summary

3
ContainerとDevOps

4
DevOps lifecycle
Build Test ProductionDevelopment
<>
<>
Application
Code
Artifact

5
DevOps lifecycle
Build Test ProductionDevelopment
<>
<>
+
AMI Provisioning
Code
Application
Code
Artifact
Provisioning
C...

6
After Docker…
+ <>+
Build Test ProductionDevelopment
<>
<>
+
{} {} {}

7
After Docker…
+
Provisioning
Code
<>
Application
Code
Docker
Image
+
Dockerfile
Docker
Image
Build Test ProductionDevelo...

8
Dev and Ops
• Dev
– インフラに関するコードを書かずに、アプリをCI/CDする
– 価値あるコードを生み出し続ける
• Ops
– どんなアプリが動くかに依存しないインフラ管理
– スケーラビリティ、コスト最適化

9
Infrastructure for Docker containers
Build Test ProductionDevelopment Registry
Service A
Service B
Service C

10
Resource Utility of Heterogeneous Containers
35%
85%
~80%
Amazon ECS

11
Resource Utility of Heterogeneous Instances
Amazon ECS
Amazon EC2
Spot Fleet
+
c3.xlarge
c3.xlarge
c3.xlarge
r3.8xlarge...

12
Cluster管理とScheduler
• Cluster管理
– 計算機群のリソース、
状態を常に管理
• Scheduler
– Cluster全体を見て適切
にContainerを配置
CPU: 500
Mem: 300
CPU: ...

13 Source: eurosys2013.tudos.org/wp-content/uploads/2013/paper/Schwarzkopf.pdf

14
Docker
Task
Container Instance
Amazon
ECS
Container
ECS Agent
ELB
Internet
ELB
User / Scheduler
API
Cluster Management ...

15
Amazon ECS: Task Definition

16
Amazon ECS: Task Definition
• Containerの集合を定義
– 必ず同じInstanceで稼働
– 要求するリソースを指定
• CPU, memory, (Port)
• ボリュームも定義可能
– Inst...

17
Task Definition: Container Definition
{
"name": "simple-demo",
"image": "foo/my-demo",
"cpu": 10,
"memory": 500,
"portM...

18
Task Definition: Overview
Shared data volume
PHP App
Time of day
App
Task Definition

19
Task Definition: Overview
Container
Instance
Schedule
Shared data volume
PHP App
Time of day
App
Task Definition Task

20
Amazon ECS: Service

21
Amazon ECS: Service
• Web/APIの様に長期稼働する
ワークロードに最適
• Taskを必要数保ってくれるスケ
ジューラ
– 自動復旧にも対応
• 新しいTask Definitionをデプロ
イしつつ切替
• E...

22
Amazon ECS: Serviceの例

23
Amazon ECS: ServiceのUpdate
• Serviceが使うTask DefinitionをUpdateすると、
新しいTaskをデプロイできる
• 空いているリソースで新しいTaskを起動しなが
ら、徐々に古いTask...

24
Cluster
Amazon ECS: ServiceのUpdate
Service
Task Definition:1
Task:1Task:1 Task:1

25
Cluster
Amazon ECS: ServiceのUpdate
Service
Task Definition:1 Task Definition:2
Task:1Task:1 Task:1

26
Cluster
Amazon ECS: ServiceのUpdate
Service
Task Definition:1 Task Definition:2
Task:1Task:1 Task:1Task:2 Task:2

27
Cluster
Amazon ECS: ServiceのUpdate
Service
Task Definition:1 Task Definition:2
Task:1Task:2 Task:2

28
Cluster
Amazon ECS: ServiceのUpdate
Service
Task Definition:1 Task Definition:2
Task:1Task:2 Task:2Task:2

29
Cluster
Amazon ECS: ServiceのUpdate
Service
Task Definition:1 Task Definition:2
Task:2 Task:2Task:2

30
Case: Sony (Batch jobs)

© 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Konstantin Wilms, Enterprise Solutions Architect...

1秒1秒が大事
なぜ？
スピードがコストに跳ね返る

変化
なぜ？
動画エンコードのライフサイクルは速い

ソフトウェアは捨てられる
なぜ？
しばしば高いエンジニアリングコストで
v1.0 v2.0 v3.0

AWSがどう役立ったか？
どのようにして？
エンコードの課題を解決するために

Amazon ECS
スケジュール
Amazon EC2
処理
中心となるサービス群
保存
AWS Lambda
繋ぎ
Amazon EFS &
Amazon S3
100ms単位課金
インフラ管理不要
カスタムのバイナリ
中心となるストレージ...

アーキテクチャ全体
Source
Storage
Ingest
Container
Storage
EC2
Bootstrap
Transcode
ECS
EC2
Manager
Target
Stitch
Manager
 入力ファイルがや...

Auto Scaling
 単純な複数AZを使った
スケール
 ワークロードの単位で決
定論的なスケジューリン
グのために
Min=Max=Desired
 いつでも簡単に捨てるこ
とができる
 インスタンスのタイプと
トータルメモリが...

Amazon EC2 インスタンスの初期化
 起動時にECSクラスタ
に参加させる
 ECSクラスタの各イン
スタンスでAmazon
EFSをマウントする
 どのAZかを知るため
にメタデータにクエ
リする
 これ以外の魔法は、
全てD...

Amazon EFSでメディア処理
 メディアのチャンク用
の一時的なストレージ
 メディアのソースと
チャンクを移動する必
要がない
 Scales linearly
 線形にスケールする
 巨大なファイルを並列
で読み書きするのに...

Amazon ECSクラスタとスケジューラの設定
 キャパシティの単位
 共有ステータス、楽観的
並行制御
 単純なスケジューラの設
計 – list*, describe*,
run*, start*
 10 CPU単位で我々は
キャ...

コンテナの構造
FROM ubuntu:14.04
ENV FLASK_JOB https://s3/xxx/jobs/h264.sh
ENV FLASK_FRAG https://s3/xxx/media/frag-000.mp4
ENV F...

コンテナのデプロイパイプライン
docker save 2408e7a48bac
| sudo docker-squash -t
transcode-toolkit:1.01s
-verbose | docker load
 ロジックを...

44
まとめ

45
Batch Processing Open-source Paas Real-time Image Transformation
Solr Search Cluster
PaaSGaming Engine
Web Application ...

46 https://aws.amazon.com/docker/
AWS Container Partners

47
Amazon ECSまとめ
• 多数の本番稼働実績、多くのパートナー
– 2,000 containersが動いているお客様、エンタープライズ・大規模企業
• とてもシンプルなのに強力
– Master的なサーバ、Configuratio...

48
Appendix

49
Case: Remind

© 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Eric Holmes & Michael Barrett, Remind
October 20...

Remind
• A messaging platform for teachers.
• Chat/announcements/files
• Over 30 million users
• Used actively in ~50% of ...

Heroku was great, but…
• Every app on Heroku is publicly accessible
• Databases need to be exposed to Internet traffic
• L...

What we want from a PaaS
• AWS
• Flexibility
• Shared patterns for deployment
• Easy service operation
• Containers/Docker

Building an Empire

Design Goals
• Easy to operate
• Open source
• Support 12-factor stateless apps (12factor.net)
• Swappable scheduling back...

Empire :: V2
Scheduler Router Control Plane
ECS ELB
Heroku Platform API
Spec + emp CLI

Empire :: V2
An open-source, self-hosted PaaS for running
twelve-factor Docker apps backed by AWS
services

Twelve-Factor Tenants
I. Codebase
II. Dependencies
III. Config
IV. Backing Services
V. Build, release, run
VI. Processes
V...

12factor :: Dependencies
“Explicitly declare and isolate dependencies”
FROM ruby
RUN apt-get install imagemagick
RUN bundl...

12factor :: Build, release, run
“Strictly separate build and run stages”
Empire

12factor :: Build
$ git push

12factor :: Release, Run
Config
{}
Release
Amazon ECS

12factor :: Release, Run
$ cat Procfile
web: ./bin/web
worker: ./bin/worker
$ aws ecs list-services
arn:aws:ecs:us-east-1:...

Service Discovery
$ aws ecs describe-services --service api--web
"loadBalancers": [{
"containerName": "web”,
"containerPor...

12factor :: Concurrency
“Scale out via the process model”
$ emp scale web=10
$ aws ecs describe-service --service api--web...

12factor :: Dev/prod parity
“Keep development, staging, and production as similar as
possible”
$ docker run --env-file <(e...

12factor :: Logs
“Treat logs as event streams”
$ emp log
“GET / HTTP/1.1” 200
STDOUT Amazon Kinesis

12factor :: Admin processes
“Run admin/management tasks as one-off processes”
$ emp run rake db:migrate
Migrated

69
Case: Coursera

© 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Frank Chen, Coursera
Brennan Saeta, Coursera
Oct...

Bad Old Days of Batch Processing @ Coursera
Cascade
• PHP-based job runner
• Originally ran in screen sessions
• Polled AP...

Bad Old Days of Batch Processing @ Coursera
Saturn
• Scala scheduled batch job runner
• Powered by Quartz Scheduler librar...

What Else Did We Look At?
Home-grown Tech
• Tried, but proved
to be unreliable
• Difficult to
handle
coordination and
sync...

Amazon ECS to the Rescue
Little
maintenance
Integrated with
rest of AWS
Easy to
develop for

However…
Amazon ECS is a great building block,
but we still need to build tools around it
for our purposes.

What We Built: Iguazú
Marissa Strniste (https://www.flickr.com/photos/mstrniste/5999464924) CC-BY-2.0
• Batch Job Schedule...

Iguazú
Frontend
Iguazú
Scheduler
Iguazú
Backend
Iguazú: Architecture
CassandraServices Services
Iguazú
Admin
ECS
Workers
S...

Iguazú: Developer / Ops User Interface

Deploying Jobs
Easy Deployment
1. Developers  Merge into master. Done!
Jenkins Build Steps:
1. Builds zip package from ma...

Since April 2015…
65 jobs in
production
>1000 runs
per day
44 different
scheduled jobs

Programming Assignments at Coursera

The Security Challenge
Compiling and running untrusted, arbitrary code in
Amazon EC2
Would you like to compile and run C c...

What We Built: GrID
Patrick Hoesly (https://www.flickr.com/photos/zooboing/5665221326/) CC-BY-2.0
• Service + architecture...

High-level GrID Architecture
Learners
GrID
Iguazú
S3 Bucket
ECS API
Grading
Machines
VPC
Firewalls
Production Acct GrID Gr...

Share Slideshare

LinkedIn
Facebook
Twitter

Embed

Size (px)

Show related Slideshows at end

WordPress Shortcode

Link

Share
Email

AWS Blackbelt 2015シリーズ Amazon EC2 C... by Amazon Web Servic... 37921 views
AWS初心者向けWebinar AWSでBig Data活用 by Amazon Web Servic... 15492 views
Amazon Elastic MapReduce with Hive/... by Amazon Web Servic... 18088 views
AWSでのビッグデータ分析 by Amazon Web Servic... 23876 views
AWS Black Belt Online Seminar 2016 ... by Amazon Web Servic... 54493 views
AWS Black Belt Tech シリーズ 2015 - Ama... by Amazon Web Servic... 104757 views

View on Slideshare

1 of 86 Ad

View on Slideshare

1 of 86 Ad