Uploaded byAmazon Web Services Japan
20190911 AWS Black Belt Online Seminar AWS Batch
The document discusses Amazon Web Services (AWS) Batch and how it can help customers run batch computing workloads on AWS. It notes that AWS Batch automatically provisions the optimal quantity and type of compute resources (e.g., EC2 instances) required to run jobs efficiently. It also allows customers to integrate their own scheduling and application code with AWS Batch through simple API calls or SDKs.
More Related Content
Similar to 20190911 AWS Black Belt Online Seminar AWS Batch
![[20220126] JAWS-UG 2022初頭までに葬ったAWSアンチパターン大紹介](https://cdn.slidesharecdn.com/ss_thumbnails/20220126-anti-220126190603-thumbnail.jpg?width=640&height=640&fit=bounds)
20190911 AWS Black Belt Online Seminar AWS Batch
- 1. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved.© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
- 2. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. ❏ ❏ ❏ ❖ ❖ ❖
- 3. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • ① 吹き出しをクリック ② 質問を入力 ③ Sendをクリック
- 4. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • • •
- 5. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. ❏ ❖ ❖ ❖ ❏ ❖ ❖
- 6. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • • • • •
- 7. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • • • • •
- 8. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • • •
- 9. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved.
- 10. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • •
- 11. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. CPU < > (queueing) (dispatch) dispatch B A A B
- 12. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • • • •
- 13. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • • • • •
- 14. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. 従来は処理のピークに合わせてリソースを 予め用意していた。ピーク時に賄えないリ ソースは、ジョブスケジューラにより、処 理するタイミングをずらして対応 クラウドの場合はその時に必要なリソー スを立ち上げて、処理を実行する Time Time
- 15. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. 従来は手持ちの限られたリソースで、逐次処理していたジョブもクラウドであれば 必要な台数、インスタンスを起動して、一斉処理が可能 のインスタンス費用は原則「時間×台数」なのでどちらもほぼ同じコスト
- 16. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. オンプレミス 環境 従来のクラスタ 構成は固定 固定のリソース に、ジョブをス ケジューリング
- 17. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. クラウド環境従来のクラスタ 構成は固定 オンプレミス 環境 固定のリソース に、ジョブをス ケジューリング クラウド環境
- 18. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. 必要に応じて 必要な台数で クラスタを構成 ジョブをスケ ジューリング 従来のクラスタ 構成は固定 オンプレミス 環境 固定のリソース に、ジョブをス ケジューリング クラウド環境 クラウド環境
- 19. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. 従来のクラスタ 構成は固定 ジョブが終了したら インスタンスを終了 計算ノードの 課金が停止 オンプレミス 環境 固定のリソース に、ジョブをス ケジューリング クラウド環境
- 20. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • • • •
- 21. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. Media & Entertainment: Healthcare & Life Sciences: Internet Companies: Scientific Research: Engineering and Design:
- 22. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. 上に コアを伸縮自在に追加するシス テムを構築。 万ジョブを処理し、従来 週間 かかるシミュレーションを 日で完了 ドライブヘッド設計で、数百万パターンに及ぶパラ メータスタディ実行。ピーク時 以上のコアを 同時利用、従来 ヶ月かかる処理を 時間で完了 万の化合物のスクリーニング実行。 ピーク時 約 コアを同時利用し 年分 の計算処理を 時間で完了
- 23. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • • • • •
- 24. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved.
- 25. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • がインスタンスの起動や停止を行うた め、スケジューラや計算ノードなどの 管理が不要 • ジョブは コンテナイメージ を元に作成し、 自動でスケールするコンピューティング環境で実 行する • コンピューティング環境ではインスタンスタイプ や 数、スポットインスタンス利用有無など を任意に指定可能 • 万 クラスの大規模な計算にも対応 で管理 処理を 依頼 スケジュール 実行
- 26. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • • • • • •
- 27. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • • • • • • • •
- 28. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • • •
- 29. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • • • • •
- 30. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • • • • •
- 31. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. インスタンス
- 32. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • • • • • • • •
- 33. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • • • • • • • •
- 34. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • • •
- 35. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • • • • • • • • •
- 36. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved.
- 37. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • •
- 38. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. インスタンス
- 39. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • • • • •
- 40. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • • • • •
- 41. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • • • • • Submitted Runnable Starting Running Succeeded FAILED Pending
- 42. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • $AWS_BATCH_JOB_ARRAY_INDEX • • “Job-A” “Job-B” “Job-A” Job-A:0 … Job-A:1 Job-A:2 Job-A:3 Job-A:4 Job-A:5 Job-A:97 Job-A:98 Job-A:99
- 43. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. “Job-A” Job-A:0 … Job-A:1 Job-A:99 Job-A:2 “Job-A” Job-A:0 … Job-A:1 Job-A:2 Job-A:3 Job-A:4 Job-A:5 Job-A:97 Job-A:98 Job-A:99 “Job-B” “Job-B” Job-B:0 … Job-B:1 Job-B:2 Job-B:3 Job-B:4 Job-B:5 Job-B:97 Job-B:98 Job-B:99 “Job-A”
- 44. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • • • • • • •
- 45. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • • • • •
- 46. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • • • • • • “Job-A”
- 47. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • • • •
- 48. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • •
- 49. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • • • • •
- 50. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved.
- 51. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. インスタンス • • •
- 52. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved.
- 53. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • •
- 54. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • • • • •
- 55. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • •
- 56. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • •
- 57. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • •
- 58. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • • • •
- 59. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • • •
- 60. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved.
- 61. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • • • • • • • • • • • •
- 62. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • • • • •
- 63. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. • • • • • • • • • • • •
- 64. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved.
- 65. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. https://amzn.to/JPArchive
- 66. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved. AWS Well-Architected 個別技術相談会 • •
- 67. © 2019, AmazonWeb Services, Inc. or its Affiliates. All rights reserved.© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.