SlideShare a Scribd company logo
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Makoto Shimura, Analytics Specialist Solution Architect
Amazon Web Services Japan, K. K.
Amazon SageMaker
ML
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
•
•
•
• Amazon Athena
• AWS Glue
• Amazon SageMaker
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Agenda
• ML Ops
• Amazon SageMaker
• Amazon SageMaker ML
• ML
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
ML
Ops
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
ML
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
ML
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
ML
1.
•
•
2. ML
•
• ML
3. ML
•
•
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
ML
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Kinesis S3
EMR Glue
Redshift Athena QuickSight
FargateECS
SageMaker
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
ML
Kinesis S3
EMR Glue
Redshift Athena QuickSight
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
ML
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
ML
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
ML
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AB
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon SageMaker
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon SageMaker
ML
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Jupyter Notebook
•
•
•
• VPC
ENI VPC
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
CreateTrainingJob API Docker
•
• 2
•
S3
•
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
CreateEndpoint API Docker
• AB
•
•
• S3
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon SageMaker
ML
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon SageMaker
ML
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Kinesis
Firehose
S3
SageMaker
Glue
Athena QuickSight
App
Servers
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
EC
Kinesis
Firehose
S3
SageMaker
Glue
Athena QuickSight
App
Servers
DynamoDB Lambda
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Camera Device
Detection App
GPU
Greengrass Core
Camera
AWS IoT
Glue
Athena QuickSight
S3 SageMaker
Greengrass
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
ML
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
StepFunctions ML
Start
CodeBuild
StartBuild
SageMaker
CreateTrainingJob
CodeBuild
StartBuild
SageMaker
CreateModel
SageMaker
CreateEndpointConfig
SageMaker
CreateEndpoint
UndateEndpoint
wait
wait
wait wait
SNS
SNS
Greengrass
CreateDeployment
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
StepFunctions
RDS
S3
RedShift
Glue S3
Glue RDS
SageMaker
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
SageMaker
SageMaker Glue Dev Endpoint
Dev Endpoint
boto3 Glue
Glue
SageMake
r S3
Athena
SageMaker Athena
CTAS Athena
S3 SageMaker
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
ML
Start
SageMaker
CreateTrainingJob
CloudWatchLogs Lambda
DB
QuickSight
SageMaker
CreateTrainingJob
SageMaker
CreateTrainingJob
......
RDS
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
S3
RDS
Start
CreateTrainingJob CreateModel
JSON
ID
Dockerfile
CodeCommit
S3
SageMaker
ECR
DVCGit LFS
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AB
Elasticsearch
Service
Lambda SNS
S3
Athena & QuickSight
SageMaker
AB
App
Server
s
Kinesis
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
/
ML AWS
S3 AWS
ML SageMaker
S3 AWS
SageMaker S3CodeBuild
SageMakerS3
Direct
Connect
Direct
Connect
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
ML
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
ML
ML
• /
• at rest / in transit encryption
•
AWS IAM AWS KMS Amazon VPC AWS Glue
Amazon
CloudWatch
AWS
CloudTrail
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
UI
REST API
ETL ETL
REST API
ML
ML
SQL SQL
Notebook
REST API
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS Glue / Amazon SageMaker
AWS Glue
• Glue S3, RDS, DynamoDB, Redshift
/
• Athena / EMR
Amazon SageMaker API
• ML
•
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
SageMaker :
SageMaker
Notebook
Instance
• IP
• IAM
• VPC
VPC
• VPC S3
S3
EFSRedshift
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
SageMaker :
SageMaker
• API Private Link
• S3 KMS
• S3 VPC
S3
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
SageMaker :
SageMaker
• API Private Link
• S3 KMS
• S3 VPC
S3
App
Servers
ELB
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
ML DevOps
Amazon SageMaker
Amazon SageMaker AWS
ML
Amazon SageMaker を中心とした持続的な ML システム

More Related Content

What's hot

What's hot (20)

Amazon SageMaker 推論エンドポイントを利用したアプリケーション開発
Amazon SageMaker 推論エンドポイントを利用したアプリケーション開発Amazon SageMaker 推論エンドポイントを利用したアプリケーション開発
Amazon SageMaker 推論エンドポイントを利用したアプリケーション開発
 
20190911 AWS Black Belt Online Seminar AWS Batch
20190911 AWS Black Belt Online Seminar AWS Batch20190911 AWS Black Belt Online Seminar AWS Batch
20190911 AWS Black Belt Online Seminar AWS Batch
 
20190220 AWS Black Belt Online Seminar Amazon S3 / Glacier
20190220 AWS Black Belt Online Seminar Amazon S3 / Glacier20190220 AWS Black Belt Online Seminar Amazon S3 / Glacier
20190220 AWS Black Belt Online Seminar Amazon S3 / Glacier
 
Amazon SageMakerでscikit-learnで作ったモデルのEndpoint作成
Amazon SageMakerでscikit-learnで作ったモデルのEndpoint作成Amazon SageMakerでscikit-learnで作ったモデルのEndpoint作成
Amazon SageMakerでscikit-learnで作ったモデルのEndpoint作成
 
20210526 AWS Expert Online マルチアカウント管理の基本
20210526 AWS Expert Online マルチアカウント管理の基本20210526 AWS Expert Online マルチアカウント管理の基本
20210526 AWS Expert Online マルチアカウント管理の基本
 
20210317 AWS Black Belt Online Seminar Amazon MQ
20210317 AWS Black Belt Online Seminar Amazon MQ 20210317 AWS Black Belt Online Seminar Amazon MQ
20210317 AWS Black Belt Online Seminar Amazon MQ
 
202106 AWS Black Belt Online Seminar 小売現場のデータを素早くビジネス に活用するAWSデータ基盤
202106 AWS Black Belt Online Seminar 小売現場のデータを素早くビジネス に活用するAWSデータ基盤202106 AWS Black Belt Online Seminar 小売現場のデータを素早くビジネス に活用するAWSデータ基盤
202106 AWS Black Belt Online Seminar 小売現場のデータを素早くビジネス に活用するAWSデータ基盤
 
Amazon Game Tech Night #25 ゲーム業界向け機械学習最新状況アップデート
Amazon Game Tech Night #25 ゲーム業界向け機械学習最新状況アップデートAmazon Game Tech Night #25 ゲーム業界向け機械学習最新状況アップデート
Amazon Game Tech Night #25 ゲーム業界向け機械学習最新状況アップデート
 
20191009 AWS Black Belt Online Seminar Amazon GameLift
20191009 AWS Black Belt Online Seminar Amazon GameLift20191009 AWS Black Belt Online Seminar Amazon GameLift
20191009 AWS Black Belt Online Seminar Amazon GameLift
 
Amazon S3を中心とするデータ分析のベストプラクティス
Amazon S3を中心とするデータ分析のベストプラクティスAmazon S3を中心とするデータ分析のベストプラクティス
Amazon S3を中心とするデータ分析のベストプラクティス
 
[Aurora事例祭り]Amazon Aurora を使いこなすためのベストプラクティス
[Aurora事例祭り]Amazon Aurora を使いこなすためのベストプラクティス[Aurora事例祭り]Amazon Aurora を使いこなすためのベストプラクティス
[Aurora事例祭り]Amazon Aurora を使いこなすためのベストプラクティス
 
20190604 AWS Black Belt Online Seminar Amazon Simple Notification Service (SNS)
20190604 AWS Black Belt Online Seminar Amazon Simple Notification Service (SNS)20190604 AWS Black Belt Online Seminar Amazon Simple Notification Service (SNS)
20190604 AWS Black Belt Online Seminar Amazon Simple Notification Service (SNS)
 
データ活用を加速するAWS分析サービスのご紹介
データ活用を加速するAWS分析サービスのご紹介データ活用を加速するAWS分析サービスのご紹介
データ活用を加速するAWS分析サービスのご紹介
 
Amazon Connect ハンズオン初級編
Amazon Connect ハンズオン初級編Amazon Connect ハンズオン初級編
Amazon Connect ハンズオン初級編
 
AWS IoT SiteWise のご紹介 (AWS IoT Deep Dive #5)
AWS IoT SiteWise のご紹介 (AWS IoT Deep Dive #5)AWS IoT SiteWise のご紹介 (AWS IoT Deep Dive #5)
AWS IoT SiteWise のご紹介 (AWS IoT Deep Dive #5)
 
AWSではじめるMLOps
AWSではじめるMLOpsAWSではじめるMLOps
AWSではじめるMLOps
 
Kinesis + Elasticsearchでつくるさいきょうのログ分析基盤
Kinesis + Elasticsearchでつくるさいきょうのログ分析基盤Kinesis + Elasticsearchでつくるさいきょうのログ分析基盤
Kinesis + Elasticsearchでつくるさいきょうのログ分析基盤
 
AWS Black Belt Online Seminar 2016 Amazon ElastiCache
AWS Black Belt Online Seminar 2016 Amazon ElastiCacheAWS Black Belt Online Seminar 2016 Amazon ElastiCache
AWS Black Belt Online Seminar 2016 Amazon ElastiCache
 
[CTO Night & Day 2019] AWS で構築するデータレイク基盤と amazon.com での導入事例 #ctonight
[CTO Night & Day 2019] AWS で構築するデータレイク基盤と amazon.com での導入事例 #ctonight[CTO Night & Day 2019] AWS で構築するデータレイク基盤と amazon.com での導入事例 #ctonight
[CTO Night & Day 2019] AWS で構築するデータレイク基盤と amazon.com での導入事例 #ctonight
 
20200526 AWS Black Belt Online Seminar AWS X-Ray
20200526 AWS Black Belt Online Seminar AWS X-Ray20200526 AWS Black Belt Online Seminar AWS X-Ray
20200526 AWS Black Belt Online Seminar AWS X-Ray
 

Similar to Amazon SageMaker を中心とした持続的な ML システム

Similar to Amazon SageMaker を中心とした持続的な ML システム (20)

Serverless:It All Started in Vegas (DVC306) - AWS re:Invent 2018
Serverless:It All Started in Vegas (DVC306) - AWS re:Invent 2018Serverless:It All Started in Vegas (DVC306) - AWS re:Invent 2018
Serverless:It All Started in Vegas (DVC306) - AWS re:Invent 2018
 
Visualise and Voice-Enable Your Security
Visualise and Voice-Enable Your SecurityVisualise and Voice-Enable Your Security
Visualise and Voice-Enable Your Security
 
CI/CD for Your Machine Learning Pipeline with Amazon SageMaker (DVC303) - AWS...
CI/CD for Your Machine Learning Pipeline with Amazon SageMaker (DVC303) - AWS...CI/CD for Your Machine Learning Pipeline with Amazon SageMaker (DVC303) - AWS...
CI/CD for Your Machine Learning Pipeline with Amazon SageMaker (DVC303) - AWS...
 
Modern Applications Web Day | Manage Your Infrastructure and Configuration on...
Modern Applications Web Day | Manage Your Infrastructure and Configuration on...Modern Applications Web Day | Manage Your Infrastructure and Configuration on...
Modern Applications Web Day | Manage Your Infrastructure and Configuration on...
 
Aws summit strikingly analytics
Aws summit   strikingly analyticsAws summit   strikingly analytics
Aws summit strikingly analytics
 
Automate & Audit Cloud Governance & Compliance in Your Landing Zone (ENT315-R...
Automate & Audit Cloud Governance & Compliance in Your Landing Zone (ENT315-R...Automate & Audit Cloud Governance & Compliance in Your Landing Zone (ENT315-R...
Automate & Audit Cloud Governance & Compliance in Your Landing Zone (ENT315-R...
 
Visualise and Voice-Enable Your Security - AWS Summit Sydney 2018
Visualise and Voice-Enable Your Security - AWS Summit Sydney 2018Visualise and Voice-Enable Your Security - AWS Summit Sydney 2018
Visualise and Voice-Enable Your Security - AWS Summit Sydney 2018
 
20190306 AWS Black Belt Online Seminar Amazon EC2スポットインスタンス
20190306 AWS Black Belt Online Seminar Amazon EC2スポットインスタンス20190306 AWS Black Belt Online Seminar Amazon EC2スポットインスタンス
20190306 AWS Black Belt Online Seminar Amazon EC2スポットインスタンス
 
Websites go Serverless | AWS Floor28
Websites go Serverless | AWS Floor28Websites go Serverless | AWS Floor28
Websites go Serverless | AWS Floor28
 
Websites go Serverless - Floor28
Websites go Serverless - Floor28Websites go Serverless - Floor28
Websites go Serverless - Floor28
 
End to End Model Development to Deployment using SageMaker
End to End Model Development to Deployment using SageMakerEnd to End Model Development to Deployment using SageMaker
End to End Model Development to Deployment using SageMaker
 
New AI/ML Solutions with AWS DeepLens & Amazon SageMaker with ConocoPhillips ...
New AI/ML Solutions with AWS DeepLens & Amazon SageMaker with ConocoPhillips ...New AI/ML Solutions with AWS DeepLens & Amazon SageMaker with ConocoPhillips ...
New AI/ML Solutions with AWS DeepLens & Amazon SageMaker with ConocoPhillips ...
 
20190306 AWS Black Belt Online Seminar Amazon EC2 スポットインスタンス
20190306 AWS Black Belt Online Seminar Amazon EC2 スポットインスタンス20190306 AWS Black Belt Online Seminar Amazon EC2 スポットインスタンス
20190306 AWS Black Belt Online Seminar Amazon EC2 スポットインスタンス
 
Build Your Own Log Analytics Solutions on AWS (ANT323-R) - AWS re:Invent 2018
Build Your Own Log Analytics Solutions on AWS (ANT323-R) - AWS re:Invent 2018Build Your Own Log Analytics Solutions on AWS (ANT323-R) - AWS re:Invent 2018
Build Your Own Log Analytics Solutions on AWS (ANT323-R) - AWS re:Invent 2018
 
Serverless Architectural Patterns
Serverless Architectural PatternsServerless Architectural Patterns
Serverless Architectural Patterns
 
Intro to SageMaker
Intro to SageMakerIntro to SageMaker
Intro to SageMaker
 
Scaling from zero to millions of users
Scaling from zero to millions of usersScaling from zero to millions of users
Scaling from zero to millions of users
 
AWS で構築するコンピュータビジョンアプリケーション
AWS で構築するコンピュータビジョンアプリケーションAWS で構築するコンピュータビジョンアプリケーション
AWS で構築するコンピュータビジョンアプリケーション
 
20190213 AWS Black Belt Online Seminar Amazon SageMaker Advanced Session
20190213 AWS Black Belt Online Seminar Amazon SageMaker Advanced Session20190213 AWS Black Belt Online Seminar Amazon SageMaker Advanced Session
20190213 AWS Black Belt Online Seminar Amazon SageMaker Advanced Session
 
AWS SAM(Serverless Application Model) 을 이용한 백오피스 마이그레이션 (현창훈, HBSmith) :: AWS...
AWS SAM(Serverless Application Model) 을 이용한 백오피스 마이그레이션 (현창훈, HBSmith) :: AWS...AWS SAM(Serverless Application Model) 을 이용한 백오피스 마이그레이션 (현창훈, HBSmith) :: AWS...
AWS SAM(Serverless Application Model) 을 이용한 백오피스 마이그레이션 (현창훈, HBSmith) :: AWS...
 

More from Amazon Web Services Japan

More from Amazon Web Services Japan (20)

202205 AWS Black Belt Online Seminar Amazon VPC IP Address Manager (IPAM)
202205 AWS Black Belt Online Seminar Amazon VPC IP Address Manager (IPAM)202205 AWS Black Belt Online Seminar Amazon VPC IP Address Manager (IPAM)
202205 AWS Black Belt Online Seminar Amazon VPC IP Address Manager (IPAM)
 
202205 AWS Black Belt Online Seminar Amazon FSx for OpenZFS
202205 AWS Black Belt Online Seminar Amazon FSx for OpenZFS202205 AWS Black Belt Online Seminar Amazon FSx for OpenZFS
202205 AWS Black Belt Online Seminar Amazon FSx for OpenZFS
 
202204 AWS Black Belt Online Seminar AWS IoT Device Defender
202204 AWS Black Belt Online Seminar AWS IoT Device Defender202204 AWS Black Belt Online Seminar AWS IoT Device Defender
202204 AWS Black Belt Online Seminar AWS IoT Device Defender
 
Infrastructure as Code (IaC) 談義 2022
Infrastructure as Code (IaC) 談義 2022Infrastructure as Code (IaC) 談義 2022
Infrastructure as Code (IaC) 談義 2022
 
202204 AWS Black Belt Online Seminar Amazon Connect を活用したオンコール対応の実現
202204 AWS Black Belt Online Seminar Amazon Connect を活用したオンコール対応の実現202204 AWS Black Belt Online Seminar Amazon Connect を活用したオンコール対応の実現
202204 AWS Black Belt Online Seminar Amazon Connect を活用したオンコール対応の実現
 
202204 AWS Black Belt Online Seminar Amazon Connect Salesforce連携(第1回 CTI Adap...
202204 AWS Black Belt Online Seminar Amazon Connect Salesforce連携(第1回 CTI Adap...202204 AWS Black Belt Online Seminar Amazon Connect Salesforce連携(第1回 CTI Adap...
202204 AWS Black Belt Online Seminar Amazon Connect Salesforce連携(第1回 CTI Adap...
 
20220409 AWS BLEA 開発にあたって検討したこと
20220409 AWS BLEA 開発にあたって検討したこと20220409 AWS BLEA 開発にあたって検討したこと
20220409 AWS BLEA 開発にあたって検討したこと
 
202202 AWS Black Belt Online Seminar AWS Managed Rules for AWS WAF の活用
202202 AWS Black Belt Online Seminar AWS Managed Rules for AWS WAF の活用202202 AWS Black Belt Online Seminar AWS Managed Rules for AWS WAF の活用
202202 AWS Black Belt Online Seminar AWS Managed Rules for AWS WAF の活用
 
202203 AWS Black Belt Online Seminar Amazon Connect Tasks.pdf
202203 AWS Black Belt Online Seminar Amazon Connect Tasks.pdf202203 AWS Black Belt Online Seminar Amazon Connect Tasks.pdf
202203 AWS Black Belt Online Seminar Amazon Connect Tasks.pdf
 
SaaS テナント毎のコストを把握するための「AWS Application Cost Profiler」のご紹介
SaaS テナント毎のコストを把握するための「AWS Application Cost Profiler」のご紹介SaaS テナント毎のコストを把握するための「AWS Application Cost Profiler」のご紹介
SaaS テナント毎のコストを把握するための「AWS Application Cost Profiler」のご紹介
 
Amazon QuickSight の組み込み方法をちょっぴりDD
Amazon QuickSight の組み込み方法をちょっぴりDDAmazon QuickSight の組み込み方法をちょっぴりDD
Amazon QuickSight の組み込み方法をちょっぴりDD
 
マルチテナント化で知っておきたいデータベースのこと
マルチテナント化で知っておきたいデータベースのことマルチテナント化で知っておきたいデータベースのこと
マルチテナント化で知っておきたいデータベースのこと
 
機密データとSaaSは共存しうるのか!?セキュリティー重視のユーザー層を取り込む為のネットワーク通信のアプローチ
機密データとSaaSは共存しうるのか!?セキュリティー重視のユーザー層を取り込む為のネットワーク通信のアプローチ機密データとSaaSは共存しうるのか!?セキュリティー重視のユーザー層を取り込む為のネットワーク通信のアプローチ
機密データとSaaSは共存しうるのか!?セキュリティー重視のユーザー層を取り込む為のネットワーク通信のアプローチ
 
パッケージソフトウェアを簡単にSaaS化!?既存の資産を使ったSaaS化手法のご紹介
パッケージソフトウェアを簡単にSaaS化!?既存の資産を使ったSaaS化手法のご紹介パッケージソフトウェアを簡単にSaaS化!?既存の資産を使ったSaaS化手法のご紹介
パッケージソフトウェアを簡単にSaaS化!?既存の資産を使ったSaaS化手法のご紹介
 
202202 AWS Black Belt Online Seminar Amazon Connect Customer Profiles
202202 AWS Black Belt Online Seminar Amazon Connect Customer Profiles202202 AWS Black Belt Online Seminar Amazon Connect Customer Profiles
202202 AWS Black Belt Online Seminar Amazon Connect Customer Profiles
 
Amazon Game Tech Night #24 KPIダッシュボードを最速で用意するために
Amazon Game Tech Night #24 KPIダッシュボードを最速で用意するためにAmazon Game Tech Night #24 KPIダッシュボードを最速で用意するために
Amazon Game Tech Night #24 KPIダッシュボードを最速で用意するために
 
202202 AWS Black Belt Online Seminar AWS SaaS Boost で始めるSaaS開発⼊⾨
202202 AWS Black Belt Online Seminar AWS SaaS Boost で始めるSaaS開発⼊⾨202202 AWS Black Belt Online Seminar AWS SaaS Boost で始めるSaaS開発⼊⾨
202202 AWS Black Belt Online Seminar AWS SaaS Boost で始めるSaaS開発⼊⾨
 
[20220126] JAWS-UG 2022初頭までに葬ったAWSアンチパターン大紹介
[20220126] JAWS-UG 2022初頭までに葬ったAWSアンチパターン大紹介[20220126] JAWS-UG 2022初頭までに葬ったAWSアンチパターン大紹介
[20220126] JAWS-UG 2022初頭までに葬ったAWSアンチパターン大紹介
 
202111 AWS Black Belt Online Seminar AWSで構築するSmart Mirrorのご紹介
202111 AWS Black Belt Online Seminar AWSで構築するSmart Mirrorのご紹介202111 AWS Black Belt Online Seminar AWSで構築するSmart Mirrorのご紹介
202111 AWS Black Belt Online Seminar AWSで構築するSmart Mirrorのご紹介
 
202201 AWS Black Belt Online Seminar Apache Spark Performnace Tuning for AWS ...
202201 AWS Black Belt Online Seminar Apache Spark Performnace Tuning for AWS ...202201 AWS Black Belt Online Seminar Apache Spark Performnace Tuning for AWS ...
202201 AWS Black Belt Online Seminar Apache Spark Performnace Tuning for AWS ...
 

Recently uploaded

Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo DiehlFuture Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Peter Udo Diehl
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
Safe Software
 

Recently uploaded (20)

IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptxIOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
 
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo DiehlFuture Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
 
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptxUnpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
 
UiPath Test Automation using UiPath Test Suite series, part 2
UiPath Test Automation using UiPath Test Suite series, part 2UiPath Test Automation using UiPath Test Suite series, part 2
UiPath Test Automation using UiPath Test Suite series, part 2
 
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
IESVE for Early Stage Design and Planning
IESVE for Early Stage Design and PlanningIESVE for Early Stage Design and Planning
IESVE for Early Stage Design and Planning
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
 
UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1UiPath Test Automation using UiPath Test Suite series, part 1
UiPath Test Automation using UiPath Test Suite series, part 1
 
AI revolution and Salesforce, Jiří Karpíšek
AI revolution and Salesforce, Jiří KarpíšekAI revolution and Salesforce, Jiří Karpíšek
AI revolution and Salesforce, Jiří Karpíšek
 
Powerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara LaskowskaPowerful Start- the Key to Project Success, Barbara Laskowska
Powerful Start- the Key to Project Success, Barbara Laskowska
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
 
10 Differences between Sales Cloud and CPQ, Blanka Doktorová
10 Differences between Sales Cloud and CPQ, Blanka Doktorová10 Differences between Sales Cloud and CPQ, Blanka Doktorová
10 Differences between Sales Cloud and CPQ, Blanka Doktorová
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
 

Amazon SageMaker を中心とした持続的な ML システム

  • 1. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Makoto Shimura, Analytics Specialist Solution Architect Amazon Web Services Japan, K. K. Amazon SageMaker ML
  • 2. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. • • • • Amazon Athena • AWS Glue • Amazon SageMaker
  • 3. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Agenda • ML Ops • Amazon SageMaker • Amazon SageMaker ML • ML
  • 4. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ML Ops
  • 5. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ML
  • 6. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ML
  • 7. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ML 1. • • 2. ML • • ML 3. ML • •
  • 8. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ML
  • 9. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Kinesis S3 EMR Glue Redshift Athena QuickSight FargateECS SageMaker
  • 10. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ML Kinesis S3 EMR Glue Redshift Athena QuickSight
  • 11. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ML
  • 12. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ML
  • 13. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 14. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ML
  • 15. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 16. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AB
  • 17. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 18. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon SageMaker
  • 19. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon SageMaker ML
  • 20. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Jupyter Notebook • • • • VPC ENI VPC
  • 21. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. CreateTrainingJob API Docker • • 2 • S3 •
  • 22. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. CreateEndpoint API Docker • AB • • • S3
  • 23. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon SageMaker ML
  • 24. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon SageMaker ML
  • 25. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Kinesis Firehose S3 SageMaker Glue Athena QuickSight App Servers
  • 26. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. EC Kinesis Firehose S3 SageMaker Glue Athena QuickSight App Servers DynamoDB Lambda
  • 27. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Camera Device Detection App GPU Greengrass Core Camera AWS IoT Glue Athena QuickSight S3 SageMaker Greengrass
  • 28. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ML
  • 29. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. StepFunctions ML Start CodeBuild StartBuild SageMaker CreateTrainingJob CodeBuild StartBuild SageMaker CreateModel SageMaker CreateEndpointConfig SageMaker CreateEndpoint UndateEndpoint wait wait wait wait SNS SNS Greengrass CreateDeployment
  • 30. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. StepFunctions RDS S3 RedShift Glue S3 Glue RDS SageMaker
  • 31. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. SageMaker SageMaker Glue Dev Endpoint Dev Endpoint boto3 Glue Glue SageMake r S3 Athena SageMaker Athena CTAS Athena S3 SageMaker
  • 32. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ML Start SageMaker CreateTrainingJob CloudWatchLogs Lambda DB QuickSight SageMaker CreateTrainingJob SageMaker CreateTrainingJob ...... RDS
  • 33. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. S3 RDS Start CreateTrainingJob CreateModel JSON ID Dockerfile CodeCommit S3 SageMaker ECR DVCGit LFS
  • 34. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AB Elasticsearch Service Lambda SNS S3 Athena & QuickSight SageMaker AB App Server s Kinesis
  • 35. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. / ML AWS S3 AWS ML SageMaker S3 AWS SageMaker S3CodeBuild SageMakerS3 Direct Connect Direct Connect
  • 36. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ML
  • 37. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ML ML • / • at rest / in transit encryption • AWS IAM AWS KMS Amazon VPC AWS Glue Amazon CloudWatch AWS CloudTrail
  • 38. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. UI REST API ETL ETL REST API ML ML SQL SQL Notebook REST API
  • 39. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS Glue / Amazon SageMaker AWS Glue • Glue S3, RDS, DynamoDB, Redshift / • Athena / EMR Amazon SageMaker API • ML •
  • 40. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. SageMaker : SageMaker Notebook Instance • IP • IAM • VPC VPC • VPC S3 S3 EFSRedshift
  • 41. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. SageMaker : SageMaker • API Private Link • S3 KMS • S3 VPC S3
  • 42. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. SageMaker : SageMaker • API Private Link • S3 KMS • S3 VPC S3 App Servers ELB
  • 43. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 44. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ML DevOps Amazon SageMaker Amazon SageMaker AWS ML