Seoul
신규 서비스 살펴보기
Thomas Park
Head of Solutions Architecture, Korea
What if you could devote 30% more of
your resources to your customers?
IT Map - Traditional IT
E-mail, Productivity,
Collaboration, HR,
Finance, ERP
Desktop Support, Device
Management, Telephony,
IT Support
Information Security, CISO
Encryption, Key Management, Identity
Management, Firewalls, IDS, DDoS
Business Applications
Digital Products, Brand
Websites, Mobile
Applications, Point of Sale
Systems, Commerce
Corporate Applications End User Computing
Infrastructure Servers, Storage, Networking, Databases,
Data Warehousing, Data Centers
IT Map - Traditional IT with AWS
Information Security, CISO
Corporate Applications End User Computing
Infrastructure
Business Applications
AWS Elastic Beanstalk,
AWS Lambda, Amazon SQS,
Amazon SNS, Amazon
Mobile Analytics, Amazon
CloudFront
Amazon WorkMail,
Amazon WorkDocs, AWS
Marketplace, AWS
Directory Service, SaaS
Amazon WorkSpaces,
Amazon AppStream, AWS
Marketplace, AWS Mobile
Services, SaaS
AWS Identity and Access Management
(IAM), AWS CloudHSM, AWS Key
Management Service (AWS KMS),
Security Groups, AWS Marketplace
Amazon EC2, Amazon S3, Amazon RDS, Amazon VPC,
Amazon Direct Connect, Directory Service, IAM, AWS
Service Catalog
Enterprise Customers
IT Map - A Cloud-First Tomorrow
Information Security, CISO
Business Applications
DevOps
Corporate Applications
End User Computing
AWS Elastic Beanstalk,
AWS Lambda, Amazon SQS, Amazon
SNS, Amazon Mobile Analytics,
Amazon CloudFront
Amazon WorkMail,
Amazon WorkDocs, AWS
Marketplace, AWS
Directory Service, SaaS
Amazon WorkSpaces,
Amazon AppStream, AWS
Marketplace, AWS Mobile
Services, SaaS
Amazon EC2, Amazon S3, Amazon RDS, Amazon VPC,
Amazon Direct Connect, Directory Service, IAM, AWS
Service Catalog, AWS Code Services
AWS Identity and Access Management
(IAM), AWS CloudHSM, AWS Key
Management Service (AWS KMS),
Security Groups, AWS Marketplace
• Service-Oriented
Architecture (SOA)
• Everything gets a
service interface
• Primitives
• “Microservices”
• Decentralized
• Two-pizza teams
• Agility, autonomy,
accountability, and
ownership
• “DevOps”
• Deployment service
• Zero downtime
• Health checking
• Versioned artifacts
& rollbacks
• Continuous
delivery
• From check-in to
production
• CI/CD + release
automation
• >90% of teams
Pipelines
DevOps
Pipeline
Source
Developers
commit
changes
Build
Changes
are built and
unit tested
Staging
Code deployed
to staging and
load/UI tested
Production
Code is
deployed to
production
Changes,
Updates, and
Fixes
Ideas,
Requests, and
Bugs
Developers Customers
= 50 million deployments a year
Thousands of teams +
Microservices architecture +
Multiple environments +
Continuous delivery
AWS Code services
CodeCommit
Private Beta
CodePipeline
Private Beta
CodeDeploy
Launched
What about the infrastructure?
Amazon EC2 Container Service
What are containers?
• OS virtualization
• Process isolation
• Automation
• ImagesServer
Guest OS
Bins/Libs Bins/Libs
App2App1
Common Customer Challenges/Desires
• Cluster Management
• Configuration Management
• Availability
• Scalability (application and repository)
• Scheduling
• Monitoring
• AWS integration
– VPC, ELB, Auto Scaling, CloudWatch, etc.
Amazon EC2 Container Service
• Building Block Service
• Cluster Management Made
Easy
• Flexible Scheduling
• Performance at Scale
• Security
• Extensible
AWS Lambda
Amazon S3 Bucket Events
Original image Thumbnailed image
1
2
3
Application
Monitoring
Security
Deploy
Yes, you can do with EC2 instances…
Amazon S3 Bucket Events
Original image Thumbnailed image
1
2
3
Application
Monitoring
Security
Deploy
High
Availability Scalability
PUT
Original
GET
PUT
Thumbnail
Application
Monitoring
Security
Deploy
An event-driven computing service for dynamic
applications
High
Availability Scalability
What is AWS Lambda?
AWS Lambda is a compute service that runs your code in
response to events such as image uploads, in-app activity,
website clicks, or outputs from connected devices.
Data Triggers: Amazon S3
Amazon S3 Bucket Events AWS Lambda
Original image Thumbnailed image
1
2
3
Amazon Machine Learning
Three types of data-driven development
Retrospective
analysis and
reporting
Here-and-now
real-time processing
and dashboards
Predictions
to enable smart
applications
Amazon Kinesis
Amazon EC2
AWS Lambda
Amazon Redshift,
Amazon RDS
Amazon S3
Amazon EMR
Machine learning and smart applications
Machine learning is the technology that
automatically finds patterns in your data
and uses them to make predictions for new
data points as they become available
Your data + machine learning = smart applications
Building smart applications – a counter-pattern
Dear Thomas,
This awesome quadcopter is on sale
for just $49.99!
Smart applications by counter-example
SELECT c.ID
FROM customers c
LEFT JOIN orders o
ON c.ID = o.customer
GROUP BY c.ID
HAVING o.date > GETDATE() – 30
We can start by
sending the offer to
all customers who
placed an order in
the last 30 days
Smart applications by counter-example
SELECT c.ID
FROM customers c
LEFT JOIN orders o
ON c.ID = o.customer
GROUP BY c.ID
HAVING
AND o.date > GETDATE() – 30
… let’s narrow it
down to just
customers who
bought toys
Smart applications by counter-example
SELECT c.ID
FROM customers c
LEFT JOIN orders o
ON c.ID = o.customer
GROUP BY c.ID
HAVING o.category = ‘toys’
AND
(COUNT(*) > 2
AND
)
… and expand the
query to customers
who purchased other
toy helicopters
recently
Smart applications by counter-example
SELECT c.ID
FROM customers c
LEFT JOIN orders o
ON c.ID = o.customer
GROUP BY c.ID
HAVING o.category = ‘toys’
AND
(COUNT(*) > 2
AND SUM(o.price) > 200
AND o.date > GETDATE() – 30)
)
Use machine learning
technology to learn
your business rules
from data!
Why aren’t there more smart applications?
1. Machine learning expertise is rare
2. Building and scaling machine learning
technology is hard
3. Closing the gap between models and
applications is time-consuming and
expensive
Introducing Amazon Machine Learning
Easy to use, managed machine learning
service built for developers
Robust, powerful machine learning
technology based on Amazon’s internal
systems
Create models using your data already
stored in the AWS cloud
Deploy models to production in seconds
Explore and understand your data
Explore model quality
Batch predictions with Amazon Redshift
Structured data
In Amazon Redshift
Load predictions into
Amazon Redshift
-or-
Read prediction results
directly from S3
Predictions
in S3
Query for predictions with
Amazon ML batch API
Your application
Real-time predictions for interactive applications
Your application
Query for predictions with
Amazon ML real-time API
Unconstrained Big Data Growth
• IT/Application server logs
IT Infrastructure logs, Metering, Audit logs,
Change logs
• Websites/Mobile apps/Ads
Clickstream, User Engagement
• Sensor data/IoT
Weather, Smart Grids, Wearables
• Social media, user content
450MM+ Tweets/day
GB
TB
PB
ZB
EB
Amazon RDS Aurora
Current DB architectures are monolithic
Multiple layers of
functionality all on a
single box
SQL
Transactions
Caching
Logging
Current DB architectures are monolithic
Even when you scale
it out, you’re still
replicating the same
stack
SQL
Transactions
Caching
Logging
SQL
Transactions
Caching
Logging
Application
Current DB architectures are monolithic
SQL
Transactions
Caching
Logging
SQL
Transactions
Caching
Logging
Storage
Application Even when you scale
it out, you’re still
replicating the same
stack
This is a problem.
For cost. For flexibility. And for availability.
Reimagining the relational database
What if you were inventing the database today?
You wouldn’t design it the way we did in 1970. At least not entirely.
You’d build something that can scale out, that is self-healing, and that
leverages existing AWS services.
Amazon Aurora is Easy to Use
Amazon RDS
Aurora
Aurora storage
• Highly available by default
– 6-way replication across 3 AZs
– 4 of 6 write quorum
• Automatic fallback to
3 of 4 if an AZ is unavailable
– 3 of 6 read quorum
• SSD, scale-out, multi-tenant storage
– Seamless storage scalability
– Up to 64 TB database size
– Only pay for what you use
• Log-structured storage
– Many small segments, each with
their own redo logs
– Log pages used to generate data pages
– Eliminates chatter between database and
storage
SQL
Transactions
AZ 1 AZ 2 AZ 3
Caching
Amazon S3
Self-healing, fault-tolerant
• Lose two copies or an AZ failure without read or write availability impact
• Lose three copies without read availability impact
• Automatic detection, replication, and repair
SQL
Transactio
n
AZ 1 AZ 2 AZ 3
Caching
SQL
Transactio
n
AZ 1 AZ 2 AZ 3
Caching
Read and write availabilityRead availability
Survivable caches
• We moved the cache out of
the database process
• Cache remains warm in the
event of a database restart
• Lets you resume fully loaded
operations much faster
• Instant crash recovery +
survivable cache = quick and
easy recovery from DB
failures
SQL
Transactions
Caching
SQL
Transactions
Caching
SQL
Transactions
Caching
Caching process is outside the DB process
and remains warm across a database restart
Simulate failures using SQL
• To cause the failure of a component at the database node:
ALTER SYSTEM CRASH [{INSTANCE | DISPATCHER | NODE}]
• To simulate the failure of disks:
ALTER SYSTEM SIMULATE percent_failure DISK failure_type IN
[DISK index | NODE index] FOR INTERVAL interval
• To simulate the failure of networking:
ALTER SYSTEM SIMULATE percent_failure NETWORK failure_type
[TO {ALL | read_replica | availability_zone}] FOR INTERVAL interval
Amazon Elastic File System (EFS)
Operating shared file storage today is a pain
Application owner
or developer
IT administrator
Business owner
• Estimate demand
• Procure hardware
• Set aside physical space
• Set up and maintain hardware (and network)
• Manage access and security
• Provide demand forecasts/business case
• Add lead times and extra coordination to your schedule
• Limit your flexibility and agility
• Make up-front capital investments, over-buy, stay on a
constant upgrade/refresh cycle
• Sacrifice business agility
• Distract your people from your business’s mission
We focused on changing the game
EFS is
simple
EFS is
elastic
EFS is
scalable
1 2 3
EFS is simple
• Fully managed
– No hardware, network, file layer
– Create a scalable file system in seconds!
• Seamless integration with existing
tools and apps
– NFS v4—widespread, open
– Standard file system semantics
– Works with standard OS file system APIs
• Simple pricing = simple forecasting
1
EFS is elastic
• File systems grow and shrink
automatically as you add and remove
files
• No need to provision storage capacity
or performance
• You pay only for the storage space you
use, with no minimum fee
2
• File systems can grow to petabyte
scale
• Throughput and IOPS scale
automatically as file systems grow
• Consistent low latencies regardless
of file system size
• Support for thousands of concurrent
NFS connections
EFS is scalable3
Cloud Has Become The New Normal
Infrastructure Regions Points of PresenceAvailability Zones
Core Services
Storage
(Object, Block
and Archival)
Compute
(VMs, Auto-scaling
and Load Balancing)
Databases
(Relational, NoSQL, Caching)
Networking
(VPC, DX, DNS)
CDN
Access Control
Usage
Auditing
Monitoring and
Logs
Administration &
Security
Key
Storage
Identity
Management
Platform Services
Deployment & Management
One-click web app
deployment
Dev/ops resource
management
Resource
Templates
Push
Notifications
Mobile Services
Mobile
Analytics
Identity
Sync
App Services
Workflow
Transcoding
Email
Search
Queuing &
Notifications
App streaming
Analytics
Hadoop
Data
Pipelines
Data
Warehouse
Real-time
Streaming Data
Enterprise
Applications
Virtual
Desktops
Collaboration and
Sharing
More Functionality Than Any Other Infrastructure Provider
What if you could devote 30% more of
your resources to your customers?
PLACE

AWS Summit Seoul 2015 - AWS 최신 서비스 살펴보기 - Aurora, Lambda, EFS, Machine Learning, ECS

  • 1.
  • 2.
    신규 서비스 살펴보기 ThomasPark Head of Solutions Architecture, Korea
  • 3.
    What if youcould devote 30% more of your resources to your customers?
  • 4.
    IT Map -Traditional IT E-mail, Productivity, Collaboration, HR, Finance, ERP Desktop Support, Device Management, Telephony, IT Support Information Security, CISO Encryption, Key Management, Identity Management, Firewalls, IDS, DDoS Business Applications Digital Products, Brand Websites, Mobile Applications, Point of Sale Systems, Commerce Corporate Applications End User Computing Infrastructure Servers, Storage, Networking, Databases, Data Warehousing, Data Centers
  • 5.
    IT Map -Traditional IT with AWS Information Security, CISO Corporate Applications End User Computing Infrastructure Business Applications AWS Elastic Beanstalk, AWS Lambda, Amazon SQS, Amazon SNS, Amazon Mobile Analytics, Amazon CloudFront Amazon WorkMail, Amazon WorkDocs, AWS Marketplace, AWS Directory Service, SaaS Amazon WorkSpaces, Amazon AppStream, AWS Marketplace, AWS Mobile Services, SaaS AWS Identity and Access Management (IAM), AWS CloudHSM, AWS Key Management Service (AWS KMS), Security Groups, AWS Marketplace Amazon EC2, Amazon S3, Amazon RDS, Amazon VPC, Amazon Direct Connect, Directory Service, IAM, AWS Service Catalog
  • 6.
  • 7.
    IT Map -A Cloud-First Tomorrow Information Security, CISO Business Applications DevOps Corporate Applications End User Computing AWS Elastic Beanstalk, AWS Lambda, Amazon SQS, Amazon SNS, Amazon Mobile Analytics, Amazon CloudFront Amazon WorkMail, Amazon WorkDocs, AWS Marketplace, AWS Directory Service, SaaS Amazon WorkSpaces, Amazon AppStream, AWS Marketplace, AWS Mobile Services, SaaS Amazon EC2, Amazon S3, Amazon RDS, Amazon VPC, Amazon Direct Connect, Directory Service, IAM, AWS Service Catalog, AWS Code Services AWS Identity and Access Management (IAM), AWS CloudHSM, AWS Key Management Service (AWS KMS), Security Groups, AWS Marketplace
  • 9.
    • Service-Oriented Architecture (SOA) •Everything gets a service interface • Primitives • “Microservices”
  • 10.
    • Decentralized • Two-pizzateams • Agility, autonomy, accountability, and ownership • “DevOps”
  • 12.
    • Deployment service •Zero downtime • Health checking • Versioned artifacts & rollbacks
  • 13.
    • Continuous delivery • Fromcheck-in to production • CI/CD + release automation • >90% of teams Pipelines
  • 14.
    DevOps Pipeline Source Developers commit changes Build Changes are built and unittested Staging Code deployed to staging and load/UI tested Production Code is deployed to production Changes, Updates, and Fixes Ideas, Requests, and Bugs Developers Customers
  • 15.
    = 50 milliondeployments a year Thousands of teams + Microservices architecture + Multiple environments + Continuous delivery
  • 17.
    AWS Code services CodeCommit PrivateBeta CodePipeline Private Beta CodeDeploy Launched
  • 18.
    What about theinfrastructure?
  • 19.
  • 20.
    What are containers? •OS virtualization • Process isolation • Automation • ImagesServer Guest OS Bins/Libs Bins/Libs App2App1
  • 22.
    Common Customer Challenges/Desires •Cluster Management • Configuration Management • Availability • Scalability (application and repository) • Scheduling • Monitoring • AWS integration – VPC, ELB, Auto Scaling, CloudWatch, etc.
  • 24.
    Amazon EC2 ContainerService • Building Block Service • Cluster Management Made Easy • Flexible Scheduling • Performance at Scale • Security • Extensible
  • 25.
  • 26.
    Amazon S3 BucketEvents Original image Thumbnailed image 1 2 3 Application Monitoring Security Deploy
  • 27.
    Yes, you cando with EC2 instances… Amazon S3 Bucket Events Original image Thumbnailed image 1 2 3 Application Monitoring Security Deploy High Availability Scalability
  • 29.
  • 30.
    What is AWSLambda? AWS Lambda is a compute service that runs your code in response to events such as image uploads, in-app activity, website clicks, or outputs from connected devices.
  • 31.
    Data Triggers: AmazonS3 Amazon S3 Bucket Events AWS Lambda Original image Thumbnailed image 1 2 3
  • 32.
  • 33.
    Three types ofdata-driven development Retrospective analysis and reporting Here-and-now real-time processing and dashboards Predictions to enable smart applications Amazon Kinesis Amazon EC2 AWS Lambda Amazon Redshift, Amazon RDS Amazon S3 Amazon EMR
  • 34.
    Machine learning andsmart applications Machine learning is the technology that automatically finds patterns in your data and uses them to make predictions for new data points as they become available Your data + machine learning = smart applications
  • 35.
    Building smart applications– a counter-pattern Dear Thomas, This awesome quadcopter is on sale for just $49.99!
  • 36.
    Smart applications bycounter-example SELECT c.ID FROM customers c LEFT JOIN orders o ON c.ID = o.customer GROUP BY c.ID HAVING o.date > GETDATE() – 30 We can start by sending the offer to all customers who placed an order in the last 30 days
  • 37.
    Smart applications bycounter-example SELECT c.ID FROM customers c LEFT JOIN orders o ON c.ID = o.customer GROUP BY c.ID HAVING AND o.date > GETDATE() – 30 … let’s narrow it down to just customers who bought toys
  • 38.
    Smart applications bycounter-example SELECT c.ID FROM customers c LEFT JOIN orders o ON c.ID = o.customer GROUP BY c.ID HAVING o.category = ‘toys’ AND (COUNT(*) > 2 AND ) … and expand the query to customers who purchased other toy helicopters recently
  • 39.
    Smart applications bycounter-example SELECT c.ID FROM customers c LEFT JOIN orders o ON c.ID = o.customer GROUP BY c.ID HAVING o.category = ‘toys’ AND (COUNT(*) > 2 AND SUM(o.price) > 200 AND o.date > GETDATE() – 30) ) Use machine learning technology to learn your business rules from data!
  • 40.
    Why aren’t theremore smart applications? 1. Machine learning expertise is rare 2. Building and scaling machine learning technology is hard 3. Closing the gap between models and applications is time-consuming and expensive
  • 41.
    Introducing Amazon MachineLearning Easy to use, managed machine learning service built for developers Robust, powerful machine learning technology based on Amazon’s internal systems Create models using your data already stored in the AWS cloud Deploy models to production in seconds
  • 42.
  • 43.
  • 44.
    Batch predictions withAmazon Redshift Structured data In Amazon Redshift Load predictions into Amazon Redshift -or- Read prediction results directly from S3 Predictions in S3 Query for predictions with Amazon ML batch API Your application
  • 45.
    Real-time predictions forinteractive applications Your application Query for predictions with Amazon ML real-time API
  • 46.
    Unconstrained Big DataGrowth • IT/Application server logs IT Infrastructure logs, Metering, Audit logs, Change logs • Websites/Mobile apps/Ads Clickstream, User Engagement • Sensor data/IoT Weather, Smart Grids, Wearables • Social media, user content 450MM+ Tweets/day GB TB PB ZB EB
  • 47.
  • 49.
    Current DB architecturesare monolithic Multiple layers of functionality all on a single box SQL Transactions Caching Logging
  • 50.
    Current DB architecturesare monolithic Even when you scale it out, you’re still replicating the same stack SQL Transactions Caching Logging SQL Transactions Caching Logging Application
  • 51.
    Current DB architecturesare monolithic SQL Transactions Caching Logging SQL Transactions Caching Logging Storage Application Even when you scale it out, you’re still replicating the same stack
  • 52.
    This is aproblem. For cost. For flexibility. And for availability.
  • 53.
    Reimagining the relationaldatabase What if you were inventing the database today? You wouldn’t design it the way we did in 1970. At least not entirely. You’d build something that can scale out, that is self-healing, and that leverages existing AWS services.
  • 54.
    Amazon Aurora isEasy to Use Amazon RDS Aurora
  • 55.
    Aurora storage • Highlyavailable by default – 6-way replication across 3 AZs – 4 of 6 write quorum • Automatic fallback to 3 of 4 if an AZ is unavailable – 3 of 6 read quorum • SSD, scale-out, multi-tenant storage – Seamless storage scalability – Up to 64 TB database size – Only pay for what you use • Log-structured storage – Many small segments, each with their own redo logs – Log pages used to generate data pages – Eliminates chatter between database and storage SQL Transactions AZ 1 AZ 2 AZ 3 Caching Amazon S3
  • 56.
    Self-healing, fault-tolerant • Losetwo copies or an AZ failure without read or write availability impact • Lose three copies without read availability impact • Automatic detection, replication, and repair SQL Transactio n AZ 1 AZ 2 AZ 3 Caching SQL Transactio n AZ 1 AZ 2 AZ 3 Caching Read and write availabilityRead availability
  • 57.
    Survivable caches • Wemoved the cache out of the database process • Cache remains warm in the event of a database restart • Lets you resume fully loaded operations much faster • Instant crash recovery + survivable cache = quick and easy recovery from DB failures SQL Transactions Caching SQL Transactions Caching SQL Transactions Caching Caching process is outside the DB process and remains warm across a database restart
  • 58.
    Simulate failures usingSQL • To cause the failure of a component at the database node: ALTER SYSTEM CRASH [{INSTANCE | DISPATCHER | NODE}] • To simulate the failure of disks: ALTER SYSTEM SIMULATE percent_failure DISK failure_type IN [DISK index | NODE index] FOR INTERVAL interval • To simulate the failure of networking: ALTER SYSTEM SIMULATE percent_failure NETWORK failure_type [TO {ALL | read_replica | availability_zone}] FOR INTERVAL interval
  • 59.
    Amazon Elastic FileSystem (EFS)
  • 60.
    Operating shared filestorage today is a pain Application owner or developer IT administrator Business owner • Estimate demand • Procure hardware • Set aside physical space • Set up and maintain hardware (and network) • Manage access and security • Provide demand forecasts/business case • Add lead times and extra coordination to your schedule • Limit your flexibility and agility • Make up-front capital investments, over-buy, stay on a constant upgrade/refresh cycle • Sacrifice business agility • Distract your people from your business’s mission
  • 61.
    We focused onchanging the game EFS is simple EFS is elastic EFS is scalable 1 2 3
  • 62.
    EFS is simple •Fully managed – No hardware, network, file layer – Create a scalable file system in seconds! • Seamless integration with existing tools and apps – NFS v4—widespread, open – Standard file system semantics – Works with standard OS file system APIs • Simple pricing = simple forecasting 1
  • 63.
    EFS is elastic •File systems grow and shrink automatically as you add and remove files • No need to provision storage capacity or performance • You pay only for the storage space you use, with no minimum fee 2
  • 64.
    • File systemscan grow to petabyte scale • Throughput and IOPS scale automatically as file systems grow • Consistent low latencies regardless of file system size • Support for thousands of concurrent NFS connections EFS is scalable3
  • 65.
    Cloud Has BecomeThe New Normal
  • 66.
    Infrastructure Regions Pointsof PresenceAvailability Zones Core Services Storage (Object, Block and Archival) Compute (VMs, Auto-scaling and Load Balancing) Databases (Relational, NoSQL, Caching) Networking (VPC, DX, DNS) CDN Access Control Usage Auditing Monitoring and Logs Administration & Security Key Storage Identity Management Platform Services Deployment & Management One-click web app deployment Dev/ops resource management Resource Templates Push Notifications Mobile Services Mobile Analytics Identity Sync App Services Workflow Transcoding Email Search Queuing & Notifications App streaming Analytics Hadoop Data Pipelines Data Warehouse Real-time Streaming Data Enterprise Applications Virtual Desktops Collaboration and Sharing More Functionality Than Any Other Infrastructure Provider
  • 67.
    What if youcould devote 30% more of your resources to your customers?
  • 69.