SlideShare a Scribd company logo
1
Module 2
AWS Storage and Content
Delivery Services
2
Module 2 Layout
• Amazon Simple Storage Service (S3)
• Amazon Elastic Block Store (EBS)
• Amazon CloudFront (CF)
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
3
Amazon Simple Storage Service (S3)
• Storage for the Internet
• Natively online, HTTP access
• Storage that allows you to store and retrieve any
amount of data, any time, from anywhere on the
web
• Highly scalable, reliable, fast and durable
Amazon S3
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
4
Amazon S3 Facts
• Can store an unlimited number of objects in a bucket
• Objects can be up to 5 TB; no bucket size limit
• Designed for 99.999999999% durability and 99.99%
availability of objects over a given year
• Can use HTTP/S endpoints to store and retrieve any amount
of data, at any time, from anywhere on the web
• Is highly scalable, reliable, fast, and inexpensive
• Can use optional server-side encryption using AWS or
customer-managed provided client-side encryption
• Auditing is provided by access logs
• Provides standards-based REST and SOAP interfaces
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
5
Amazon S3 Concepts
• Amazon S3 stores data as objects
within buckets
• An object is composed of a file and
optionally any metadata that
describes that file
• You can have up to 100 buckets in
each account
• You can control access to the bucket
and its objects
Amazon
S3
Bucket
with
Objects
Bucket
Object
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
6
Amazon S3 Buckets
• Organize the Amazon S3 namespace at the highest level.
• Identify the account responsible for storage and data transfer
charges.
• Play a role in access control.
• Serve as the unit of aggregation for usage reporting.
• Have globally unique bucket names, regardless of the AWS region in
which they were created.
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
7
Amazon S3 Region Considerations
• Amazon S3 creates a bucket in the region you select.
• You can choose a region to:
• Optimize latency
• Minimize costs
• Address regulatory requirements
• Objects stored in a region never leave the region unless
you explicitly transfer them to another region.
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
8
Amazon S3 Objects
• Objects are the fundamental entities stored in Amazon S3.
• When using the console, you can think of them as files.
• Objects consist of data and metadata. The data portion is
opaque to Amazon S3. The metadata is a set of name-value
pairs that describe the object.
• Default metadata such as the date last modified
• Standard HTTP metadata such as Content-Type
• Custom metadata at the time the object is stored
• A key that uniquely identifies as object within its bucket
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
9
Object Keys
An object key is the unique identifier for an object in a
bucket.
http://doc.s3.amazonaws.com/2006-03-01/AmazonS3.html
Bucket Object/Key
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
10
Amazon S3 Security
• You can control access to buckets and objects with:
• Access Control Lists (ACLs)
• Bucket policies
• Identity and Access Management (IAM) policies
• You can upload or download data to Amazon S3 via SSL
encrypted endpoints.
• You can encrypt data using AWS SDKs.
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
11
Amazon S3 Versioning
• Protects from accidental overwrites and deletes
with no performance penalty.
• Generates a new version with every upload.
• Allows easily retrieval of deleted objects or roll back
to previous versions.
• Three states of an Amazon S3 bucket
• Un-versioned (default)
• Versioning-enabled
• Versioning-suspended
Versioning Enabled
Key: photo.gif
ID: 121212
Key: photo.gif
ID: 111111
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
12
Amazon S3 Object Lifecycle
Lifecycle management defines how Amazon S3 manages objects
during their lifetime. Some objects that you store in an Amazon S3
bucket might have a well-defined lifecycle:
• Log files
• Archive documents
• Digital media archives
• Financial and healthcare records
• Raw genomics sequence data
• Long-term database backups
• Data that must be retained for regulatory compliance
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
13
Common Use Scenarios
• Storage and backup
• Application file hosting
• Media hosting
• Software delivery
• Store AMIs and snapshots
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
14
Landsat on AWS
We have committed to make up to 1
petabyte of Landsat imagery readily
available as objects on Amazon S3.
All Landsat 8 scenes from 2015 are
available, along with a selection of
cloud-free scenes from 2013 and
2014. All new Landsat 8 scenes are
made available each day (~700 per
day), often within hours of production.
Now anyone can work with Landsat
data with no up-front investment of
time or capital expense.
15
Snapsat
A team of five novice programmers
used Landsat on AWS to build a web
app called Snapsat that creates
Landsat data visualizations in
seconds.
Snapsat was built during the team’s
8-week training program at Code
Fellows. They launched it just
months after learning to write code.
http://snapsat.org
16
Amazon S3 Pricing
• Pay only for what you use
• No minimum fee
• Prices based on location of your Amazon S3 bucket
• Estimate monthly bill using the AWS Simple Monthly Calculator
• Pricing is available as:
• Storage Pricing
• Request Pricing
• Data Transfer Pricing: data transferred out of Amazon S3
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
17
Amazon Glacier
• Long term low-cost archiving service
• Optimal for infrequently accessed data
• Designed for 99.999999999% durability
• Three to five hours’ retrieval time
• Less than $0.01 per GB/month (depending on region)
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
18
Amazon S3 + Amazon Glacier
S3 Lifecycle policies allow you to delete or move
objects based on age and set rules per S3 bucket.
bucket with
objects
30 Days
Glacier
archive
365 Days
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
19
Amazon S3 Storage Classes
Storage Class Durability Availability Other Considerations
Amazon S3
Standard
99.999999999% 99.99%
Amazon S3
Standard -
Infrequent
Access (IA)
99.999999999% 99.9%
• Retrieval fee associated with
objects
• Most suitable for infrequently
accessed data
Glacier 99.999999999%
99.99%
(once restored)
• Not available for real-time
access
• Must restore objects before you
can access them
• Restoring objects can take 3-5
hours
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
20
Instructor Demo
Amazon S3
21
Amazon Elastic Block Store (EBS)
• Persistent block level storage volumes offer
consistent and low-latency performance.
• Stored data is automatically replicated within its
Availability Zone.
• Snapshots are stored durably in Amazon S3.
Amazon
EBS
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
22
Amazon EBS Lifecycle
Vast amounts of
unused space Create
Call CreateVolume
1 GiB to 16 TiB
Attach
Call AttachVolume to affiliate with
one Amazon EC2 instance
Attached
and
In Use
• Format from Amazon EC2
instance OS
• Mount formatted drive
CreateSnapshot
Snapshot to
Amazon S3
Detach
Call DetachVolume
Deleted
Call DeleteVolume
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
23
Amazon EBS Volume Types
• SSD-backed volumes are
• Optimized for transactional workloads that involve frequent
read/write operations with small I/O size.
• Dominant in IOPS performance.
• HDD-backed volumes are
• Optimized for large streaming workloads.
• Dominant in throughput (measured in MiB/s).
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
24
Amazon EBS Volume Types
SSD HDD
Volume Type
General Purpose
SSD (gp2)
Provisioned IOPS
SSD (io1)
Throughput Optimized
HDD (st1)
Cold HDD (sc1)
Description
Balances price and
performance for a
wide variety of
transactional loads.
Highest-
performance SSD
volume designed for
mission-critical
applications.
Low-cost HDD
designed for frequently
accessed, throughput-
intensive workloads.
Lowest cost HDD
designed for less
frequently accessed
workloads.
Volume Sizes 1 GiB – 16 TiB 4 GiB – 16 TiB 500 GiB – 16 TiB 500 GiB – 16 TiB
Dominant
Performance
Attribute
IOPS IOPS MiB/s MiB/s
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
25
Amazon EBS Facts
• EBS is recommended when data must be quickly
accessible and requires long-term persistence.
• You can launch your EBS volumes as encrypted
volumes – data stored at rest on the volume, disk I/O,
and snapshots created from the volume are all
encrypted.
• You can create point-in-time snapshots of EBS
volumes, which are persisted to Amazon S3.
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
26
Amazon EBS Use Cases
• OS: Use for boot/root volume, secondary volumes
• Databases: Scales with your performance needs
• Enterprise applications: Provides reliable block storage to run
mission-critical applications
• Business continuity: Minimize data loss and recovery time by
regularly backing up using EBS Snapshots
• Applications: Install and persist any application
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
27
Amazon EBS Pricing
Pay for what you provision:
• Pricing based on region
• Review Pricing Calculator online
• Pricing is available as:
• Storage
• IOPS
* Check Amazon EBS Pricing page for current pricing for all regions.
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
28
Amazon EBS Scope
Amazon EBS volumes are in a single Availability Zone
Availability Zone A
EBS Volume 1
Availability Zone B
EBS Volume 2
Volume data is replicated across multiple servers in an Availability Zone.
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
29
Amazon EBS and Amazon S3
Amazon EBS Amazon S3
Paradigm Block storage with file system Object store
Performance Very fast Fast
Redundancy Across multiple servers in an
Availability Zone
Across multiple facilities in a
Region
Security EBS Encryption – Data volumes
and Snapshots
Encryption
Access from the
Internet?
No (1) Yes (2)
Typical use case It is a disk drive Online storage
(1) Accessible from the Internet if mounted to server and set up as FTP, etc.
(2) Only with proper credentials, unless ACLs are world-readable
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
30
Amazon CloudFront
31
Amazon CloudFront
• Easy and cost effective way to distribute
content to end users
• Low latency, high data transfer speeds
• Deliver your entire website, including static,
dynamic, and streaming content using a global
network of edge locations
Amazon
CloudFront
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
32
How You Configure CloudFront to Deliver
Your Content
Developer
S3 bucket or
HTTP server
1
Objects/data
2
Web distribution
CloudFront
3
http://d111111abcdef8.cloudfront.net
Edge
locations
Your distribution’s
configuration
4
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
33
How CloudFront Delivers Content to Your
Users
Amazon S3 server
or HTTP server
User Website
example.com
1
3a
Edge location
Object/data
3b
Object/
data
3/3c
2
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
34
Q & A
35
Lunch Time !

More Related Content

What's hot

AWSome Day 2016 - Module 3: Security, Identity, and Access Management
AWSome Day 2016 - Module 3: Security, Identity, and Access ManagementAWSome Day 2016 - Module 3: Security, Identity, and Access Management
AWSome Day 2016 - Module 3: Security, Identity, and Access Management
Amazon Web Services
 

What's hot (20)

ENT302 Deep Dive on AWS Management Tools and New Launches
ENT302 Deep Dive on AWS Management Tools and New LaunchesENT302 Deep Dive on AWS Management Tools and New Launches
ENT302 Deep Dive on AWS Management Tools and New Launches
 
SRV418 Deep Dive on Accelerating Content, APIs, and Applications with Amazon ...
SRV418 Deep Dive on Accelerating Content, APIs, and Applications with Amazon ...SRV418 Deep Dive on Accelerating Content, APIs, and Applications with Amazon ...
SRV418 Deep Dive on Accelerating Content, APIs, and Applications with Amazon ...
 
The Best of re:invent 2016
The Best of re:invent 2016The Best of re:invent 2016
The Best of re:invent 2016
 
protecting your data in aws
protecting your data in aws protecting your data in aws
protecting your data in aws
 
Shared Responsibility and Setting Up Secure Account Structures
Shared Responsibility and Setting Up Secure Account StructuresShared Responsibility and Setting Up Secure Account Structures
Shared Responsibility and Setting Up Secure Account Structures
 
BDA402 Deep Dive: Log Analytics with Amazon Elasticsearch Service
BDA402 Deep Dive: Log Analytics with Amazon Elasticsearch ServiceBDA402 Deep Dive: Log Analytics with Amazon Elasticsearch Service
BDA402 Deep Dive: Log Analytics with Amazon Elasticsearch Service
 
Being Well Architected in the Cloud (Updated)
Being Well Architected in the Cloud (Updated)Being Well Architected in the Cloud (Updated)
Being Well Architected in the Cloud (Updated)
 
AWSome Day 2016 - Module 3: Security, Identity, and Access Management
AWSome Day 2016 - Module 3: Security, Identity, and Access ManagementAWSome Day 2016 - Module 3: Security, Identity, and Access Management
AWSome Day 2016 - Module 3: Security, Identity, and Access Management
 
Getting Started with Managed Database Services on AWS - September 2016 Webina...
Getting Started with Managed Database Services on AWS - September 2016 Webina...Getting Started with Managed Database Services on AWS - September 2016 Webina...
Getting Started with Managed Database Services on AWS - September 2016 Webina...
 
AWS Enterprise Summit Netherlands - Big Data Architectural Patterns & Best Pr...
AWS Enterprise Summit Netherlands - Big Data Architectural Patterns & Best Pr...AWS Enterprise Summit Netherlands - Big Data Architectural Patterns & Best Pr...
AWS Enterprise Summit Netherlands - Big Data Architectural Patterns & Best Pr...
 
Getting started with the hybrid cloud enterprise backup and recovery - Toronto
Getting started with the hybrid cloud   enterprise backup and recovery - TorontoGetting started with the hybrid cloud   enterprise backup and recovery - Toronto
Getting started with the hybrid cloud enterprise backup and recovery - Toronto
 
Databases on AWS Workshop.pdf
Databases on AWS Workshop.pdfDatabases on AWS Workshop.pdf
Databases on AWS Workshop.pdf
 
Protecting Your Data in AWS
Protecting Your Data in AWSProtecting Your Data in AWS
Protecting Your Data in AWS
 
Hackproof Your Gov Cloud: Mitigating Risks for 2017 and Beyond | AWS Public S...
Hackproof Your Gov Cloud: Mitigating Risks for 2017 and Beyond | AWS Public S...Hackproof Your Gov Cloud: Mitigating Risks for 2017 and Beyond | AWS Public S...
Hackproof Your Gov Cloud: Mitigating Risks for 2017 and Beyond | AWS Public S...
 
Protecting Your Data in AWS
Protecting Your Data in AWSProtecting Your Data in AWS
Protecting Your Data in AWS
 
Security best practices
Security best practices Security best practices
Security best practices
 
AWS APAC Webinar Week - Real Time Data Processing with Kinesis
AWS APAC Webinar Week - Real Time Data Processing with KinesisAWS APAC Webinar Week - Real Time Data Processing with Kinesis
AWS APAC Webinar Week - Real Time Data Processing with Kinesis
 
ENT305 Migrating Your Databases to AWS: Deep Dive on Amazon Relational Databa...
ENT305 Migrating Your Databases to AWS: Deep Dive on Amazon Relational Databa...ENT305 Migrating Your Databases to AWS: Deep Dive on Amazon Relational Databa...
ENT305 Migrating Your Databases to AWS: Deep Dive on Amazon Relational Databa...
 
AWS re:Invent 2016: Driving Innovation with Big Data and IoT (GPSST304)
AWS re:Invent 2016: Driving Innovation with Big Data and IoT (GPSST304)AWS re:Invent 2016: Driving Innovation with Big Data and IoT (GPSST304)
AWS re:Invent 2016: Driving Innovation with Big Data and IoT (GPSST304)
 
AWS Enterprise Summit Netherlands - Cost Optimisation at Scale
AWS Enterprise Summit Netherlands - Cost Optimisation at ScaleAWS Enterprise Summit Netherlands - Cost Optimisation at Scale
AWS Enterprise Summit Netherlands - Cost Optimisation at Scale
 

Viewers also liked

S3 Intro
S3 IntroS3 Intro
S3 Intro
fool2nd
 
Rackspace: Best Practices for Security Compliance on AWS
Rackspace: Best Practices for Security Compliance on AWSRackspace: Best Practices for Security Compliance on AWS
Rackspace: Best Practices for Security Compliance on AWS
Amazon Web Services
 

Viewers also liked (20)

Getting Started on AWS
Getting Started on AWSGetting Started on AWS
Getting Started on AWS
 
AWS Partnership Model
AWS Partnership ModelAWS Partnership Model
AWS Partnership Model
 
Introduction to AWS
Introduction to AWS Introduction to AWS
Introduction to AWS
 
Develop a Custom Data Solution Architecture with NorthBay
Develop a Custom Data Solution Architecture with NorthBayDevelop a Custom Data Solution Architecture with NorthBay
Develop a Custom Data Solution Architecture with NorthBay
 
Add User Sign in and Management to your Apps with Amazon Cognito
Add User Sign in and Management to your Apps with Amazon CognitoAdd User Sign in and Management to your Apps with Amazon Cognito
Add User Sign in and Management to your Apps with Amazon Cognito
 
AWS Security & Compliance
AWS Security & ComplianceAWS Security & Compliance
AWS Security & Compliance
 
S3 Intro
S3 IntroS3 Intro
S3 Intro
 
Security Innovations in the Cloud
Security Innovations in the CloudSecurity Innovations in the Cloud
Security Innovations in the Cloud
 
Getting Started on AWS
Getting Started on AWS Getting Started on AWS
Getting Started on AWS
 
Data Warehousing with Amazon Redshift
Data Warehousing with Amazon RedshiftData Warehousing with Amazon Redshift
Data Warehousing with Amazon Redshift
 
Deep Dive on Microservices and Amazon ECS
Deep Dive on Microservices and Amazon ECSDeep Dive on Microservices and Amazon ECS
Deep Dive on Microservices and Amazon ECS
 
Deep Dive Amazon Redshift for Big Data Analytics - September Webinar Series
Deep Dive Amazon Redshift for Big Data Analytics - September Webinar SeriesDeep Dive Amazon Redshift for Big Data Analytics - September Webinar Series
Deep Dive Amazon Redshift for Big Data Analytics - September Webinar Series
 
AWS Enterprise Summit Netherlands - Starting Your Journey in the Cloud
AWS Enterprise Summit Netherlands - Starting Your Journey in the CloudAWS Enterprise Summit Netherlands - Starting Your Journey in the Cloud
AWS Enterprise Summit Netherlands - Starting Your Journey in the Cloud
 
Getting started with Amazon ElastiCache
Getting started with Amazon ElastiCacheGetting started with Amazon ElastiCache
Getting started with Amazon ElastiCache
 
Rackspace: Best Practices for Security Compliance on AWS
Rackspace: Best Practices for Security Compliance on AWSRackspace: Best Practices for Security Compliance on AWS
Rackspace: Best Practices for Security Compliance on AWS
 
DevOps at Amazon: A Look at Our Tools and Processes
 DevOps at Amazon: A Look at Our Tools and Processes DevOps at Amazon: A Look at Our Tools and Processes
DevOps at Amazon: A Look at Our Tools and Processes
 
AWS Enterprise Summit Netherlands - Creating a Landing Zone
AWS Enterprise Summit Netherlands - Creating a Landing ZoneAWS Enterprise Summit Netherlands - Creating a Landing Zone
AWS Enterprise Summit Netherlands - Creating a Landing Zone
 
Fast Data at Scale with Amazon ElastiCache for Redis
Fast Data at Scale with Amazon ElastiCache for RedisFast Data at Scale with Amazon ElastiCache for Redis
Fast Data at Scale with Amazon ElastiCache for Redis
 
Real-time Data Processing Using AWS Lambda
Real-time Data Processing Using AWS LambdaReal-time Data Processing Using AWS Lambda
Real-time Data Processing Using AWS Lambda
 
AWS Enterprise Summit Netherlands - AWS IoT
AWS Enterprise Summit Netherlands - AWS IoTAWS Enterprise Summit Netherlands - AWS IoT
AWS Enterprise Summit Netherlands - AWS IoT
 

Similar to Storage & Content Delivery

Similar to Storage & Content Delivery (20)

Amazon ec2 s3 dynamo db
Amazon ec2 s3 dynamo dbAmazon ec2 s3 dynamo db
Amazon ec2 s3 dynamo db
 
Storage and Compute
Storage and ComputeStorage and Compute
Storage and Compute
 
Storage with Amazon S3 and Amazon Glacier
Storage with Amazon S3 and Amazon GlacierStorage with Amazon S3 and Amazon Glacier
Storage with Amazon S3 and Amazon Glacier
 
Introduction to AWS Storage Services
Introduction to AWS Storage ServicesIntroduction to AWS Storage Services
Introduction to AWS Storage Services
 
Understanding AWS Storage Options
Understanding AWS Storage OptionsUnderstanding AWS Storage Options
Understanding AWS Storage Options
 
How to backup, restore and archive your data on AWS
How to backup, restore and archive your data on AWSHow to backup, restore and archive your data on AWS
How to backup, restore and archive your data on AWS
 
cse40822-amazon.pptx
cse40822-amazon.pptxcse40822-amazon.pptx
cse40822-amazon.pptx
 
AWS May Webinar Series - Getting Started: Storage with Amazon S3 and Amazon G...
AWS May Webinar Series - Getting Started: Storage with Amazon S3 and Amazon G...AWS May Webinar Series - Getting Started: Storage with Amazon S3 and Amazon G...
AWS May Webinar Series - Getting Started: Storage with Amazon S3 and Amazon G...
 
STG301_Deep Dive on Amazon S3 and Glacier Architecture
STG301_Deep Dive on Amazon S3 and Glacier ArchitectureSTG301_Deep Dive on Amazon S3 and Glacier Architecture
STG301_Deep Dive on Amazon S3 and Glacier Architecture
 
(SOV203) Understanding AWS Storage Options | AWS re:Invent 2014
(SOV203) Understanding AWS Storage Options | AWS re:Invent 2014(SOV203) Understanding AWS Storage Options | AWS re:Invent 2014
(SOV203) Understanding AWS Storage Options | AWS re:Invent 2014
 
SRV301 Latest Updates & Best Practices for Amazon S3
 SRV301 Latest Updates & Best Practices for Amazon S3 SRV301 Latest Updates & Best Practices for Amazon S3
SRV301 Latest Updates & Best Practices for Amazon S3
 
數位媒體雲端儲存案例和技術分享 (AWS Storage Options for Media Industry)
數位媒體雲端儲存案例和技術分享 (AWS Storage Options for Media Industry)數位媒體雲端儲存案例和技術分享 (AWS Storage Options for Media Industry)
數位媒體雲端儲存案例和技術分享 (AWS Storage Options for Media Industry)
 
Backup and archiving in the aws cloud
Backup and archiving in the aws cloudBackup and archiving in the aws cloud
Backup and archiving in the aws cloud
 
Protect & Manage Amazon S3 & Amazon Glacier Objects at Scale (STG316-R1) - AW...
Protect & Manage Amazon S3 & Amazon Glacier Objects at Scale (STG316-R1) - AW...Protect & Manage Amazon S3 & Amazon Glacier Objects at Scale (STG316-R1) - AW...
Protect & Manage Amazon S3 & Amazon Glacier Objects at Scale (STG316-R1) - AW...
 
AWS Storage - S3 Fundamentals
AWS Storage - S3 FundamentalsAWS Storage - S3 Fundamentals
AWS Storage - S3 Fundamentals
 
Understanding AWS Storage Options (STG101) | AWS re:Invent 2013
Understanding AWS Storage Options (STG101) | AWS re:Invent 2013Understanding AWS Storage Options (STG101) | AWS re:Invent 2013
Understanding AWS Storage Options (STG101) | AWS re:Invent 2013
 
Active Archiving with Amazon S3 and Tiering to Amazon Glacier - March 2017 AW...
Active Archiving with Amazon S3 and Tiering to Amazon Glacier - March 2017 AW...Active Archiving with Amazon S3 and Tiering to Amazon Glacier - March 2017 AW...
Active Archiving with Amazon S3 and Tiering to Amazon Glacier - March 2017 AW...
 
(BDT322) How Redfin & Twitter Leverage Amazon S3 For Big Data
(BDT322) How Redfin & Twitter Leverage Amazon S3 For Big Data(BDT322) How Redfin & Twitter Leverage Amazon S3 For Big Data
(BDT322) How Redfin & Twitter Leverage Amazon S3 For Big Data
 
Building Hybrid Cloud Storage Architectures with AWS @scale
Building Hybrid Cloud Storage Architectures with AWS @scaleBuilding Hybrid Cloud Storage Architectures with AWS @scale
Building Hybrid Cloud Storage Architectures with AWS @scale
 
Building Hybrid Cloud Storage Architectures with AWS
Building Hybrid Cloud Storage Architectures with AWSBuilding Hybrid Cloud Storage Architectures with AWS
Building Hybrid Cloud Storage Architectures with AWS
 

More from Amazon Web Services

Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
Amazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
Amazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
Amazon Web Services
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
Amazon Web Services
 

More from Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 

Recently uploaded

Recently uploaded (20)

Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
 
Salesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
Salesforce Adoption – Metrics, Methods, and Motivation, Antone KomSalesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
Salesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
 
IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024IoT Analytics Company Presentation May 2024
IoT Analytics Company Presentation May 2024
 
UiPath Test Automation using UiPath Test Suite series, part 2
UiPath Test Automation using UiPath Test Suite series, part 2UiPath Test Automation using UiPath Test Suite series, part 2
UiPath Test Automation using UiPath Test Suite series, part 2
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
 
ODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User GroupODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User Group
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
 
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
Integrating Telephony Systems with Salesforce: Insights and Considerations, B...
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
 
"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi
 
Speed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in MinutesSpeed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in Minutes
 
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptxUnpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
 
10 Differences between Sales Cloud and CPQ, Blanka Doktorová
10 Differences between Sales Cloud and CPQ, Blanka Doktorová10 Differences between Sales Cloud and CPQ, Blanka Doktorová
10 Differences between Sales Cloud and CPQ, Blanka Doktorová
 

Storage & Content Delivery

  • 1. 1 Module 2 AWS Storage and Content Delivery Services
  • 2. 2 Module 2 Layout • Amazon Simple Storage Service (S3) • Amazon Elastic Block Store (EBS) • Amazon CloudFront (CF) © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 3. 3 Amazon Simple Storage Service (S3) • Storage for the Internet • Natively online, HTTP access • Storage that allows you to store and retrieve any amount of data, any time, from anywhere on the web • Highly scalable, reliable, fast and durable Amazon S3 © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 4. 4 Amazon S3 Facts • Can store an unlimited number of objects in a bucket • Objects can be up to 5 TB; no bucket size limit • Designed for 99.999999999% durability and 99.99% availability of objects over a given year • Can use HTTP/S endpoints to store and retrieve any amount of data, at any time, from anywhere on the web • Is highly scalable, reliable, fast, and inexpensive • Can use optional server-side encryption using AWS or customer-managed provided client-side encryption • Auditing is provided by access logs • Provides standards-based REST and SOAP interfaces © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 5. 5 Amazon S3 Concepts • Amazon S3 stores data as objects within buckets • An object is composed of a file and optionally any metadata that describes that file • You can have up to 100 buckets in each account • You can control access to the bucket and its objects Amazon S3 Bucket with Objects Bucket Object © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 6. 6 Amazon S3 Buckets • Organize the Amazon S3 namespace at the highest level. • Identify the account responsible for storage and data transfer charges. • Play a role in access control. • Serve as the unit of aggregation for usage reporting. • Have globally unique bucket names, regardless of the AWS region in which they were created. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 7. 7 Amazon S3 Region Considerations • Amazon S3 creates a bucket in the region you select. • You can choose a region to: • Optimize latency • Minimize costs • Address regulatory requirements • Objects stored in a region never leave the region unless you explicitly transfer them to another region. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 8. 8 Amazon S3 Objects • Objects are the fundamental entities stored in Amazon S3. • When using the console, you can think of them as files. • Objects consist of data and metadata. The data portion is opaque to Amazon S3. The metadata is a set of name-value pairs that describe the object. • Default metadata such as the date last modified • Standard HTTP metadata such as Content-Type • Custom metadata at the time the object is stored • A key that uniquely identifies as object within its bucket © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 9. 9 Object Keys An object key is the unique identifier for an object in a bucket. http://doc.s3.amazonaws.com/2006-03-01/AmazonS3.html Bucket Object/Key © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 10. 10 Amazon S3 Security • You can control access to buckets and objects with: • Access Control Lists (ACLs) • Bucket policies • Identity and Access Management (IAM) policies • You can upload or download data to Amazon S3 via SSL encrypted endpoints. • You can encrypt data using AWS SDKs. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 11. 11 Amazon S3 Versioning • Protects from accidental overwrites and deletes with no performance penalty. • Generates a new version with every upload. • Allows easily retrieval of deleted objects or roll back to previous versions. • Three states of an Amazon S3 bucket • Un-versioned (default) • Versioning-enabled • Versioning-suspended Versioning Enabled Key: photo.gif ID: 121212 Key: photo.gif ID: 111111 © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 12. 12 Amazon S3 Object Lifecycle Lifecycle management defines how Amazon S3 manages objects during their lifetime. Some objects that you store in an Amazon S3 bucket might have a well-defined lifecycle: • Log files • Archive documents • Digital media archives • Financial and healthcare records • Raw genomics sequence data • Long-term database backups • Data that must be retained for regulatory compliance © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 13. 13 Common Use Scenarios • Storage and backup • Application file hosting • Media hosting • Software delivery • Store AMIs and snapshots © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 14. 14 Landsat on AWS We have committed to make up to 1 petabyte of Landsat imagery readily available as objects on Amazon S3. All Landsat 8 scenes from 2015 are available, along with a selection of cloud-free scenes from 2013 and 2014. All new Landsat 8 scenes are made available each day (~700 per day), often within hours of production. Now anyone can work with Landsat data with no up-front investment of time or capital expense.
  • 15. 15 Snapsat A team of five novice programmers used Landsat on AWS to build a web app called Snapsat that creates Landsat data visualizations in seconds. Snapsat was built during the team’s 8-week training program at Code Fellows. They launched it just months after learning to write code. http://snapsat.org
  • 16. 16 Amazon S3 Pricing • Pay only for what you use • No minimum fee • Prices based on location of your Amazon S3 bucket • Estimate monthly bill using the AWS Simple Monthly Calculator • Pricing is available as: • Storage Pricing • Request Pricing • Data Transfer Pricing: data transferred out of Amazon S3 © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 17. 17 Amazon Glacier • Long term low-cost archiving service • Optimal for infrequently accessed data • Designed for 99.999999999% durability • Three to five hours’ retrieval time • Less than $0.01 per GB/month (depending on region) © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 18. 18 Amazon S3 + Amazon Glacier S3 Lifecycle policies allow you to delete or move objects based on age and set rules per S3 bucket. bucket with objects 30 Days Glacier archive 365 Days © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 19. 19 Amazon S3 Storage Classes Storage Class Durability Availability Other Considerations Amazon S3 Standard 99.999999999% 99.99% Amazon S3 Standard - Infrequent Access (IA) 99.999999999% 99.9% • Retrieval fee associated with objects • Most suitable for infrequently accessed data Glacier 99.999999999% 99.99% (once restored) • Not available for real-time access • Must restore objects before you can access them • Restoring objects can take 3-5 hours © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 21. 21 Amazon Elastic Block Store (EBS) • Persistent block level storage volumes offer consistent and low-latency performance. • Stored data is automatically replicated within its Availability Zone. • Snapshots are stored durably in Amazon S3. Amazon EBS © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 22. 22 Amazon EBS Lifecycle Vast amounts of unused space Create Call CreateVolume 1 GiB to 16 TiB Attach Call AttachVolume to affiliate with one Amazon EC2 instance Attached and In Use • Format from Amazon EC2 instance OS • Mount formatted drive CreateSnapshot Snapshot to Amazon S3 Detach Call DetachVolume Deleted Call DeleteVolume © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 23. 23 Amazon EBS Volume Types • SSD-backed volumes are • Optimized for transactional workloads that involve frequent read/write operations with small I/O size. • Dominant in IOPS performance. • HDD-backed volumes are • Optimized for large streaming workloads. • Dominant in throughput (measured in MiB/s). © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 24. 24 Amazon EBS Volume Types SSD HDD Volume Type General Purpose SSD (gp2) Provisioned IOPS SSD (io1) Throughput Optimized HDD (st1) Cold HDD (sc1) Description Balances price and performance for a wide variety of transactional loads. Highest- performance SSD volume designed for mission-critical applications. Low-cost HDD designed for frequently accessed, throughput- intensive workloads. Lowest cost HDD designed for less frequently accessed workloads. Volume Sizes 1 GiB – 16 TiB 4 GiB – 16 TiB 500 GiB – 16 TiB 500 GiB – 16 TiB Dominant Performance Attribute IOPS IOPS MiB/s MiB/s © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 25. 25 Amazon EBS Facts • EBS is recommended when data must be quickly accessible and requires long-term persistence. • You can launch your EBS volumes as encrypted volumes – data stored at rest on the volume, disk I/O, and snapshots created from the volume are all encrypted. • You can create point-in-time snapshots of EBS volumes, which are persisted to Amazon S3. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 26. 26 Amazon EBS Use Cases • OS: Use for boot/root volume, secondary volumes • Databases: Scales with your performance needs • Enterprise applications: Provides reliable block storage to run mission-critical applications • Business continuity: Minimize data loss and recovery time by regularly backing up using EBS Snapshots • Applications: Install and persist any application © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 27. 27 Amazon EBS Pricing Pay for what you provision: • Pricing based on region • Review Pricing Calculator online • Pricing is available as: • Storage • IOPS * Check Amazon EBS Pricing page for current pricing for all regions. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 28. 28 Amazon EBS Scope Amazon EBS volumes are in a single Availability Zone Availability Zone A EBS Volume 1 Availability Zone B EBS Volume 2 Volume data is replicated across multiple servers in an Availability Zone. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 29. 29 Amazon EBS and Amazon S3 Amazon EBS Amazon S3 Paradigm Block storage with file system Object store Performance Very fast Fast Redundancy Across multiple servers in an Availability Zone Across multiple facilities in a Region Security EBS Encryption – Data volumes and Snapshots Encryption Access from the Internet? No (1) Yes (2) Typical use case It is a disk drive Online storage (1) Accessible from the Internet if mounted to server and set up as FTP, etc. (2) Only with proper credentials, unless ACLs are world-readable © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 31. 31 Amazon CloudFront • Easy and cost effective way to distribute content to end users • Low latency, high data transfer speeds • Deliver your entire website, including static, dynamic, and streaming content using a global network of edge locations Amazon CloudFront © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 32. 32 How You Configure CloudFront to Deliver Your Content Developer S3 bucket or HTTP server 1 Objects/data 2 Web distribution CloudFront 3 http://d111111abcdef8.cloudfront.net Edge locations Your distribution’s configuration 4 © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 33. 33 How CloudFront Delivers Content to Your Users Amazon S3 server or HTTP server User Website example.com 1 3a Edge location Object/data 3b Object/ data 3/3c 2 © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.