SlideShare a Scribd company logo
1 of 28
Download to read offline
AWS Brown bag
session
11 Nov 2016
1UK Sales Conference
Image by Leah Juarez
Pathum Fernando
What is AWS stands for ?
Agenda
DynamoDB
Simple Queue Service ( SQS )
Simple Storage Service ( s3 )
DynamoDB
What is DynamoDB ?
● Amazon DynamoDB is a fast and flexible NoSql service
for all Application.
● Single digit millisecond latency
● It is fully managed by AWS
● Supported Key-Value data model
Quick facts about DynamoDB
● Stored on SSD Storage
● Spread across 3 geographical distints datacenter
● Eventually consistent read
● Strongly consistent read
Read More…
1. Why is Amazon DynamoDB built on Solid
State Drives?
2. What does read consistency mean? Why
should I care?
3. What is the consistency model of Amazon
DynamoDB?
The Basics
● Table
● Items ( Think a raw of data in a table )
● Attributes ( Think of column of data in a table )
Items
Attributes
Table
The Basics
Indexing and Keys
● Two type of primary keys Available
Single Attribute ( think unique ID )
-Partition Key
Composite ( Think unique ID and a date range )
- Partition Key and sort Key composed of two attributes
● Local indexing
● Global Indexing
Provisioned throughput
1. Unit of Read Provisioned throughput
A. All reads are round up to increments of 4KB
B. Eventually consistent Reads ( default ) consist of 2 reads per
second
C. Strongly consistent reads consist of 1 read per second.
1. Unit of write provisioned throughput
A. All writes are 1KB
B. All writes consist of 1 write per second.
Provisioned throughput ( Magic
formula )
You have an application that needs to read 25 items of 13kb in size per
second. Your application uses strongly consistent reads. What should
you set the read throughput to?
Read Throughput
Write Throughput
Read
Throughput
(Size of Read rounded up
to nearest 4KB chunk /
4KB )
no of items= X
Write
Throughput
( Size of Write rounded up
to nearest 1KB chunk /
1KB )
no of items= X
Simple Queue Service ( SQS )
What is SQS ?
● Amazon SQS is a web service that gives you access to a message
queue
● Amazon SQS is distributed queue system
● This is the very first service that the AWS launched
● Using SQS, you can decouple the components of an application
● Amazon SQS ensures delivery of each message at least once, and
support multiple readers and writers.
● SQS does not guarantee first in, first out delivery of messages.
SQS illustrate
To illustrate, suppose you have a number of image files to encode. In
an Amazon SQS worker queue, you create an Amazon SQS message
for each file specifying the command (jpeg-encode) and the location of
the file in Amazon S3. A pool of Amazon EC2 instances running the
needed image processing software does the encoding
SQS illustrate
SQS illustrate
SQS illustrate
SQS - Autoscaling
Simple Storage Service ( s3 )
What is S3 ?
● S3 is a safe place to store your files
● It is object based storage. Allows you to upload files
● The data is spread across multiple devices and facilities
● File can be from 1 byte to 5TB
● S3 is unlimited storage
● Files are stored in Buckets
● Bucket name should be unique globally
● Key-Value store
● Amazon guarantees 99.99% availability for the s3 platform and
99.999999999% durability for s3 information
● Use as a static hosting method
S3 consistency models
● Read after write consistency for PUTS of new objects
● Eventual consistency for overwrite PUTS and DELETES ( can take
some time to propagate )
S3 Storage Tiers/Classes
● S3 - 99.99% availability and 99.999999999% durability ,
redundantly across multiple devices in multiple facilities
● S3 - IA ( Infrequently Accessed ) For data that is accessed less
frequently, but requires rapid access when needed, Lower free
than S3
● Reduced Redundancy Storage - Designed to provide 99.99%
durability and 99.99% availability.
● Glacier - Very cheap, but used for archival only, It takes 3-5 hours
to restore from Glacier
S3 Storage Tiers/Classes
S3 Version Control
● Stores all version of an object
● Great backup tool
● Integrates with Lifecycle rules
● Versioning has MFA Delete capability
S3 Lifecycle Management
You manage an object's lifecycle by using a lifecycle configuration,
which defines how Amazon S3 manages objects during their lifetime.
Lifecycle configuration enables you to simplify the lifecycle
management of your objects, such as automated transition of
less-frequently accessed objects to low-cost storage alternatives and
scheduled deletions. You can configure as many as 1000 lifecycle rules
per bucket.
Are you looking for a AWS Certification
?
Are you looking for a AWS Certification
?
AWS Brown Bag

More Related Content

What's hot

Server-less solution for moving Millions of Images in Cloud - Brett Sutter, ...
 Server-less solution for moving Millions of Images in Cloud - Brett Sutter, ... Server-less solution for moving Millions of Images in Cloud - Brett Sutter, ...
Server-less solution for moving Millions of Images in Cloud - Brett Sutter, ...AWS Chicago
 
Cassandra for mission critical data
Cassandra for mission critical dataCassandra for mission critical data
Cassandra for mission critical dataOleksandr Semenov
 
Running MongoDB on AWS
Running MongoDB on AWSRunning MongoDB on AWS
Running MongoDB on AWSMongoDB
 
Compare DynamoDB vs. MongoDB
Compare DynamoDB vs. MongoDBCompare DynamoDB vs. MongoDB
Compare DynamoDB vs. MongoDBAmar Das
 
How to migrate your existing MongoDB and Cassandra Apps to Azure Cosmos DB
How to migrate your existing MongoDB and Cassandra Apps to Azure Cosmos DBHow to migrate your existing MongoDB and Cassandra Apps to Azure Cosmos DB
How to migrate your existing MongoDB and Cassandra Apps to Azure Cosmos DBMicrosoft Tech Community
 
Getting started with S3
Getting started with S3Getting started with S3
Getting started with S3AWS UG PK
 
AWS re:Invent 2016: Case Study: Librato's Experience Running Cassandra Using ...
AWS re:Invent 2016: Case Study: Librato's Experience Running Cassandra Using ...AWS re:Invent 2016: Case Study: Librato's Experience Running Cassandra Using ...
AWS re:Invent 2016: Case Study: Librato's Experience Running Cassandra Using ...Amazon Web Services
 
Scaling MongoDB on Amazon Web Services (DAT209) | AWS re:Invent 2013
Scaling MongoDB on Amazon Web Services (DAT209) | AWS re:Invent 2013Scaling MongoDB on Amazon Web Services (DAT209) | AWS re:Invent 2013
Scaling MongoDB on Amazon Web Services (DAT209) | AWS re:Invent 2013Amazon Web Services
 
MongoDB and AWS: Integrations
MongoDB and AWS: IntegrationsMongoDB and AWS: Integrations
MongoDB and AWS: IntegrationsMongoDB
 
Cloud Storage in Azure, AWS and Google Cloud
Cloud  Storage in Azure, AWS and Google CloudCloud  Storage in Azure, AWS and Google Cloud
Cloud Storage in Azure, AWS and Google CloudThurupathan Vijayakumar
 
Getting Started with EC2, S3 and EMR
Getting Started with EC2, S3 and EMRGetting Started with EC2, S3 and EMR
Getting Started with EC2, S3 and EMRArun Sirimalla
 
Deep Dive on EC2 and S3
Deep Dive on EC2 and S3Deep Dive on EC2 and S3
Deep Dive on EC2 and S3Arun Sirimalla
 
Cost Optimization with Spot Instances
Cost Optimization with Spot InstancesCost Optimization with Spot Instances
Cost Optimization with Spot InstancesArun Sirimalla
 
Media Content Ingest, Storage, and Archiving with AWS - John Downey, Amazon W...
Media Content Ingest, Storage, and Archiving with AWS - John Downey, Amazon W...Media Content Ingest, Storage, and Archiving with AWS - John Downey, Amazon W...
Media Content Ingest, Storage, and Archiving with AWS - John Downey, Amazon W...Amazon Web Services
 
Aws platform overview
Aws platform overviewAws platform overview
Aws platform overviewVinay Yelluri
 
AWS S3 | Tutorial For Beginners | AWS S3 Bucket Tutorial | AWS Tutorial For B...
AWS S3 | Tutorial For Beginners | AWS S3 Bucket Tutorial | AWS Tutorial For B...AWS S3 | Tutorial For Beginners | AWS S3 Bucket Tutorial | AWS Tutorial For B...
AWS S3 | Tutorial For Beginners | AWS S3 Bucket Tutorial | AWS Tutorial For B...Simplilearn
 

What's hot (20)

Server-less solution for moving Millions of Images in Cloud - Brett Sutter, ...
 Server-less solution for moving Millions of Images in Cloud - Brett Sutter, ... Server-less solution for moving Millions of Images in Cloud - Brett Sutter, ...
Server-less solution for moving Millions of Images in Cloud - Brett Sutter, ...
 
Cassandra for mission critical data
Cassandra for mission critical dataCassandra for mission critical data
Cassandra for mission critical data
 
Running MongoDB on AWS
Running MongoDB on AWSRunning MongoDB on AWS
Running MongoDB on AWS
 
Compare DynamoDB vs. MongoDB
Compare DynamoDB vs. MongoDBCompare DynamoDB vs. MongoDB
Compare DynamoDB vs. MongoDB
 
How to migrate your existing MongoDB and Cassandra Apps to Azure Cosmos DB
How to migrate your existing MongoDB and Cassandra Apps to Azure Cosmos DBHow to migrate your existing MongoDB and Cassandra Apps to Azure Cosmos DB
How to migrate your existing MongoDB and Cassandra Apps to Azure Cosmos DB
 
Getting started with S3
Getting started with S3Getting started with S3
Getting started with S3
 
AWS re:Invent 2016: Case Study: Librato's Experience Running Cassandra Using ...
AWS re:Invent 2016: Case Study: Librato's Experience Running Cassandra Using ...AWS re:Invent 2016: Case Study: Librato's Experience Running Cassandra Using ...
AWS re:Invent 2016: Case Study: Librato's Experience Running Cassandra Using ...
 
Scaling MongoDB on Amazon Web Services (DAT209) | AWS re:Invent 2013
Scaling MongoDB on Amazon Web Services (DAT209) | AWS re:Invent 2013Scaling MongoDB on Amazon Web Services (DAT209) | AWS re:Invent 2013
Scaling MongoDB on Amazon Web Services (DAT209) | AWS re:Invent 2013
 
MongoDB and AWS: Integrations
MongoDB and AWS: IntegrationsMongoDB and AWS: Integrations
MongoDB and AWS: Integrations
 
Cloud Storage in Azure, AWS and Google Cloud
Cloud  Storage in Azure, AWS and Google CloudCloud  Storage in Azure, AWS and Google Cloud
Cloud Storage in Azure, AWS and Google Cloud
 
Getting Started with EC2, S3 and EMR
Getting Started with EC2, S3 and EMRGetting Started with EC2, S3 and EMR
Getting Started with EC2, S3 and EMR
 
Hands-On With Amazon Web Services (AWS) - part 3
Hands-On With Amazon Web Services (AWS) - part 3Hands-On With Amazon Web Services (AWS) - part 3
Hands-On With Amazon Web Services (AWS) - part 3
 
Deep Dive on EC2 and S3
Deep Dive on EC2 and S3Deep Dive on EC2 and S3
Deep Dive on EC2 and S3
 
Aws s3 security
Aws s3 securityAws s3 security
Aws s3 security
 
Cost Optimization with Spot Instances
Cost Optimization with Spot InstancesCost Optimization with Spot Instances
Cost Optimization with Spot Instances
 
Media Content Ingest, Storage, and Archiving with AWS - John Downey, Amazon W...
Media Content Ingest, Storage, and Archiving with AWS - John Downey, Amazon W...Media Content Ingest, Storage, and Archiving with AWS - John Downey, Amazon W...
Media Content Ingest, Storage, and Archiving with AWS - John Downey, Amazon W...
 
Aws platform overview
Aws platform overviewAws platform overview
Aws platform overview
 
AWS S3 | Tutorial For Beginners | AWS S3 Bucket Tutorial | AWS Tutorial For B...
AWS S3 | Tutorial For Beginners | AWS S3 Bucket Tutorial | AWS Tutorial For B...AWS S3 | Tutorial For Beginners | AWS S3 Bucket Tutorial | AWS Tutorial For B...
AWS S3 | Tutorial For Beginners | AWS S3 Bucket Tutorial | AWS Tutorial For B...
 
Almacenamiento en la nube con AWS
Almacenamiento en la nube con AWSAlmacenamiento en la nube con AWS
Almacenamiento en la nube con AWS
 
Cassandra vs Databases
Cassandra vs Databases Cassandra vs Databases
Cassandra vs Databases
 

Similar to AWS Brown Bag

Amazon ec2 s3 dynamo db
Amazon ec2 s3 dynamo dbAmazon ec2 s3 dynamo db
Amazon ec2 s3 dynamo dbPankaj Thakur
 
AWS Study Group - Chapter 09 - Storage Option [Solution Architect Associate G...
AWS Study Group - Chapter 09 - Storage Option [Solution Architect Associate G...AWS Study Group - Chapter 09 - Storage Option [Solution Architect Associate G...
AWS Study Group - Chapter 09 - Storage Option [Solution Architect Associate G...QCloudMentor
 
Real-Time Data Exploration and Analytics with Amazon Elasticsearch Service
Real-Time Data Exploration and Analytics with Amazon Elasticsearch ServiceReal-Time Data Exploration and Analytics with Amazon Elasticsearch Service
Real-Time Data Exploration and Analytics with Amazon Elasticsearch ServiceAmazon Web Services
 
Understanding AWS Storage Options
Understanding AWS Storage OptionsUnderstanding AWS Storage Options
Understanding AWS Storage OptionsAmazon Web Services
 
PowerPoint Presentation.pdf
PowerPoint Presentation.pdfPowerPoint Presentation.pdf
PowerPoint Presentation.pdfmarvellPalenewen
 
Scaling up to your first 10 million users - Pop-up Loft Tel Aviv
Scaling up to your first 10 million users - Pop-up Loft Tel AvivScaling up to your first 10 million users - Pop-up Loft Tel Aviv
Scaling up to your first 10 million users - Pop-up Loft Tel AvivAmazon Web Services
 
NEW LAUNCH! Introducing PostgreSQL compatibility for Amazon Aurora
NEW LAUNCH! Introducing PostgreSQL compatibility for Amazon AuroraNEW LAUNCH! Introducing PostgreSQL compatibility for Amazon Aurora
NEW LAUNCH! Introducing PostgreSQL compatibility for Amazon AuroraAmazon Web Services
 
Running Relational Databases on AWS
Running Relational Databases on AWS  Running Relational Databases on AWS
Running Relational Databases on AWS Amazon Web Services
 
Announcing Amazon Aurora with PostgreSQL Compatibility - January 2017 AWS Onl...
Announcing Amazon Aurora with PostgreSQL Compatibility - January 2017 AWS Onl...Announcing Amazon Aurora with PostgreSQL Compatibility - January 2017 AWS Onl...
Announcing Amazon Aurora with PostgreSQL Compatibility - January 2017 AWS Onl...Amazon Web Services
 
Store stream data on Data Lake
Store stream data on Data LakeStore stream data on Data Lake
Store stream data on Data LakeMarcos Rebelo
 
Enterprise Grade SQL Server Deployments in AWS
Enterprise Grade SQL Server Deployments in AWSEnterprise Grade SQL Server Deployments in AWS
Enterprise Grade SQL Server Deployments in AWSAmazon Web Services
 
The Enterprise Grade SQL Server Deployments in AWS
The Enterprise Grade SQL Server Deployments in AWSThe Enterprise Grade SQL Server Deployments in AWS
The Enterprise Grade SQL Server Deployments in AWSAmazon Web Services
 
Amazon Aurora: The New Relational Database Engine from Amazon
Amazon Aurora: The New Relational Database Engine from AmazonAmazon Aurora: The New Relational Database Engine from Amazon
Amazon Aurora: The New Relational Database Engine from AmazonAmazon Web Services
 
getting started with amazon aurora
getting started with amazon auroragetting started with amazon aurora
getting started with amazon auroraAmazon Web Services
 
Deep Dive: Amazon Elastic MapReduce
Deep Dive: Amazon Elastic MapReduceDeep Dive: Amazon Elastic MapReduce
Deep Dive: Amazon Elastic MapReduceAmazon Web Services
 

Similar to AWS Brown Bag (20)

Amazon ec2 s3 dynamo db
Amazon ec2 s3 dynamo dbAmazon ec2 s3 dynamo db
Amazon ec2 s3 dynamo db
 
Aws storage options
Aws storage optionsAws storage options
Aws storage options
 
AWS Study Group - Chapter 09 - Storage Option [Solution Architect Associate G...
AWS Study Group - Chapter 09 - Storage Option [Solution Architect Associate G...AWS Study Group - Chapter 09 - Storage Option [Solution Architect Associate G...
AWS Study Group - Chapter 09 - Storage Option [Solution Architect Associate G...
 
Real-Time Data Exploration and Analytics with Amazon Elasticsearch Service
Real-Time Data Exploration and Analytics with Amazon Elasticsearch ServiceReal-Time Data Exploration and Analytics with Amazon Elasticsearch Service
Real-Time Data Exploration and Analytics with Amazon Elasticsearch Service
 
Understanding AWS Storage Options
Understanding AWS Storage OptionsUnderstanding AWS Storage Options
Understanding AWS Storage Options
 
Intro to AWS: Storage Services
Intro to AWS: Storage ServicesIntro to AWS: Storage Services
Intro to AWS: Storage Services
 
PowerPoint Presentation.pdf
PowerPoint Presentation.pdfPowerPoint Presentation.pdf
PowerPoint Presentation.pdf
 
What's New in Amazon Aurora
What's New in Amazon AuroraWhat's New in Amazon Aurora
What's New in Amazon Aurora
 
Scaling up to your first 10 million users - Pop-up Loft Tel Aviv
Scaling up to your first 10 million users - Pop-up Loft Tel AvivScaling up to your first 10 million users - Pop-up Loft Tel Aviv
Scaling up to your first 10 million users - Pop-up Loft Tel Aviv
 
NEW LAUNCH! Introducing PostgreSQL compatibility for Amazon Aurora
NEW LAUNCH! Introducing PostgreSQL compatibility for Amazon AuroraNEW LAUNCH! Introducing PostgreSQL compatibility for Amazon Aurora
NEW LAUNCH! Introducing PostgreSQL compatibility for Amazon Aurora
 
Running Relational Databases on AWS
Running Relational Databases on AWS  Running Relational Databases on AWS
Running Relational Databases on AWS
 
Announcing Amazon Aurora with PostgreSQL Compatibility - January 2017 AWS Onl...
Announcing Amazon Aurora with PostgreSQL Compatibility - January 2017 AWS Onl...Announcing Amazon Aurora with PostgreSQL Compatibility - January 2017 AWS Onl...
Announcing Amazon Aurora with PostgreSQL Compatibility - January 2017 AWS Onl...
 
Amazon Aurora: Under the Hood
Amazon Aurora: Under the HoodAmazon Aurora: Under the Hood
Amazon Aurora: Under the Hood
 
Store stream data on Data Lake
Store stream data on Data LakeStore stream data on Data Lake
Store stream data on Data Lake
 
EC2 and S3 Level 100
EC2 and S3 Level 100EC2 and S3 Level 100
EC2 and S3 Level 100
 
Enterprise Grade SQL Server Deployments in AWS
Enterprise Grade SQL Server Deployments in AWSEnterprise Grade SQL Server Deployments in AWS
Enterprise Grade SQL Server Deployments in AWS
 
The Enterprise Grade SQL Server Deployments in AWS
The Enterprise Grade SQL Server Deployments in AWSThe Enterprise Grade SQL Server Deployments in AWS
The Enterprise Grade SQL Server Deployments in AWS
 
Amazon Aurora: The New Relational Database Engine from Amazon
Amazon Aurora: The New Relational Database Engine from AmazonAmazon Aurora: The New Relational Database Engine from Amazon
Amazon Aurora: The New Relational Database Engine from Amazon
 
getting started with amazon aurora
getting started with amazon auroragetting started with amazon aurora
getting started with amazon aurora
 
Deep Dive: Amazon Elastic MapReduce
Deep Dive: Amazon Elastic MapReduceDeep Dive: Amazon Elastic MapReduce
Deep Dive: Amazon Elastic MapReduce
 

AWS Brown Bag

  • 1. AWS Brown bag session 11 Nov 2016 1UK Sales Conference Image by Leah Juarez Pathum Fernando
  • 2. What is AWS stands for ?
  • 3. Agenda DynamoDB Simple Queue Service ( SQS ) Simple Storage Service ( s3 )
  • 5. What is DynamoDB ? ● Amazon DynamoDB is a fast and flexible NoSql service for all Application. ● Single digit millisecond latency ● It is fully managed by AWS ● Supported Key-Value data model
  • 6. Quick facts about DynamoDB ● Stored on SSD Storage ● Spread across 3 geographical distints datacenter ● Eventually consistent read ● Strongly consistent read Read More… 1. Why is Amazon DynamoDB built on Solid State Drives? 2. What does read consistency mean? Why should I care? 3. What is the consistency model of Amazon DynamoDB?
  • 7. The Basics ● Table ● Items ( Think a raw of data in a table ) ● Attributes ( Think of column of data in a table ) Items Attributes Table
  • 9. Indexing and Keys ● Two type of primary keys Available Single Attribute ( think unique ID ) -Partition Key Composite ( Think unique ID and a date range ) - Partition Key and sort Key composed of two attributes ● Local indexing ● Global Indexing
  • 10. Provisioned throughput 1. Unit of Read Provisioned throughput A. All reads are round up to increments of 4KB B. Eventually consistent Reads ( default ) consist of 2 reads per second C. Strongly consistent reads consist of 1 read per second. 1. Unit of write provisioned throughput A. All writes are 1KB B. All writes consist of 1 write per second.
  • 11. Provisioned throughput ( Magic formula ) You have an application that needs to read 25 items of 13kb in size per second. Your application uses strongly consistent reads. What should you set the read throughput to? Read Throughput Write Throughput Read Throughput (Size of Read rounded up to nearest 4KB chunk / 4KB ) no of items= X Write Throughput ( Size of Write rounded up to nearest 1KB chunk / 1KB ) no of items= X
  • 13. What is SQS ? ● Amazon SQS is a web service that gives you access to a message queue ● Amazon SQS is distributed queue system ● This is the very first service that the AWS launched ● Using SQS, you can decouple the components of an application ● Amazon SQS ensures delivery of each message at least once, and support multiple readers and writers. ● SQS does not guarantee first in, first out delivery of messages.
  • 14. SQS illustrate To illustrate, suppose you have a number of image files to encode. In an Amazon SQS worker queue, you create an Amazon SQS message for each file specifying the command (jpeg-encode) and the location of the file in Amazon S3. A pool of Amazon EC2 instances running the needed image processing software does the encoding
  • 20. What is S3 ? ● S3 is a safe place to store your files ● It is object based storage. Allows you to upload files ● The data is spread across multiple devices and facilities ● File can be from 1 byte to 5TB ● S3 is unlimited storage ● Files are stored in Buckets ● Bucket name should be unique globally ● Key-Value store ● Amazon guarantees 99.99% availability for the s3 platform and 99.999999999% durability for s3 information ● Use as a static hosting method
  • 21. S3 consistency models ● Read after write consistency for PUTS of new objects ● Eventual consistency for overwrite PUTS and DELETES ( can take some time to propagate )
  • 22. S3 Storage Tiers/Classes ● S3 - 99.99% availability and 99.999999999% durability , redundantly across multiple devices in multiple facilities ● S3 - IA ( Infrequently Accessed ) For data that is accessed less frequently, but requires rapid access when needed, Lower free than S3 ● Reduced Redundancy Storage - Designed to provide 99.99% durability and 99.99% availability. ● Glacier - Very cheap, but used for archival only, It takes 3-5 hours to restore from Glacier
  • 24. S3 Version Control ● Stores all version of an object ● Great backup tool ● Integrates with Lifecycle rules ● Versioning has MFA Delete capability
  • 25. S3 Lifecycle Management You manage an object's lifecycle by using a lifecycle configuration, which defines how Amazon S3 manages objects during their lifetime. Lifecycle configuration enables you to simplify the lifecycle management of your objects, such as automated transition of less-frequently accessed objects to low-cost storage alternatives and scheduled deletions. You can configure as many as 1000 lifecycle rules per bucket.
  • 26. Are you looking for a AWS Certification ?
  • 27. Are you looking for a AWS Certification ?