Introduction to AWS

Storage Options
Szilveszter Molnar

@moszinet
Development vs Operations
Recap
Recap
• Infrastructure as a Service -
IAAS
• No reason to do it by yourself
• Elastic Computing
• Regions an Availability Zones
• Elastic Compute Cloud - EC2
AWS Services Overview
Compute
• EC2 (On-Demand, Reserved, Spot)
• Autoscaling
• ELB
• AWS Lambda
• Container Service
• VM Import/Export
Storage & Content Delivery
• Amazon S3
• Glacier
• Elastic Block Store - EBS
• Elastic File System
• CloudFront
• Import/Export Snowball
Storage & Content Delivery
• Amazon S3
• Glacier
• Elastic Block Store - EBS
• Elastic File System
• CloudFront
• Import/Export Snowball
Database
• Relational Database Service - RDS
• MySQL, MS SQL, Oracle, Postgres, etc ...
• Aurora
• AWS Database Migration Service
• DynamoDB
• Redshift
• ElastiCache
Networking
• Amazon VPC
• AWS Direct Connect
• Amazon Route53
Developer Tools
• AWS CodeCommit
• AWS CodeDeploy
• AWS CodePipeline
...
• Management Tools
• Security & Identity
• Analytics
• Internet of Things
• Mobile Services
• Application Services
• Enterprise Applications
Storage Options
Storage Options
• EBS
• Instance Store Volumes
• S3
• Glacier
EBS
Elastic Block Storage
• Block level storage
• Use with EC2 instances
• Types
• Standard - ~100 IOPS, "best effort"
• Provisioned - max 2000 IOPS / volume
• stripe volumes for more (RAID 0)
Elastic Block Storage
• Highly available and reliable
• Replicated across multiple servers in an AZ
• Snapshots
• Incremental
• Stored in S3
• Annual Durability w/ less then 20 GB modified data
99.5%-99.9%
Elastic Block Storage
• Ideal Usage Patterns
• relatively frequent data changes
• databases with consistent read & writes
• raw block-level storage
Elastic Block Storage
• Anti-Patterns
• Temporary storage (use local instance
volumes, SQS or ElastiCache)
• Highly-durable storage (use S3, Glacier)
• Static data (use S3)
Instance Store Volumes
• Temporary
• SSD
• up to 120,000 IOPS
• attached to the physical server
• NOT Durable: lost if the instance is stopped/fails
S3
Simple Storage Service
• Simple key-value storage
• 1 Byte - 5 TB object size
• Buckets
• Highly scalable, reliable and low-latency
• Durability: 99.999999999 %
• Availability: 99.99 %
Simple Storage Service
• Versioning
• Lifetime control
• Multi-Factor Auth Delete
• Reduced Redundancy - 99.99% durability
• 400x more durable than 1 typical HDD
Simple Storage Service
• Ideal Usage Patterns
• Static web content and media
• Static website hosting
• Archival of critical data
Simple Storage Service
• Anti-Patterns
• File System
• Structured data with query
• Rapidly changing data
• Backup and archival storage
Glacier
Glacier
• 0.01$ / GB
• Store "archives"
• Retrieve archives by initiating a retrieval job
• Archives organised in vaults
• Durability 99.999999999 %
• Retrieve jobs complete in 3-5 hours
Glacier
• Ideal Usage Patterns
• Offsite archival
• Magnetic tape replacement
• Anti-patterns
• Rapidly changing data
• Real time access
Recap
Recap
• EBS
• "Hard disk"
• S3
• Buckets, highly durable 11 9's, fast access
• Glacier
• Archives, highly durable 11 9's, slow access
• AWS Overview White Paper
• AWS Storage Options Whitepaper
• qwiklab.com (free until end of March)
Thank you!
@moszinet

Introduction 2 to aws and storage options

  • 1.
    Introduction to AWS
 StorageOptions Szilveszter Molnar
 @moszinet
  • 2.
  • 3.
  • 4.
    Recap • Infrastructure asa Service - IAAS • No reason to do it by yourself • Elastic Computing • Regions an Availability Zones • Elastic Compute Cloud - EC2
  • 5.
  • 6.
    Compute • EC2 (On-Demand,Reserved, Spot) • Autoscaling • ELB • AWS Lambda • Container Service • VM Import/Export
  • 7.
    Storage & ContentDelivery • Amazon S3 • Glacier • Elastic Block Store - EBS • Elastic File System • CloudFront • Import/Export Snowball
  • 8.
    Storage & ContentDelivery • Amazon S3 • Glacier • Elastic Block Store - EBS • Elastic File System • CloudFront • Import/Export Snowball
  • 9.
    Database • Relational DatabaseService - RDS • MySQL, MS SQL, Oracle, Postgres, etc ... • Aurora • AWS Database Migration Service • DynamoDB • Redshift • ElastiCache
  • 10.
    Networking • Amazon VPC •AWS Direct Connect • Amazon Route53
  • 11.
    Developer Tools • AWSCodeCommit • AWS CodeDeploy • AWS CodePipeline
  • 12.
    ... • Management Tools •Security & Identity • Analytics • Internet of Things • Mobile Services • Application Services • Enterprise Applications
  • 14.
  • 15.
    Storage Options • EBS •Instance Store Volumes • S3 • Glacier
  • 16.
  • 17.
    Elastic Block Storage •Block level storage • Use with EC2 instances • Types • Standard - ~100 IOPS, "best effort" • Provisioned - max 2000 IOPS / volume • stripe volumes for more (RAID 0)
  • 18.
    Elastic Block Storage •Highly available and reliable • Replicated across multiple servers in an AZ • Snapshots • Incremental • Stored in S3 • Annual Durability w/ less then 20 GB modified data 99.5%-99.9%
  • 19.
    Elastic Block Storage •Ideal Usage Patterns • relatively frequent data changes • databases with consistent read & writes • raw block-level storage
  • 20.
    Elastic Block Storage •Anti-Patterns • Temporary storage (use local instance volumes, SQS or ElastiCache) • Highly-durable storage (use S3, Glacier) • Static data (use S3)
  • 21.
    Instance Store Volumes •Temporary • SSD • up to 120,000 IOPS • attached to the physical server • NOT Durable: lost if the instance is stopped/fails
  • 22.
  • 23.
    Simple Storage Service •Simple key-value storage • 1 Byte - 5 TB object size • Buckets • Highly scalable, reliable and low-latency • Durability: 99.999999999 % • Availability: 99.99 %
  • 24.
    Simple Storage Service •Versioning • Lifetime control • Multi-Factor Auth Delete • Reduced Redundancy - 99.99% durability • 400x more durable than 1 typical HDD
  • 25.
    Simple Storage Service •Ideal Usage Patterns • Static web content and media • Static website hosting • Archival of critical data
  • 26.
    Simple Storage Service •Anti-Patterns • File System • Structured data with query • Rapidly changing data • Backup and archival storage
  • 27.
  • 28.
    Glacier • 0.01$ /GB • Store "archives" • Retrieve archives by initiating a retrieval job • Archives organised in vaults • Durability 99.999999999 % • Retrieve jobs complete in 3-5 hours
  • 29.
    Glacier • Ideal UsagePatterns • Offsite archival • Magnetic tape replacement • Anti-patterns • Rapidly changing data • Real time access
  • 30.
  • 31.
    Recap • EBS • "Harddisk" • S3 • Buckets, highly durable 11 9's, fast access • Glacier • Archives, highly durable 11 9's, slow access
  • 32.
    • AWS OverviewWhite Paper • AWS Storage Options Whitepaper • qwiklab.com (free until end of March)
  • 33.