AWS Summit 2013 | Auckland - Understanding AWS Storage Options


Published on

AWS provides multiple storage options to meet your varying needs. This presentation provides an overview of how AWS Cloud storage services can be used to support application development and delivery, backup, archive, disaster recovery, and virtualized compute.

Published in: Technology, Business
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

AWS Summit 2013 | Auckland - Understanding AWS Storage Options

  1. 1. Jeff PuttUnderstanding AWS Storage OptionsBusiness Development Manager, APAC, AWS
  2. 2. AWS Storage OptionsObject Storage Block StorageConnect AWS Storage with On-Premises EnvironmentsFor NoSQL and Relational Database storage, catch the dedicated sessions+ +
  3. 3. We are sincerely eager to hearyour feedback on thispresentation and on re:Invent.Please fill out an evaluation formwhen you have a chance.We are constantly producing more data
  4. 4. We are sincerely eager to hearyour feedback on thispresentation and on re:Invent.Please fill out an evaluation formwhen you have a chance.From all types of industries
  5. 5. #1Object Storage●○○
  6. 6. Amazon S3Simple Storage Service
  7. 7. 99.999999999%Durability
  8. 8. Over 1 TrillionUnique Customer Objects
  9. 9. 750,000+Peak Transactions Per Second
  10. 10. 1. High Durability2. Unlimited Capacity3. Low latency4. High Volume Static Websites5. Security & Compliance6. Delivery via CDNS3 gives you So you can buildMobile AppsMusic AppsVideo networksVideo AppsBackup AppsPhoto AppsStatic WebsitesAd networksAnything else you’d like!
  11. 11. Amazon GlacierLow-Cost Archiving Service
  12. 12. 1¢Per GB / Month
  13. 13. $120Per TB / Year
  14. 14. 99.999999999%Durability
  15. 15. 3−5 HoursData Retrieval
  16. 16. Storage Costsvs.Retrieval Costs
  17. 17. 1. High Durability2. Low cost3. 3-5 hour latencyGlacier gives you So you can• Archive files• Build Hierarchal StorageManagement in the cloud
  18. 18. Amazon S3 and Glacier can help you build…GamingCommerceDigital MediaDistributionWebsites Social MediaPhoto/VideoSharing andBackupBig Data
  19. 19. Store unlimited objects in Amazon S3 and Amazon GlacierS3 Glacier
  20. 20. Access both via SDKs and via third-party softwareS3 GlacierInternet WebServices APIHTTP(S)Via SDK Via 3rd parties
  21. 21. Or send S3 files directly to GlacierS3 Glacier
  22. 22. S3 storage costs as low as 4.7 cents per GB
  23. 23. Serve static content at high volumes
  24. 24. Deliver content with lower latency via Amazon CloudFront
  25. 25. Smugmug is home to millions of customers sharingBillions of photos
  26. 26. Adds over 20,000 tracks of music a day
  27. 27. Nasdaq FinQloud is a WORM compliant archive forBroker Dealer financial data
  28. 28. Shazam hit 500,000 writes per secondduring the Super Bowl
  29. 29. nearmap Aerial Imagerynearmap routinely captures hi-res aerial imagescovering 75% of Australia’s populationnearmap provides browser-based access to up-to-date and historical aerial imagery to thousands ofcompanies, large and small30
  30. 30. Clear31
  31. 31. CurrentImages are delivered within7-14 days, rather than 3-6months after flying6moTraditionalnearmapProcessing Time3mo 9mo 1yrBrisbane floods – nearmap was the only company to capture theflooded areas and publish within days32
  32. 32. Bundaberg Flood33
  33. 33. 34Bundaberg Flood
  34. 34. 35Bundaberg Flood : Before
  35. 35. 36Bundaberg Flood : After
  36. 36. 37Bundaberg Flood : Before
  37. 37. 38Bundaberg Flood : After
  38. 38. 39Bundaberg Flood : Before
  39. 39. 40Bundaberg Flood : After
  40. 40. nearmap ToolsThe photomap iscorrectly scaled foraccuratemeasurementsObjects are shown intheir correct real-world position45
  41. 41. Why Use nearmap• Less time driving• Less time on site• Reduce fleet costs and environmental impact• Eliminates existing spend on imagery• Integrates with enterprise systems46
  42. 42. nearmap and AWSQ. What does nearmap use AWS for?A. Everything• Production• Development and QA• Corporate systems• Image archival47
  43. 43. AWS Features UsedEC2 - both Reserved and Spot InstancesS3GlacierRDSRoute53CloudFormationCloudWatchIAMSESDirect Connect4 June, 2013
  44. 44. Image Data Storage6 Terabytes of new image data per monthWe have 4+ years of existing image dataS3: 150 Terabytes and countingGlacier: 300 Terabytes and counting4 June, 2013
  45. 45. 50
  46. 46. #2Block Storage●●○
  47. 47. Amazon EBSElastic Block Storage
  48. 48. Ephemeral storage is on every EC2 instance
  49. 49. EBS volumes attach to EC2 instances
  50. 50. EBS volumes persist and can be attached to other instances
  51. 51. Multiple drives on one Amazon EC2 Instance
  52. 52. 10GB1TB
  53. 53. IOPSProvisioned
  54. 54. Workloads on EBS Provisioned IOPSP-IOPS is designed to run transactional applications that require high andconsistent IO such as:• Relational databases• NoSQL databases (e.g. MongoDB)• High performance file systems• Productivity applications (e.g. Microsoft Exchange)• Enterprise applications (e.g. CRM, ERP)
  55. 55. EBSSnapshots
  56. 56. Take snapshots of EBS volumes and keep them in S3
  57. 57. Use Amazon EBS When You Need• Filesystem for an instance NTFS, ExtFS, RAID, LVM• Long-term persistent storage• Ability to change data frequently• Access to raw, unformatted block-level storage
  58. 58. #3Connect AWS Storage with On-PremisesEnvironments●●●
  59. 59. Access both via SDKs and via third-party softwareS3 GlacierInternet WebServices APIHTTP(S)Via SDK Via 3rd parties
  60. 60. Common Data Storage Challenges and the AWS OpportunityInternet WebServices APIHTTP(S)AWS DirectConnectBlock FileCustomerDataCenterStorageUse CasesArchive BackupDisasterRecoveryNextGenerationEnterpriseStorageS3 Glacier
  61. 61. Common Data Storage Challenges and the AWS OpportunityPrimaryBlockStoragePrimaryFileStorageArchivalStorageDisk-BasedBackupStorageTapeInfrastructure&ManagementReplicatedStorage forDisasterRecoveryOffsiteLocationsGeo-ResilienceNext Generation: Gateway & Cloud StorageReduceSANFootprintReduceNASFootprintEliminateArchitectureHardware& SoftwareEliminateBackupHardware& SoftwareEliminateTapeRecover inCloud orany DataCenterEliminateSecondaryDataCentersReduce Complexity. Reduce Cost.NextGenerationEnterpriseStorage-Benefits
  62. 62. Common Data Storage Challenges and the AWS OpportunityS3 & Glacier - Designed to work with other AWS Services
  63. 63. Storage Gateway – Connect On-Prem with the AWS Cloud1. Local, low-latency access to themost frequently used files whilestoring all data in Amazon S3(Cached-Volumes)Or2. Scheduled off-site backups toAmazon S3 for on-premises data(Stored-Volumes)
  64. 64. Use AWS Storage Gateway When You Need To• Backup your data• Synchronize data• Export data for migration• Set up a departmental fileshare• Conduct simple disaster recovery
  65. 65. AWS Storage OptionsObject Storage Block StorageConnect AWS Storage with On-Premises Environments+ +
  66. 66. Performance-OrientedCost-OrientedIT’S ALL ABOUTCHOICE
  67. 67. Related ContentWeb resources:••••
  68. 68. Thank You.
  69. 69. Shares customer submitted photos
  70. 70. Foursquare streams hundreds of millions of application logsinto Amazon S3 for analytics
  71. 71. Forced to choose between saving their source data or savingtheir results. With Amazon Glacier, they can keep both
  72. 72. Real Clear Politics served up 20x normal demand withS3 Websites