The goal of this course is to give you and in depth knowledge of Amazon S3 and hands on practice using it so you can use it in your own projects or organization. This course covers the basics as well as the more advanced parts that sometimes get left out such as command line commands and detailed security policy examples.
For full video course please visit:
https://www.udemy.com/aws-foundations-amazon-s3-mastery-bootcamp/?couponCode=SLIDESHARE
1. AWS Foundations: Amazon S3 Mastery Bootcamp
Instuctor
Matt Bohn
AWS Certified Solutions Architect
For complete video course with hands on exercises please visit:
https://www.udemy.com/aws-foundations-amazon-s3-mastery-bootcamp/?couponCode=SLIDESHARE
2. • Solution architects
• Software Engineers and Developers
• System Administrators
• IT Professionals
• Anyone who wants an in depth knowledge of S3 and hands
on practice using it
Who is this course for?
3. • AWS Skills are highly desired by employers
• Cloud IaaS is valued at $52 billion in 2019, and expected to
reach $83 billion by 2021 according to Gartner1.
• Amazon S3 is one of Amazon’s core cloud services
• Take advantage of low/cost, highly available cloud storage
Why learn about Amazon S3?
1. Source: Gartner (https://www.gartner.com/en/newsroom/press-releases/2018-04-12-gartner-forecasts-worldwide-public-cloud-revenue-to-grow-21-percent-in-2018)
4. • An AWS account
• A web browser and Internet access
• Know how to navigate your operating system and file system
• AWS Command line tools
• Examples use Windows, but you can use Linux or Mac also
• Familiarity with a command prompt
What you need to complete this course
5. • Fundamental Concepts
• What S3 is and key terms
• How data is stored, secured, and billed
• Understand the shared responsibility model of AWS
• How to create, update, delete, and organize your data in S3
using the S3 web console
• How to manage your S3 data with the command line
interface
• How to control access to your data with security policies
What will you learn in this course?
6. • Protect your data
• Enable versioning on files/objects
• Use cross region replication for additional redundancy
• Encryption
• Enable life cycle management to control costs
• Turn on logging to track access to your data
• Use events to trigger notifications
• Host a highly available static website
You will also learn:
7. • High level concepts and terms that will be helpful before we
dive into the hands on portion
• Decision making information
• How to choose a pricing tier
• Compliance
• Tools available to get data in and out of S3
S3 Fundamental Concepts
8. • Amazon Simple Storage Service is cloud-based storage that
can store an unlimited amount of data and retrieve that data
anytime over the web.
• Highly scalable, reliable, fast, and cost-effective data storage
built on Amazon’s global infrastructure
What is Amazon S3?
9. W
Where is my data stored?
• Your data is stored in a
region.
• A region represents a
general geographic area.
• You choose a region for your
data.
• Currently 18 geographic
regions
10. W
• A region contains availability zones
• An AZ is an isolated facility
• Data is replicated across 3 availability
zones
• Amazon handles AZ replication
11. bucket1
image1.jpg
image2.jpg
image2.jpg
image1.jpg
image2.jpg
image2.jpg
bucket2
Region: us-east-1 Key concepts
• S3 is object based storage (think object = file)
• Objects are stored in buckets
• An object can be up to 5TB
• No limit on bucket size or total data in your
account
• Permissions can be set on buckets and individual
objects
• No hierarchy
• Files replicated across at least 3 availability zones
(one exception)
• S3 provides read-after-write consistency for PUTS
of new objects
• Eventual consistency for overwrites and deletes
Objects
12. You can represent folders logically by including a prefix in the
object name. For example:
/my-bucket/my-folder/my-object.txt
my-folder/my-object.txt is the full object name
No hierarchy, BUT….
13. • Key – this is the name of the object (like a filename) and is used to retrieve the object
• Value – Any sequence of bytes you want to store
• Version ID
• A string generated by Amazon when you add an object to a bucket.
• Together the key and version ID uniquely identify an object within a bucket.
• Metadata
• Name-value pairs to store information about the object
• System-meta data – creation data, size, storage class, etc
• User metadata – is custom meta data you add to an object
• Sub resources - additional info such as acl (owner) or torrent file
What makes up an object?
15. • Customer and Amazon share responsibility for different parts
of security
• Customer is responsible for “security in the cloud”
• Setting appropriate access controls for your objects and buckets
• Control who accesses the AWS Web console, or APIs
• Amazon is responsible for “security of the cloud”
• Physical security of data centers and global infrastructure
What is the Shared Responsibility Model?
16. • AWS infrastructure and services meet numerous compliance
standards and regulations (PCI compliance, and others)
• S3 supports SSL for encryption in transit, and optionally you
can enable encryption at rest
• Your data does not leave the region you specify
• See the following for detailed info on AWS security and
compliance:
• https://aws.amazon.com/compliance/programs/
• https://aws.amazon.com/security/
How secure is my data?
17. Storage classes provide a way to select the most cost effective
storage for your data based on how frequently it is accessed
and how quickly you need to retrieve it.
Storage Classes
18. • Standard Storage
• best when you need quick access, frequently
• Standard Infrequent Access (IA)
• Use when you need data returned quickly, but not frequently accessed
• Min 128K object size and min storage timeframe of 30 days
• One Zone Infrequent Access (IA)
• Use when you have another copy or data can be re-created
• Cheaper but data is only replicated in one Availability Zone
• Glacier
• Used for long term archive and backup
• Min timeframe 90 days, can take minutes to hours to retrieve
Storage Classes
19. Durability and availability
For more information see: https://aws.amazon.com/s3/pricing/
For more information see: https://aws.amazon.com/s3/sla/
Standard Standard – IA One Zone - IA Amazon Glacier
Designed for durability 99.999999999% 99.999999999% 99.999999999% 99.999999999%
Designed for Availability 99.99% 99.9% 99.5% N/A
Most expensive per GB stored Least expensive per GB stored
Least expensive per request More expensive per request
20. • Data transfer IN to S3 is free
• Data transfer OUT costs
• Pay for requests (per 1000)
• Pay for amount of data stored
• Per GB Pricing generally goes down the more data you store
• Pricing differs across regions
Pricing
21. How to get data into and out of S3?
Web console Command line
23. AWS Import/Export
• Request a job in the AWS Console and
ship your hard drive to Amazon
• They import your data and ship your drive
back
• Up to 16 Tb per job
24. AWS Snowball – Lots of Data
• 50Tb and 80Tb Models
• Amazon Ships to you, you copy your data
• Data is encrypted on the device
• You ship back and Amazon imports your data
• Weighs 47 pounds
• Size 19.75x12.66x21.5
• ~$200-$300 per job
Image source: https://docs.aws.amazon.com/snowball/latest/ug/using-appliance.html
25. AWS Snow Mobile
• Exabyte scale transfer service / 100 Petabytes
per snowmobile
• Dedicated security personal
• Video surveillance
• GPS Tracking
Image source: https://aws.amazon.com/snowmobile
26. • Navigate the S3 dashboard
• Create buckets in a selected region
• Upload files into buckets
• Overwrite files
• Move files between buckets
• Delete buckets
• Download individual objects
Managing Data with the AWS Web Console
27. • What are object tags?
• A key-value pair
• Tags are used for categorizing storage
• Use Cases
• Use tags to allow a user/group to read/write objects with a tag
• Create lifecycle rules to move objects based on a tag to cheaper
storage tiers
• Use as filters for Analytics and Metrics
• Track costs based on tag
• For example by project, client, department, etc
Object Tags
28. • Max 10 tags on an object
• Max 50 tags on a bucket
• Keys must be unique
• Tag key can contain 128 Unicode characters
• Tag value can contain 256 Unicode characters
• Key and Values are case sensitive
• Texas <> texas
Tag Restrictions
29. • Object Metadata is descriptive data describing an object
• Consists of name-value pairs
• Returned as HTTP headers on objects
• Two types of metadata
• System metadata
• User-defined metadata
Object Metadata
30. • Metadata maintained by Amazon S3
• Two types of System Metadata
• Metadata where only Amazon S3 can modify the value
• Example: Object creation date
• Metadata that you can modify
• Example: Storage class, versioning, and encryption attributes
System Metadata
31. • Custom name-value pairs you can add to your object
• Name must begin with “x-amz-meta”
• Names are case insensitive
User Metadata
32. • Both are name value pairs
• Tag keys are case sensitive
• Metadata names are case insensitive
• Tags are used for categorizing storage to analyze cost or
along with permissions for fine grained access control
• Metadata properties are returned as HTTP headers
• Certain Metadata pairs control how data is stored
• Storage class, enabling encryption.
Metadata vs. Tags
33. For complete course with hands on exercises please visit:
https://www.udemy.com/aws-foundations-amazon-s3-
mastery-bootcamp/?couponCode=SLIDESHARE
AWS Amazon S3 Mastery Bootcamp