SlideShare a Scribd company logo
1 of 33
AWS Foundations: Amazon S3 Mastery Bootcamp
Instuctor
Matt Bohn
AWS Certified Solutions Architect
For complete video course with hands on exercises please visit:
https://www.udemy.com/aws-foundations-amazon-s3-mastery-bootcamp/?couponCode=SLIDESHARE
• Solution architects
• Software Engineers and Developers
• System Administrators
• IT Professionals
• Anyone who wants an in depth knowledge of S3 and hands
on practice using it
Who is this course for?
• AWS Skills are highly desired by employers
• Cloud IaaS is valued at $52 billion in 2019, and expected to
reach $83 billion by 2021 according to Gartner1.
• Amazon S3 is one of Amazon’s core cloud services
• Take advantage of low/cost, highly available cloud storage
Why learn about Amazon S3?
1. Source: Gartner (https://www.gartner.com/en/newsroom/press-releases/2018-04-12-gartner-forecasts-worldwide-public-cloud-revenue-to-grow-21-percent-in-2018)
• An AWS account
• A web browser and Internet access
• Know how to navigate your operating system and file system
• AWS Command line tools
• Examples use Windows, but you can use Linux or Mac also
• Familiarity with a command prompt
What you need to complete this course
• Fundamental Concepts
• What S3 is and key terms
• How data is stored, secured, and billed
• Understand the shared responsibility model of AWS
• How to create, update, delete, and organize your data in S3
using the S3 web console
• How to manage your S3 data with the command line
interface
• How to control access to your data with security policies
What will you learn in this course?
• Protect your data
• Enable versioning on files/objects
• Use cross region replication for additional redundancy
• Encryption
• Enable life cycle management to control costs
• Turn on logging to track access to your data
• Use events to trigger notifications
• Host a highly available static website
You will also learn:
• High level concepts and terms that will be helpful before we
dive into the hands on portion
• Decision making information
• How to choose a pricing tier
• Compliance
• Tools available to get data in and out of S3
S3 Fundamental Concepts
• Amazon Simple Storage Service is cloud-based storage that
can store an unlimited amount of data and retrieve that data
anytime over the web.
• Highly scalable, reliable, fast, and cost-effective data storage
built on Amazon’s global infrastructure
What is Amazon S3?
W
Where is my data stored?
• Your data is stored in a
region.
• A region represents a
general geographic area.
• You choose a region for your
data.
• Currently 18 geographic
regions
W
• A region contains availability zones
• An AZ is an isolated facility
• Data is replicated across 3 availability
zones
• Amazon handles AZ replication
bucket1
image1.jpg
image2.jpg
image2.jpg
image1.jpg
image2.jpg
image2.jpg
bucket2
Region: us-east-1 Key concepts
• S3 is object based storage (think object = file)
• Objects are stored in buckets
• An object can be up to 5TB
• No limit on bucket size or total data in your
account
• Permissions can be set on buckets and individual
objects
• No hierarchy
• Files replicated across at least 3 availability zones
(one exception)
• S3 provides read-after-write consistency for PUTS
of new objects
• Eventual consistency for overwrites and deletes
Objects
You can represent folders logically by including a prefix in the
object name. For example:
/my-bucket/my-folder/my-object.txt
my-folder/my-object.txt is the full object name
No hierarchy, BUT….
• Key – this is the name of the object (like a filename) and is used to retrieve the object
• Value – Any sequence of bytes you want to store
• Version ID
• A string generated by Amazon when you add an object to a bucket.
• Together the key and version ID uniquely identify an object within a bucket.
• Metadata
• Name-value pairs to store information about the object
• System-meta data – creation data, size, storage class, etc
• User metadata – is custom meta data you add to an object
• Sub resources - additional info such as acl (owner) or torrent file
What makes up an object?
• Metadata
• https://docs.aws.amazon.com/AmazonS3/latest/dev/UsingMetadata.html
• Objects
• https://docs.aws.amazon.com/AmazonS3/latest/dev/UsingObjects.html
For More Information
• Customer and Amazon share responsibility for different parts
of security
• Customer is responsible for “security in the cloud”
• Setting appropriate access controls for your objects and buckets
• Control who accesses the AWS Web console, or APIs
• Amazon is responsible for “security of the cloud”
• Physical security of data centers and global infrastructure
What is the Shared Responsibility Model?
• AWS infrastructure and services meet numerous compliance
standards and regulations (PCI compliance, and others)
• S3 supports SSL for encryption in transit, and optionally you
can enable encryption at rest
• Your data does not leave the region you specify
• See the following for detailed info on AWS security and
compliance:
• https://aws.amazon.com/compliance/programs/
• https://aws.amazon.com/security/
How secure is my data?
Storage classes provide a way to select the most cost effective
storage for your data based on how frequently it is accessed
and how quickly you need to retrieve it.
Storage Classes
• Standard Storage
• best when you need quick access, frequently
• Standard Infrequent Access (IA)
• Use when you need data returned quickly, but not frequently accessed
• Min 128K object size and min storage timeframe of 30 days
• One Zone Infrequent Access (IA)
• Use when you have another copy or data can be re-created
• Cheaper but data is only replicated in one Availability Zone
• Glacier
• Used for long term archive and backup
• Min timeframe 90 days, can take minutes to hours to retrieve
Storage Classes
Durability and availability
For more information see: https://aws.amazon.com/s3/pricing/
For more information see: https://aws.amazon.com/s3/sla/
Standard Standard – IA One Zone - IA Amazon Glacier
Designed for durability 99.999999999% 99.999999999% 99.999999999% 99.999999999%
Designed for Availability 99.99% 99.9% 99.5% N/A
Most expensive per GB stored Least expensive per GB stored
Least expensive per request More expensive per request
• Data transfer IN to S3 is free
• Data transfer OUT costs
• Pay for requests (per 1000)
• Pay for amount of data stored
• Per GB Pricing generally goes down the more data you store
• Pricing differs across regions
Pricing
How to get data into and out of S3?
Web console Command line
SDKs for most popular languages
Ruby C++
AWS Import/Export
• Request a job in the AWS Console and
ship your hard drive to Amazon
• They import your data and ship your drive
back
• Up to 16 Tb per job
AWS Snowball – Lots of Data
• 50Tb and 80Tb Models
• Amazon Ships to you, you copy your data
• Data is encrypted on the device
• You ship back and Amazon imports your data
• Weighs 47 pounds
• Size 19.75x12.66x21.5
• ~$200-$300 per job
Image source: https://docs.aws.amazon.com/snowball/latest/ug/using-appliance.html
AWS Snow Mobile
• Exabyte scale transfer service / 100 Petabytes
per snowmobile
• Dedicated security personal
• Video surveillance
• GPS Tracking
Image source: https://aws.amazon.com/snowmobile
• Navigate the S3 dashboard
• Create buckets in a selected region
• Upload files into buckets
• Overwrite files
• Move files between buckets
• Delete buckets
• Download individual objects
Managing Data with the AWS Web Console
• What are object tags?
• A key-value pair
• Tags are used for categorizing storage
• Use Cases
• Use tags to allow a user/group to read/write objects with a tag
• Create lifecycle rules to move objects based on a tag to cheaper
storage tiers
• Use as filters for Analytics and Metrics
• Track costs based on tag
• For example by project, client, department, etc
Object Tags
• Max 10 tags on an object
• Max 50 tags on a bucket
• Keys must be unique
• Tag key can contain 128 Unicode characters
• Tag value can contain 256 Unicode characters
• Key and Values are case sensitive
• Texas <> texas
Tag Restrictions
• Object Metadata is descriptive data describing an object
• Consists of name-value pairs
• Returned as HTTP headers on objects
• Two types of metadata
• System metadata
• User-defined metadata
Object Metadata
• Metadata maintained by Amazon S3
• Two types of System Metadata
• Metadata where only Amazon S3 can modify the value
• Example: Object creation date
• Metadata that you can modify
• Example: Storage class, versioning, and encryption attributes
System Metadata
• Custom name-value pairs you can add to your object
• Name must begin with “x-amz-meta”
• Names are case insensitive
User Metadata
• Both are name value pairs
• Tag keys are case sensitive
• Metadata names are case insensitive
• Tags are used for categorizing storage to analyze cost or
along with permissions for fine grained access control
• Metadata properties are returned as HTTP headers
• Certain Metadata pairs control how data is stored
• Storage class, enabling encryption.
Metadata vs. Tags
For complete course with hands on exercises please visit:
https://www.udemy.com/aws-foundations-amazon-s3-
mastery-bootcamp/?couponCode=SLIDESHARE
AWS Amazon S3 Mastery Bootcamp

More Related Content

What's hot

AWS Storage - S3 Fundamentals
AWS Storage - S3 FundamentalsAWS Storage - S3 Fundamentals
AWS Storage - S3 FundamentalsPiyush Agrawal
 
Amazon S3 & Amazon Glacier - Object Storage Overview
Amazon S3 & Amazon Glacier - Object Storage OverviewAmazon S3 & Amazon Glacier - Object Storage Overview
Amazon S3 & Amazon Glacier - Object Storage OverviewAmazon Web Services
 
ABCs of AWS: S3
ABCs of AWS: S3ABCs of AWS: S3
ABCs of AWS: S3Mark Cohen
 
AWS 101 - An Introduction to the Amazon Cloud
AWS 101  - An Introduction to the Amazon CloudAWS 101  - An Introduction to the Amazon Cloud
AWS 101 - An Introduction to the Amazon CloudCloudHesive
 
Cloudwatch: Monitoring your Services with Metrics and Alarms
Cloudwatch: Monitoring your Services with Metrics and AlarmsCloudwatch: Monitoring your Services with Metrics and Alarms
Cloudwatch: Monitoring your Services with Metrics and AlarmsFelipe
 
How to backup, restore and archive your data on AWS
How to backup, restore and archive your data on AWSHow to backup, restore and archive your data on AWS
How to backup, restore and archive your data on AWSAmazon Web Services
 
Amazon RDS Proxy 집중 탐구 - 윤석찬 :: AWS Unboxing 온라인 세미나
Amazon RDS Proxy 집중 탐구 - 윤석찬 :: AWS Unboxing 온라인 세미나Amazon RDS Proxy 집중 탐구 - 윤석찬 :: AWS Unboxing 온라인 세미나
Amazon RDS Proxy 집중 탐구 - 윤석찬 :: AWS Unboxing 온라인 세미나Amazon Web Services Korea
 
Azure role based access control (rbac)
Azure role based access control (rbac)Azure role based access control (rbac)
Azure role based access control (rbac)Srikanth Kappagantula
 
Data Migration to AWS with DataSync & Transfer for SFTP
Data Migration to AWS with DataSync & Transfer for SFTPData Migration to AWS with DataSync & Transfer for SFTP
Data Migration to AWS with DataSync & Transfer for SFTPAmazon Web Services
 
Encryption and Key Management in AWS
Encryption and Key Management in AWSEncryption and Key Management in AWS
Encryption and Key Management in AWSAmazon Web Services
 
AWS S3 | Tutorial For Beginners | AWS S3 Bucket Tutorial | AWS Tutorial For B...
AWS S3 | Tutorial For Beginners | AWS S3 Bucket Tutorial | AWS Tutorial For B...AWS S3 | Tutorial For Beginners | AWS S3 Bucket Tutorial | AWS Tutorial For B...
AWS S3 | Tutorial For Beginners | AWS S3 Bucket Tutorial | AWS Tutorial For B...Simplilearn
 
AWS Multi-Account Architecture and Best Practices
AWS Multi-Account Architecture and Best PracticesAWS Multi-Account Architecture and Best Practices
AWS Multi-Account Architecture and Best PracticesAmazon Web Services
 
Realizing the Full Potential of Cloud-Native Application Security
Realizing the Full Potential of Cloud-Native Application SecurityRealizing the Full Potential of Cloud-Native Application Security
Realizing the Full Potential of Cloud-Native Application SecurityOry Segal
 
AWS Security Best Practices (March 2017)
AWS Security Best Practices (March 2017)AWS Security Best Practices (March 2017)
AWS Security Best Practices (March 2017)Julien SIMON
 

What's hot (20)

AWS Storage - S3 Fundamentals
AWS Storage - S3 FundamentalsAWS Storage - S3 Fundamentals
AWS Storage - S3 Fundamentals
 
CLOUD NATIVE SECURITY
CLOUD NATIVE SECURITYCLOUD NATIVE SECURITY
CLOUD NATIVE SECURITY
 
Security Best Practices
Security Best PracticesSecurity Best Practices
Security Best Practices
 
Azure Security Overview
Azure Security OverviewAzure Security Overview
Azure Security Overview
 
Amazon S3 & Amazon Glacier - Object Storage Overview
Amazon S3 & Amazon Glacier - Object Storage OverviewAmazon S3 & Amazon Glacier - Object Storage Overview
Amazon S3 & Amazon Glacier - Object Storage Overview
 
ABCs of AWS: S3
ABCs of AWS: S3ABCs of AWS: S3
ABCs of AWS: S3
 
AWS 101 - An Introduction to the Amazon Cloud
AWS 101  - An Introduction to the Amazon CloudAWS 101  - An Introduction to the Amazon Cloud
AWS 101 - An Introduction to the Amazon Cloud
 
Security Best Practices on AWS
Security Best Practices on AWSSecurity Best Practices on AWS
Security Best Practices on AWS
 
Cloudwatch: Monitoring your Services with Metrics and Alarms
Cloudwatch: Monitoring your Services with Metrics and AlarmsCloudwatch: Monitoring your Services with Metrics and Alarms
Cloudwatch: Monitoring your Services with Metrics and Alarms
 
AWS Cloud Watch
AWS Cloud WatchAWS Cloud Watch
AWS Cloud Watch
 
How to backup, restore and archive your data on AWS
How to backup, restore and archive your data on AWSHow to backup, restore and archive your data on AWS
How to backup, restore and archive your data on AWS
 
Amazon RDS Proxy 집중 탐구 - 윤석찬 :: AWS Unboxing 온라인 세미나
Amazon RDS Proxy 집중 탐구 - 윤석찬 :: AWS Unboxing 온라인 세미나Amazon RDS Proxy 집중 탐구 - 윤석찬 :: AWS Unboxing 온라인 세미나
Amazon RDS Proxy 집중 탐구 - 윤석찬 :: AWS Unboxing 온라인 세미나
 
Azure role based access control (rbac)
Azure role based access control (rbac)Azure role based access control (rbac)
Azure role based access control (rbac)
 
Deep dive into AWS IAM
Deep dive into AWS IAMDeep dive into AWS IAM
Deep dive into AWS IAM
 
Data Migration to AWS with DataSync & Transfer for SFTP
Data Migration to AWS with DataSync & Transfer for SFTPData Migration to AWS with DataSync & Transfer for SFTP
Data Migration to AWS with DataSync & Transfer for SFTP
 
Encryption and Key Management in AWS
Encryption and Key Management in AWSEncryption and Key Management in AWS
Encryption and Key Management in AWS
 
AWS S3 | Tutorial For Beginners | AWS S3 Bucket Tutorial | AWS Tutorial For B...
AWS S3 | Tutorial For Beginners | AWS S3 Bucket Tutorial | AWS Tutorial For B...AWS S3 | Tutorial For Beginners | AWS S3 Bucket Tutorial | AWS Tutorial For B...
AWS S3 | Tutorial For Beginners | AWS S3 Bucket Tutorial | AWS Tutorial For B...
 
AWS Multi-Account Architecture and Best Practices
AWS Multi-Account Architecture and Best PracticesAWS Multi-Account Architecture and Best Practices
AWS Multi-Account Architecture and Best Practices
 
Realizing the Full Potential of Cloud-Native Application Security
Realizing the Full Potential of Cloud-Native Application SecurityRealizing the Full Potential of Cloud-Native Application Security
Realizing the Full Potential of Cloud-Native Application Security
 
AWS Security Best Practices (March 2017)
AWS Security Best Practices (March 2017)AWS Security Best Practices (March 2017)
AWS Security Best Practices (March 2017)
 

Similar to AWS S3 Mastery: Foundations, Concepts, Tools & Hands-On

Aws Solution Architecture Associate - summary
Aws Solution Architecture Associate - summaryAws Solution Architecture Associate - summary
Aws Solution Architecture Associate - summaryonoffshake
 
Amazon ec2 s3 dynamo db
Amazon ec2 s3 dynamo dbAmazon ec2 s3 dynamo db
Amazon ec2 s3 dynamo dbPankaj Thakur
 
Supercharging the Value of Your Data with Amazon S3
Supercharging the Value of Your Data with Amazon S3Supercharging the Value of Your Data with Amazon S3
Supercharging the Value of Your Data with Amazon S3Amazon Web Services
 
Deep Dive on Object Storage: Amazon S3 and Amazon Glacier
Deep Dive on Object Storage: Amazon S3 and Amazon GlacierDeep Dive on Object Storage: Amazon S3 and Amazon Glacier
Deep Dive on Object Storage: Amazon S3 and Amazon GlacierAdrian Hornsby
 
Deep Dive on Object Storage: Amazon S3 and Amazon Glacier
Deep Dive on Object Storage: Amazon S3 and Amazon GlacierDeep Dive on Object Storage: Amazon S3 and Amazon Glacier
Deep Dive on Object Storage: Amazon S3 and Amazon GlacierAmazon Web Services
 
AWS Summit Auckland - Building a Server-less Data Lake on AWS
AWS Summit Auckland - Building a Server-less Data Lake on AWSAWS Summit Auckland - Building a Server-less Data Lake on AWS
AWS Summit Auckland - Building a Server-less Data Lake on AWSAmazon Web Services
 
Building a Server-less Data Lake on AWS - Technical 301
Building a Server-less Data Lake on AWS - Technical 301Building a Server-less Data Lake on AWS - Technical 301
Building a Server-less Data Lake on AWS - Technical 301Amazon Web Services
 
Introduction to AWS Storage Services
Introduction to AWS Storage ServicesIntroduction to AWS Storage Services
Introduction to AWS Storage ServicesAmazon Web Services
 
Being Well Architected in the Cloud (Updated)
Being Well Architected in the Cloud (Updated)Being Well Architected in the Cloud (Updated)
Being Well Architected in the Cloud (Updated)Adrian Hornsby
 
Being Well-Architected in the Cloud
Being Well-Architected in the CloudBeing Well-Architected in the Cloud
Being Well-Architected in the CloudAmazon Web Services
 
AWS Well Architected-Info Session WeCloudData
AWS Well Architected-Info Session WeCloudDataAWS Well Architected-Info Session WeCloudData
AWS Well Architected-Info Session WeCloudDataWeCloudData
 
Backup and archiving in the aws cloud
Backup and archiving in the aws cloudBackup and archiving in the aws cloud
Backup and archiving in the aws cloudAmazon Web Services
 
Module 1 - CP Datalake on AWS
Module 1 - CP Datalake on AWSModule 1 - CP Datalake on AWS
Module 1 - CP Datalake on AWSLam Le
 
Deep Dive on Object Storage: Amazon S3 and Amazon Glacier | AWS Public Sector...
Deep Dive on Object Storage: Amazon S3 and Amazon Glacier | AWS Public Sector...Deep Dive on Object Storage: Amazon S3 and Amazon Glacier | AWS Public Sector...
Deep Dive on Object Storage: Amazon S3 and Amazon Glacier | AWS Public Sector...Amazon Web Services
 
(BDT322) How Redfin & Twitter Leverage Amazon S3 For Big Data
(BDT322) How Redfin & Twitter Leverage Amazon S3 For Big Data(BDT322) How Redfin & Twitter Leverage Amazon S3 For Big Data
(BDT322) How Redfin & Twitter Leverage Amazon S3 For Big DataAmazon Web Services
 
Deep Dive on Amazon S3 - March 2017 AWS Online Tech Talks
Deep Dive on Amazon S3 - March 2017 AWS Online Tech TalksDeep Dive on Amazon S3 - March 2017 AWS Online Tech Talks
Deep Dive on Amazon S3 - March 2017 AWS Online Tech TalksAmazon Web Services
 
(SOV203) Understanding AWS Storage Options | AWS re:Invent 2014
(SOV203) Understanding AWS Storage Options | AWS re:Invent 2014(SOV203) Understanding AWS Storage Options | AWS re:Invent 2014
(SOV203) Understanding AWS Storage Options | AWS re:Invent 2014Amazon Web Services
 

Similar to AWS S3 Mastery: Foundations, Concepts, Tools & Hands-On (20)

Aws Solution Architecture Associate - summary
Aws Solution Architecture Associate - summaryAws Solution Architecture Associate - summary
Aws Solution Architecture Associate - summary
 
Amazon ec2 s3 dynamo db
Amazon ec2 s3 dynamo dbAmazon ec2 s3 dynamo db
Amazon ec2 s3 dynamo db
 
Supercharging the Value of Your Data with Amazon S3
Supercharging the Value of Your Data with Amazon S3Supercharging the Value of Your Data with Amazon S3
Supercharging the Value of Your Data with Amazon S3
 
Deep Dive on Object Storage: Amazon S3 and Amazon Glacier
Deep Dive on Object Storage: Amazon S3 and Amazon GlacierDeep Dive on Object Storage: Amazon S3 and Amazon Glacier
Deep Dive on Object Storage: Amazon S3 and Amazon Glacier
 
Deep Dive on Object Storage: Amazon S3 and Amazon Glacier
Deep Dive on Object Storage: Amazon S3 and Amazon GlacierDeep Dive on Object Storage: Amazon S3 and Amazon Glacier
Deep Dive on Object Storage: Amazon S3 and Amazon Glacier
 
AWS Summit Auckland - Building a Server-less Data Lake on AWS
AWS Summit Auckland - Building a Server-less Data Lake on AWSAWS Summit Auckland - Building a Server-less Data Lake on AWS
AWS Summit Auckland - Building a Server-less Data Lake on AWS
 
Building a Server-less Data Lake on AWS - Technical 301
Building a Server-less Data Lake on AWS - Technical 301Building a Server-less Data Lake on AWS - Technical 301
Building a Server-less Data Lake on AWS - Technical 301
 
Introduction to AWS Storage Services
Introduction to AWS Storage ServicesIntroduction to AWS Storage Services
Introduction to AWS Storage Services
 
Being Well Architected in the Cloud (Updated)
Being Well Architected in the Cloud (Updated)Being Well Architected in the Cloud (Updated)
Being Well Architected in the Cloud (Updated)
 
Being Well-Architected in the Cloud
Being Well-Architected in the CloudBeing Well-Architected in the Cloud
Being Well-Architected in the Cloud
 
IBM Cloud Object Storage
IBM Cloud Object StorageIBM Cloud Object Storage
IBM Cloud Object Storage
 
Aws storage for media overview
Aws storage for media overview Aws storage for media overview
Aws storage for media overview
 
Introduction to Amazon Athena
Introduction to Amazon AthenaIntroduction to Amazon Athena
Introduction to Amazon Athena
 
AWS Well Architected-Info Session WeCloudData
AWS Well Architected-Info Session WeCloudDataAWS Well Architected-Info Session WeCloudData
AWS Well Architected-Info Session WeCloudData
 
Backup and archiving in the aws cloud
Backup and archiving in the aws cloudBackup and archiving in the aws cloud
Backup and archiving in the aws cloud
 
Module 1 - CP Datalake on AWS
Module 1 - CP Datalake on AWSModule 1 - CP Datalake on AWS
Module 1 - CP Datalake on AWS
 
Deep Dive on Object Storage: Amazon S3 and Amazon Glacier | AWS Public Sector...
Deep Dive on Object Storage: Amazon S3 and Amazon Glacier | AWS Public Sector...Deep Dive on Object Storage: Amazon S3 and Amazon Glacier | AWS Public Sector...
Deep Dive on Object Storage: Amazon S3 and Amazon Glacier | AWS Public Sector...
 
(BDT322) How Redfin & Twitter Leverage Amazon S3 For Big Data
(BDT322) How Redfin & Twitter Leverage Amazon S3 For Big Data(BDT322) How Redfin & Twitter Leverage Amazon S3 For Big Data
(BDT322) How Redfin & Twitter Leverage Amazon S3 For Big Data
 
Deep Dive on Amazon S3 - March 2017 AWS Online Tech Talks
Deep Dive on Amazon S3 - March 2017 AWS Online Tech TalksDeep Dive on Amazon S3 - March 2017 AWS Online Tech Talks
Deep Dive on Amazon S3 - March 2017 AWS Online Tech Talks
 
(SOV203) Understanding AWS Storage Options | AWS re:Invent 2014
(SOV203) Understanding AWS Storage Options | AWS re:Invent 2014(SOV203) Understanding AWS Storage Options | AWS re:Invent 2014
(SOV203) Understanding AWS Storage Options | AWS re:Invent 2014
 

Recently uploaded

CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsAndrey Dotsenko
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Patryk Bandurski
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptxLBM Solutions
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Unlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsUnlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsPrecisely
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersThousandEyes
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
APIForce Zurich 5 April Automation LPDG
APIForce Zurich 5 April  Automation LPDGAPIForce Zurich 5 April  Automation LPDG
APIForce Zurich 5 April Automation LPDGMarianaLemus7
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Neo4j
 

Recently uploaded (20)

CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food Manufacturing
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping Elbows
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
Hot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort Service
Hot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort ServiceHot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort Service
Hot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort Service
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptx
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Unlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsUnlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power Systems
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
APIForce Zurich 5 April Automation LPDG
APIForce Zurich 5 April  Automation LPDGAPIForce Zurich 5 April  Automation LPDG
APIForce Zurich 5 April Automation LPDG
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024
 
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 

AWS S3 Mastery: Foundations, Concepts, Tools & Hands-On

  • 1. AWS Foundations: Amazon S3 Mastery Bootcamp Instuctor Matt Bohn AWS Certified Solutions Architect For complete video course with hands on exercises please visit: https://www.udemy.com/aws-foundations-amazon-s3-mastery-bootcamp/?couponCode=SLIDESHARE
  • 2. • Solution architects • Software Engineers and Developers • System Administrators • IT Professionals • Anyone who wants an in depth knowledge of S3 and hands on practice using it Who is this course for?
  • 3. • AWS Skills are highly desired by employers • Cloud IaaS is valued at $52 billion in 2019, and expected to reach $83 billion by 2021 according to Gartner1. • Amazon S3 is one of Amazon’s core cloud services • Take advantage of low/cost, highly available cloud storage Why learn about Amazon S3? 1. Source: Gartner (https://www.gartner.com/en/newsroom/press-releases/2018-04-12-gartner-forecasts-worldwide-public-cloud-revenue-to-grow-21-percent-in-2018)
  • 4. • An AWS account • A web browser and Internet access • Know how to navigate your operating system and file system • AWS Command line tools • Examples use Windows, but you can use Linux or Mac also • Familiarity with a command prompt What you need to complete this course
  • 5. • Fundamental Concepts • What S3 is and key terms • How data is stored, secured, and billed • Understand the shared responsibility model of AWS • How to create, update, delete, and organize your data in S3 using the S3 web console • How to manage your S3 data with the command line interface • How to control access to your data with security policies What will you learn in this course?
  • 6. • Protect your data • Enable versioning on files/objects • Use cross region replication for additional redundancy • Encryption • Enable life cycle management to control costs • Turn on logging to track access to your data • Use events to trigger notifications • Host a highly available static website You will also learn:
  • 7. • High level concepts and terms that will be helpful before we dive into the hands on portion • Decision making information • How to choose a pricing tier • Compliance • Tools available to get data in and out of S3 S3 Fundamental Concepts
  • 8. • Amazon Simple Storage Service is cloud-based storage that can store an unlimited amount of data and retrieve that data anytime over the web. • Highly scalable, reliable, fast, and cost-effective data storage built on Amazon’s global infrastructure What is Amazon S3?
  • 9. W Where is my data stored? • Your data is stored in a region. • A region represents a general geographic area. • You choose a region for your data. • Currently 18 geographic regions
  • 10. W • A region contains availability zones • An AZ is an isolated facility • Data is replicated across 3 availability zones • Amazon handles AZ replication
  • 11. bucket1 image1.jpg image2.jpg image2.jpg image1.jpg image2.jpg image2.jpg bucket2 Region: us-east-1 Key concepts • S3 is object based storage (think object = file) • Objects are stored in buckets • An object can be up to 5TB • No limit on bucket size or total data in your account • Permissions can be set on buckets and individual objects • No hierarchy • Files replicated across at least 3 availability zones (one exception) • S3 provides read-after-write consistency for PUTS of new objects • Eventual consistency for overwrites and deletes Objects
  • 12. You can represent folders logically by including a prefix in the object name. For example: /my-bucket/my-folder/my-object.txt my-folder/my-object.txt is the full object name No hierarchy, BUT….
  • 13. • Key – this is the name of the object (like a filename) and is used to retrieve the object • Value – Any sequence of bytes you want to store • Version ID • A string generated by Amazon when you add an object to a bucket. • Together the key and version ID uniquely identify an object within a bucket. • Metadata • Name-value pairs to store information about the object • System-meta data – creation data, size, storage class, etc • User metadata – is custom meta data you add to an object • Sub resources - additional info such as acl (owner) or torrent file What makes up an object?
  • 14. • Metadata • https://docs.aws.amazon.com/AmazonS3/latest/dev/UsingMetadata.html • Objects • https://docs.aws.amazon.com/AmazonS3/latest/dev/UsingObjects.html For More Information
  • 15. • Customer and Amazon share responsibility for different parts of security • Customer is responsible for “security in the cloud” • Setting appropriate access controls for your objects and buckets • Control who accesses the AWS Web console, or APIs • Amazon is responsible for “security of the cloud” • Physical security of data centers and global infrastructure What is the Shared Responsibility Model?
  • 16. • AWS infrastructure and services meet numerous compliance standards and regulations (PCI compliance, and others) • S3 supports SSL for encryption in transit, and optionally you can enable encryption at rest • Your data does not leave the region you specify • See the following for detailed info on AWS security and compliance: • https://aws.amazon.com/compliance/programs/ • https://aws.amazon.com/security/ How secure is my data?
  • 17. Storage classes provide a way to select the most cost effective storage for your data based on how frequently it is accessed and how quickly you need to retrieve it. Storage Classes
  • 18. • Standard Storage • best when you need quick access, frequently • Standard Infrequent Access (IA) • Use when you need data returned quickly, but not frequently accessed • Min 128K object size and min storage timeframe of 30 days • One Zone Infrequent Access (IA) • Use when you have another copy or data can be re-created • Cheaper but data is only replicated in one Availability Zone • Glacier • Used for long term archive and backup • Min timeframe 90 days, can take minutes to hours to retrieve Storage Classes
  • 19. Durability and availability For more information see: https://aws.amazon.com/s3/pricing/ For more information see: https://aws.amazon.com/s3/sla/ Standard Standard – IA One Zone - IA Amazon Glacier Designed for durability 99.999999999% 99.999999999% 99.999999999% 99.999999999% Designed for Availability 99.99% 99.9% 99.5% N/A Most expensive per GB stored Least expensive per GB stored Least expensive per request More expensive per request
  • 20. • Data transfer IN to S3 is free • Data transfer OUT costs • Pay for requests (per 1000) • Pay for amount of data stored • Per GB Pricing generally goes down the more data you store • Pricing differs across regions Pricing
  • 21. How to get data into and out of S3? Web console Command line
  • 22. SDKs for most popular languages Ruby C++
  • 23. AWS Import/Export • Request a job in the AWS Console and ship your hard drive to Amazon • They import your data and ship your drive back • Up to 16 Tb per job
  • 24. AWS Snowball – Lots of Data • 50Tb and 80Tb Models • Amazon Ships to you, you copy your data • Data is encrypted on the device • You ship back and Amazon imports your data • Weighs 47 pounds • Size 19.75x12.66x21.5 • ~$200-$300 per job Image source: https://docs.aws.amazon.com/snowball/latest/ug/using-appliance.html
  • 25. AWS Snow Mobile • Exabyte scale transfer service / 100 Petabytes per snowmobile • Dedicated security personal • Video surveillance • GPS Tracking Image source: https://aws.amazon.com/snowmobile
  • 26. • Navigate the S3 dashboard • Create buckets in a selected region • Upload files into buckets • Overwrite files • Move files between buckets • Delete buckets • Download individual objects Managing Data with the AWS Web Console
  • 27. • What are object tags? • A key-value pair • Tags are used for categorizing storage • Use Cases • Use tags to allow a user/group to read/write objects with a tag • Create lifecycle rules to move objects based on a tag to cheaper storage tiers • Use as filters for Analytics and Metrics • Track costs based on tag • For example by project, client, department, etc Object Tags
  • 28. • Max 10 tags on an object • Max 50 tags on a bucket • Keys must be unique • Tag key can contain 128 Unicode characters • Tag value can contain 256 Unicode characters • Key and Values are case sensitive • Texas <> texas Tag Restrictions
  • 29. • Object Metadata is descriptive data describing an object • Consists of name-value pairs • Returned as HTTP headers on objects • Two types of metadata • System metadata • User-defined metadata Object Metadata
  • 30. • Metadata maintained by Amazon S3 • Two types of System Metadata • Metadata where only Amazon S3 can modify the value • Example: Object creation date • Metadata that you can modify • Example: Storage class, versioning, and encryption attributes System Metadata
  • 31. • Custom name-value pairs you can add to your object • Name must begin with “x-amz-meta” • Names are case insensitive User Metadata
  • 32. • Both are name value pairs • Tag keys are case sensitive • Metadata names are case insensitive • Tags are used for categorizing storage to analyze cost or along with permissions for fine grained access control • Metadata properties are returned as HTTP headers • Certain Metadata pairs control how data is stored • Storage class, enabling encryption. Metadata vs. Tags
  • 33. For complete course with hands on exercises please visit: https://www.udemy.com/aws-foundations-amazon-s3- mastery-bootcamp/?couponCode=SLIDESHARE AWS Amazon S3 Mastery Bootcamp