SlideShare a Scribd company logo
AWS Foundations: Amazon S3 Mastery Bootcamp
Instuctor
Matt Bohn
AWS Certified Solutions Architect
For complete video course with hands on exercises please visit:
https://www.udemy.com/aws-foundations-amazon-s3-mastery-bootcamp/?couponCode=SLIDESHARE
• Solution architects
• Software Engineers and Developers
• System Administrators
• IT Professionals
• Anyone who wants an in depth knowledge of S3 and hands
on practice using it
Who is this course for?
• AWS Skills are highly desired by employers
• Cloud IaaS is valued at $52 billion in 2019, and expected to
reach $83 billion by 2021 according to Gartner1.
• Amazon S3 is one of Amazon’s core cloud services
• Take advantage of low/cost, highly available cloud storage
Why learn about Amazon S3?
1. Source: Gartner (https://www.gartner.com/en/newsroom/press-releases/2018-04-12-gartner-forecasts-worldwide-public-cloud-revenue-to-grow-21-percent-in-2018)
• An AWS account
• A web browser and Internet access
• Know how to navigate your operating system and file system
• AWS Command line tools
• Examples use Windows, but you can use Linux or Mac also
• Familiarity with a command prompt
What you need to complete this course
• Fundamental Concepts
• What S3 is and key terms
• How data is stored, secured, and billed
• Understand the shared responsibility model of AWS
• How to create, update, delete, and organize your data in S3
using the S3 web console
• How to manage your S3 data with the command line
interface
• How to control access to your data with security policies
What will you learn in this course?
• Protect your data
• Enable versioning on files/objects
• Use cross region replication for additional redundancy
• Encryption
• Enable life cycle management to control costs
• Turn on logging to track access to your data
• Use events to trigger notifications
• Host a highly available static website
You will also learn:
• High level concepts and terms that will be helpful before we
dive into the hands on portion
• Decision making information
• How to choose a pricing tier
• Compliance
• Tools available to get data in and out of S3
S3 Fundamental Concepts
• Amazon Simple Storage Service is cloud-based storage that
can store an unlimited amount of data and retrieve that data
anytime over the web.
• Highly scalable, reliable, fast, and cost-effective data storage
built on Amazon’s global infrastructure
What is Amazon S3?
W
Where is my data stored?
• Your data is stored in a
region.
• A region represents a
general geographic area.
• You choose a region for your
data.
• Currently 18 geographic
regions
W
• A region contains availability zones
• An AZ is an isolated facility
• Data is replicated across 3 availability
zones
• Amazon handles AZ replication
bucket1
image1.jpg
image2.jpg
image2.jpg
image1.jpg
image2.jpg
image2.jpg
bucket2
Region: us-east-1 Key concepts
• S3 is object based storage (think object = file)
• Objects are stored in buckets
• An object can be up to 5TB
• No limit on bucket size or total data in your
account
• Permissions can be set on buckets and individual
objects
• No hierarchy
• Files replicated across at least 3 availability zones
(one exception)
• S3 provides read-after-write consistency for PUTS
of new objects
• Eventual consistency for overwrites and deletes
Objects
You can represent folders logically by including a prefix in the
object name. For example:
/my-bucket/my-folder/my-object.txt
my-folder/my-object.txt is the full object name
No hierarchy, BUT….
• Key – this is the name of the object (like a filename) and is used to retrieve the object
• Value – Any sequence of bytes you want to store
• Version ID
• A string generated by Amazon when you add an object to a bucket.
• Together the key and version ID uniquely identify an object within a bucket.
• Metadata
• Name-value pairs to store information about the object
• System-meta data – creation data, size, storage class, etc
• User metadata – is custom meta data you add to an object
• Sub resources - additional info such as acl (owner) or torrent file
What makes up an object?
• Metadata
• https://docs.aws.amazon.com/AmazonS3/latest/dev/UsingMetadata.html
• Objects
• https://docs.aws.amazon.com/AmazonS3/latest/dev/UsingObjects.html
For More Information
• Customer and Amazon share responsibility for different parts
of security
• Customer is responsible for “security in the cloud”
• Setting appropriate access controls for your objects and buckets
• Control who accesses the AWS Web console, or APIs
• Amazon is responsible for “security of the cloud”
• Physical security of data centers and global infrastructure
What is the Shared Responsibility Model?
• AWS infrastructure and services meet numerous compliance
standards and regulations (PCI compliance, and others)
• S3 supports SSL for encryption in transit, and optionally you
can enable encryption at rest
• Your data does not leave the region you specify
• See the following for detailed info on AWS security and
compliance:
• https://aws.amazon.com/compliance/programs/
• https://aws.amazon.com/security/
How secure is my data?
Storage classes provide a way to select the most cost effective
storage for your data based on how frequently it is accessed
and how quickly you need to retrieve it.
Storage Classes
• Standard Storage
• best when you need quick access, frequently
• Standard Infrequent Access (IA)
• Use when you need data returned quickly, but not frequently accessed
• Min 128K object size and min storage timeframe of 30 days
• One Zone Infrequent Access (IA)
• Use when you have another copy or data can be re-created
• Cheaper but data is only replicated in one Availability Zone
• Glacier
• Used for long term archive and backup
• Min timeframe 90 days, can take minutes to hours to retrieve
Storage Classes
Durability and availability
For more information see: https://aws.amazon.com/s3/pricing/
For more information see: https://aws.amazon.com/s3/sla/
Standard Standard – IA One Zone - IA Amazon Glacier
Designed for durability 99.999999999% 99.999999999% 99.999999999% 99.999999999%
Designed for Availability 99.99% 99.9% 99.5% N/A
Most expensive per GB stored Least expensive per GB stored
Least expensive per request More expensive per request
• Data transfer IN to S3 is free
• Data transfer OUT costs
• Pay for requests (per 1000)
• Pay for amount of data stored
• Per GB Pricing generally goes down the more data you store
• Pricing differs across regions
Pricing
How to get data into and out of S3?
Web console Command line
SDKs for most popular languages
Ruby C++
AWS Import/Export
• Request a job in the AWS Console and
ship your hard drive to Amazon
• They import your data and ship your drive
back
• Up to 16 Tb per job
AWS Snowball – Lots of Data
• 50Tb and 80Tb Models
• Amazon Ships to you, you copy your data
• Data is encrypted on the device
• You ship back and Amazon imports your data
• Weighs 47 pounds
• Size 19.75x12.66x21.5
• ~$200-$300 per job
Image source: https://docs.aws.amazon.com/snowball/latest/ug/using-appliance.html
AWS Snow Mobile
• Exabyte scale transfer service / 100 Petabytes
per snowmobile
• Dedicated security personal
• Video surveillance
• GPS Tracking
Image source: https://aws.amazon.com/snowmobile
• Navigate the S3 dashboard
• Create buckets in a selected region
• Upload files into buckets
• Overwrite files
• Move files between buckets
• Delete buckets
• Download individual objects
Managing Data with the AWS Web Console
• What are object tags?
• A key-value pair
• Tags are used for categorizing storage
• Use Cases
• Use tags to allow a user/group to read/write objects with a tag
• Create lifecycle rules to move objects based on a tag to cheaper
storage tiers
• Use as filters for Analytics and Metrics
• Track costs based on tag
• For example by project, client, department, etc
Object Tags
• Max 10 tags on an object
• Max 50 tags on a bucket
• Keys must be unique
• Tag key can contain 128 Unicode characters
• Tag value can contain 256 Unicode characters
• Key and Values are case sensitive
• Texas <> texas
Tag Restrictions
• Object Metadata is descriptive data describing an object
• Consists of name-value pairs
• Returned as HTTP headers on objects
• Two types of metadata
• System metadata
• User-defined metadata
Object Metadata
• Metadata maintained by Amazon S3
• Two types of System Metadata
• Metadata where only Amazon S3 can modify the value
• Example: Object creation date
• Metadata that you can modify
• Example: Storage class, versioning, and encryption attributes
System Metadata
• Custom name-value pairs you can add to your object
• Name must begin with “x-amz-meta”
• Names are case insensitive
User Metadata
• Both are name value pairs
• Tag keys are case sensitive
• Metadata names are case insensitive
• Tags are used for categorizing storage to analyze cost or
along with permissions for fine grained access control
• Metadata properties are returned as HTTP headers
• Certain Metadata pairs control how data is stored
• Storage class, enabling encryption.
Metadata vs. Tags
For complete course with hands on exercises please visit:
https://www.udemy.com/aws-foundations-amazon-s3-
mastery-bootcamp/?couponCode=SLIDESHARE
AWS Amazon S3 Mastery Bootcamp

More Related Content

What's hot

Object Storage: Amazon S3 and Amazon Glacier
Object Storage: Amazon S3 and Amazon GlacierObject Storage: Amazon S3 and Amazon Glacier
Object Storage: Amazon S3 and Amazon Glacier
Amazon Web Services
 
AWS EC2
AWS EC2AWS EC2
AWS EC2
Mahesh Raj
 
(STG401) Amazon S3 Deep Dive & Best Practices
(STG401) Amazon S3 Deep Dive & Best Practices(STG401) Amazon S3 Deep Dive & Best Practices
(STG401) Amazon S3 Deep Dive & Best Practices
Amazon Web Services
 
AWS basics
AWS basicsAWS basics
AWS basics
mbaric
 
Backup and archiving in the aws cloud
Backup and archiving in the aws cloudBackup and archiving in the aws cloud
Backup and archiving in the aws cloud
Amazon Web Services
 
Introduction to Amazon Elastic File System (EFS)
Introduction to Amazon Elastic File System (EFS)Introduction to Amazon Elastic File System (EFS)
Introduction to Amazon Elastic File System (EFS)
Amazon Web Services
 
ABCs of AWS: S3
ABCs of AWS: S3ABCs of AWS: S3
ABCs of AWS: S3
Mark Cohen
 
Security Architectures on AWS
Security Architectures on AWSSecurity Architectures on AWS
Security Architectures on AWS
Amazon Web Services
 
Amazon S3 Masterclass
Amazon S3 MasterclassAmazon S3 Masterclass
Amazon S3 Masterclass
Amazon Web Services
 
AWS S3 | Tutorial For Beginners | AWS S3 Bucket Tutorial | AWS Tutorial For B...
AWS S3 | Tutorial For Beginners | AWS S3 Bucket Tutorial | AWS Tutorial For B...AWS S3 | Tutorial For Beginners | AWS S3 Bucket Tutorial | AWS Tutorial For B...
AWS S3 | Tutorial For Beginners | AWS S3 Bucket Tutorial | AWS Tutorial For B...
Simplilearn
 
Amazon's Simple Storage Service (S3)
Amazon's Simple Storage Service (S3)Amazon's Simple Storage Service (S3)
Amazon's Simple Storage Service (S3)
James Gray
 
AWS Lambda and the Serverless Cloud
AWS Lambda and the Serverless CloudAWS Lambda and the Serverless Cloud
AWS Lambda and the Serverless Cloud
Amazon Web Services
 
Masterclass Webinar: Amazon Elastic MapReduce (EMR)
Masterclass Webinar: Amazon Elastic MapReduce (EMR)Masterclass Webinar: Amazon Elastic MapReduce (EMR)
Masterclass Webinar: Amazon Elastic MapReduce (EMR)
Amazon Web Services
 
AWS Cloud Security
AWS Cloud SecurityAWS Cloud Security
AWS Cloud Security
AWS Riyadh User Group
 
Deep Dive on Amazon S3
Deep Dive on Amazon S3Deep Dive on Amazon S3
Deep Dive on Amazon S3
Amazon Web Services
 
Intro to AWS: Database Services
Intro to AWS: Database ServicesIntro to AWS: Database Services
Intro to AWS: Database Services
Amazon Web Services
 
Basics AWS Presentation
Basics AWS PresentationBasics AWS Presentation
Basics AWS Presentation
Shyam Kumar
 
AWS Security by Design
AWS Security by Design AWS Security by Design
AWS Security by Design
Amazon Web Services
 
Encryption and Key Management in AWS
Encryption and Key Management in AWS Encryption and Key Management in AWS
Encryption and Key Management in AWS
Amazon Web Services
 

What's hot (20)

Object Storage: Amazon S3 and Amazon Glacier
Object Storage: Amazon S3 and Amazon GlacierObject Storage: Amazon S3 and Amazon Glacier
Object Storage: Amazon S3 and Amazon Glacier
 
AWS EC2
AWS EC2AWS EC2
AWS EC2
 
(STG401) Amazon S3 Deep Dive & Best Practices
(STG401) Amazon S3 Deep Dive & Best Practices(STG401) Amazon S3 Deep Dive & Best Practices
(STG401) Amazon S3 Deep Dive & Best Practices
 
AWS basics
AWS basicsAWS basics
AWS basics
 
Backup and archiving in the aws cloud
Backup and archiving in the aws cloudBackup and archiving in the aws cloud
Backup and archiving in the aws cloud
 
Introduction to Amazon Elastic File System (EFS)
Introduction to Amazon Elastic File System (EFS)Introduction to Amazon Elastic File System (EFS)
Introduction to Amazon Elastic File System (EFS)
 
ABCs of AWS: S3
ABCs of AWS: S3ABCs of AWS: S3
ABCs of AWS: S3
 
Security Architectures on AWS
Security Architectures on AWSSecurity Architectures on AWS
Security Architectures on AWS
 
AWS-S3.pptx
AWS-S3.pptxAWS-S3.pptx
AWS-S3.pptx
 
Amazon S3 Masterclass
Amazon S3 MasterclassAmazon S3 Masterclass
Amazon S3 Masterclass
 
AWS S3 | Tutorial For Beginners | AWS S3 Bucket Tutorial | AWS Tutorial For B...
AWS S3 | Tutorial For Beginners | AWS S3 Bucket Tutorial | AWS Tutorial For B...AWS S3 | Tutorial For Beginners | AWS S3 Bucket Tutorial | AWS Tutorial For B...
AWS S3 | Tutorial For Beginners | AWS S3 Bucket Tutorial | AWS Tutorial For B...
 
Amazon's Simple Storage Service (S3)
Amazon's Simple Storage Service (S3)Amazon's Simple Storage Service (S3)
Amazon's Simple Storage Service (S3)
 
AWS Lambda and the Serverless Cloud
AWS Lambda and the Serverless CloudAWS Lambda and the Serverless Cloud
AWS Lambda and the Serverless Cloud
 
Masterclass Webinar: Amazon Elastic MapReduce (EMR)
Masterclass Webinar: Amazon Elastic MapReduce (EMR)Masterclass Webinar: Amazon Elastic MapReduce (EMR)
Masterclass Webinar: Amazon Elastic MapReduce (EMR)
 
AWS Cloud Security
AWS Cloud SecurityAWS Cloud Security
AWS Cloud Security
 
Deep Dive on Amazon S3
Deep Dive on Amazon S3Deep Dive on Amazon S3
Deep Dive on Amazon S3
 
Intro to AWS: Database Services
Intro to AWS: Database ServicesIntro to AWS: Database Services
Intro to AWS: Database Services
 
Basics AWS Presentation
Basics AWS PresentationBasics AWS Presentation
Basics AWS Presentation
 
AWS Security by Design
AWS Security by Design AWS Security by Design
AWS Security by Design
 
Encryption and Key Management in AWS
Encryption and Key Management in AWS Encryption and Key Management in AWS
Encryption and Key Management in AWS
 

Similar to AWS Amazon S3 Mastery Bootcamp

Aws Solution Architecture Associate - summary
Aws Solution Architecture Associate - summaryAws Solution Architecture Associate - summary
Aws Solution Architecture Associate - summary
onoffshake
 
Amazon ec2 s3 dynamo db
Amazon ec2 s3 dynamo dbAmazon ec2 s3 dynamo db
Amazon ec2 s3 dynamo db
Pankaj Thakur
 
Supercharging the Value of Your Data with Amazon S3
Supercharging the Value of Your Data with Amazon S3Supercharging the Value of Your Data with Amazon S3
Supercharging the Value of Your Data with Amazon S3
Amazon Web Services
 
Deep Dive on Object Storage: Amazon S3 and Amazon Glacier
Deep Dive on Object Storage: Amazon S3 and Amazon GlacierDeep Dive on Object Storage: Amazon S3 and Amazon Glacier
Deep Dive on Object Storage: Amazon S3 and Amazon Glacier
Amazon Web Services
 
Deep Dive on Object Storage: Amazon S3 and Amazon Glacier
Deep Dive on Object Storage: Amazon S3 and Amazon GlacierDeep Dive on Object Storage: Amazon S3 and Amazon Glacier
Deep Dive on Object Storage: Amazon S3 and Amazon Glacier
Adrian Hornsby
 
AWS Summit Auckland - Building a Server-less Data Lake on AWS
AWS Summit Auckland - Building a Server-less Data Lake on AWSAWS Summit Auckland - Building a Server-less Data Lake on AWS
AWS Summit Auckland - Building a Server-less Data Lake on AWS
Amazon Web Services
 
Building a Server-less Data Lake on AWS - Technical 301
Building a Server-less Data Lake on AWS - Technical 301Building a Server-less Data Lake on AWS - Technical 301
Building a Server-less Data Lake on AWS - Technical 301
Amazon Web Services
 
Introduction to AWS Storage Services
Introduction to AWS Storage ServicesIntroduction to AWS Storage Services
Introduction to AWS Storage Services
Amazon Web Services
 
Being Well Architected in the Cloud (Updated)
Being Well Architected in the Cloud (Updated)Being Well Architected in the Cloud (Updated)
Being Well Architected in the Cloud (Updated)
Adrian Hornsby
 
Being Well-Architected in the Cloud
Being Well-Architected in the CloudBeing Well-Architected in the Cloud
Being Well-Architected in the Cloud
Amazon Web Services
 
IBM Cloud Object Storage
IBM Cloud Object StorageIBM Cloud Object Storage
IBM Cloud Object Storage
Nagesh Ramamoorthy
 
Aws storage for media overview
Aws storage for media overview Aws storage for media overview
Aws storage for media overview
Amazon Web Services
 
Introduction to Amazon Athena
Introduction to Amazon AthenaIntroduction to Amazon Athena
Introduction to Amazon Athena
Amazon Web Services
 
AWS Well Architected-Info Session WeCloudData
AWS Well Architected-Info Session WeCloudDataAWS Well Architected-Info Session WeCloudData
AWS Well Architected-Info Session WeCloudData
WeCloudData
 
Module 1 - CP Datalake on AWS
Module 1 - CP Datalake on AWSModule 1 - CP Datalake on AWS
Module 1 - CP Datalake on AWS
Lam Le
 
Deep Dive on Object Storage: Amazon S3 and Amazon Glacier | AWS Public Sector...
Deep Dive on Object Storage: Amazon S3 and Amazon Glacier | AWS Public Sector...Deep Dive on Object Storage: Amazon S3 and Amazon Glacier | AWS Public Sector...
Deep Dive on Object Storage: Amazon S3 and Amazon Glacier | AWS Public Sector...
Amazon Web Services
 
(BDT322) How Redfin & Twitter Leverage Amazon S3 For Big Data
(BDT322) How Redfin & Twitter Leverage Amazon S3 For Big Data(BDT322) How Redfin & Twitter Leverage Amazon S3 For Big Data
(BDT322) How Redfin & Twitter Leverage Amazon S3 For Big Data
Amazon Web Services
 
Deep Dive on Amazon S3 - March 2017 AWS Online Tech Talks
Deep Dive on Amazon S3 - March 2017 AWS Online Tech TalksDeep Dive on Amazon S3 - March 2017 AWS Online Tech Talks
Deep Dive on Amazon S3 - March 2017 AWS Online Tech Talks
Amazon Web Services
 
(SOV203) Understanding AWS Storage Options | AWS re:Invent 2014
(SOV203) Understanding AWS Storage Options | AWS re:Invent 2014(SOV203) Understanding AWS Storage Options | AWS re:Invent 2014
(SOV203) Understanding AWS Storage Options | AWS re:Invent 2014
Amazon Web Services
 
Deep Dive on Amazon S3 - AWS Online Tech Talks
Deep Dive on Amazon S3 - AWS Online Tech TalksDeep Dive on Amazon S3 - AWS Online Tech Talks
Deep Dive on Amazon S3 - AWS Online Tech Talks
Amazon Web Services
 

Similar to AWS Amazon S3 Mastery Bootcamp (20)

Aws Solution Architecture Associate - summary
Aws Solution Architecture Associate - summaryAws Solution Architecture Associate - summary
Aws Solution Architecture Associate - summary
 
Amazon ec2 s3 dynamo db
Amazon ec2 s3 dynamo dbAmazon ec2 s3 dynamo db
Amazon ec2 s3 dynamo db
 
Supercharging the Value of Your Data with Amazon S3
Supercharging the Value of Your Data with Amazon S3Supercharging the Value of Your Data with Amazon S3
Supercharging the Value of Your Data with Amazon S3
 
Deep Dive on Object Storage: Amazon S3 and Amazon Glacier
Deep Dive on Object Storage: Amazon S3 and Amazon GlacierDeep Dive on Object Storage: Amazon S3 and Amazon Glacier
Deep Dive on Object Storage: Amazon S3 and Amazon Glacier
 
Deep Dive on Object Storage: Amazon S3 and Amazon Glacier
Deep Dive on Object Storage: Amazon S3 and Amazon GlacierDeep Dive on Object Storage: Amazon S3 and Amazon Glacier
Deep Dive on Object Storage: Amazon S3 and Amazon Glacier
 
AWS Summit Auckland - Building a Server-less Data Lake on AWS
AWS Summit Auckland - Building a Server-less Data Lake on AWSAWS Summit Auckland - Building a Server-less Data Lake on AWS
AWS Summit Auckland - Building a Server-less Data Lake on AWS
 
Building a Server-less Data Lake on AWS - Technical 301
Building a Server-less Data Lake on AWS - Technical 301Building a Server-less Data Lake on AWS - Technical 301
Building a Server-less Data Lake on AWS - Technical 301
 
Introduction to AWS Storage Services
Introduction to AWS Storage ServicesIntroduction to AWS Storage Services
Introduction to AWS Storage Services
 
Being Well Architected in the Cloud (Updated)
Being Well Architected in the Cloud (Updated)Being Well Architected in the Cloud (Updated)
Being Well Architected in the Cloud (Updated)
 
Being Well-Architected in the Cloud
Being Well-Architected in the CloudBeing Well-Architected in the Cloud
Being Well-Architected in the Cloud
 
IBM Cloud Object Storage
IBM Cloud Object StorageIBM Cloud Object Storage
IBM Cloud Object Storage
 
Aws storage for media overview
Aws storage for media overview Aws storage for media overview
Aws storage for media overview
 
Introduction to Amazon Athena
Introduction to Amazon AthenaIntroduction to Amazon Athena
Introduction to Amazon Athena
 
AWS Well Architected-Info Session WeCloudData
AWS Well Architected-Info Session WeCloudDataAWS Well Architected-Info Session WeCloudData
AWS Well Architected-Info Session WeCloudData
 
Module 1 - CP Datalake on AWS
Module 1 - CP Datalake on AWSModule 1 - CP Datalake on AWS
Module 1 - CP Datalake on AWS
 
Deep Dive on Object Storage: Amazon S3 and Amazon Glacier | AWS Public Sector...
Deep Dive on Object Storage: Amazon S3 and Amazon Glacier | AWS Public Sector...Deep Dive on Object Storage: Amazon S3 and Amazon Glacier | AWS Public Sector...
Deep Dive on Object Storage: Amazon S3 and Amazon Glacier | AWS Public Sector...
 
(BDT322) How Redfin & Twitter Leverage Amazon S3 For Big Data
(BDT322) How Redfin & Twitter Leverage Amazon S3 For Big Data(BDT322) How Redfin & Twitter Leverage Amazon S3 For Big Data
(BDT322) How Redfin & Twitter Leverage Amazon S3 For Big Data
 
Deep Dive on Amazon S3 - March 2017 AWS Online Tech Talks
Deep Dive on Amazon S3 - March 2017 AWS Online Tech TalksDeep Dive on Amazon S3 - March 2017 AWS Online Tech Talks
Deep Dive on Amazon S3 - March 2017 AWS Online Tech Talks
 
(SOV203) Understanding AWS Storage Options | AWS re:Invent 2014
(SOV203) Understanding AWS Storage Options | AWS re:Invent 2014(SOV203) Understanding AWS Storage Options | AWS re:Invent 2014
(SOV203) Understanding AWS Storage Options | AWS re:Invent 2014
 
Deep Dive on Amazon S3 - AWS Online Tech Talks
Deep Dive on Amazon S3 - AWS Online Tech TalksDeep Dive on Amazon S3 - AWS Online Tech Talks
Deep Dive on Amazon S3 - AWS Online Tech Talks
 

Recently uploaded

Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Tobias Schneck
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
Safe Software
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
RTTS
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
DianaGray10
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
Kari Kakkonen
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
Product School
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
Product School
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
Sri Ambati
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
KatiaHIMEUR1
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
Paul Groth
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
Cheryl Hung
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
91mobiles
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
Product School
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
OnBoard
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
Alan Dix
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance
 
Generating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using SmithyGenerating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using Smithy
g2nightmarescribd
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
James Anderson
 

Recently uploaded (20)

Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
 
Generating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using SmithyGenerating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using Smithy
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
 

AWS Amazon S3 Mastery Bootcamp

  • 1. AWS Foundations: Amazon S3 Mastery Bootcamp Instuctor Matt Bohn AWS Certified Solutions Architect For complete video course with hands on exercises please visit: https://www.udemy.com/aws-foundations-amazon-s3-mastery-bootcamp/?couponCode=SLIDESHARE
  • 2. • Solution architects • Software Engineers and Developers • System Administrators • IT Professionals • Anyone who wants an in depth knowledge of S3 and hands on practice using it Who is this course for?
  • 3. • AWS Skills are highly desired by employers • Cloud IaaS is valued at $52 billion in 2019, and expected to reach $83 billion by 2021 according to Gartner1. • Amazon S3 is one of Amazon’s core cloud services • Take advantage of low/cost, highly available cloud storage Why learn about Amazon S3? 1. Source: Gartner (https://www.gartner.com/en/newsroom/press-releases/2018-04-12-gartner-forecasts-worldwide-public-cloud-revenue-to-grow-21-percent-in-2018)
  • 4. • An AWS account • A web browser and Internet access • Know how to navigate your operating system and file system • AWS Command line tools • Examples use Windows, but you can use Linux or Mac also • Familiarity with a command prompt What you need to complete this course
  • 5. • Fundamental Concepts • What S3 is and key terms • How data is stored, secured, and billed • Understand the shared responsibility model of AWS • How to create, update, delete, and organize your data in S3 using the S3 web console • How to manage your S3 data with the command line interface • How to control access to your data with security policies What will you learn in this course?
  • 6. • Protect your data • Enable versioning on files/objects • Use cross region replication for additional redundancy • Encryption • Enable life cycle management to control costs • Turn on logging to track access to your data • Use events to trigger notifications • Host a highly available static website You will also learn:
  • 7. • High level concepts and terms that will be helpful before we dive into the hands on portion • Decision making information • How to choose a pricing tier • Compliance • Tools available to get data in and out of S3 S3 Fundamental Concepts
  • 8. • Amazon Simple Storage Service is cloud-based storage that can store an unlimited amount of data and retrieve that data anytime over the web. • Highly scalable, reliable, fast, and cost-effective data storage built on Amazon’s global infrastructure What is Amazon S3?
  • 9. W Where is my data stored? • Your data is stored in a region. • A region represents a general geographic area. • You choose a region for your data. • Currently 18 geographic regions
  • 10. W • A region contains availability zones • An AZ is an isolated facility • Data is replicated across 3 availability zones • Amazon handles AZ replication
  • 11. bucket1 image1.jpg image2.jpg image2.jpg image1.jpg image2.jpg image2.jpg bucket2 Region: us-east-1 Key concepts • S3 is object based storage (think object = file) • Objects are stored in buckets • An object can be up to 5TB • No limit on bucket size or total data in your account • Permissions can be set on buckets and individual objects • No hierarchy • Files replicated across at least 3 availability zones (one exception) • S3 provides read-after-write consistency for PUTS of new objects • Eventual consistency for overwrites and deletes Objects
  • 12. You can represent folders logically by including a prefix in the object name. For example: /my-bucket/my-folder/my-object.txt my-folder/my-object.txt is the full object name No hierarchy, BUT….
  • 13. • Key – this is the name of the object (like a filename) and is used to retrieve the object • Value – Any sequence of bytes you want to store • Version ID • A string generated by Amazon when you add an object to a bucket. • Together the key and version ID uniquely identify an object within a bucket. • Metadata • Name-value pairs to store information about the object • System-meta data – creation data, size, storage class, etc • User metadata – is custom meta data you add to an object • Sub resources - additional info such as acl (owner) or torrent file What makes up an object?
  • 14. • Metadata • https://docs.aws.amazon.com/AmazonS3/latest/dev/UsingMetadata.html • Objects • https://docs.aws.amazon.com/AmazonS3/latest/dev/UsingObjects.html For More Information
  • 15. • Customer and Amazon share responsibility for different parts of security • Customer is responsible for “security in the cloud” • Setting appropriate access controls for your objects and buckets • Control who accesses the AWS Web console, or APIs • Amazon is responsible for “security of the cloud” • Physical security of data centers and global infrastructure What is the Shared Responsibility Model?
  • 16. • AWS infrastructure and services meet numerous compliance standards and regulations (PCI compliance, and others) • S3 supports SSL for encryption in transit, and optionally you can enable encryption at rest • Your data does not leave the region you specify • See the following for detailed info on AWS security and compliance: • https://aws.amazon.com/compliance/programs/ • https://aws.amazon.com/security/ How secure is my data?
  • 17. Storage classes provide a way to select the most cost effective storage for your data based on how frequently it is accessed and how quickly you need to retrieve it. Storage Classes
  • 18. • Standard Storage • best when you need quick access, frequently • Standard Infrequent Access (IA) • Use when you need data returned quickly, but not frequently accessed • Min 128K object size and min storage timeframe of 30 days • One Zone Infrequent Access (IA) • Use when you have another copy or data can be re-created • Cheaper but data is only replicated in one Availability Zone • Glacier • Used for long term archive and backup • Min timeframe 90 days, can take minutes to hours to retrieve Storage Classes
  • 19. Durability and availability For more information see: https://aws.amazon.com/s3/pricing/ For more information see: https://aws.amazon.com/s3/sla/ Standard Standard – IA One Zone - IA Amazon Glacier Designed for durability 99.999999999% 99.999999999% 99.999999999% 99.999999999% Designed for Availability 99.99% 99.9% 99.5% N/A Most expensive per GB stored Least expensive per GB stored Least expensive per request More expensive per request
  • 20. • Data transfer IN to S3 is free • Data transfer OUT costs • Pay for requests (per 1000) • Pay for amount of data stored • Per GB Pricing generally goes down the more data you store • Pricing differs across regions Pricing
  • 21. How to get data into and out of S3? Web console Command line
  • 22. SDKs for most popular languages Ruby C++
  • 23. AWS Import/Export • Request a job in the AWS Console and ship your hard drive to Amazon • They import your data and ship your drive back • Up to 16 Tb per job
  • 24. AWS Snowball – Lots of Data • 50Tb and 80Tb Models • Amazon Ships to you, you copy your data • Data is encrypted on the device • You ship back and Amazon imports your data • Weighs 47 pounds • Size 19.75x12.66x21.5 • ~$200-$300 per job Image source: https://docs.aws.amazon.com/snowball/latest/ug/using-appliance.html
  • 25. AWS Snow Mobile • Exabyte scale transfer service / 100 Petabytes per snowmobile • Dedicated security personal • Video surveillance • GPS Tracking Image source: https://aws.amazon.com/snowmobile
  • 26. • Navigate the S3 dashboard • Create buckets in a selected region • Upload files into buckets • Overwrite files • Move files between buckets • Delete buckets • Download individual objects Managing Data with the AWS Web Console
  • 27. • What are object tags? • A key-value pair • Tags are used for categorizing storage • Use Cases • Use tags to allow a user/group to read/write objects with a tag • Create lifecycle rules to move objects based on a tag to cheaper storage tiers • Use as filters for Analytics and Metrics • Track costs based on tag • For example by project, client, department, etc Object Tags
  • 28. • Max 10 tags on an object • Max 50 tags on a bucket • Keys must be unique • Tag key can contain 128 Unicode characters • Tag value can contain 256 Unicode characters • Key and Values are case sensitive • Texas <> texas Tag Restrictions
  • 29. • Object Metadata is descriptive data describing an object • Consists of name-value pairs • Returned as HTTP headers on objects • Two types of metadata • System metadata • User-defined metadata Object Metadata
  • 30. • Metadata maintained by Amazon S3 • Two types of System Metadata • Metadata where only Amazon S3 can modify the value • Example: Object creation date • Metadata that you can modify • Example: Storage class, versioning, and encryption attributes System Metadata
  • 31. • Custom name-value pairs you can add to your object • Name must begin with “x-amz-meta” • Names are case insensitive User Metadata
  • 32. • Both are name value pairs • Tag keys are case sensitive • Metadata names are case insensitive • Tags are used for categorizing storage to analyze cost or along with permissions for fine grained access control • Metadata properties are returned as HTTP headers • Certain Metadata pairs control how data is stored • Storage class, enabling encryption. Metadata vs. Tags
  • 33. For complete course with hands on exercises please visit: https://www.udemy.com/aws-foundations-amazon-s3- mastery-bootcamp/?couponCode=SLIDESHARE AWS Amazon S3 Mastery Bootcamp