Amazon web service
EC2 & S3 Overview
EC2
EC2 is an instance that is used for all compute work inside AWS.
It can be used as:
● Separate virtual machine with OS
● Load Balancer
● Part of RDC and other clusters
● etc
AMI
Operation System + Software = Amazon Machine Image
● Used for app scaling purposes
● Migration between regions and AZ
EC2 instances types
● General purpose
● Compute optimized
● Memory optimized
● Storage optimized
Storage
● Elastic Block Storage (EBS)
● Instance Store
● Elastic File System (EFS)
● Simple Storage Service (S3)
Instance Store
Instance store provides temporary block-level storage for your
instance.
Instance store is ideal for temporary storage of information that changes frequently, such as
buffers, caches, scratch data, and other temporary content, or for data that is replicated across a
fleet of instances, such as a load-balanced pool of web servers.
The data in an instance store persists only during the lifetime of its associated instance. If an
instance reboots (intentionally or unintentionally), data in the instance store persists. However, data
in the instance store is lost under the following circumstances:
● The underlying disk drive fails
● The instance stops
Elastic Block Store
EC2
EBS
Elastic Block Store
● EBS volumes are highly available and reliable storage volumes that can be
attached to any running instance that is in the same Availability Zone.
● Encryption available (temp EC2 store -> EBS)
● Volumes are up to 16TiB
● Types:
○ General purpose SSD (3 IOPS/GiB; up to 10,000 IOPS and 160 MB/s of throughput)
○ Provisioned IOPS SSD (up to 20,000 IOPS and 320 MB/s of throughput)
○ Throughput Optimized HDD (throughput of up to 500 MiB/s,)
Elastic File System
Amazon EFS provides scalable file storage for use with
Amazon EC2.
Main feature is to easily customize file system for multiple
instances.
VPC
INTERNET
AWS
VPC
VPC
VPC - logically isolated cloud section in AWS.
Features:
● All instances launches inside VPC
● Separation for public and private networks
● Ability to connect to private network via VPN
● Using S3 locally
SUBNET SUBNET
EC2 EC2 EC2 EC2
10.0.0.1 10.0.0.2 10.0.1.1 10.0.1.2
VPC
Network Access Control List
Routing Table
Network Access Control List
Routing Table
Public
Subnet
EC2 EC2
EC2
10.0.0.1 10.0.0.2
VPC
NAT
Gateway
S3
Simple Storage Service - service for storing files.
S3 stores files in any region you specify.
Maximum object size by single upload 5 Terabytes
S3
FILE
Metadata
Object
File type
Modified date
*.*
for example:
*.jpg; *.png; *.js;
Object Object Object
Object Object Object
Bucket
Bucket features
● Bucket names should be unique through all AWS
● Bucket name is used to generate link to get access from browser or app
● Cross-region replication (copy to only one other region)
Uploading to S3
Console
small number of file
uploading
CLI
recursive directory
uploading
SDK
Dynamic in Code
uploading
CORS
Amazon re:Invent 2016
Amazon re:Invent 2016
During 2016 have already
been launched or will have
been launched soon ~1000
new services
Amazon re:Invent 2016
Computing:
● New Instances:
○ R4 - up to 64 vCPUs and 488 GiB of memory
○ t2.xlarge (16 Gib of memory) and t2.2xlarge(32 Gib of memory)
○ F1 - give you access to FPGA. You can write code that runs on the FPGA and speeds up
many types of genomics, seismic analysis, financial risk analysis, big data search, and
encryption algorithms by up to 30 times
○ New C5 Instances - Intel’s brand new Xeon “Skylake” processor (up to 72 vCPUs and 144
GiB of memory.)
● Elastic GPUs - EC2 instance types, with your choice of 1 GiB to 8 GiB of GPU memory and
compute power to match.
Amazon Elastic Beanstalk manages
● EC2 instance prefered
● S3 connection
● SNS, Alarms
● Load Balancing
● Auto Scaling
● Application Health Monitoring
You just need to:
Amazon re:Invent 2016
Amazon
LightSail
Amazon re:Invent 2016
Amazon Athena - a new serverless query service that makes it easy to
analyze large amounts of data stored in Amazon S3 using Standard SQL.
Features:
● You pay only for the queries that you run.
● Behind the scenes, Athena parallelizes your query, spreads it out across hundreds or
thousands of cores, and delivers results in seconds
● Queries are expressed in standard ANSI SQL and can use JOINs, window functions, and other
advanced features
● Can query data in many different formats including JSON, CSV, log files, text with custom
delimiters, Apache Parquet, and Apache ORC.
Amazon re:Invent 2016
Amazon Aurora Update – PostgreSQL Compatibility
Amazon Aurora – Cost-Effective MySQL-Compatible Database Engine for
Amazon RDS
Amazon re:Invent 2016
Other innovations:
● AWS Snowmobile (Data transferring)
● AWS Greengrass (IoT)
● AI & Machine Learning:
○ Amazon Polly – Text to speech (47 Voices and 24 Languages)
○ Amazon Recognition – Image Detection and Recognition Powered by Deep Learning
○ Amazon Lex – Automatic Speech Recognition

Amazon Web Services lection 2

  • 1.
  • 2.
    EC2 EC2 is aninstance that is used for all compute work inside AWS. It can be used as: ● Separate virtual machine with OS ● Load Balancer ● Part of RDC and other clusters ● etc
  • 3.
    AMI Operation System +Software = Amazon Machine Image ● Used for app scaling purposes ● Migration between regions and AZ
  • 4.
    EC2 instances types ●General purpose ● Compute optimized ● Memory optimized ● Storage optimized
  • 5.
    Storage ● Elastic BlockStorage (EBS) ● Instance Store ● Elastic File System (EFS) ● Simple Storage Service (S3)
  • 6.
    Instance Store Instance storeprovides temporary block-level storage for your instance. Instance store is ideal for temporary storage of information that changes frequently, such as buffers, caches, scratch data, and other temporary content, or for data that is replicated across a fleet of instances, such as a load-balanced pool of web servers. The data in an instance store persists only during the lifetime of its associated instance. If an instance reboots (intentionally or unintentionally), data in the instance store persists. However, data in the instance store is lost under the following circumstances: ● The underlying disk drive fails ● The instance stops
  • 7.
  • 8.
    Elastic Block Store ●EBS volumes are highly available and reliable storage volumes that can be attached to any running instance that is in the same Availability Zone. ● Encryption available (temp EC2 store -> EBS) ● Volumes are up to 16TiB ● Types: ○ General purpose SSD (3 IOPS/GiB; up to 10,000 IOPS and 160 MB/s of throughput) ○ Provisioned IOPS SSD (up to 20,000 IOPS and 320 MB/s of throughput) ○ Throughput Optimized HDD (throughput of up to 500 MiB/s,)
  • 9.
    Elastic File System AmazonEFS provides scalable file storage for use with Amazon EC2. Main feature is to easily customize file system for multiple instances.
  • 10.
  • 11.
    VPC VPC - logicallyisolated cloud section in AWS. Features: ● All instances launches inside VPC ● Separation for public and private networks ● Ability to connect to private network via VPN ● Using S3 locally
  • 12.
    SUBNET SUBNET EC2 EC2EC2 EC2 10.0.0.1 10.0.0.2 10.0.1.1 10.0.1.2 VPC Network Access Control List Routing Table Network Access Control List Routing Table
  • 13.
  • 14.
    S3 Simple Storage Service- service for storing files. S3 stores files in any region you specify. Maximum object size by single upload 5 Terabytes
  • 15.
  • 16.
    Object Object Object ObjectObject Object Bucket
  • 17.
    Bucket features ● Bucketnames should be unique through all AWS ● Bucket name is used to generate link to get access from browser or app ● Cross-region replication (copy to only one other region)
  • 18.
    Uploading to S3 Console smallnumber of file uploading CLI recursive directory uploading SDK Dynamic in Code uploading
  • 19.
  • 20.
  • 21.
    Amazon re:Invent 2016 During2016 have already been launched or will have been launched soon ~1000 new services
  • 22.
    Amazon re:Invent 2016 Computing: ●New Instances: ○ R4 - up to 64 vCPUs and 488 GiB of memory ○ t2.xlarge (16 Gib of memory) and t2.2xlarge(32 Gib of memory) ○ F1 - give you access to FPGA. You can write code that runs on the FPGA and speeds up many types of genomics, seismic analysis, financial risk analysis, big data search, and encryption algorithms by up to 30 times ○ New C5 Instances - Intel’s brand new Xeon “Skylake” processor (up to 72 vCPUs and 144 GiB of memory.) ● Elastic GPUs - EC2 instance types, with your choice of 1 GiB to 8 GiB of GPU memory and compute power to match.
  • 24.
    Amazon Elastic Beanstalkmanages ● EC2 instance prefered ● S3 connection ● SNS, Alarms ● Load Balancing ● Auto Scaling ● Application Health Monitoring You just need to:
  • 25.
  • 26.
    Amazon re:Invent 2016 AmazonAthena - a new serverless query service that makes it easy to analyze large amounts of data stored in Amazon S3 using Standard SQL. Features: ● You pay only for the queries that you run. ● Behind the scenes, Athena parallelizes your query, spreads it out across hundreds or thousands of cores, and delivers results in seconds ● Queries are expressed in standard ANSI SQL and can use JOINs, window functions, and other advanced features ● Can query data in many different formats including JSON, CSV, log files, text with custom delimiters, Apache Parquet, and Apache ORC.
  • 27.
    Amazon re:Invent 2016 AmazonAurora Update – PostgreSQL Compatibility Amazon Aurora – Cost-Effective MySQL-Compatible Database Engine for Amazon RDS
  • 28.
    Amazon re:Invent 2016 Otherinnovations: ● AWS Snowmobile (Data transferring) ● AWS Greengrass (IoT) ● AI & Machine Learning: ○ Amazon Polly – Text to speech (47 Voices and 24 Languages) ○ Amazon Recognition – Image Detection and Recognition Powered by Deep Learning ○ Amazon Lex – Automatic Speech Recognition

Editor's Notes

  • #9 Amazon EBS is recommended when data must be quickly accessible and requires long-term persistence
  • #28 The feedback that we have received from our customers since then has been heart-warming. Customers love the MySQL compatibility, the focus on high availability, and the built-in encryption. They count on the fact that Aurora is built around fault-tolerant, self-healing storage that allows them to scale from 10 GB all the way up to 64 TB without pre-provisioning. They know that Aurora makes six copies of their data across three Availability Zones and backs it up to Amazon Simple Storage Service (S3) without impacting performance or availability. As they scale, they know that they can create up to 15 low-latency read replicas that draw from common storage. To learn more about how our customers are using Aurora in world-scale production environments, take some time to read our Amazon Aurora Testimonials.