07/06/2019 Big Data class by Alexandre Bergere 1
Cloud Architecture
07/06/2019 Big Data class by Alexandre Bergere 2
alexandre.bergere@gmail.com
https://fr.linkedin.com/in/alexandrebergere
@AlexPhile
ESAIP
2013 - 2016
Avanade
2016 - 2019
Sr Anls, Data EngineeringStudent
Worked as a senior analyst at Avanade
France, I have developed my skills in data
analysis (MSBI, Power BI, R, Python) by
working on innovative projects and proofs of
concept in the energy industry.
ESAIP
Teacher
2016 - x
Freelance
2019 - x
Data Analyst & Data Architect
07/06/2019 Big Data class by Alexandre Bergere 3
What is Cloud Computing?
Cloud computing is the on-demand delivery of compute power,
database storage, applications, and other IT resources through
a cloud services platform via the internet with pay-as-you-go
pricing.
https://aws.amazon.com/what-is-cloud-computing/?nc1=h_ls
07/06/2019 Big Data class by Alexandre Bergere 4
Cloud Computing Models
IaaS: cloud-based services, pay-as-you-go for services such as
storage, networking, and virtualization.
PaaS: hardware and software tools available over the
internet.
SaaS: software that’s available via a third-party over the
internet
07/06/2019 Big Data class by Alexandre Bergere 5
Why cloud computing
o Pay only for the amount you consume (stop guessing capacity)
o Increase speed and agility (minutes to waiting ressources)
o Stop spending money on running and maintening data centers
o Go global in minutes
Market leader
07/06/2019 Big Data class by Alexandre Bergere 6
Market leader
07/06/2019 Big Data class by Alexandre Bergere 7
07/06/2019 Big Data class by Alexandre Bergere 8
Choose your location
07/06/2019 Big Data class by Alexandre Bergere 9
Avaibility zones
07/06/2019 Big Data class by Alexandre Bergere 10
Interact with AWS
07/06/2019 Big Data class by Alexandre Bergere 11
Interact with AWS
07/06/2019 Big Data class by Alexandre Bergere 12
07/06/2019 Big Data class by Alexandre Bergere 13
AWS Services
The 5 Pillars of the AWS Well-Architected Framework
07/06/2019 Big Data class by Alexandre Bergere 14
Operational
excellence
The ability to run and
monitor systems to
deliver business value
and to continually
improve supporting
processes and
procedures
he security pillar
includes the ability to
protect information,
systems, and assets
while delivering
business value through
risk assessments and
mitigation strategies.
The reliability pillar
includes the ability of a
system to recover from
infrastructure or service
disruptions,
dynamically acquire
computing resources to
meet demand, and
mitigate disruptions
The performance
efficiency pillar includes
the ability to use
computing resources
efficiently to meet
system requirements
and to maintain that
efficiency as demand
changes and
technologies evolve.
The cost optimization
pillar includes the
ability to avoid or
eliminate unneeded
cost or suboptimal
resources.
Security Reliability
Performance
Efficiency
Cost
Optimization
AWS Foundation Services
07/06/2019 Big Data class by Alexandre Bergere 15
Storage
07/06/2019 Big Data class by Alexandre Bergere 16
AWS S3
Storage
07/06/2019 Big Data class by Alexandre Bergere 17
o A block storage
o You need an EC2 instance to
attach it to
Amazon Block Storage
(Amazon EBS)
Amazon Simple Storage Services
(Amazon S3)
Amazon S3 Glacier
o An object store
o Great for storing logs
Amazon Elastic File System
(Amazon EFS)
o Long term archive storage
o Extremely cheap to store
o Potentially very expensive to
retrieve
o Takes up to 4 hours to "read
back" your data
o Network filesystem
o expensive compared to EBS
Compute
07/06/2019 Big Data class by Alexandre Bergere 18
Amazon EC2
(Amazon Elastic Compute Cloud)
AWS Lambda
web service that provides secure,
resizable compute capacity in the
cloud. It is designed to make web-
scale cloud computing easier for
developers.
AWS Lambda lets you run code
without provisioning or managing
servers. You pay only for the compute
time you consume - there is no charge
when your code is not running.
Network - Security
07/06/2019 Big Data class by Alexandre Bergere 19
Amazon CloudFront
CDN
Amazon Route 53
DNS
Amazon CloudFront is a fast content
delivery network (CDN) service that
securely delivers data, videos,
applications, and APIs to customers
globally with low latency, high transfer
speeds, all within a developer-friendly
environment.
Amazon Route 53 is a highly available
and scalable cloud Domain Name
System (DNS) web service.
AWS WAF
Firewall
AWS Shield
DDOS
AWS WAF is a web application firewall
that helps protect your web
applications from common web
exploits that could affect application
availability, compromise security, or
consume excessive resources.
AWS Shield is a managed Distributed
Denial of Service (DDoS) protection
service that safeguards applications
running on AWS.
AWS Foundation Services
07/06/2019 Big Data class by Alexandre Bergere 20
Data storage
07/06/2019 Big Data class by Alexandre Bergere 21
Amazon
Quantum
Ledger Database
Amazon
Elasticsearch
Service
Amazon RDS Amazon
DynamoDB
Relational
Key-value
Document
Amazon
DocumentDB
Document
Amazon
ElastiCache
In Memory Graph Time-series LedgerSearch
Amazon
Neptune
Amazon
Timestream
Amazon Aurora
Analytics
07/06/2019 Big Data class by Alexandre Bergere 22
Amazon Redshift
Datawarehouse
Amazon Athena
Data discovery
Amazon EMR
Data Analytics
Amazon Kinesis
Stream
Management Tool
07/06/2019 Big Data class by Alexandre Bergere 23
AWS Cloud​Formation
Firewall
Amazon CloudWatch
Monitoring
AWS CloudFormation provides a
common language for you to describe
and provision all the infrastructure
resources in your cloud environment.
Amazon CloudWatch is a monitoring
and management service built for
developers, system operators, site
reliability engineers (SRE), and IT
managers.
Web
07/06/2019 Big Data class by Alexandre Bergere 24
Amazon API Gateway
APIs at any scale
Amazon Cognito
Authentification
Amazon API Gateway is a fully
managed service that makes it easy
for developers to create, publish,
maintain, monitor, and secure APIs at
any scale.
Amazon Cognito lets you add user
sign-up, sign-in, and access control to
your web and mobile apps quickly and
easily.
AWS Amplify
build mobile and web apps that
scale
Amazon SQS
(Simple Queue Service)
Microservice
AWS Amplify makes it easy to create,
configure, and implement scalable
mobile and web apps powered by
AWS.
Amazon Simple Queue Service (SQS) is
a fully managed message queuing
service that enables you to decouple
and scale microservices, distributed
systems, and serverless applications.
07/06/2019 Big Data class by Alexandre Bergere 25
Ressources
AWS – Architecture blog
07/06/2019 Big Data class by Alexandre Bergere 26
Getting start on AWS
07/06/2019 Big Data class by Alexandre Bergere 27
AWS - training
07/06/2019 Big Data class by Alexandre Bergere 28
AWS - certifications
07/06/2019 Big Data class by Alexandre Bergere 29
07/06/2019 Big Data class by Alexandre Bergere 30
Event
AWS – Architecture blog
07/06/2019 Big Data class by Alexandre Bergere 31
Bordeaux
Côte d’Azur
Grenoble
Lille
Lyon
Montpellier
Nantes
Paris
Rennes
Rouen
Toulouse
07/06/2019 Big Data class by Alexandre Bergere 32
AWS account
07/06/2019 Big Data class by Alexandre Bergere 33
Choose your location
07/06/2019 Big Data class by Alexandre Bergere 34
07/06/2019 Big Data class by Alexandre Bergere 35
Azure Services
Networking
07/06/2019 Big Data class by Alexandre Bergere 36
Native firewalling capabilities with
built-in high availability,
unrestricted cloud scalability, and
zero maintenance
Azure Firewall
Protect your applications from
Distributed Denial of Service
(DDoS) attacks
Azure DDoS Protection
Establish secure, cross-premises
connectivity
VPN Gateway
Host your DNS domain in Azure
Azure DNS
Dedicated private network fiber
connections to Azure
ExpressRoute
Compute
07/06/2019 Big Data class by Alexandre Bergere 37
Provision Windows and Linux
virtual machines in seconds
Virtual Machines
Provision virtual machines for
Ubuntu, Red Hat, and more
Linux Virtual Machines
Simplify the deployment,
management, and operations of
Kubernetes
Azure Kubernetes Service (AKS)
Process events with serverless
code
Azure Functions
Databases
07/06/2019 Big Data class by Alexandre Bergere 38
Managed relational SQL Database
as a service
Azure SQL Database
Globally distributed, multi-model
database for any scale
Azure Cosmos DB
NoSQL key-value store using semi-
structured datasets
Table Storage
Managed MySQL database service
for app developers
Azure Database for MySQL
Simplify on-premises database
migration to the cloud
Azure Database Migration Service
Analytics
07/06/2019 Big Data class by Alexandre Bergere 39
Fast, easy, and collaborative
Apache Spark-based analytics
platform
Azure Databricks
Real-time data stream processing
from millions of IoT devices
Azure Stream Analytics
Hybrid data integration at
enterprise scale, made easy
Data Factory
Enterprise-grade analytics engine
as a service
Azure Analysis Services
Elastic data warehouse as a service
with enterprise-class features
SQL Data Warehouse
Storage
07/06/2019 Big Data class by Alexandre Bergere 40
REST-based object storage for
unstructured data
Blob Storage
Simplify data protection and
protect against ransomware
Azure Backup
Massively scalable, secure data
lake functionality built on Azure
Blob Storage
Azure Data Lake Storage
Internet of Things
07/06/2019 Big Data class by Alexandre Bergere 41
Connect, monitor and manage
billions of IoT assets
Azure IoT Hub
Explore and analyze time-series
data from IoT devices
Azure Time Series Insights
Receive telemetry from millions of
devices
Event Hubs
Web
07/06/2019 Big Data class by Alexandre Bergere 42
Automate business processes
Logic Apps
Quickly create and deploy mission
critical web apps at scale
Web Apps
Build mobile apps for any device
Mobile Apps
07/06/2019 Big Data class by Alexandre Bergere 43
Ressources
Azure - training
07/06/2019 Big Data class by Alexandre Bergere 44
Azure – cloud workshop
07/06/2019 Big Data class by Alexandre Bergere 45
Microsoft – Hands-on Labs
07/06/2019 Big Data class by Alexandre Bergere 46
Azure - certifications
07/06/2019 Big Data class by Alexandre Bergere 47
07/06/2019 Big Data class by Alexandre Bergere 48
Azure account
UPDATED DATA SERVICES COMPARISON: AWS VS. AZURE
07/06/2019 Big Data class by Alexandre Bergere 49
https://thomaslarock.com/2019/05/updated-data-services-comparison-aws-vs-azure/?utm_source=feedburner&utm_medium=feed&utm_campaign=Feed%3A+SQLRockstar+%28SQLRockstar%29
UPDATED ANALYTICS AND BIG DATA COMPARISON: AWS
VS. AZURE
07/06/2019 Big Data class by Alexandre Bergere 50
https://thomaslarock.com/2019/05/updated-analytics-and-big-data-comparison-aws-vs-azure/?utm_source=feedburner&utm_medium=feed&utm_campaign=Feed%3A+SQLRockstar+%28SQLRockstar%29

Cloud architecture - Azure - AWS

  • 1.
    07/06/2019 Big Dataclass by Alexandre Bergere 1 Cloud Architecture
  • 2.
    07/06/2019 Big Dataclass by Alexandre Bergere 2 alexandre.bergere@gmail.com https://fr.linkedin.com/in/alexandrebergere @AlexPhile ESAIP 2013 - 2016 Avanade 2016 - 2019 Sr Anls, Data EngineeringStudent Worked as a senior analyst at Avanade France, I have developed my skills in data analysis (MSBI, Power BI, R, Python) by working on innovative projects and proofs of concept in the energy industry. ESAIP Teacher 2016 - x Freelance 2019 - x Data Analyst & Data Architect
  • 3.
    07/06/2019 Big Dataclass by Alexandre Bergere 3 What is Cloud Computing? Cloud computing is the on-demand delivery of compute power, database storage, applications, and other IT resources through a cloud services platform via the internet with pay-as-you-go pricing. https://aws.amazon.com/what-is-cloud-computing/?nc1=h_ls
  • 4.
    07/06/2019 Big Dataclass by Alexandre Bergere 4 Cloud Computing Models IaaS: cloud-based services, pay-as-you-go for services such as storage, networking, and virtualization. PaaS: hardware and software tools available over the internet. SaaS: software that’s available via a third-party over the internet
  • 5.
    07/06/2019 Big Dataclass by Alexandre Bergere 5 Why cloud computing o Pay only for the amount you consume (stop guessing capacity) o Increase speed and agility (minutes to waiting ressources) o Stop spending money on running and maintening data centers o Go global in minutes
  • 6.
    Market leader 07/06/2019 BigData class by Alexandre Bergere 6
  • 7.
    Market leader 07/06/2019 BigData class by Alexandre Bergere 7
  • 8.
    07/06/2019 Big Dataclass by Alexandre Bergere 8
  • 9.
    Choose your location 07/06/2019Big Data class by Alexandre Bergere 9
  • 10.
    Avaibility zones 07/06/2019 BigData class by Alexandre Bergere 10
  • 11.
    Interact with AWS 07/06/2019Big Data class by Alexandre Bergere 11
  • 12.
    Interact with AWS 07/06/2019Big Data class by Alexandre Bergere 12
  • 13.
    07/06/2019 Big Dataclass by Alexandre Bergere 13 AWS Services
  • 14.
    The 5 Pillarsof the AWS Well-Architected Framework 07/06/2019 Big Data class by Alexandre Bergere 14 Operational excellence The ability to run and monitor systems to deliver business value and to continually improve supporting processes and procedures he security pillar includes the ability to protect information, systems, and assets while delivering business value through risk assessments and mitigation strategies. The reliability pillar includes the ability of a system to recover from infrastructure or service disruptions, dynamically acquire computing resources to meet demand, and mitigate disruptions The performance efficiency pillar includes the ability to use computing resources efficiently to meet system requirements and to maintain that efficiency as demand changes and technologies evolve. The cost optimization pillar includes the ability to avoid or eliminate unneeded cost or suboptimal resources. Security Reliability Performance Efficiency Cost Optimization
  • 15.
    AWS Foundation Services 07/06/2019Big Data class by Alexandre Bergere 15
  • 16.
    Storage 07/06/2019 Big Dataclass by Alexandre Bergere 16 AWS S3
  • 17.
    Storage 07/06/2019 Big Dataclass by Alexandre Bergere 17 o A block storage o You need an EC2 instance to attach it to Amazon Block Storage (Amazon EBS) Amazon Simple Storage Services (Amazon S3) Amazon S3 Glacier o An object store o Great for storing logs Amazon Elastic File System (Amazon EFS) o Long term archive storage o Extremely cheap to store o Potentially very expensive to retrieve o Takes up to 4 hours to "read back" your data o Network filesystem o expensive compared to EBS
  • 18.
    Compute 07/06/2019 Big Dataclass by Alexandre Bergere 18 Amazon EC2 (Amazon Elastic Compute Cloud) AWS Lambda web service that provides secure, resizable compute capacity in the cloud. It is designed to make web- scale cloud computing easier for developers. AWS Lambda lets you run code without provisioning or managing servers. You pay only for the compute time you consume - there is no charge when your code is not running.
  • 19.
    Network - Security 07/06/2019Big Data class by Alexandre Bergere 19 Amazon CloudFront CDN Amazon Route 53 DNS Amazon CloudFront is a fast content delivery network (CDN) service that securely delivers data, videos, applications, and APIs to customers globally with low latency, high transfer speeds, all within a developer-friendly environment. Amazon Route 53 is a highly available and scalable cloud Domain Name System (DNS) web service. AWS WAF Firewall AWS Shield DDOS AWS WAF is a web application firewall that helps protect your web applications from common web exploits that could affect application availability, compromise security, or consume excessive resources. AWS Shield is a managed Distributed Denial of Service (DDoS) protection service that safeguards applications running on AWS.
  • 20.
    AWS Foundation Services 07/06/2019Big Data class by Alexandre Bergere 20
  • 21.
    Data storage 07/06/2019 BigData class by Alexandre Bergere 21 Amazon Quantum Ledger Database Amazon Elasticsearch Service Amazon RDS Amazon DynamoDB Relational Key-value Document Amazon DocumentDB Document Amazon ElastiCache In Memory Graph Time-series LedgerSearch Amazon Neptune Amazon Timestream Amazon Aurora
  • 22.
    Analytics 07/06/2019 Big Dataclass by Alexandre Bergere 22 Amazon Redshift Datawarehouse Amazon Athena Data discovery Amazon EMR Data Analytics Amazon Kinesis Stream
  • 23.
    Management Tool 07/06/2019 BigData class by Alexandre Bergere 23 AWS Cloud​Formation Firewall Amazon CloudWatch Monitoring AWS CloudFormation provides a common language for you to describe and provision all the infrastructure resources in your cloud environment. Amazon CloudWatch is a monitoring and management service built for developers, system operators, site reliability engineers (SRE), and IT managers.
  • 24.
    Web 07/06/2019 Big Dataclass by Alexandre Bergere 24 Amazon API Gateway APIs at any scale Amazon Cognito Authentification Amazon API Gateway is a fully managed service that makes it easy for developers to create, publish, maintain, monitor, and secure APIs at any scale. Amazon Cognito lets you add user sign-up, sign-in, and access control to your web and mobile apps quickly and easily. AWS Amplify build mobile and web apps that scale Amazon SQS (Simple Queue Service) Microservice AWS Amplify makes it easy to create, configure, and implement scalable mobile and web apps powered by AWS. Amazon Simple Queue Service (SQS) is a fully managed message queuing service that enables you to decouple and scale microservices, distributed systems, and serverless applications.
  • 25.
    07/06/2019 Big Dataclass by Alexandre Bergere 25 Ressources
  • 26.
    AWS – Architectureblog 07/06/2019 Big Data class by Alexandre Bergere 26
  • 27.
    Getting start onAWS 07/06/2019 Big Data class by Alexandre Bergere 27
  • 28.
    AWS - training 07/06/2019Big Data class by Alexandre Bergere 28
  • 29.
    AWS - certifications 07/06/2019Big Data class by Alexandre Bergere 29
  • 30.
    07/06/2019 Big Dataclass by Alexandre Bergere 30 Event
  • 31.
    AWS – Architectureblog 07/06/2019 Big Data class by Alexandre Bergere 31 Bordeaux Côte d’Azur Grenoble Lille Lyon Montpellier Nantes Paris Rennes Rouen Toulouse
  • 32.
    07/06/2019 Big Dataclass by Alexandre Bergere 32 AWS account
  • 33.
    07/06/2019 Big Dataclass by Alexandre Bergere 33
  • 34.
    Choose your location 07/06/2019Big Data class by Alexandre Bergere 34
  • 35.
    07/06/2019 Big Dataclass by Alexandre Bergere 35 Azure Services
  • 36.
    Networking 07/06/2019 Big Dataclass by Alexandre Bergere 36 Native firewalling capabilities with built-in high availability, unrestricted cloud scalability, and zero maintenance Azure Firewall Protect your applications from Distributed Denial of Service (DDoS) attacks Azure DDoS Protection Establish secure, cross-premises connectivity VPN Gateway Host your DNS domain in Azure Azure DNS Dedicated private network fiber connections to Azure ExpressRoute
  • 37.
    Compute 07/06/2019 Big Dataclass by Alexandre Bergere 37 Provision Windows and Linux virtual machines in seconds Virtual Machines Provision virtual machines for Ubuntu, Red Hat, and more Linux Virtual Machines Simplify the deployment, management, and operations of Kubernetes Azure Kubernetes Service (AKS) Process events with serverless code Azure Functions
  • 38.
    Databases 07/06/2019 Big Dataclass by Alexandre Bergere 38 Managed relational SQL Database as a service Azure SQL Database Globally distributed, multi-model database for any scale Azure Cosmos DB NoSQL key-value store using semi- structured datasets Table Storage Managed MySQL database service for app developers Azure Database for MySQL Simplify on-premises database migration to the cloud Azure Database Migration Service
  • 39.
    Analytics 07/06/2019 Big Dataclass by Alexandre Bergere 39 Fast, easy, and collaborative Apache Spark-based analytics platform Azure Databricks Real-time data stream processing from millions of IoT devices Azure Stream Analytics Hybrid data integration at enterprise scale, made easy Data Factory Enterprise-grade analytics engine as a service Azure Analysis Services Elastic data warehouse as a service with enterprise-class features SQL Data Warehouse
  • 40.
    Storage 07/06/2019 Big Dataclass by Alexandre Bergere 40 REST-based object storage for unstructured data Blob Storage Simplify data protection and protect against ransomware Azure Backup Massively scalable, secure data lake functionality built on Azure Blob Storage Azure Data Lake Storage
  • 41.
    Internet of Things 07/06/2019Big Data class by Alexandre Bergere 41 Connect, monitor and manage billions of IoT assets Azure IoT Hub Explore and analyze time-series data from IoT devices Azure Time Series Insights Receive telemetry from millions of devices Event Hubs
  • 42.
    Web 07/06/2019 Big Dataclass by Alexandre Bergere 42 Automate business processes Logic Apps Quickly create and deploy mission critical web apps at scale Web Apps Build mobile apps for any device Mobile Apps
  • 43.
    07/06/2019 Big Dataclass by Alexandre Bergere 43 Ressources
  • 44.
    Azure - training 07/06/2019Big Data class by Alexandre Bergere 44
  • 45.
    Azure – cloudworkshop 07/06/2019 Big Data class by Alexandre Bergere 45
  • 46.
    Microsoft – Hands-onLabs 07/06/2019 Big Data class by Alexandre Bergere 46
  • 47.
    Azure - certifications 07/06/2019Big Data class by Alexandre Bergere 47
  • 48.
    07/06/2019 Big Dataclass by Alexandre Bergere 48 Azure account
  • 49.
    UPDATED DATA SERVICESCOMPARISON: AWS VS. AZURE 07/06/2019 Big Data class by Alexandre Bergere 49 https://thomaslarock.com/2019/05/updated-data-services-comparison-aws-vs-azure/?utm_source=feedburner&utm_medium=feed&utm_campaign=Feed%3A+SQLRockstar+%28SQLRockstar%29
  • 50.
    UPDATED ANALYTICS ANDBIG DATA COMPARISON: AWS VS. AZURE 07/06/2019 Big Data class by Alexandre Bergere 50 https://thomaslarock.com/2019/05/updated-analytics-and-big-data-comparison-aws-vs-azure/?utm_source=feedburner&utm_medium=feed&utm_campaign=Feed%3A+SQLRockstar+%28SQLRockstar%29