Microsoft Azure
Filipe Prezado
Cloud Solution Architect, Azure
26/11/2015
The cloud platform
built for business
The next strategic opportunity is here
How do you use
technology
innovation…
Mobile Big dataCloud Social
Customer
growth
Embrace
new models
Increased
productivity
Real-time
insights
to architect
business
innovation?
?
Cloud & IT Strategy
SaaS
(Software as
a Service)
Public Cloud Platforms
Physical
Virtual
?
The Azure Platform Strategy
Public, Global, Shared DatacentersMicrosoft Azure Stack
& Cloud Platform System
Security&
Management
SaaS
(Software as a Service)
O365, CRM, VSO etc…
+
3rd Party SaaS Solutions
Public
Cloud
Platform
Hybrid
Operations
Security&
Management
Hybrid
Operations
"Microsoft’s comprehensive hybrid
story, which spans applications and
platforms as well as infrastructure, is
highly attractive to many companies,
drawing them towards the cloud in
general.”
LYDIA LEONG,
GARTNER
Industry
validation
Microsoft Leads Everywhere…
Public Cloud IaaS (May 2015) Cloud Storage (June 2015) Enterprise App PaaS (Jan 2014) Operational DBMS Systems (Oct 2015)X86 Server Virt (July 2015)
Hyper scale Infrastructure is the enabler
27 Regions Worldwide, 22 ONLINE…huge capacity around the world…growing every year
 100+ datacenters
 Top 3 networks in the world
 2.5x AWS, 7x Google DC Regions
 G Series – Largest VM in World, 32 cores, 448GB Ram, SSD…
Operational
Announced/Not Operational
Central US
Iowa
West US
California
East US
Virginia
US Gov
Virginia
North Central US
Illinois
US Gov
Iowa
South Central US
Texas
Brazil South
Sao Paulo State
West Europe
Netherlands
China North *
Beijing
China South *
Shanghai
Japan East
Tokyo, Saitama
Japan West
Osaka
India South
Chennai
East Asia
Hong Kong
SE Asia
Singapore
Australia South East
Victoria
Australia East
New South Wales
* Operated by 21Vianet
India Central
Pune
Canada East
Quebec City
Canada Central
Toronto
India West
Mumbai
Germany North East
Magdeburg
Germany Central
Frankfurt
United Kingdom
Regions
North Europe
Ireland
East US 2
Virginia
ISO/IEC 27001 SOC 1 SOC 2 PCI DSS L1 version 3 Cloud Security Alliance
Cloud Security Matrix
HIPAA
(Healthcare)
FedRAMP FIPS 140-2 Life Sciences GxP Family Educational Rights
& Privacy Act
European Union
Model Clause
China
Multi Layer Protection
Scheme
United Kingdom
G-Cloud
Singapore
Multi-Tier Cloud
Security
China
CCCPPF
Australian Signals
Directorate I-RAP
Assessment
Criminal Justice
Information System
Defense Information
Systems Agency L2
Sarbanes Oxley ITAR Defense Information
Systems Agency L3-5
ISO / IEC 27018
Azure compliance audits and certifications
Global
United
States
Regional
Coming
soon
Applications
Clients
Infrastructure
Management
Databases &
Middleware
App Frameworks
& Tools
DevOps
PaaS &
DevOps
Platform Services
Infrastructure Services
Web Apps
Mobile
Apps
API
Management
API Apps
Logic Apps
Notification
Hubs
Content
Delivery
Network (CDN)
Media
Services
BizTalk
Services
Hybrid
Connections
Service Bus
Storage
Queues
Hybrid
Operations
Backup
StorSimple
Azure Site
Recovery
Import/Export
SQL
Database
DocumentDB
Redis
Cache
Azure
Search
Storage
Tables
Data
Warehouse Azure AD
Health Monitoring
AD Privileged
Identity
Management
Operational
Analytics
Cloud
Services
Batch
RemoteApp
Service
Fabric
Visual Studio
App
Insights
Azure
SDK
VS Online
Domain Services
HDInsight Machine
Learning
Stream
Analytics
Data
Factory
Event
Hubs
Mobile
Engagement
Data
Lake
IoT Hub
Data
Catalog
Security &
Management
Azure Active
Directory
Multi-Factor
Authentication
Automation
Portal
Key Vault
Store/
Marketplace
VM Image Gallery
& VM Depot
Azure AD
B2C
Scheduler
MICROSOFT CONFIDENTIAL
Delivering an enterprise data hub on demand
Time-to-Insight
Scalable Data Management
Efficiency and Cost Savings
Cloudera on Azure
MICROSOFT CONFIDENTIAL
http://www.cloudera.com/content/www/en-us/documentation/other/reference-
architecture/PDF/cloudera_ref_arch_azure.pdf
MICROSOFT CONFIDENTIAL
http://www.cloudera.com/content/www/en-us/documentation/other/reference-
architecture/PDF/cloudera_ref_arch_azure.pdf
MICROSOFT CONFIDENTIAL
Workload Type Typical Services Comments
Low • MRv2 (YARN)
• Hive
• Pig
• Crunch
Suitable for workloads that are
predominantly batch oriented in nature and
involve MapReduce
Medium • Hbase
• Solr
• Impala
• Spark
Suitable for higher resource consuming
services and production workloads but
limited to only one of these running at any
time.
High / Full EDH • All CDH services Full scale production workloads with
multiple services running in parallel on a
multi-tenant cluster.
MICROSOFT CONFIDENTIAL
MICROSOFT CONFIDENTIAL
MICROSOFT CONFIDENTIAL
Demo: Deploy Cloudera from
Azure Marketplace
1 Trillion
Messages delivered every
month with Event Hubs
~100,000
New Azure customer
subscriptions/month
20Million
SQL database hours
used every day
>5Trillion
Storage transactions
every month
60Billion
Hits to Websites run on
Azure Web App Service
425Million
Azure Active
Directory Users
Azure momentum
57%
Of Fortune 500 Companies
use Microsoft Azure
>50Trillion
Storage objects
in Azure
Azure Site Recovery: Protect VMWare and Physical Servers
in Public Preview
Azure Backup Generally Available
Azure API Management Premium simplifies high availability and
massive scale for APIs
ExpressRoute for Office 365
Azure Active Directory Dynamic Membership For Groups
Automatic Password Change for Social Media Shared Accounts
Compute-Intensive A10 and A11 Virtual Machine Instances
Remote Desktop app for Windows Phone support for Gateway
and Remote Resources
Informatica Cloud Agent availability in Linux and Windows Virtual
Machines
Azure DocumentDB Hadoop Connector
Azure HDInsight support for more VM sizes
Enterprise-Grade Array-Based Replication and Disaster Recovery
Integrating Cloudera & Microsoft Azure

Integrating Cloudera & Microsoft Azure

  • 1.
    Microsoft Azure Filipe Prezado CloudSolution Architect, Azure 26/11/2015 The cloud platform built for business
  • 2.
    The next strategicopportunity is here How do you use technology innovation… Mobile Big dataCloud Social Customer growth Embrace new models Increased productivity Real-time insights to architect business innovation? ?
  • 3.
    Cloud & ITStrategy SaaS (Software as a Service) Public Cloud Platforms Physical Virtual ?
  • 4.
    The Azure PlatformStrategy Public, Global, Shared DatacentersMicrosoft Azure Stack & Cloud Platform System Security& Management SaaS (Software as a Service) O365, CRM, VSO etc… + 3rd Party SaaS Solutions Public Cloud Platform Hybrid Operations Security& Management Hybrid Operations
  • 5.
    "Microsoft’s comprehensive hybrid story,which spans applications and platforms as well as infrastructure, is highly attractive to many companies, drawing them towards the cloud in general.” LYDIA LEONG, GARTNER Industry validation Microsoft Leads Everywhere… Public Cloud IaaS (May 2015) Cloud Storage (June 2015) Enterprise App PaaS (Jan 2014) Operational DBMS Systems (Oct 2015)X86 Server Virt (July 2015)
  • 6.
    Hyper scale Infrastructureis the enabler 27 Regions Worldwide, 22 ONLINE…huge capacity around the world…growing every year  100+ datacenters  Top 3 networks in the world  2.5x AWS, 7x Google DC Regions  G Series – Largest VM in World, 32 cores, 448GB Ram, SSD… Operational Announced/Not Operational Central US Iowa West US California East US Virginia US Gov Virginia North Central US Illinois US Gov Iowa South Central US Texas Brazil South Sao Paulo State West Europe Netherlands China North * Beijing China South * Shanghai Japan East Tokyo, Saitama Japan West Osaka India South Chennai East Asia Hong Kong SE Asia Singapore Australia South East Victoria Australia East New South Wales * Operated by 21Vianet India Central Pune Canada East Quebec City Canada Central Toronto India West Mumbai Germany North East Magdeburg Germany Central Frankfurt United Kingdom Regions North Europe Ireland East US 2 Virginia
  • 7.
    ISO/IEC 27001 SOC1 SOC 2 PCI DSS L1 version 3 Cloud Security Alliance Cloud Security Matrix HIPAA (Healthcare) FedRAMP FIPS 140-2 Life Sciences GxP Family Educational Rights & Privacy Act European Union Model Clause China Multi Layer Protection Scheme United Kingdom G-Cloud Singapore Multi-Tier Cloud Security China CCCPPF Australian Signals Directorate I-RAP Assessment Criminal Justice Information System Defense Information Systems Agency L2 Sarbanes Oxley ITAR Defense Information Systems Agency L3-5 ISO / IEC 27018 Azure compliance audits and certifications Global United States Regional Coming soon
  • 8.
  • 9.
    Platform Services Infrastructure Services WebApps Mobile Apps API Management API Apps Logic Apps Notification Hubs Content Delivery Network (CDN) Media Services BizTalk Services Hybrid Connections Service Bus Storage Queues Hybrid Operations Backup StorSimple Azure Site Recovery Import/Export SQL Database DocumentDB Redis Cache Azure Search Storage Tables Data Warehouse Azure AD Health Monitoring AD Privileged Identity Management Operational Analytics Cloud Services Batch RemoteApp Service Fabric Visual Studio App Insights Azure SDK VS Online Domain Services HDInsight Machine Learning Stream Analytics Data Factory Event Hubs Mobile Engagement Data Lake IoT Hub Data Catalog Security & Management Azure Active Directory Multi-Factor Authentication Automation Portal Key Vault Store/ Marketplace VM Image Gallery & VM Depot Azure AD B2C Scheduler
  • 10.
    MICROSOFT CONFIDENTIAL Delivering anenterprise data hub on demand Time-to-Insight Scalable Data Management Efficiency and Cost Savings Cloudera on Azure
  • 11.
  • 12.
  • 13.
    MICROSOFT CONFIDENTIAL Workload TypeTypical Services Comments Low • MRv2 (YARN) • Hive • Pig • Crunch Suitable for workloads that are predominantly batch oriented in nature and involve MapReduce Medium • Hbase • Solr • Impala • Spark Suitable for higher resource consuming services and production workloads but limited to only one of these running at any time. High / Full EDH • All CDH services Full scale production workloads with multiple services running in parallel on a multi-tenant cluster.
  • 14.
  • 15.
  • 16.
    MICROSOFT CONFIDENTIAL Demo: DeployCloudera from Azure Marketplace
  • 17.
    1 Trillion Messages deliveredevery month with Event Hubs ~100,000 New Azure customer subscriptions/month 20Million SQL database hours used every day >5Trillion Storage transactions every month 60Billion Hits to Websites run on Azure Web App Service 425Million Azure Active Directory Users Azure momentum 57% Of Fortune 500 Companies use Microsoft Azure >50Trillion Storage objects in Azure
  • 18.
    Azure Site Recovery:Protect VMWare and Physical Servers in Public Preview Azure Backup Generally Available Azure API Management Premium simplifies high availability and massive scale for APIs ExpressRoute for Office 365 Azure Active Directory Dynamic Membership For Groups Automatic Password Change for Social Media Shared Accounts Compute-Intensive A10 and A11 Virtual Machine Instances Remote Desktop app for Windows Phone support for Gateway and Remote Resources Informatica Cloud Agent availability in Linux and Windows Virtual Machines Azure DocumentDB Hadoop Connector Azure HDInsight support for more VM sizes Enterprise-Grade Array-Based Replication and Disaster Recovery