1© Copyright 2011 EMC Corporation. All rights reserved.
Cloud Meets Big
Data For
VMware
Environments
<Phil King
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
2© Copyright 2011 EMC Corporation. All rights reserved.
Cloud Meets Big Data
• Cloud Architecture And Mission Critical Applications
– Oracle, Microsoft, SAP
• Big Data Impact On IT Infrastructure
– Scale-Out vs. Scale-Up Computing
• VMware = The Core Platform For IT
– Seamless Mobility And Control Across Applications
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
CLOUD COMPUTING
4© Copyright 2011 EMC Corporation. All rights reserved.
Application Environments Historically
Physical Infrastructure Limits Value
Challenges
Limits on Performance
Different
environments
(prod/test/dev)
Physical
silos of
servers and
storage
Multiple
software
versions
Underutilized Hardware
Management Complexity
Complex Recovery
5© Copyright 2011 EMC Corporation. All rights reserved.
Strong Momentum – Virtualizing
Business Critical Applications
38%
53%
43%
25% 25%
18%
42%
67%
47%
34%
28% 28%
0%
10%
20%
30%
40%
50%
60%
70%
80%
Microsoft
Exchange
Microsoft
SharePoint
Microsoft SQL Oracle
Middleware
Oracle DB SAP
2010 2011
% Of Workload Instances Running on VMware
6© Copyright 2011 EMC Corporation. All rights reserved.
Why Virtualize Applications?
Cost Savings And Service Quality Improvement
14%
14%
19%
20%
20%
24%
14%
14%
14%
20%
17%
11%
65%
65%
64%
56%
60%
57%
7%
7%
3%
4%
4%
8%
Oracle enterprise apps
Custom enterprise apps
SQL database
SAP
MS Exchange
Oracle database
Cost savings Service improvement Both Neither
7© Copyright 2011 EMC Corporation. All rights reserved.
Cloud – A New Architecture
Dedicated, Vertical Stacks
Old World – Physical New World – Virtual
Dynamic Pools Of
Compute & Storage
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
8© Copyright 2011 EMC Corporation. All rights reserved.
vSphere
vFabric
vCenter
Virtual Storage Requirements
vSphere
vFabric
vCenter
Flash SATA
Automated Storage Tiering
VMware Integration
Cloud Infrastructure
Dynamic Pools Of
Compute & Storage
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
9© Copyright 2011 EMC Corporation. All rights reserved.
The Performance Gap Challenge
CPU Improves 100 Times Every Decade; HDD Remains Flat
100-times
Improved
10,000-times
Improved
2000 2010 2020
MOORE’S LAW:
100x
PER
DECADE
CPU Continues To Improve
While Disk Drive
Performance Remains Flat
As A Result, Applications Will
Increasingly Suffer Unless
We Rapidly Move To Flash
FLASH
EMC Proven Solution are Powered
by Intel® Xeon® Processor
Technology
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
10© Copyright 2011 EMC Corporation. All rights reserved.
Oracle
server
Static Association Of
Disk Groups To Applications
Based On Best Gues
Exchange
server
SQL
server
MANUAL PROCESS
• FAST Cache continuously ensures
that the hottest data is served from
high performance Flash SSDs
• FAST VP (Virtual Pools)* optimizes
storage pools automatically,
ensuring that active data is being
served from SSDs, while cold data is
moved to lower cost disk
• EMC Proven Solution Results:
– 150% more OLTP TPM
– 3X more users
– 80% faster tuning
– Powered by Intel® Xeon® Processor
Technology
SSD NL-
SAS
SAS
Dynamic, Self-Optimizing
Storage Pools
Based On Actual Data Activity
Oracle Microsoft SAP
100% AUTOMATED
Flash And EMC FAST Automation
FAST Cache & FAST VP
Optimizes Production Application Environments
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
11© Copyright 2011 EMC Corporation. All rights reserved.
EMC VFCache For Virtualized Server
Performance
• Server Flash caching solution that
uses intelligent caching software and
PCIe Flash technology to reduce
latency and increase throughput
• “Hottest” data accessed on the PCIe
card in the server increasing
performance
• EMC Proven Solution Results:
– 200% more TPM
– 60% decrease in latency
– 50% more IO serviced within 1 ms
or less
– Powered by Intel® Xeon® Processor
Technology
VFCache VFCache VFCacheVFCache
Extends EMC FAST To The Server Layer
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
12© Copyright 2011 EMC Corporation. All rights reserved.
Virtualized Production Applications
CLAL Insurance
• Doubled Oracle server
utilization from 15-20%
to nearly 50%
• Increased database
performance and mobility
with VMware
Synopsis
• SAP production
runtime increased
by 9x through FAST
• Database response
efficiency increased
470%
Vanderbilt
• Virtualized SQL Server
• FAST Cache deployed
• 78% of all I/O serviced
by just 1.6% EFD
13© Copyright 2011 EMC Corporation. All rights reserved.
Maximize Application Quality of Service
Capability
Quality of Service
IMPOVE BACKUPS
 Off-load backups to
dedicated storage device
 Maintain use of native
backup management tools
De-Duplication
SIMPLIFY
REPLICATION
 Snaps and clones for
recovery and multi-tasks
 Server failover and
maintenance
 Self-service for DBAs
Storage and Server
Replication
ACCELERATE
RECOVERY
 Protect all application
tiers with one solution
 Recover applications
to any point-in-time
locally or remotely
Application Recovery
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
14© Copyright 2011 EMC Corporation. All rights reserved.
Deduplication Improves Backup
Efficiency
Perform More Full And Incremental Backups With Less Disk
Production
Dedupe &
Compress
EMC Data Domain
DD800 Appliance
• Up to 50% faster backup
– Throughput of up to 26.3 TB/Hour
– Send only de-duped and compressed
data over network
– Ex: 40:1 de-dupe ratio reduces cost
• Improved recoverability
– Instant restore and rollback
– Extended online backup retention
• No changes to backup scripts,
processes or system architectureRemote Site
EMC
Networker
DD Boost
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
15© Copyright 2011 EMC Corporation. All rights reserved.
Simplify Data Replication
• Replicate data in minutes vs.
hours
– Clones for full, consistent recovery
– Snaps for space efficiency
– GUI interface enables DBA control
CloneDB
Snap or
Clone
CloneDB
Clone
• Combined with VMware:
– Move workload within or across virtual
servers transparently
– Provision production or test/dev
servers in minutes vs. hours
– Perform maintenance on servers
without application downtime
Production
Server A Server B
Virtual Server Virtual Server
vMotion
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
16© Copyright 2011 EMC Corporation. All rights reserved.
Virtualized Backup, Recovery,
Deduplication
Washington Trust
• 95% de-duplication of backup
• 10:1 server consolidation
• New database deployment in
<1 hour
Swedbank
• 95% faster deployment of
test and development
• Deployed more Oracle
software on the same host
increases ROI
17© Copyright 2011 EMC Corporation. All rights reserved.
Standardize Visibility And Control
End-to-end visibility and control across
physical and virtual environments
• Analyze SAN topologies and relationships
across your virtual and physical environment
• Monitor impact of FAST policies across all
virtualized application environments
• Monitor alerts and view properties for both
physical and virtual objects
• Track capacity consumption and perform
chargeback reporting
CONTROLCENTER:END-TO-ENDVISIBILITYAND
CONTROL
SAN
VMware ESX Servers
Physical or Virtual Storage
VMware VMware VMware
Symmetrix VNX Third party
EMC Control Center
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
18© Copyright 2011 EMC Corporation. All rights reserved.
EMC Virtual Storage Integrator (VSI) for
VMware vSphere
• VM Administrator Control OF VNX/VNXe
storage
– Create VMFS datastores
(iSCSI, FC, FCoE)
– Create RDM Volumes
(iSCSI, FC, FCoE)
– Create NFS datastores
– Configure FAST-VP Tiering Policies
– Legacy support for Celerra and CLARiiON
• Clone virtual machines (VNX File)
– Provision cloned VMs to VMware View
– Refresh desktops in VMware View
• Compress virtual machines (VNX File)
– Reduce the storage space for VMs through VNX File
Deduplication and Compression
– Uncompress VMs on demand
Celerra
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
19© Copyright 2011 EMC Corporation. All rights reserved.
Big Data
Impact On
Virtual
Infrastructure
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
20© Copyright 2011 EMC Corporation. All rights reserved.
Unstructured Data
New Big Data Applications
Clickstream
Analysis
Genomics
Seismic
Exploration
Movie
Rendering
Social
Graphing
?
Enterprise Applications
VMAX VNX
Structured Data
Cloud InfrastructureCloud Infrastructure
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
21© Copyright 2011 EMC Corporation. All rights reserved.
Big Data In Enterprise Applications
Example Big Data
Sources
• Large Scale Test,
Development
• Large Home Directories
• Unstructured Data
Source: IDC
By 2012, 80% of all
storage capacity sold
will be for file-based
data
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
EMC Proven Solution are Powered
by Intel® Xeon® Processor
Technology
22© Copyright 2011 EMC Corporation. All rights reserved.
Data goes global
23© Copyright 2011 EMC Corporation. All rights reserved.
Pressure from new markets
•5.9 billion mobile subscribers (87% of world) - 30% in China/India
•1.9 billion have smartphones
•1.2 billion use smartphones on the internet
•Forrester predict 2 billion PCs and laptops in use by 2013
•80 million ipads will be sold in 2012, accessing 300k apps
•Other viable devices include thin client terminals, most new internet
enabled TVs, Xboxes and playstations......
Current addressable market driven by c.4bn viable end point devices.
When VMware first launched VDI in 2005, they foresaw 500m viable end-
points by 2010.
24© Copyright 2011 EMC Corporation. All rights reserved.
EMC Isilon.
Record Capacity.
Record Scalability.
Remarkable
Simplicity.EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
25© Copyright 2011 EMC Corporation. All rights reserved.
Isilon Single Volume Simplicity
EMPTYEMPTYEMPTYEMPTYEMPTYFULLFULLFULLFULLBALANC
ED
BALANCE
D
BALANCE
D
BALANC
ED
BALANCE
D
Directories and files striped across nodes
in a single volume
60 sec
Upgrade
Seamless Scale-Out For VMware With Isilon
Uneven Utilization/Complex To
Scale
Many Systems or 2-way clusters
Many File Systems and Volumes
Many Points of Management
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
26© Copyright 2011 EMC Corporation. All rights reserved.
Unstructured Data
Big Data ApplicationsEnterprise Applications
Structured Data
Big Data Storage For Big Data
Applications
VMAX VNX Isilon
Cloud InfrastructureCloud Infrastructure
EMC Proven Solution are Powered
by Intel® Xeon® Processor
Technology
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
27© Copyright 2011 EMC Corporation. All rights reserved.
Enterprise Applications
Next-Generation Cloud Infrastructure
Big Data Applications
vMotion
Fully Automated Storage Tiering (FAST)
Compute
Tier
Storage
Tier
Cloud Infrastructure
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
28© Copyright 2011 EMC Corporation. All rights reserved.
Cloud Meets Big Data
• Cloud Architecture Is Ready For Mission Critical Apps
– More Performance And Easier Management
• Big Data Requires New Approach To Infrastructure
– Isilon = Scale Out Infrastructure Standard For Big Data
• VMware = Platform For Cloud + Big Data
– Seamless Mobility And Control Across Applications
EMC Solutions are Powered by
Intel® Xeon® Processor
Technology
29© Copyright 2011 EMC Corporation. All rights reserved.
THANK
YOU
Presentation   cloud meets big

Presentation cloud meets big

  • 1.
    1© Copyright 2011EMC Corporation. All rights reserved. Cloud Meets Big Data For VMware Environments <Phil King EMC Solutions are Powered by Intel® Xeon® Processor Technology
  • 2.
    2© Copyright 2011EMC Corporation. All rights reserved. Cloud Meets Big Data • Cloud Architecture And Mission Critical Applications – Oracle, Microsoft, SAP • Big Data Impact On IT Infrastructure – Scale-Out vs. Scale-Up Computing • VMware = The Core Platform For IT – Seamless Mobility And Control Across Applications EMC Solutions are Powered by Intel® Xeon® Processor Technology
  • 3.
  • 4.
    4© Copyright 2011EMC Corporation. All rights reserved. Application Environments Historically Physical Infrastructure Limits Value Challenges Limits on Performance Different environments (prod/test/dev) Physical silos of servers and storage Multiple software versions Underutilized Hardware Management Complexity Complex Recovery
  • 5.
    5© Copyright 2011EMC Corporation. All rights reserved. Strong Momentum – Virtualizing Business Critical Applications 38% 53% 43% 25% 25% 18% 42% 67% 47% 34% 28% 28% 0% 10% 20% 30% 40% 50% 60% 70% 80% Microsoft Exchange Microsoft SharePoint Microsoft SQL Oracle Middleware Oracle DB SAP 2010 2011 % Of Workload Instances Running on VMware
  • 6.
    6© Copyright 2011EMC Corporation. All rights reserved. Why Virtualize Applications? Cost Savings And Service Quality Improvement 14% 14% 19% 20% 20% 24% 14% 14% 14% 20% 17% 11% 65% 65% 64% 56% 60% 57% 7% 7% 3% 4% 4% 8% Oracle enterprise apps Custom enterprise apps SQL database SAP MS Exchange Oracle database Cost savings Service improvement Both Neither
  • 7.
    7© Copyright 2011EMC Corporation. All rights reserved. Cloud – A New Architecture Dedicated, Vertical Stacks Old World – Physical New World – Virtual Dynamic Pools Of Compute & Storage EMC Solutions are Powered by Intel® Xeon® Processor Technology
  • 8.
    8© Copyright 2011EMC Corporation. All rights reserved. vSphere vFabric vCenter Virtual Storage Requirements vSphere vFabric vCenter Flash SATA Automated Storage Tiering VMware Integration Cloud Infrastructure Dynamic Pools Of Compute & Storage EMC Solutions are Powered by Intel® Xeon® Processor Technology
  • 9.
    9© Copyright 2011EMC Corporation. All rights reserved. The Performance Gap Challenge CPU Improves 100 Times Every Decade; HDD Remains Flat 100-times Improved 10,000-times Improved 2000 2010 2020 MOORE’S LAW: 100x PER DECADE CPU Continues To Improve While Disk Drive Performance Remains Flat As A Result, Applications Will Increasingly Suffer Unless We Rapidly Move To Flash FLASH EMC Proven Solution are Powered by Intel® Xeon® Processor Technology EMC Solutions are Powered by Intel® Xeon® Processor Technology
  • 10.
    10© Copyright 2011EMC Corporation. All rights reserved. Oracle server Static Association Of Disk Groups To Applications Based On Best Gues Exchange server SQL server MANUAL PROCESS • FAST Cache continuously ensures that the hottest data is served from high performance Flash SSDs • FAST VP (Virtual Pools)* optimizes storage pools automatically, ensuring that active data is being served from SSDs, while cold data is moved to lower cost disk • EMC Proven Solution Results: – 150% more OLTP TPM – 3X more users – 80% faster tuning – Powered by Intel® Xeon® Processor Technology SSD NL- SAS SAS Dynamic, Self-Optimizing Storage Pools Based On Actual Data Activity Oracle Microsoft SAP 100% AUTOMATED Flash And EMC FAST Automation FAST Cache & FAST VP Optimizes Production Application Environments EMC Solutions are Powered by Intel® Xeon® Processor Technology
  • 11.
    11© Copyright 2011EMC Corporation. All rights reserved. EMC VFCache For Virtualized Server Performance • Server Flash caching solution that uses intelligent caching software and PCIe Flash technology to reduce latency and increase throughput • “Hottest” data accessed on the PCIe card in the server increasing performance • EMC Proven Solution Results: – 200% more TPM – 60% decrease in latency – 50% more IO serviced within 1 ms or less – Powered by Intel® Xeon® Processor Technology VFCache VFCache VFCacheVFCache Extends EMC FAST To The Server Layer EMC Solutions are Powered by Intel® Xeon® Processor Technology
  • 12.
    12© Copyright 2011EMC Corporation. All rights reserved. Virtualized Production Applications CLAL Insurance • Doubled Oracle server utilization from 15-20% to nearly 50% • Increased database performance and mobility with VMware Synopsis • SAP production runtime increased by 9x through FAST • Database response efficiency increased 470% Vanderbilt • Virtualized SQL Server • FAST Cache deployed • 78% of all I/O serviced by just 1.6% EFD
  • 13.
    13© Copyright 2011EMC Corporation. All rights reserved. Maximize Application Quality of Service Capability Quality of Service IMPOVE BACKUPS  Off-load backups to dedicated storage device  Maintain use of native backup management tools De-Duplication SIMPLIFY REPLICATION  Snaps and clones for recovery and multi-tasks  Server failover and maintenance  Self-service for DBAs Storage and Server Replication ACCELERATE RECOVERY  Protect all application tiers with one solution  Recover applications to any point-in-time locally or remotely Application Recovery EMC Solutions are Powered by Intel® Xeon® Processor Technology
  • 14.
    14© Copyright 2011EMC Corporation. All rights reserved. Deduplication Improves Backup Efficiency Perform More Full And Incremental Backups With Less Disk Production Dedupe & Compress EMC Data Domain DD800 Appliance • Up to 50% faster backup – Throughput of up to 26.3 TB/Hour – Send only de-duped and compressed data over network – Ex: 40:1 de-dupe ratio reduces cost • Improved recoverability – Instant restore and rollback – Extended online backup retention • No changes to backup scripts, processes or system architectureRemote Site EMC Networker DD Boost EMC Solutions are Powered by Intel® Xeon® Processor Technology
  • 15.
    15© Copyright 2011EMC Corporation. All rights reserved. Simplify Data Replication • Replicate data in minutes vs. hours – Clones for full, consistent recovery – Snaps for space efficiency – GUI interface enables DBA control CloneDB Snap or Clone CloneDB Clone • Combined with VMware: – Move workload within or across virtual servers transparently – Provision production or test/dev servers in minutes vs. hours – Perform maintenance on servers without application downtime Production Server A Server B Virtual Server Virtual Server vMotion EMC Solutions are Powered by Intel® Xeon® Processor Technology
  • 16.
    16© Copyright 2011EMC Corporation. All rights reserved. Virtualized Backup, Recovery, Deduplication Washington Trust • 95% de-duplication of backup • 10:1 server consolidation • New database deployment in <1 hour Swedbank • 95% faster deployment of test and development • Deployed more Oracle software on the same host increases ROI
  • 17.
    17© Copyright 2011EMC Corporation. All rights reserved. Standardize Visibility And Control End-to-end visibility and control across physical and virtual environments • Analyze SAN topologies and relationships across your virtual and physical environment • Monitor impact of FAST policies across all virtualized application environments • Monitor alerts and view properties for both physical and virtual objects • Track capacity consumption and perform chargeback reporting CONTROLCENTER:END-TO-ENDVISIBILITYAND CONTROL SAN VMware ESX Servers Physical or Virtual Storage VMware VMware VMware Symmetrix VNX Third party EMC Control Center EMC Solutions are Powered by Intel® Xeon® Processor Technology
  • 18.
    18© Copyright 2011EMC Corporation. All rights reserved. EMC Virtual Storage Integrator (VSI) for VMware vSphere • VM Administrator Control OF VNX/VNXe storage – Create VMFS datastores (iSCSI, FC, FCoE) – Create RDM Volumes (iSCSI, FC, FCoE) – Create NFS datastores – Configure FAST-VP Tiering Policies – Legacy support for Celerra and CLARiiON • Clone virtual machines (VNX File) – Provision cloned VMs to VMware View – Refresh desktops in VMware View • Compress virtual machines (VNX File) – Reduce the storage space for VMs through VNX File Deduplication and Compression – Uncompress VMs on demand Celerra EMC Solutions are Powered by Intel® Xeon® Processor Technology
  • 19.
    19© Copyright 2011EMC Corporation. All rights reserved. Big Data Impact On Virtual Infrastructure EMC Solutions are Powered by Intel® Xeon® Processor Technology
  • 20.
    20© Copyright 2011EMC Corporation. All rights reserved. Unstructured Data New Big Data Applications Clickstream Analysis Genomics Seismic Exploration Movie Rendering Social Graphing ? Enterprise Applications VMAX VNX Structured Data Cloud InfrastructureCloud Infrastructure EMC Solutions are Powered by Intel® Xeon® Processor Technology
  • 21.
    21© Copyright 2011EMC Corporation. All rights reserved. Big Data In Enterprise Applications Example Big Data Sources • Large Scale Test, Development • Large Home Directories • Unstructured Data Source: IDC By 2012, 80% of all storage capacity sold will be for file-based data EMC Solutions are Powered by Intel® Xeon® Processor Technology EMC Proven Solution are Powered by Intel® Xeon® Processor Technology
  • 22.
    22© Copyright 2011EMC Corporation. All rights reserved. Data goes global
  • 23.
    23© Copyright 2011EMC Corporation. All rights reserved. Pressure from new markets •5.9 billion mobile subscribers (87% of world) - 30% in China/India •1.9 billion have smartphones •1.2 billion use smartphones on the internet •Forrester predict 2 billion PCs and laptops in use by 2013 •80 million ipads will be sold in 2012, accessing 300k apps •Other viable devices include thin client terminals, most new internet enabled TVs, Xboxes and playstations...... Current addressable market driven by c.4bn viable end point devices. When VMware first launched VDI in 2005, they foresaw 500m viable end- points by 2010.
  • 24.
    24© Copyright 2011EMC Corporation. All rights reserved. EMC Isilon. Record Capacity. Record Scalability. Remarkable Simplicity.EMC Solutions are Powered by Intel® Xeon® Processor Technology
  • 25.
    25© Copyright 2011EMC Corporation. All rights reserved. Isilon Single Volume Simplicity EMPTYEMPTYEMPTYEMPTYEMPTYFULLFULLFULLFULLBALANC ED BALANCE D BALANCE D BALANC ED BALANCE D Directories and files striped across nodes in a single volume 60 sec Upgrade Seamless Scale-Out For VMware With Isilon Uneven Utilization/Complex To Scale Many Systems or 2-way clusters Many File Systems and Volumes Many Points of Management EMC Solutions are Powered by Intel® Xeon® Processor Technology
  • 26.
    26© Copyright 2011EMC Corporation. All rights reserved. Unstructured Data Big Data ApplicationsEnterprise Applications Structured Data Big Data Storage For Big Data Applications VMAX VNX Isilon Cloud InfrastructureCloud Infrastructure EMC Proven Solution are Powered by Intel® Xeon® Processor Technology EMC Solutions are Powered by Intel® Xeon® Processor Technology
  • 27.
    27© Copyright 2011EMC Corporation. All rights reserved. Enterprise Applications Next-Generation Cloud Infrastructure Big Data Applications vMotion Fully Automated Storage Tiering (FAST) Compute Tier Storage Tier Cloud Infrastructure EMC Solutions are Powered by Intel® Xeon® Processor Technology
  • 28.
    28© Copyright 2011EMC Corporation. All rights reserved. Cloud Meets Big Data • Cloud Architecture Is Ready For Mission Critical Apps – More Performance And Easier Management • Big Data Requires New Approach To Infrastructure – Isilon = Scale Out Infrastructure Standard For Big Data • VMware = Platform For Cloud + Big Data – Seamless Mobility And Control Across Applications EMC Solutions are Powered by Intel® Xeon® Processor Technology
  • 29.
    29© Copyright 2011EMC Corporation. All rights reserved. THANK YOU