L'agilité du cloud public dans votre datacenter avec ECS & Neutrino

© Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved
JEUDI 19 NOVEMBRE 2015
Denis JANNOT – EMEA Principal Systems Engineer
L‘AGILITE DU CLOUD PUBLIC DANS VOTRE DATACENTER
AVEC ECS & NEUTRINO

2© Copyright 2014 EMC Corporation. All rights reserved.© Copyright 2014 EMC Corporation. All rights reserved.
SOFTWARE IS EATING THE WORLD WARE A
COMPANIES EFFECTIVELY USING SOFTWARE DEVELOPMENT TO ACHIEVE
COMPETITIVE ADVANTAGE ARE MORE PROFITABLE THAN THEIR PEERS

SOFTWARE DEVELOPMENT MODELS ARE EVOLVING
FROM A TRADITIONAL “WATERFALL” MODEL
Project Span
Requirements Analysis Design Build Test Roll Out
Current Date: 24th
October 2014
Planned Start Date:
1st Jan 2014
Planned End Date:
31st Dec 2014
TO AN “AGILE” MODEL
Weeks or months available to provide the infrastructure Infrastructure needed in days or hours

NEW DATA SOURCES ARE EMERGING
AND THEY CANNOT BE PROCESSED WITH TRADITIONAL SYSTEMS
Social Networks, UGCPublic records
Location
Data
Internet Of Things
Emerging Data Sources
Unstructured Data
Dark Data
Structured Data
Traditional Data Sources

AWS SERVICES ON PREMISE
Amazon S3 Amazon EBSAWS Storage
Gateway
Amazon Glacier Amazon EC2 Amazon EMR
ECS ScaleIO
Cloud
storage /
Active
archive
Cold
archive
Cloud
gateway
Block
storage
IaaS Data
analytics
Elastic Beanstalk
PaaS
Neutrino
CloudArray
Syncplicity
CloudBoost
NTP
Software
CloudPool
Pivotal
Cloud
Foundry
Pivotal HD

ECS OVERVIEW

REMOTE OFFICES
Cloudarray
56% cost
reduction
INNOVATE
REDUCE COST
THE ECS JOURNEY
NEXT GEN APPLICATIONS
50% faster
time to
market
BIG DATA
71% cost
reduction
USER DATA
Up to 83%
cost reduction

SIMPLIFY MANAGEMENT OF THE
REMOTE OFFICES

NAS appliance
File server
NAS appliance
File server
$ 0.021/GB/month $ 0.089/GB/month $ 0.042/GB/month
Backup
software
Deduplication
appliance
Deduplication
appliance
Backup
software
Deduplication
appliance
Backup
software
Deduplication
appliance
Backup
software
Deduplication
appliance
Replication
TODAY’S CHALLENGES WITH REMOTE OFFICES
CAPACITY PLANNING IS COMPLEX
PRIMARY STORAGE AND BACKUP COSTS ARE HIGH
A file server or a NAS is located
on each remote office
The File servers and NAS appliances are then backed up and the backups are replicated

CLOUDARRAY & ECS
100 x Cloudarray VE
with 3 TB cache
2 x ECS appliances U1500
Replication
$ 0.053/GB/month – 56% cost reduction – Protection included – Hypervisors & Load balancers included
For 1 PB stored, the cost reduction over 3 years is greater than $3,200,000
10 TB per site average capacity
More recent 3 TB cached locally
SIMPLIFY REMOTE OFFICES MANAGEMENT

ENABLE COLLABORATION

USER DATA IS GENERALLY STORED IN A NAS

Today
TODAY’S CHALLENGES WITH USER DATA
Infrastructure team Users
We need a
CIFS share for
our new
project
When do you
need it ?
I hope they
won’t say
today …
NAS appliance NAS storage must be backed up
Users send emails with attachments

IPADMACBOOK AIR IPHONEWINDOWS 8 IPHONE ANDROID MS SURFACE
- Save a file in any folder
and it’s accessible from
everywhere
- Share it easily
- Send links instead of
attachments
ENABLE COLLABORATION / REDUCE PRIMARY STORAGE AND BACKUP COSTS BY 50%
WHY SYNCPLICITY ?

ARCHIVE COLD DATA

SOME CUSTOMERS ARE BACKING UP USER DATA

Backup
software
Deduplication
appliance
Deduplication
appliance
Replication
$ 0.089/GB/month $ 0.042/GB/month
NAS
appliance
NAS
appliance
Replication
$ 0.042/GB/month
PRIMARY STORAGE AND BACKUP COSTS ARE HIGH
Users are storing their
documents in network shares
THE NAS APPLIANCE IS THEN BACKED UP AND THE
BACKUPS ARE REPLICATED

OTHERS ARE PROTECTING THE DATA WITH SNAPSHOTS

NAS
appliance
NAS
appliance
Replication
$ 0.042/GB/month
PRIMARY STORAGE AND SNAPSHOT COSTS ARE HIGH
Users are storing their documents
in network shares
THE NAS APPLIANCE IS THEN PROTECTED WITH
SNAPSHOTS
$ 0.01/GB/month
Snapshots
Snapshots

IN BOTH CASES, INTRODUCING ARCHIVING HELPS REDUCING
COSTS

NTP SOFTWARE & ECS
NAS
appliance
NAS
appliance
Replication
Replication
$ 0.032/GB/month – 39 to 82% cost reduction – Protection included – Load balancers included
For 1 PB archived, the cost reduction over 3 years is up to $5,300,000
2 x ECS appliances U1500
2 x NTP bundle for ECS U1500
Archive cold data

OTHER TRADITIONAL
USE CASES

EMC CLOUDBOOST
Long-Term Retention to the Cloud
LAN LAN/WAN
CloudBoost
virtual
appliance
Desktops
Laptops
Files NAS/NDMP
VMware &
Hyper-V
Databases
Email Applications
DB
ROBO
Included in the
Data Protection
Suite!

ISILON CLOUDPOOLS
Smart Tiering to Object Store
Key Features
Benefits
 Stub to Cloud of choice
 Extending SmartPools workflow to
CloudPools
 Ability to send encrypted data to the
cloud
 Compression for efficient transport
 Simple policy based management
 Combine file & object store benefits
 Use stubs to optimize local storage
space, with offsite archive protection
 Seamless placement and availability
of data per policy
 One Accessible namespace
SmartPools ->
CloudPools
Clients
SMB | NFS | REST| HDFS | SWIFT
OneFS
Service
Provider
Public
Cloud
ECS

MODERNIZE APPLICATIONS
WITH ECS

Today
TODAY’S CHALLENGES WITH APPLICATIONS
Infrastructure team Application team
We need
some storage
for our new
application
How much
capacity do
you need ?
Good question.
We don’t know
how many
users we’ll
have. Probably
5 TB.
10 TB, I think
When do you
need it ?
I hope they
won’t say
today …

Access Method NFS / CIFS
Access From One site
The same application can only run on one site
Disaster Recovery is complex
Provisioning Needed
The application team needs to tell how much storage they’ll need
in advance
WAN friendly The application and the storage must reside on the same site
Developer friendly
More lines of code needed to manage the file system structure
and perform many checks (capacity available, share mounted, …)
User Metadata Any information about the files must be stored in a database
TODAY’S CHALLENGES WITH APPLICATIONS

Access Method HTTP
Access From Any site
The same application can run on any site which provides native
high availability and faster response time for the users
Provisioning No The application team can access storage on demand
WAN friendly
The application and the storage can be on different sites which
allows many new use cases like archiving data on many sites to a
central location
Developer friendly
A developer just need to download the SDK corresponding to the
language he wants to use and doesn’t have to manage any file
system structure
User Metadata
Information about the objects can be stored as a metadata
instead of being stored in an expensive database
WHY OBJECT STORAGE ?
Reduce the lines of code and the development time by at least 50%

WHY ECS ?
Support many APIs
Provide performance and efficiency
with objects of any size
AA
A
Enable in place data analytics
Store
objects
in
chunks Add
parity
Delete
original
chunks

API EXTENSIONS
TO LEVERAGE THE ECS UNIQUE CAPABILITIES
• Updating a byte range within an object
• Overwriting part of an object
• Appending data to an object
• Reading multiple byte ranges within an
object
• Apply a retention to an object

CENTERA-LEVEL COMPLIANCE
COMPLIANCE ARCHIVING AND LONG-TERM RETENTION
• Utilizes the CAS API to enable compliance
features for Centera data
• Now also available for the other APIs
• Enabled at object or bucket level
• Time-based retention enforcement
• Immutability and checksum
• Privileged delete
• Audit logging

EXTRACT VALUE FROM
YOUR DATA

TODAY’S CHALLENGES WITH DATA ANALYTICS
Time needed to copy the data is high
Duplication of data increases costs
Data protection is complex and expensive
Original data is stored on
traditional storage
Manual copy jobs are executed to protect the data in a remote
Hadoop cluster
Data is then copied to an
Hadoop cluster where 3
copies of each file are
created
Primary
storage
Primary
storage
Replication
$ 0.042/GB/month
Hadoop
cluster
Copy
Analytics
$ 0.02/GB/month
Hadoop
cluster
Copy
$ 0.02/GB/month

 Store the HDFS data
 Compute Map-Reduce
job output
EthernetNetwork
DataNode(s)  Metadata catalog
 3 GB of RAM / million files
 Active-passive mode for
HA
NameNode(s)
 Enable access to HDFS
 Many options exist for
client systems
Client(s)
HADOOP ENVIRONMENT COMPONENTS
WHAT MAKES UP A TRADITIONAL HADOOP ENVIRONMENT ?

Hadoop
cluster
Hadoop
cluster
Site 1 Site 2
Local
Pool
Local
Pool
Global Pool
Read local data
Analyze the data
Write the output
in a global pool
Read local and
remote data
Write the output
in a global pool
Analyze the data
GLOBAL DATA ANALYTICS WITH ECS
$ 0.024/GB/month – 71% cost reduction – Protection included
For 2 PB capacity, the cost reduction over 3 years is greater than $4,450,000

EMC ECS NFS DATA SERVICE
Active / Active Scale out File

ECS U MODELS
Model U300 U700 U1100 U1500 U1800 U2200 U2500 U3000
Nodes 4 4 4 4 8 8 8 8
Disks 60 120 180 240 300 360 420 480
Raw TB 360 720 1080 1440 1800 2160 2520 2880
Max
Power
kVA
3.6 4.1 4.6 5.1 8.1 8.6 9.1 9.6
Max
Hear
BTU/h
12150 13838 15525 17213 27337 29025 30712 32400
Weight
lbs
970 1150 1330 1510 2020 2200 2380 2560
Height
in
75
Width
in
24
Depth
in
44

BENCHMARKS
More
than 400
millions
objects
written
or read
per day
More
than 50
TB
written
per day
More
than 150
TB read
per day

NEUTRINO OVERVIEW

Neutrino
Hardware
Software Services
INTRODUCING NEUTRINO
TURNKEY, OPEN SOURCE PRIVATE CLOUD
Commodity
IaaS
PaaS
Provisioning,
management UI
Delivers an on-
premise, private cloud
in a single day
”iPhone of
Cloud-Native
platforms”

• Public cloud offerings set the expectations for cloud
infrastructure
– But they are not always possible
• Open source is the foundation for building cloud
infrastructure
– But it is complex and very hard to use
• Cloud infrastructure is flexible to run many services
– But it requires many specialists to configure and tune
WHY NEUTRINO?

• Turn-key platform
– The iPhone of CloudNative platforms
– Services: CloudCompute, Developer platform
– Stable and validated infrastructure stack
– Integrated monitoring, planning, showback, tenancy
• Single support
– EMC support hw and software stacks in Neutrino(not
customer VMs and their developed apps)
• Low TCO
• Integrated patching and upgrades
THE VALUE PROPOSITION

• Web and mobile applications
– Cloud-native applications
– Elastically scaling
– Self-healing
• Devops
– Internal development environment
for cloud-native applications
• Hadoop batch analytics
– Parallel processing engine for large
amounts of data
NEUTRINO USE CASES

NEUTRINO PORTFOLIO
Neutrino is a private cloud platform that enables
customers to rapidly deploy and simply manage cloud
services offerings for their tenants and users.
1. Neutrino Big Data: Big Data PaaS – Hadoop-based big data
service (similar to EMR)
2. Neutrino Cloud Compute: OpenStack operating
environment (similar to EC2)
3. Neutrino Developer Platform: CloudFoundry on OpenStack
(similar to EB)

(ECS)(ScaleIO)
Hardware
NEUTRINO ARCHITECTURE
….
Cloud Compute
(OpenStack)
Orchestration/
Reporting
Provisioning Engine
Dense / High-Cap Add-on brick
…
Developer Platform
(Cloud Foundry)
Big Data
(Pivotal, Hortonworks)
(ECS)

NEUTRINO DASHBOARD

NEUTRINO ELASTICITY
DEPLOY NEW NODES IN LESS THAN 15 MINUTES

NEUTRINO CLOUD COMPUTE
THE FULL OPENSTACK USER EXPERIENCE

NEUTRINO CLOUD COMPUTE
POWERED BY SCALEIO

NEUTRINO LOG MANAGEMENT
POWERED BY ELASTICSEARCH & KIBANA

NEUTRINO ACCOUNTS
IDPIDP
• Keystone
– Users and groups
– AuthN and authZ
– Domains and projects
• Account service
– Aggregation of
domains or user sets
– Multiple domains/IDP
per customer
– Base for account level
reporting
• Cloud Compute, Big
Data, and Object
resources
– Get created and
associated to
accounts, domains
within accounts
– Account wide
management for M&R
cross domain reports
Domain
HR
Project
sandbo
x
Account
Project
dev
Project
secret
Domain
Finance
Project
stats
Project
results
Project
quarter
s
Keystone
Default
Domain
Hadoop
Cluster 1
Cloud Compute
Resource Pool A
Object
Namespace
Cloud Compute
Resource Pool
B
Account
ServiceKeystone
Logical resources created and linked to accounts
Users
Groups
Users
Groups
Cloud Admin

NEUTRINO CHARGEBACK

NEUTRINO DEVELOPER PLATFORM
AN “AGILE” SOFTWARE DEVELOPMENT MODEL
• Dramatically improve developer
experience
• Agile teams, rapid iteration
• Ingest and incubate open source
advancements and new data services
• Continuous delivery, no planned
downtime
• Instant scaling of apps and data services
• Automation and deployment consistency
at every step
DEVELOPERS OPERATORS

NEUTRINO DEVELOPER PLATFORM
TO TAKE THE APPLICATION LIFECYCLES FROM MONTHS TO HOURS AND MINUTES
• Auto-select runtimes
• Deploy app
• Select and bind middleware
• Scale app
• Establish infrastructure
• Provision
• Add capacity
• Control Auth, Policies, HA
DEVELOPERS OPERATORS
App Deployment: 30-90 seconds Cloud Deployment: 2-4 hours

© Copyright 2015 EMC Corporation. All rights reserved© Copyright 2015 EMC Corporation. All rights reserved
Si vous avez des questions sur cette présentation,
n’hésitez pas à prendre contact directement contact
avec :
Denis JANNOT
denis.jannot@emc.com

L'agilité du cloud public dans votre datacenter avec ECS & Neutrino

L'agilité du cloud public dans votre datacenter avec ECS & Neutrino

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to L'agilité du cloud public dans votre datacenter avec ECS & Neutrino

Similar to L'agilité du cloud public dans votre datacenter avec ECS & Neutrino (20)

More from RSD

More from RSD (20)

Recently uploaded

Recently uploaded (20)

L'agilité du cloud public dans votre datacenter avec ECS & Neutrino