SlideShare a Scribd company logo
Rohit Goyal
rohit@maginatics.com
Sr. Technical Marketing Engineer
Maginatics Cloud Storage Platform (MCSP)
MCSP 3.0 Technical Highlights
Data Protection
Data Protection
3
One-Click Disaster Recovery
•  Hot-standby MVF VMs
•  AES-256 bit encrypted backups
•  Reduced RPO, RTO, and RCO
Amazon High Availability
•  Multi-Availability Zone (AZ) Support
•  Tolerate single or dual AZ outage(s)
•  Relational Database Support (RDS)
•  Fast MagFS Agent failover
•  Seamless failover
VMware vSphere High Availability
•  VMware vSphere HA
•  Fast MagFS Agent failover
•  Tolerate ESX Host, disk or memory failure
•  Application restart or migration
Healing
4
Healing
•  Fast VM recovery
•  Requires less resources (no DR cluster is needed)
•  No downtime for the namespace
Share 1 Share 2 Share 3
Management
Share 1 Share 2 Share 3
Management
Database(s)
System Config System Config
Database(s)
Object Storage
Backing up
share metadata
Primary Site DR Site
Object Storage
Restoring share
metadata
1
2
One-Click Disaster Recovery
Region
Mgmt
Availability Zone Availability Zone
S3 Object
Storage
RDS
Availability Zone
Share 1Share 1DNS Server
RP: Elastic IP
Discovery Service
FQDN: Inst. Name
Sync. Service
RP: Elastic IP
Discovery Service
FQDN: Inst. Name
Sync. Service
Public DNS
Discovery Service
FQDN: Int. Name
Sync. Service
VPC
MCSP Deployment: Single-Node Redundacy
Share 2 Share 2
Public DNS
Discovery Service
FQDN: Inst. Name
Sync. Service
Public DNS
Discovery Service
FQDN: Inst. Name
Sync. Service
Region
Mgmt
Availability Zone Availability Zone
S3 Object
Storage
RDS
Availability Zone
Share 1Share 1DNS Server
RP: Elastic IP
Discovery Service
FQDN: Inst. Name
Sync. Service
RP: Elastic IP
Discovery Service
FQDN: Inst. Name
Sync. Service
Public DNS
Discovery Service
FQDN: Int. Name
Sync. Service
VPC
MCSP Deployment: Dual-Node Redundacy
VMware vSphere High Availability
8
Primary
ESX host
VMware
vSphere
Application Failover
VMware vSphere
Secondary
ESX host
1
2
Application
Restart
Share 1 Share 2 Share 3
Management
Maginatics
Virtual Filer
1 2
Share 1 Share 2 Share 3
Management
Share 1 Share 2 Share 3
Management
3
Lost Virtual Machine Restored
Functionality
•  Maginatics Management Dashboard
•  Single click Recovery
•  Easy to find problem VM
Healing Maginatics VMs
Snapshots
10
MVF
Metadatabase
VM
Full
MVF Snapshot
/snapshot /snapshot1 /snapshotX
Database
Artifact
Snapshot 1 Snapshot X
Incremental
Metadata
Database
LVM Pool
/dev/sdb1 /dev/sdc1 /dev/sdd1
Logical Volume(s)
Volume Group(s)
Physical Volume(s)
Incremental
Multi-tier Caching
Site Cache v1.0 (Read Cache) and CDC
12
Site Cache
•  Local Virtual Machine
•  Shared cache within office
•  Improved READ performance
•  LAN speed (100Mbps)
•  Auto-discover nearest site cache (15ms RTT)
•  MagFS Agents work with both Site Cache and CDC enabled
Content Delivery Cache (CDC)
•  Amazon infrastructure
•  Shared regional cache
•  Improved READ performance
•  52 AWS edge locations (typically 5-10ms from client)
•  Optimized data paths (Amazon, high speed network backbone)
MCSP provides several caching mechanisms for shared
data access across dispersed clients
Site Cache
1ms
CDN
1–5ms
Object Storage
10–300ms
Client Cache
< 1ms
LAN
Edge Network
WAN
Office ‘A’ Office ‘B’
Edge Node
MagFS Agent MagFS Agent MagFS Agent MagFS Agent
The first cold read fetches chunks of a file from the cloud
object storage
Site Cache
1ms
CDN
1–5ms
Object Storage
10–300ms
Client Cache
< 1ms
LAN
Edge Network
WAN
Office ‘A’ Office ‘B’
Edge Node
MagFS Agent MagFS Agent MagFS Agent MagFS Agent
1
In the process, all MCSP layers of caching in the read path
get populated – CDN, Site Cache, Client cache(s).
Site Cache
1ms
CDN
1–5ms
Object Storage
10–300ms
Client Cache
< 1ms
LAN
Edge Network
WAN
Office ‘A’ Office ‘B’
Edge Node
MagFS Agent MagFS Agent MagFS Agent MagFS Agent
1
Subsequent reads from any client in the same branch
(LAN) get cache hits from the Site Cache
Site Cache
1ms
CDN
1–5ms
Object Storage
10–300ms
Client Cache
< 1ms
LAN
Edge Network
WAN
Office ‘A’ Office ‘B’
Edge Node
MagFS Agent MagFS Agent MagFS Agent MagFS Agent
1 2
Subsequent reads from any client in the same region
(common edge node) get cache hits from CDN
Site Cache
1ms
CDN
1–5ms
Object Storage
10–300ms
Client Cache
< 1ms
LAN
Edge Network
WAN
Office ‘A’ Office ‘B’
Edge Node
MagFS Agent MagFS Agent MagFS Agent MagFS Agent
1 2 3
Additionally, the MagFS Agent has 3 levels of local caching:
Kernel (IO Buffer), L1 (In memory) and L2 (Disk)
Site Cache
1ms
L2 (disk)
L1 (in memory)
Kernel (IO Buffer)
CDN
1–5ms
Object Storage
10–300ms
Client Cache
< 1ms
LAN
Edge Network
WAN
Office ‘A’ Office ‘B’
Edge Node
MagFS Agent MagFS Agent MagFS Agent MagFS Agent
MagFS Agent
1 2 3 4
5
Site Cache
1ms
L2 (disk)
L1 (in memory)
Kernel (IO Buffer)
CDN
1–5ms
Object Storage
10–300ms
Client Cache
< 1ms
LAN
Edge Network
WAN
Office ‘A’ Office ‘B’
Edge Node
MagFS Agent MagFS Agent MagFS Agent MagFS Agent
MagFS Agent
Our unique, multi-tier caching layers hide WAN latency
and enable high throughput transfers (reads).
APIs
MCSP 3.0 - RESTful APIs
21
•  Control any aspect of Management via Web UI or our new RESTful APIs
•  Full, programmatic control over a MCSP cluster
•  Automate any or all aspects (e.g., provisioning, managing and
monitoring)
•  On-demand resource configuration
•  Automate cloud resource usage for bursty workloads
•  IaaS cost reduction (e.g., expand storage when required)
Provisioning and Management APIs
22
0
50
VM lifecycle mgmt.
MCSP lifecycle mgmt.
Manual
•  EC2 Management Console
•  vSphere Client/vCenter
Manual
•  UI Driven
Programmatic
•  Cloud Formation
•  vSphere APIs
Programmatic
•  RESTful API
MCSP 3.0 - Simplified Operation
23
Home Folder Redirection
•  Auto-mount home folders
•  Simplifies user experience when accessing MCSP
•  Simplifies integration within AD scripted infrastructure to mount
network shares
Access Based Enumeration
•  Hide files and folders based on ACLs
•  Enhanced security when sharing infrastructure
across teams and organizations (users only see what they can
access)
ACL Manipulation tool
•  Simplifies the task of managing file system ACLs independently of
the IDM in use
Multi-Share Web Services
•  Pool multiple Web Servers together
•  Multiple share access, single interface
Operating Environment Enhanced
Compatibility
24
Two File System Modes
•  Mixed Mode (default)
•  Full Windows file system semantics and POSIX compatibility
•  Unicode support with respect to file names
•  Windows PCs, Mac and Linux interoperability
•  File locking supported on Windows PCs and Mac
•  Case insensitive
•  POSIX Mode
•  POSIX file system semantics only (e.g., case sensitivity)
•  Unicode support with respect to file names
•  Linux and Mac interoperability
•  Case sensitive
With MCSP v3.0 - Admin Auditing Logs
25
Management UI - Active Directory Integration
Licenses
26
From v3.0 onward, licenses are cluster-based and not tied to a share. E.g., a
10 TB license can be used for 10 x 1 TB shares or 1 x 10 TB share at your
discretion.
Licenses issued for <3.x deployments will not be compatible with 3.x.
Equally the new MCSP 3.x license format is not backward compatible with
older versions.
•  30 day grace period in which to update your license
•  Alerts are visible on the Management Server UI and via System
Notifications (email)
•  We required the FQDN of your Management Server to generate a 3.x
license
•  Existing, valid license will be updated for 3.x at no charge. Your
existing license length and capacity will not be impacted.
MCSP 3.0 - EMC ViPR object storage support
27
EMC ViPR Platform
ViPR
Controller
Provisioning Self-Service Reporting Automation
ViPR
Data Services
Third-Party
Isilon
Atmos
VMAX VNX VPLEX
Commodity
XtremIOCentera
Maginatics Virtual Filer
Elastic NAS NAS Consolidation
Thank you.
28

More Related Content

What's hot

An Elastic Metadata Store for eBay’s Media Platform
An Elastic Metadata Store for eBay’s Media PlatformAn Elastic Metadata Store for eBay’s Media Platform
An Elastic Metadata Store for eBay’s Media Platform
MongoDB
 
Gluster Storage
Gluster StorageGluster Storage
Gluster Storage
Raz Tamir
 
Configuring workload-based storage and topologies
Configuring workload-based storage and topologiesConfiguring workload-based storage and topologies
Configuring workload-based storage and topologies
MariaDB plc
 
Powering Microservices with Docker, Kubernetes, Kafka, and MongoDB
Powering Microservices with Docker, Kubernetes, Kafka, and MongoDBPowering Microservices with Docker, Kubernetes, Kafka, and MongoDB
Powering Microservices with Docker, Kubernetes, Kafka, and MongoDB
MongoDB
 
Storage as a Service with Gluster
Storage as a Service with GlusterStorage as a Service with Gluster
Storage as a Service with Gluster
Vijay Bellur
 
{code} and Containers - Open Source Infrastructure within Dell Technologies
{code} and Containers - Open Source Infrastructure within Dell Technologies{code} and Containers - Open Source Infrastructure within Dell Technologies
{code} and Containers - Open Source Infrastructure within Dell Technologies
The {code} Team
 
Dustin Black - Red Hat Storage Server Administration Deep Dive
Dustin Black - Red Hat Storage Server Administration Deep DiveDustin Black - Red Hat Storage Server Administration Deep Dive
Dustin Black - Red Hat Storage Server Administration Deep Dive
Gluster.org
 
Glusterfs and openstack
Glusterfs  and openstackGlusterfs  and openstack
Glusterfs and openstackopenstackindia
 
Mongo DB Monitoring - Become a MongoDB DBA
Mongo DB Monitoring - Become a MongoDB DBAMongo DB Monitoring - Become a MongoDB DBA
Mongo DB Monitoring - Become a MongoDB DBA
Severalnines
 
Redis vs Memcached
Redis vs MemcachedRedis vs Memcached
Redis vs Memcached
Gaurav Agrawal
 
Securing Your Enterprise Web Apps with MongoDB Enterprise
Securing Your Enterprise Web Apps with MongoDB Enterprise Securing Your Enterprise Web Apps with MongoDB Enterprise
Securing Your Enterprise Web Apps with MongoDB Enterprise
MongoDB
 
Storing and processing data with the wso2 platform
Storing and processing data with the wso2 platformStoring and processing data with the wso2 platform
Storing and processing data with the wso2 platformWSO2
 
Remote DBA Experts SQL Server 2008 New Features
Remote DBA Experts SQL Server 2008 New FeaturesRemote DBA Experts SQL Server 2008 New Features
Remote DBA Experts SQL Server 2008 New Features
Remote DBA Experts
 
Rhel cluster basics 1
Rhel cluster basics   1Rhel cluster basics   1
Rhel cluster basics 1
Manoj Singh
 
Cloud economics design, capacity and operational concerns
Cloud economics  design, capacity and operational concernsCloud economics  design, capacity and operational concerns
Cloud economics design, capacity and operational concerns
Marcos García
 
Red Hat Gluster Storage - Direction, Roadmap and Use-Cases
Red Hat Gluster Storage - Direction, Roadmap and Use-CasesRed Hat Gluster Storage - Direction, Roadmap and Use-Cases
Red Hat Gluster Storage - Direction, Roadmap and Use-Cases
Red_Hat_Storage
 
Hadoop Meetup Jan 2019 - Router-Based Federation and Storage Tiering
Hadoop Meetup Jan 2019 - Router-Based Federation and Storage TieringHadoop Meetup Jan 2019 - Router-Based Federation and Storage Tiering
Hadoop Meetup Jan 2019 - Router-Based Federation and Storage Tiering
Erik Krogen
 
Inside CynosDB: MariaDB optimized for the cloud at Tencent
Inside CynosDB: MariaDB optimized for the cloud at TencentInside CynosDB: MariaDB optimized for the cloud at Tencent
Inside CynosDB: MariaDB optimized for the cloud at Tencent
MariaDB plc
 
Introduction to Container Storage Interface (CSI)
Introduction to Container Storage Interface (CSI)Introduction to Container Storage Interface (CSI)
Introduction to Container Storage Interface (CSI)
Idan Atias
 
Sdc challenges-2012
Sdc challenges-2012Sdc challenges-2012
Sdc challenges-2012
Gluster.org
 

What's hot (20)

An Elastic Metadata Store for eBay’s Media Platform
An Elastic Metadata Store for eBay’s Media PlatformAn Elastic Metadata Store for eBay’s Media Platform
An Elastic Metadata Store for eBay’s Media Platform
 
Gluster Storage
Gluster StorageGluster Storage
Gluster Storage
 
Configuring workload-based storage and topologies
Configuring workload-based storage and topologiesConfiguring workload-based storage and topologies
Configuring workload-based storage and topologies
 
Powering Microservices with Docker, Kubernetes, Kafka, and MongoDB
Powering Microservices with Docker, Kubernetes, Kafka, and MongoDBPowering Microservices with Docker, Kubernetes, Kafka, and MongoDB
Powering Microservices with Docker, Kubernetes, Kafka, and MongoDB
 
Storage as a Service with Gluster
Storage as a Service with GlusterStorage as a Service with Gluster
Storage as a Service with Gluster
 
{code} and Containers - Open Source Infrastructure within Dell Technologies
{code} and Containers - Open Source Infrastructure within Dell Technologies{code} and Containers - Open Source Infrastructure within Dell Technologies
{code} and Containers - Open Source Infrastructure within Dell Technologies
 
Dustin Black - Red Hat Storage Server Administration Deep Dive
Dustin Black - Red Hat Storage Server Administration Deep DiveDustin Black - Red Hat Storage Server Administration Deep Dive
Dustin Black - Red Hat Storage Server Administration Deep Dive
 
Glusterfs and openstack
Glusterfs  and openstackGlusterfs  and openstack
Glusterfs and openstack
 
Mongo DB Monitoring - Become a MongoDB DBA
Mongo DB Monitoring - Become a MongoDB DBAMongo DB Monitoring - Become a MongoDB DBA
Mongo DB Monitoring - Become a MongoDB DBA
 
Redis vs Memcached
Redis vs MemcachedRedis vs Memcached
Redis vs Memcached
 
Securing Your Enterprise Web Apps with MongoDB Enterprise
Securing Your Enterprise Web Apps with MongoDB Enterprise Securing Your Enterprise Web Apps with MongoDB Enterprise
Securing Your Enterprise Web Apps with MongoDB Enterprise
 
Storing and processing data with the wso2 platform
Storing and processing data with the wso2 platformStoring and processing data with the wso2 platform
Storing and processing data with the wso2 platform
 
Remote DBA Experts SQL Server 2008 New Features
Remote DBA Experts SQL Server 2008 New FeaturesRemote DBA Experts SQL Server 2008 New Features
Remote DBA Experts SQL Server 2008 New Features
 
Rhel cluster basics 1
Rhel cluster basics   1Rhel cluster basics   1
Rhel cluster basics 1
 
Cloud economics design, capacity and operational concerns
Cloud economics  design, capacity and operational concernsCloud economics  design, capacity and operational concerns
Cloud economics design, capacity and operational concerns
 
Red Hat Gluster Storage - Direction, Roadmap and Use-Cases
Red Hat Gluster Storage - Direction, Roadmap and Use-CasesRed Hat Gluster Storage - Direction, Roadmap and Use-Cases
Red Hat Gluster Storage - Direction, Roadmap and Use-Cases
 
Hadoop Meetup Jan 2019 - Router-Based Federation and Storage Tiering
Hadoop Meetup Jan 2019 - Router-Based Federation and Storage TieringHadoop Meetup Jan 2019 - Router-Based Federation and Storage Tiering
Hadoop Meetup Jan 2019 - Router-Based Federation and Storage Tiering
 
Inside CynosDB: MariaDB optimized for the cloud at Tencent
Inside CynosDB: MariaDB optimized for the cloud at TencentInside CynosDB: MariaDB optimized for the cloud at Tencent
Inside CynosDB: MariaDB optimized for the cloud at Tencent
 
Introduction to Container Storage Interface (CSI)
Introduction to Container Storage Interface (CSI)Introduction to Container Storage Interface (CSI)
Introduction to Container Storage Interface (CSI)
 
Sdc challenges-2012
Sdc challenges-2012Sdc challenges-2012
Sdc challenges-2012
 

Similar to Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights

Cloud stack overview
Cloud stack overviewCloud stack overview
Cloud stack overviewhowie YU
 
Presentazione VMware @ VMUGIT UserCon 2015
Presentazione VMware @ VMUGIT UserCon 2015Presentazione VMware @ VMUGIT UserCon 2015
Presentazione VMware @ VMUGIT UserCon 2015
VMUG IT
 
Thr30092 building a resilient iaa s architecture
Thr30092  building a resilient iaa s architectureThr30092  building a resilient iaa s architecture
Thr30092 building a resilient iaa s architecture
Abou CONDE
 
Membase Meetup 2010
Membase Meetup 2010Membase Meetup 2010
Membase Meetup 2010Membase
 
AMIS Beyond the Horizon - High density deployments using weblogic multitenancy
AMIS Beyond the Horizon - High density deployments using weblogic multitenancyAMIS Beyond the Horizon - High density deployments using weblogic multitenancy
AMIS Beyond the Horizon - High density deployments using weblogic multitenancy
Jaap Poot
 
Ultimate SharePoint Infrastructure Best Practises Session - Isle of Man Share...
Ultimate SharePoint Infrastructure Best Practises Session - Isle of Man Share...Ultimate SharePoint Infrastructure Best Practises Session - Isle of Man Share...
Ultimate SharePoint Infrastructure Best Practises Session - Isle of Man Share...Michael Noel
 
Virtual SAN 6.2, hyper-converged infrastructure software
Virtual SAN 6.2, hyper-converged infrastructure softwareVirtual SAN 6.2, hyper-converged infrastructure software
Virtual SAN 6.2, hyper-converged infrastructure software
Duncan Epping
 
VMWARE Professionals - Storage and Resources
VMWARE Professionals -  Storage and ResourcesVMWARE Professionals -  Storage and Resources
VMWARE Professionals - Storage and ResourcesPaulo Freitas
 
Migra le tue file shares in cloud con FSx for Windows
Migra le tue file shares in cloud con FSx for Windows Migra le tue file shares in cloud con FSx for Windows
Migra le tue file shares in cloud con FSx for Windows
Amazon Web Services
 
State of the Container Ecosystem
State of the Container EcosystemState of the Container Ecosystem
State of the Container Ecosystem
Vinay Rao
 
VMworld 2015: The Future of Software- Defined Storage- What Does it Look Like...
VMworld 2015: The Future of Software- Defined Storage- What Does it Look Like...VMworld 2015: The Future of Software- Defined Storage- What Does it Look Like...
VMworld 2015: The Future of Software- Defined Storage- What Does it Look Like...
VMworld
 
Hacking apache cloud stack
Hacking apache cloud stackHacking apache cloud stack
Hacking apache cloud stackNitin Mehta
 
VMworld 2013: IBM Solutions for VMware Virtual SAN
VMworld 2013: IBM Solutions for VMware Virtual SAN VMworld 2013: IBM Solutions for VMware Virtual SAN
VMworld 2013: IBM Solutions for VMware Virtual SAN
VMworld
 
Oracle rac 10g best practices
Oracle rac 10g best practicesOracle rac 10g best practices
Oracle rac 10g best practicesHaseeb Alam
 
OSDC 2015: Bernd Mathiske | Why the Datacenter Needs an Operating System
OSDC 2015: Bernd Mathiske | Why the Datacenter Needs an Operating SystemOSDC 2015: Bernd Mathiske | Why the Datacenter Needs an Operating System
OSDC 2015: Bernd Mathiske | Why the Datacenter Needs an Operating System
NETWAYS
 
VMworld 2013: Maximize Database Performance in Your Software-Defined Data Center
VMworld 2013: Maximize Database Performance in Your Software-Defined Data CenterVMworld 2013: Maximize Database Performance in Your Software-Defined Data Center
VMworld 2013: Maximize Database Performance in Your Software-Defined Data Center
VMworld
 
CloudStack Architecture Future
CloudStack Architecture FutureCloudStack Architecture Future
CloudStack Architecture Future
Kimihiko Kitase
 
Experience In Building Scalable Web Sites Through Infrastructure's View
Experience In Building Scalable Web Sites Through Infrastructure's ViewExperience In Building Scalable Web Sites Through Infrastructure's View
Experience In Building Scalable Web Sites Through Infrastructure's View
Phuwadon D
 
Nordic infrastructure Conference 2017 - SQL Server on Linux Overview
Nordic infrastructure Conference 2017 - SQL Server on Linux OverviewNordic infrastructure Conference 2017 - SQL Server on Linux Overview
Nordic infrastructure Conference 2017 - SQL Server on Linux Overview
Travis Wright
 
Plandas-CacheCloud
Plandas-CacheCloudPlandas-CacheCloud
Plandas-CacheCloud
Gyuman Cho
 

Similar to Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights (20)

Cloud stack overview
Cloud stack overviewCloud stack overview
Cloud stack overview
 
Presentazione VMware @ VMUGIT UserCon 2015
Presentazione VMware @ VMUGIT UserCon 2015Presentazione VMware @ VMUGIT UserCon 2015
Presentazione VMware @ VMUGIT UserCon 2015
 
Thr30092 building a resilient iaa s architecture
Thr30092  building a resilient iaa s architectureThr30092  building a resilient iaa s architecture
Thr30092 building a resilient iaa s architecture
 
Membase Meetup 2010
Membase Meetup 2010Membase Meetup 2010
Membase Meetup 2010
 
AMIS Beyond the Horizon - High density deployments using weblogic multitenancy
AMIS Beyond the Horizon - High density deployments using weblogic multitenancyAMIS Beyond the Horizon - High density deployments using weblogic multitenancy
AMIS Beyond the Horizon - High density deployments using weblogic multitenancy
 
Ultimate SharePoint Infrastructure Best Practises Session - Isle of Man Share...
Ultimate SharePoint Infrastructure Best Practises Session - Isle of Man Share...Ultimate SharePoint Infrastructure Best Practises Session - Isle of Man Share...
Ultimate SharePoint Infrastructure Best Practises Session - Isle of Man Share...
 
Virtual SAN 6.2, hyper-converged infrastructure software
Virtual SAN 6.2, hyper-converged infrastructure softwareVirtual SAN 6.2, hyper-converged infrastructure software
Virtual SAN 6.2, hyper-converged infrastructure software
 
VMWARE Professionals - Storage and Resources
VMWARE Professionals -  Storage and ResourcesVMWARE Professionals -  Storage and Resources
VMWARE Professionals - Storage and Resources
 
Migra le tue file shares in cloud con FSx for Windows
Migra le tue file shares in cloud con FSx for Windows Migra le tue file shares in cloud con FSx for Windows
Migra le tue file shares in cloud con FSx for Windows
 
State of the Container Ecosystem
State of the Container EcosystemState of the Container Ecosystem
State of the Container Ecosystem
 
VMworld 2015: The Future of Software- Defined Storage- What Does it Look Like...
VMworld 2015: The Future of Software- Defined Storage- What Does it Look Like...VMworld 2015: The Future of Software- Defined Storage- What Does it Look Like...
VMworld 2015: The Future of Software- Defined Storage- What Does it Look Like...
 
Hacking apache cloud stack
Hacking apache cloud stackHacking apache cloud stack
Hacking apache cloud stack
 
VMworld 2013: IBM Solutions for VMware Virtual SAN
VMworld 2013: IBM Solutions for VMware Virtual SAN VMworld 2013: IBM Solutions for VMware Virtual SAN
VMworld 2013: IBM Solutions for VMware Virtual SAN
 
Oracle rac 10g best practices
Oracle rac 10g best practicesOracle rac 10g best practices
Oracle rac 10g best practices
 
OSDC 2015: Bernd Mathiske | Why the Datacenter Needs an Operating System
OSDC 2015: Bernd Mathiske | Why the Datacenter Needs an Operating SystemOSDC 2015: Bernd Mathiske | Why the Datacenter Needs an Operating System
OSDC 2015: Bernd Mathiske | Why the Datacenter Needs an Operating System
 
VMworld 2013: Maximize Database Performance in Your Software-Defined Data Center
VMworld 2013: Maximize Database Performance in Your Software-Defined Data CenterVMworld 2013: Maximize Database Performance in Your Software-Defined Data Center
VMworld 2013: Maximize Database Performance in Your Software-Defined Data Center
 
CloudStack Architecture Future
CloudStack Architecture FutureCloudStack Architecture Future
CloudStack Architecture Future
 
Experience In Building Scalable Web Sites Through Infrastructure's View
Experience In Building Scalable Web Sites Through Infrastructure's ViewExperience In Building Scalable Web Sites Through Infrastructure's View
Experience In Building Scalable Web Sites Through Infrastructure's View
 
Nordic infrastructure Conference 2017 - SQL Server on Linux Overview
Nordic infrastructure Conference 2017 - SQL Server on Linux OverviewNordic infrastructure Conference 2017 - SQL Server on Linux Overview
Nordic infrastructure Conference 2017 - SQL Server on Linux Overview
 
Plandas-CacheCloud
Plandas-CacheCloudPlandas-CacheCloud
Plandas-CacheCloud
 

Recently uploaded

Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
Aftab Hussain
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
Sri Ambati
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
Alpen-Adria-Universität
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
OnBoard
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
Jemma Hussein Allen
 
Enhancing Performance with Globus and the Science DMZ
Enhancing Performance with Globus and the Science DMZEnhancing Performance with Globus and the Science DMZ
Enhancing Performance with Globus and the Science DMZ
Globus
 
By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024
Pierluigi Pugliese
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Safe Software
 
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
James Anderson
 
UiPath Community Day Dubai: AI at Work..
UiPath Community Day Dubai: AI at Work..UiPath Community Day Dubai: AI at Work..
UiPath Community Day Dubai: AI at Work..
UiPathCommunity
 
Elevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsElevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object Calisthenics
Dorra BARTAGUIZ
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
BookNet Canada
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
KatiaHIMEUR1
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
James Anderson
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance
 
Free Complete Python - A step towards Data Science
Free Complete Python - A step towards Data ScienceFree Complete Python - A step towards Data Science
Free Complete Python - A step towards Data Science
RinaMondal9
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
Guy Korland
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
DianaGray10
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance
 
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
sonjaschweigert1
 

Recently uploaded (20)

Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
 
Enhancing Performance with Globus and the Science DMZ
Enhancing Performance with Globus and the Science DMZEnhancing Performance with Globus and the Science DMZ
Enhancing Performance with Globus and the Science DMZ
 
By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
 
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...
 
UiPath Community Day Dubai: AI at Work..
UiPath Community Day Dubai: AI at Work..UiPath Community Day Dubai: AI at Work..
UiPath Community Day Dubai: AI at Work..
 
Elevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsElevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object Calisthenics
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
Free Complete Python - A step towards Data Science
Free Complete Python - A step towards Data ScienceFree Complete Python - A step towards Data Science
Free Complete Python - A step towards Data Science
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
 
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
 

Maginatics Cloud Storage Platform - MCSP 3.0 Technical Highlights

  • 1. Rohit Goyal rohit@maginatics.com Sr. Technical Marketing Engineer Maginatics Cloud Storage Platform (MCSP) MCSP 3.0 Technical Highlights
  • 3. Data Protection 3 One-Click Disaster Recovery •  Hot-standby MVF VMs •  AES-256 bit encrypted backups •  Reduced RPO, RTO, and RCO Amazon High Availability •  Multi-Availability Zone (AZ) Support •  Tolerate single or dual AZ outage(s) •  Relational Database Support (RDS) •  Fast MagFS Agent failover •  Seamless failover VMware vSphere High Availability •  VMware vSphere HA •  Fast MagFS Agent failover •  Tolerate ESX Host, disk or memory failure •  Application restart or migration
  • 4. Healing 4 Healing •  Fast VM recovery •  Requires less resources (no DR cluster is needed) •  No downtime for the namespace
  • 5. Share 1 Share 2 Share 3 Management Share 1 Share 2 Share 3 Management Database(s) System Config System Config Database(s) Object Storage Backing up share metadata Primary Site DR Site Object Storage Restoring share metadata 1 2 One-Click Disaster Recovery
  • 6. Region Mgmt Availability Zone Availability Zone S3 Object Storage RDS Availability Zone Share 1Share 1DNS Server RP: Elastic IP Discovery Service FQDN: Inst. Name Sync. Service RP: Elastic IP Discovery Service FQDN: Inst. Name Sync. Service Public DNS Discovery Service FQDN: Int. Name Sync. Service VPC MCSP Deployment: Single-Node Redundacy
  • 7. Share 2 Share 2 Public DNS Discovery Service FQDN: Inst. Name Sync. Service Public DNS Discovery Service FQDN: Inst. Name Sync. Service Region Mgmt Availability Zone Availability Zone S3 Object Storage RDS Availability Zone Share 1Share 1DNS Server RP: Elastic IP Discovery Service FQDN: Inst. Name Sync. Service RP: Elastic IP Discovery Service FQDN: Inst. Name Sync. Service Public DNS Discovery Service FQDN: Int. Name Sync. Service VPC MCSP Deployment: Dual-Node Redundacy
  • 8. VMware vSphere High Availability 8 Primary ESX host VMware vSphere Application Failover VMware vSphere Secondary ESX host 1 2 Application Restart
  • 9. Share 1 Share 2 Share 3 Management Maginatics Virtual Filer 1 2 Share 1 Share 2 Share 3 Management Share 1 Share 2 Share 3 Management 3 Lost Virtual Machine Restored Functionality •  Maginatics Management Dashboard •  Single click Recovery •  Easy to find problem VM Healing Maginatics VMs
  • 10. Snapshots 10 MVF Metadatabase VM Full MVF Snapshot /snapshot /snapshot1 /snapshotX Database Artifact Snapshot 1 Snapshot X Incremental Metadata Database LVM Pool /dev/sdb1 /dev/sdc1 /dev/sdd1 Logical Volume(s) Volume Group(s) Physical Volume(s) Incremental
  • 12. Site Cache v1.0 (Read Cache) and CDC 12 Site Cache •  Local Virtual Machine •  Shared cache within office •  Improved READ performance •  LAN speed (100Mbps) •  Auto-discover nearest site cache (15ms RTT) •  MagFS Agents work with both Site Cache and CDC enabled Content Delivery Cache (CDC) •  Amazon infrastructure •  Shared regional cache •  Improved READ performance •  52 AWS edge locations (typically 5-10ms from client) •  Optimized data paths (Amazon, high speed network backbone)
  • 13. MCSP provides several caching mechanisms for shared data access across dispersed clients Site Cache 1ms CDN 1–5ms Object Storage 10–300ms Client Cache < 1ms LAN Edge Network WAN Office ‘A’ Office ‘B’ Edge Node MagFS Agent MagFS Agent MagFS Agent MagFS Agent
  • 14. The first cold read fetches chunks of a file from the cloud object storage Site Cache 1ms CDN 1–5ms Object Storage 10–300ms Client Cache < 1ms LAN Edge Network WAN Office ‘A’ Office ‘B’ Edge Node MagFS Agent MagFS Agent MagFS Agent MagFS Agent 1
  • 15. In the process, all MCSP layers of caching in the read path get populated – CDN, Site Cache, Client cache(s). Site Cache 1ms CDN 1–5ms Object Storage 10–300ms Client Cache < 1ms LAN Edge Network WAN Office ‘A’ Office ‘B’ Edge Node MagFS Agent MagFS Agent MagFS Agent MagFS Agent 1
  • 16. Subsequent reads from any client in the same branch (LAN) get cache hits from the Site Cache Site Cache 1ms CDN 1–5ms Object Storage 10–300ms Client Cache < 1ms LAN Edge Network WAN Office ‘A’ Office ‘B’ Edge Node MagFS Agent MagFS Agent MagFS Agent MagFS Agent 1 2
  • 17. Subsequent reads from any client in the same region (common edge node) get cache hits from CDN Site Cache 1ms CDN 1–5ms Object Storage 10–300ms Client Cache < 1ms LAN Edge Network WAN Office ‘A’ Office ‘B’ Edge Node MagFS Agent MagFS Agent MagFS Agent MagFS Agent 1 2 3
  • 18. Additionally, the MagFS Agent has 3 levels of local caching: Kernel (IO Buffer), L1 (In memory) and L2 (Disk) Site Cache 1ms L2 (disk) L1 (in memory) Kernel (IO Buffer) CDN 1–5ms Object Storage 10–300ms Client Cache < 1ms LAN Edge Network WAN Office ‘A’ Office ‘B’ Edge Node MagFS Agent MagFS Agent MagFS Agent MagFS Agent MagFS Agent 1 2 3 4 5
  • 19. Site Cache 1ms L2 (disk) L1 (in memory) Kernel (IO Buffer) CDN 1–5ms Object Storage 10–300ms Client Cache < 1ms LAN Edge Network WAN Office ‘A’ Office ‘B’ Edge Node MagFS Agent MagFS Agent MagFS Agent MagFS Agent MagFS Agent Our unique, multi-tier caching layers hide WAN latency and enable high throughput transfers (reads).
  • 20. APIs
  • 21. MCSP 3.0 - RESTful APIs 21 •  Control any aspect of Management via Web UI or our new RESTful APIs •  Full, programmatic control over a MCSP cluster •  Automate any or all aspects (e.g., provisioning, managing and monitoring) •  On-demand resource configuration •  Automate cloud resource usage for bursty workloads •  IaaS cost reduction (e.g., expand storage when required)
  • 22. Provisioning and Management APIs 22 0 50 VM lifecycle mgmt. MCSP lifecycle mgmt. Manual •  EC2 Management Console •  vSphere Client/vCenter Manual •  UI Driven Programmatic •  Cloud Formation •  vSphere APIs Programmatic •  RESTful API
  • 23. MCSP 3.0 - Simplified Operation 23 Home Folder Redirection •  Auto-mount home folders •  Simplifies user experience when accessing MCSP •  Simplifies integration within AD scripted infrastructure to mount network shares Access Based Enumeration •  Hide files and folders based on ACLs •  Enhanced security when sharing infrastructure across teams and organizations (users only see what they can access) ACL Manipulation tool •  Simplifies the task of managing file system ACLs independently of the IDM in use Multi-Share Web Services •  Pool multiple Web Servers together •  Multiple share access, single interface
  • 24. Operating Environment Enhanced Compatibility 24 Two File System Modes •  Mixed Mode (default) •  Full Windows file system semantics and POSIX compatibility •  Unicode support with respect to file names •  Windows PCs, Mac and Linux interoperability •  File locking supported on Windows PCs and Mac •  Case insensitive •  POSIX Mode •  POSIX file system semantics only (e.g., case sensitivity) •  Unicode support with respect to file names •  Linux and Mac interoperability •  Case sensitive
  • 25. With MCSP v3.0 - Admin Auditing Logs 25 Management UI - Active Directory Integration
  • 26. Licenses 26 From v3.0 onward, licenses are cluster-based and not tied to a share. E.g., a 10 TB license can be used for 10 x 1 TB shares or 1 x 10 TB share at your discretion. Licenses issued for <3.x deployments will not be compatible with 3.x. Equally the new MCSP 3.x license format is not backward compatible with older versions. •  30 day grace period in which to update your license •  Alerts are visible on the Management Server UI and via System Notifications (email) •  We required the FQDN of your Management Server to generate a 3.x license •  Existing, valid license will be updated for 3.x at no charge. Your existing license length and capacity will not be impacted.
  • 27. MCSP 3.0 - EMC ViPR object storage support 27 EMC ViPR Platform ViPR Controller Provisioning Self-Service Reporting Automation ViPR Data Services Third-Party Isilon Atmos VMAX VNX VPLEX Commodity XtremIOCentera Maginatics Virtual Filer Elastic NAS NAS Consolidation