Breakout session during Proact's SYNC 2013, 18 september 2013.
Software Defined StorageClustered Data ONTAP: The Storage Hypervisor by Wessel Gans, NetApp
2. Business Impact Demands IT Agility
Maintain “excellent” service
level
Deliver more from your
resources
Be ready for the unanticipated
Accelerate the business with
new possibilities
2
6. Organizations Need IT to Move Further and Faster
Slow service delivery
Impact of downtime
Spiraling costs
Complexity at scale
Performance challenges
Inflexibility of siloed
architectures
3
8. Software Defined Data Center
An emerging architectural model where
resources are:
Delivered via API integration
Provisioned by policies
Defined in software
8
The promise:
Purchasers have more options
IT increases agility & operational efficiency
Users and app owners get services faster
9. Software Defined Storage
9
Application self-service
Autonomy & speed for app owners
Virtualized Storage Services
Efficiency, control, & automation
Provisioning via policies & service levels
Multi-Vendor Hardware
Deploy on platform of choice
11. 20 Years of Innovation in Software
11
First unified SAN and NAS appliance
Snapshot™
First network-attached storage appliance
Birth of an
industry and
storage efficiency
Clustering
across
SAN & NAS
Affordable data
protection
Unified storage
systems
Compounding
storage
efficiencies
Shared
virtualized
systems
Software
Clustered
storage
SnapMirror
®
replication
First unified dedupe
for primary/secondary
storage
Thin provisioning and
FlexClone®
16. Painting the Cloud with ONTAP
16
SVM SVM SVM SVM
VM VM VM VM
SVM SVM
Cloud Data CenterOn-Prem Data Center
17. Software Defined Storage, Today
17
SVM SVM SVM SVM
VM VM VM VM
SVM SVM
On-Prem Data Center Cloud Data Center
Multi-Vendor
Hardware
Virtualized
Storage
Services
Application
Self-Service
18. Clustered ONTAP Value Proposition
Non-Disruptive Operations
Save Money, Accelerate Business
Eliminate planned &
unplanned downtime
No application downtime for
maintenance and tech
refreshes or upgrades
Storage efficient backups
Conduct business 24x7
and evolve with business needs
Proven Efficiency
Lower OPEX and CAPEX
For Business At Any Scale
Secure multi-tenancy
Automation (policy based)
Storage QoS
Shared infrastructure for
enterprise apps
Storage efficiency
Virtual storage tiering
Increase productivity and scale, not
IT expense
Seamless Scalability
Pay As You Grow
69PB+ scale
Single container up to 20PB
(InfiniteVolume)
SAN scalability (8-node/49k
LUNs)
Achieve on-demand scale/flexibility
without impacting business
18
19. Separation between Control and Dataplane
19
Multiprotocol Data Plane
ONTAP Native NFS/CIFS/FC/FCoE/iSCSI
SVM SVM SVM SVM
Control Plane
ONTAP Programmable API
Native or Workflow Automation
21. OnCommand® Product Portfolio
OnCommand Management Software
Control
OnCommand System Manager
My AutoSupport™
OnCommand Report
Automate
OnCommand Unified Manager
OnCommand Workflow Automation
SnapManager® & SnapDrive® software
Analyze
OnCommand Insight
OnCommand Balance
IT Integration
Access
OnCommand Unified Manager; Insight;
Balance Connectors for BMC, CA
Virtual Storage Console
OnCommand Plug-ins for VMware and Microsoft
Develop NetApp SDK
21
22. What Is Workflow Automation (WFA)?
Highly Flexible Automation Framework
– Enable automation of simple to complex storage processes
– Open Source structure
An Operations Portal
– One-click to perform common tasks
– Authentication and Authorization
A point of integration
– Initiate 3rd party actions
– Drive WFA from Web Services
“The Easy Button”
22
23. Efficiency with Service Automation
23
4 VMs on Tier 1 Servers
NetApp
OnCommand®4 2TB LUNs
Thin Provisioned
Deduplicated
Replicated
4 2TB LUNs
“Gold” SLA
I need four 2TB
instances at the
Gold service level
NetApp SnapMirror®
Portal
26. Software-Defined Storage (SDS) Benefits
Autonomy for application owners/dev teams
– Instantly deploy new applications and services
– Dynamically respond to shifts in demand
Responsiveness for IT teams
– Provision based on priority and service level
– Automate via policy-based security and delegation
Flexibility for purchase decision makers
– Deploy on platform of choice
– Extend capabilities of existing assets
26
28. ING DIRECT Innovates with
NetApp, Cisco, and Microsoft Private Cloud
28
Accelerates
time to market
Business Impact
Positioned
for new product and
service delivery
rapid provisioning
capabilities with
fully integrated
testing and development
architecture
Increased Flexibility
Reduces
provisioning time
Increased Efficiency
Improves
developer
productivity
Established
cloud-enabled
operating model
“NetApp® technologies help us off-load
storage seamlessly behind the scenes without
overloading our infrastructure. For one
environment that’s a savings. When you’re
deploying many concurrently, it’s critical.”
Head of IT Strategy, ING DIRECT
the world's leading direct savings bank
Another NetApp solution delivered with
29. Bank-in-a-Box
ING Direct Innovates Faster with FlexPod
39 different environments, with 70 VMs per blade
Each environment uses 5.5TB storage
Provisioned 395 copies of the bank since November 2011
per march 2012 (Growing)
Takes under 10 minutes to provision a new BIAB instance
Really using 214TB of storage (39 x 5.5TB)
That’s 3900% storage amplification (214TB/5.5TBx100)
Server virtualization
with Microsoft Hyper-V
Stateless computing
with Cisco UCS
Storage efficiency with
NetApp FlexClone
29
31. Market Leading Storage Solutions
31
Flash Arrays
for ultra-high performance
E-Series
for price/performance at scale
StorageGRID
for web scale object storage
Clustered Data ONTAP
for Software Defined Storage
IT has traditionally focused on building cost-effective services for the organization. IT has thought a lot about the various technologies to run itself more efficiently, in fact many organizations put IT under the CFO as a way of ensuring that efficiency was the number 1 item on the agenda.Examples of how things are changing include… -Application-based silos are expensive to implement and manage -Multiple hardware architectures make management expensive and difficult -There are still too many manual processes -Traditional storage was architected for service or efficiency, but not both -Old analytic approaches aren’t optimized to deal with unstructured data, certainly not the quantities being created todayRunning an efficient IT organization continues to be critically important, but many of you are looking at how to have more impact on your business. The Data center is becoming virtualized and moving to a cloud-based model. How you thought, how you built, how you responded to business needs is changing. Today you’re thinking about how you can enable the business and have real business impact with on-demand services. Many CIO’s that I speak to are also being paid on the value that IT delivers, that will clearly influence change
What’s driving software-defined storage? It’s two things… a set of traditional business challenges, and the desire for agility (specifically from application administrators and development teams.) Traditional challenges include:IT takes too long to deliver services for new and existing appsIT downtime is hurting productivity, and internal and external customer satisfactionIt’s certainly about costs --costs of running the data center, from staffing, training and operations as well as capital expenditures for the devices inside of the data center;The issue of complexity at scale is not just scale in terms of data and volumes of data but scale in terms of number of devices and hardware-specific functionality; On the performance front, cloud computing and virtualization introduce a significant amount of abstraction between data and the hardware. Unexpected changes in the workload can be very disruptive.Taken in total, what we’re seeing very clearly are the weaknesses in the monolithic, siloed storage architectures that have traditionally been used.
SDDC is an emerging architecture and set of technologies that build upon existing cloud and virtualization modelsDesign goal is to enable resources to be defined in software, provisioned based on policy, and deployable on any hardwareInnovation to increase IT agility and operational efficiency while speeding delivery of services to application owners So what we've seen emerge from the technology vendors, to advance the delivery of these services to the application owners and IT end users, is this concept of Software Defined Data Center, where every device in the IT infrastructure will be consumed and managed through software-defined constructs such as service levels and quality of service, service policies, and charge back mechanisms. This emerging architectural model is designed to speed delivery of IT services while improving operational and resource efficiency. Built on cloud and virtualization models, SDDC has three core characteristics:Resources (compute, networks, security, and data storage) are defined in software, allowing more efficient use and reuse of equipment.Resources are provisioned based on policies and service levels, allowing a mix of workloads to use a shared pool of hardware.Resources can be deployed on a variety of hardware, providing more choice for the purchasing process.
Software-Defined Storage, or SDS, is one of the elements in the SDDC model, along with Software-Defined Compute, Network, and Security. SDS is about doing for storage what server virtualization did for servers--breaking down the physical barriers that that bind data to specific hardware, enabling greater operational efficiency, greater availability and lower cost. At NetApp, we're excited by the market energy around SDS, because it's so consistent with the direction we've been taking with our Storage Operating system, Data ONTAP. For years we've been attacking the challenges of the hardware-centric monolithic storage model—where data is imprisoned: its expense, complexity, and inflexibility. Our latest release, version 8.2, of Clustered Data ONTAP has capabilities that perfectly match the 3 core tenants of Software-Defined Storage:It is integrated with applications to allow application admins direct access and control;It’s a fully virtualized storage environment that allows provisioning based on SLAs, including performance, availability, and efficiency; andIt's deployable across a range of hardwareLet me tell you a bit more about how ONTAP delivers Software-Defined Storage, and why this gets CIOs so excited.
And Clustered ONTAP runs on the storage systems you already know. This is an important preservation of the investments you’ve made. We will continue to introduce new price-performance points, new nodes, that can be integrated into a cluster, or can be used to refresh older nodes in a cluster, providing a steady, incremental approach to infinite growth.
Now we are extending that to the cloud, and we are embracing the cloud in a couple of really interesting ways. Our recent announcement of Amazon Direct Connect, which incidentally in the last 12 months is probably one of the most interesting announcements we have made and we didn't even realize that. Triumph of culture over strategy. With Amazon Direct Connect, we extended the capabilities of ONTAP to the Amazon Cloud. The technology work that we are doing with the VSA program enables us to create again the Data ONTAP capabilities as a software appliance and make it completely hardware agnostic and hardware independent. So there's a lot of talk in the industry going on for software defined storage, and there is this mythical promise that people are making of saying there is this notion of software-defined storage, which is the only way you can create that data bus. Bullshit. It can’t. The reason why ONTAP can do it is because ONTAP is the bridge and gives the customer a completely risk free choice. It doesn't matter how you want to build that infrastructure. It will be some combination of public cloud and private cloud. Within your private cloud you will choose to build that infrastructure on NetApp's storage or somebody else's storage. You can choose to buy it as engineered systems or converged infrastructure. In the cloud you will choose your own cloud provider. It could be people by Amazon. Regardless of that, NetApp could give you a capability to make that completely frictionless, completely seamless. That is the promise of Clustered ONTAP. That is where we are heading. Peter and Eric, and a bunch of us used to stare at these slides which said “Data ONTAP strategy is to converge and complete”, and we said “what comes after complete?”. I think what is beyond complete is we have the opportunity to paint the cloud with ONTAP. I’m very excited about what clustered ONTAP can do.
Now we are extending that to the cloud, and we are embracing the cloud in a couple of really interesting ways. Our recent announcement of Amazon Direct Connect, which incidentally in the last 12 months is probably one of the most interesting announcements we have made and we didn't even realize that. Triumph of culture over strategy. With Amazon Direct Connect, we extended the capabilities of ONTAP to the Amazon Cloud. The technology work that we are doing with the VSA program enables us to create again the Data ONTAP capabilities as a software appliance and make it completely hardware agnostic and hardware independent. So there's a lot of talk in the industry going on for software defined storage, and there is this mythical promise that people are making of saying there is this notion of software-defined storage, which is the only way you can create that data bus. Bullshit. It can’t. The reason why ONTAP can do it is because ONTAP is the bridge and gives the customer a completely risk free choice. It doesn't matter how you want to build that infrastructure. It will be some combination of public cloud and private cloud. Within your private cloud you will choose to build that infrastructure on NetApp's storage or somebody else's storage. You can choose to buy it as engineered systems or converged infrastructure. In the cloud you will choose your own cloud provider. It could be people by Amazon. Regardless of that, NetApp could give you a capability to make that completely frictionless, completely seamless. That is the promise of Clustered ONTAP. That is where we are heading. Peter and Eric, and a bunch of us used to stare at these slides which said “Data ONTAP strategy is to converge and complete”, and we said “what comes after complete?”. I think what is beyond complete is we have the opportunity to paint the cloud with ONTAP. I’m very excited about what clustered ONTAP can do.
Now we are extending that to the cloud, and we are embracing the cloud in a couple of really interesting ways. Our recent announcement of Amazon Direct Connect, which incidentally in the last 12 months is probably one of the most interesting announcements we have made and we didn't even realize that. Triumph of culture over strategy. With Amazon Direct Connect, we extended the capabilities of ONTAP to the Amazon Cloud. The technology work that we are doing with the VSA program enables us to create again the Data ONTAP capabilities as a software appliance and make it completely hardware agnostic and hardware independent. So there's a lot of talk in the industry going on for software defined storage, and there is this mythical promise that people are making of saying there is this notion of software-defined storage, which is the only way you can create that data bus. Bullshit. It can’t. The reason why ONTAP can do it is because ONTAP is the bridge and gives the customer a completely risk free choice. It doesn't matter how you want to build that infrastructure. It will be some combination of public cloud and private cloud. Within your private cloud you will choose to build that infrastructure on NetApp's storage or somebody else's storage. You can choose to buy it as engineered systems or converged infrastructure. In the cloud you will choose your own cloud provider. It could be people by Amazon. Regardless of that, NetApp could give you a capability to make that completely frictionless, completely seamless. That is the promise of Clustered ONTAP. That is where we are heading. Peter and Eric, and a bunch of us used to stare at these slides which said “Data ONTAP strategy is to converge and complete”, and we said “what comes after complete?”. I think what is beyond complete is we have the opportunity to paint the cloud with ONTAP. I’m very excited about what clustered ONTAP can do.
Now we are extending that to the cloud, and we are embracing the cloud in a couple of really interesting ways. Our recent announcement of Amazon Direct Connect, which incidentally in the last 12 months is probably one of the most interesting announcements we have made and we didn't even realize that. Triumph of culture over strategy. With Amazon Direct Connect, we extended the capabilities of ONTAP to the Amazon Cloud. The technology work that we are doing with the VSA program enables us to create again the Data ONTAP capabilities as a software appliance and make it completely hardware agnostic and hardware independent. So there's a lot of talk in the industry going on for software defined storage, and there is this mythical promise that people are making of saying there is this notion of software-defined storage, which is the only way you can create that data bus. Bullshit. It can’t. The reason why ONTAP can do it is because ONTAP is the bridge and gives the customer a completely risk free choice. It doesn't matter how you want to build that infrastructure. It will be some combination of public cloud and private cloud. Within your private cloud you will choose to build that infrastructure on NetApp's storage or somebody else's storage. You can choose to buy it as engineered systems or converged infrastructure. In the cloud you will choose your own cloud provider. It could be people by Amazon. Regardless of that, NetApp could give you a capability to make that completely frictionless, completely seamless. That is the promise of Clustered ONTAP. That is where we are heading. Peter and Eric, and a bunch of us used to stare at these slides which said “Data ONTAP strategy is to converge and complete”, and we said “what comes after complete?”. I think what is beyond complete is we have the opportunity to paint the cloud with ONTAP. I’m very excited about what clustered ONTAP can do.
Now we are extending that to the cloud, and we are embracing the cloud in a couple of really interesting ways. Our recent announcement of Amazon Direct Connect, which incidentally in the last 12 months is probably one of the most interesting announcements we have made and we didn't even realize that. Triumph of culture over strategy. With Amazon Direct Connect, we extended the capabilities of ONTAP to the Amazon Cloud. The technology work that we are doing with the VSA program enables us to create again the Data ONTAP capabilities as a software appliance and make it completely hardware agnostic and hardware independent. So there's a lot of talk in the industry going on for software defined storage, and there is this mythical promise that people are making of saying there is this notion of software-defined storage, which is the only way you can create that data bus. Bullshit. It can’t. The reason why ONTAP can do it is because ONTAP is the bridge and gives the customer a completely risk free choice. It doesn't matter how you want to build that infrastructure. It will be some combination of public cloud and private cloud. Within your private cloud you will choose to build that infrastructure on NetApp's storage or somebody else's storage. You can choose to buy it as engineered systems or converged infrastructure. In the cloud you will choose your own cloud provider. It could be people by Amazon. Regardless of that, NetApp could give you a capability to make that completely frictionless, completely seamless. That is the promise of Clustered ONTAP. That is where we are heading. Peter and Eric, and a bunch of us used to stare at these slides which said “Data ONTAP strategy is to converge and complete”, and we said “what comes after complete?”. I think what is beyond complete is we have the opportunity to paint the cloud with ONTAP. I’m very excited about what clustered ONTAP can do.
Save capex and opex Faster response to provisioning for applications, VMs etc. Scale – Start small, pay as you growFlexibility to add capacity, performance and new applications as and when requiredReduce Risk by offering a single architecture enabling all applications. Enable the move to private cloud.
Now we are extending that to the cloud, and we are embracing the cloud in a couple of really interesting ways. Our recent announcement of Amazon Direct Connect, which incidentally in the last 12 months is probably one of the most interesting announcements we have made and we didn't even realize that. Triumph of culture over strategy. With Amazon Direct Connect, we extended the capabilities of ONTAP to the Amazon Cloud. The technology work that we are doing with the VSA program enables us to create again the Data ONTAP capabilities as a software appliance and make it completely hardware agnostic and hardware independent. So there's a lot of talk in the industry going on for software defined storage, and there is this mythical promise that people are making of saying there is this notion of software-defined storage, which is the only way you can create that data bus. Bullshit. It can’t. The reason why ONTAP can do it is because ONTAP is the bridge and gives the customer a completely risk free choice. It doesn't matter how you want to build that infrastructure. It will be some combination of public cloud and private cloud. Within your private cloud you will choose to build that infrastructure on NetApp's storage or somebody else's storage. You can choose to buy it as engineered systems or converged infrastructure. In the cloud you will choose your own cloud provider. It could be people by Amazon. Regardless of that, NetApp could give you a capability to make that completely frictionless, completely seamless. That is the promise of Clustered ONTAP. That is where we are heading. Peter and Eric, and a bunch of us used to stare at these slides which said “Data ONTAP strategy is to converge and complete”, and we said “what comes after complete?”. I think what is beyond complete is we have the opportunity to paint the cloud with ONTAP. I’m very excited about what clustered ONTAP can do.
FlexPod offers a broad choice of management solutions that deliver unique, differentiated value for FlexPod architecture and “built on” solutions.provides a broad choice of management solutions to address a variety of needs. From IT process management to self-service delivery, from virtual to physical infrastructure resource management, from operational automation to monitoring and analytics, fully customized to turn-key unified manageability.
=====================OnCommand Management Software includes a family of products designed to make NetApp storage the best solution for physical, virtual and cloud environments. This table highlights key products in the family.Control your NetApp storage with System Manager and My AutoSupport.System Manager provides simple, workflow-based wizards to automate the most common device management tasks. With System Manager, administrators can quickly set up and efficiently manage NetApp SAN and NAS systems using the expertise they already have.My AutoSupport is a web-based tool containing system configuration details, performance charts, events alerts, proactive in checks, configuration compare, ONTAP Upgrade Advisor and Storage Efficiency profiling features.Automate your NetApp storage infrastructure with OnCommand unified manager and SnapManager Software.OnCommand unified manager integrates the functions of Provisioning Manager, Protection Manager and Operations Manger into a single user interface. Using the OnCommand’s single user interface you can define storage service levels and policy based workflows to automate provisioning and protection of your shared storage infrastructure.SnapManager software provides the ability to automate protection of your data from the management console that you’re most familiar with. SnapManager software supports a wide variety of environments including Microsoft, VMware, Oracle and SAPAnalyze your complete shared IT infrastructure with the OnCommand Insight products. OnCommand Insight includes modules that provide visibility into your end to end infrastructure to help you optimize your shared IT infrastructure. The products formerly known as SANscreen and AkorriBalancePoint have now been integrated into OnCommand Insight. With OnCommand Insight you can optimize performance, plan your capacity requirements and assure that you are delivering to your service levels.IT Integration plug-ins provide access to OnCommand control and automation features from other management frameworks including VMware and Microsoft.Finally, using the OnCommand SDK and open APIs you can integrate with any orchestration and management framework to in a way that enables all the benefits of NetApp storage products.
Workflow Automation is a toolset and framework which provides a consistent way to define and execute common and/or repeatable processe that you might normally perform with the Data ONTAP command line or System Manager. It can be thought of as a “light” orchestration tool concerned chiefly with NetApp storage – this follows the philosophy of putting specific controls as close to the element being controlled as possible. WFA also provides a web portal so that common tasks can be run without needing a specialist storage administrator every time. This could form the basis of “self service” storage provisioning in some environments.The tool also provides a point of integration for NetApp storage with higher-order systems, such as enterprise-wide orchestration tools. Since it presents a web-services front-end, one benefit of using WFA this way is that storage workflows can be defined once in WFA, and then called from various different orchestration tools, which is helpful if the organisation hasn’t settled on a single enterprise orchestrator or if they want to change from one to another.
From a NetApp perspective, we see three primary groups inside an organization who benefit from SDS: App owners and development teams– These teams gain the ability to deploy new applications with much greater speed through open, programmable APIs and application integrations. They don’t have to wait for IT to serve their end consumers, so they are much more autonomous. In particular, they have a means to respond dynamically to shifts in demand or requests from their user base.IT teams focused on the data center– These teams can now shift away from simply provisioning hardware resources to provisioning based on policies and service levels. They no longer have to look to match hardware functionalities to service requests, or provision specific devices. Instead, once they have established a set of service-level policies they are now publishing for consumption, they shift into much more of a macro layer of management instead of a micro, hands on approach. They can focus more on overarching optimization of the data center, and scaling the set of services, rather than having to be the lead on each individual deployment. IT teams also gain a significant amount of security enhancements as well as role-based delegation once these policies are in place. These delegations are a key component in providing the autonomy to the app owners mentioned earlier.The last group that benefits from SDS are those in charge of making IT purchases. With software decoupled from pooled hardware resources, IT teams gain a lot of flexibility in terms of selecting appropriate hardware, making their choice based on application or deployment needs in terms of availability, performance or cost. SDS can also breathe new life into existing data center assets by delaying or helping to reduce net new capital requirements that arise due to changes within an application or a new direction for the IT group.
Huge opportunity and we’re in a very strong market position to…Revolutionize the world of shared infrastructure with Clustered Data ONTAPNo competitor can touch itHugely valuable to ITExploit the proven price/performance and high-reliability characteristics of the E-Series architectureContinue our presence in the emerging market of object storageDominate the storage market with the world’s best flash portfolio