SlideShare a Scribd company logo
Eliminating Storage Sprawl: Scale-out NAS for Virtualization
  ASP  WEB  Linux   DEV    HR Legacy Legacy   SQL   LOB File Servers  SQL Finance   CAD /   CAM Random Application and Server Sprawl Many underutilized servers and storage devices Costly to Manage Software updates and patches OS Versions Maintenance releases Security upgrades Backups Power consumption Underutilized Low CPU, RAM, and Disk usage In the 2 to 20% range Sub-optimal Availability Drives and storage components fail Traditional clustering unreliable
Physical Storage VMware Solves the Server Sprawl Problem Servers are virtualized and stacked Isilon’s Focus 	Run applications side-by-side VMware safely partitions servers into shared resource pools Stack applications within server Reduce physical server footprint Fewer servers to manage and backup 	Increase server utilization Since Virtual Machines (VMs) share server resources, each effectively can run at a higher utilization rate Server resources shared  	Centralize server management Example: backup multiple VMs (within one server) from a single point
Virtualization Storage Challenges Technical Challenge Impact to Business Server & storage proliferation Volumes locked to servers Storage not easily shared Monolithic scale-up storage not well-suited to virtualization Scalability limited Force over-buying / provisioning Storage complexity, brittleness Forces trade-offs in reliability for performance (or vice versa) ,[object Object]
Increased staff time
Trade-offs in protection levels, backups, and performance
Supply-side approach inflates capitol costs
Inefficient, unused system resources
Hinders business agility
Limits business agility
Systems hard to adapt
Changes introduce risk. ,[object Object]
File Server Sprawl on NAS Easy to Buy—not soEasy to Own, Scale, and Manage LUN sprawl (hidden complexity) “SAN”: RAID groups > Aggregates > Volumes > LUNs > File Systems > HBAs > Host File Systems (VMFS) NAS:  all of the above except HBAs and VMFS File system sprawl (complexity at scale) Other issues: availability, cost, etc.  /fs/01, /fs/02 RAID Groups & LUNs Storage Device #1 /fs/03, /fs/04 RAID Groups & LUNs Storage Device #2 /fs/05, /fs/06 RAID Groups & LUNs Storage Device #3
Scale-out NAS for Virtualization Reduce the cost of deploying and managing storage for large-scale virtual environments by over 35% Non-disruptive scalability Performance Capacity Maximize efficiency Higher utilization Pay-as-you-grow Volume-free provisioning Protect all Virtual Machines Cost-effectively Variable protection levels Clustered: NO SPOF All-Active HA failover Right-size on-the-fly Re-balance VMs across nodes and SmartConnect performance zones Rapidly deploy and consolidate storage for hundreds of Virtual Machines in minutes Setup and deploy a multi-terabyte cluster in minutes! Single  File System   Isilon’s OneFS Storage Device #1 Storage Device #2 Storage Device #3
Isilon IQ Enterprise-class hardware OneFS™intelligent software complete storage system Rapidly Deploy and Consolidate Storage Unprecedented simplicity Easy to setup, provision, manage, and change! Build a cluster in 30 minutes  Enterprise-class, integrated storage system Storage nodes: performance and capacity Expansion nodes: pure capacity Accelerators: pure performance Deploy virtual machines in minutes
Core Innovation  The Virtualization behind Clustered Storage Creates one giant Datastore Single file system, single volume Highest performance, fully symmetric cluster Easy to manage and grow                       Single unified platform across all products 9
Non-disruptive Scalability platform nodes Pure Performance Accelerator S-Series Backup Accelerator X-Series Linear Scaling of Performance & Capacity Independent Performance Scaling Capacity nodes EX-Series NL-Series Performance Independent Capacity Scaling Capacity
Maximize Storage EfficiencyScale-up vs. Scale-out Architecture Considerations Source: The Total Economic Impact of Isilon’s Clustered Storage System, Forrester 2008
100% AVAILABILITY 100% AVAILABILITY 100% AVAILABILITY 100% AVAILABILITY 100% AVAILABILITY 100% AVAILABILITY 100% AVAILABILITY 100% AVAILABILITY FAILED FAILED Comprehensive Data Protection Protect all Virtual Machines–at the Right Protection Level VMs stored on OneFS directory. For example:/ifs/farm1/vmachines OneFS protects all data, across all nodes in cluster All VMs striped across all nodes N+1    N+4 set on various levels File (individual VMs), Directory (multiple VMs), or Cluster (all VMs) 12 12
Reducing Acquisition Cost through Precision Right-Sizing "Large organizations feel the pain of traditional SANs in large VMware deployments.  With horizontal scaling of Isilon storage, we can right-size storage and performance for VMware, literally on the fly.    -- Storage Architect, World Leader in Jet Aircraft Engine Manufacturing and Testing  Start small From 10 TBs to 250 TBs  Pay-as-you-grow Single file systems image never change Non-disruptively scale capacity up to 3.4 PB in a single cluster Add pure capacity independently of performance  Easy to scale Add performance in minutes Add capacity nodes in minutes Core platform nodes S-Series X-Series NL-Series Linear Scaling of Performance  & Capacity “Isilon’s scale-out file storage is inherently more power efficient than NAS silos—adding what you need in granular increments, versus the gross over-provisioning that normally accompanies monolithic infrastructure silos.  Adding processing power independently also saves floor and rack space, improves performance, and significantly reduces power consumption.”
Scale-up vs. Scale-out NAS: TCOIf traditional NAS hardware were free – Isilon still offers a better 3-year TCO   Why this happens: Staffing – ease of management  Storage utilization  Effectively scale reliably Business Impact – Isilon is a better way to spend corporate money – freeing money to fund innovation and sustain the business    Source:The Total Economic Impact of Isilon’s Clustered Storage System, Forrester 2008
VMware on Isilon Customers
Server & Storage Consolidation Background Risk, financial and management consulting firm.  Also provides compliance and litigation support, data analysis, e-discovery, and data archiving services.  We love what both VMware and Isilon do; the solutions are exceptionally complimentary.  We’ve been able to streamline our entire IT operations, provide reliability and high availability—all by standardizing on clustered VMware servers and clustered storage from Isilon. We even moved a mission critical VMware application off of our Hitachi SAN and found it performed better on the Isilon.  --IT Director Infrastructure Challenge Managing storage for entire VMware environment Backing up multiple virtual machines quickly Managing more data with fewer people Solution Four Isilon IQ clusters in two locations—for production, e-discovery, archiving, and R&D SnapshotIQ used to clone virtual machines More than 70 virtual machines hosted on Isilon, including mission critical litigation app Only four people manage entire IT department, including all applications and 75TBs of storage.
Virtual Test Labs for Management Automation Background The market leader in self-service virtualization automation and lab management. Cloud hosting provider for test, development, and LOB application staging services.  Delivers end-products to name-brand accounts for IT professionals, business users, and testers/developers.  Benefits Easy of installation and management High availability Performance: exceeded goals by 2x: 4Gb/sec reads from 70 VMs  Rapid provisioning: single point of management for batch-deployment of many Virtual Machines.   Cloud Hosting Challenge Support dynamic, large scale cloud hosting environment for 1800+ Virtual Machines, reliably, at the right price-performance.  Pass strict Surgient compliance testing. Performance on traditional NAS topped out—and scalability proved impossible.  Required 2Gbps+ which traditional NAS could not provide Solution 5 IQ12000X, 1 Accelerator X with redundant IB switches Achieved 4Gb/sec reads from 70 VMs running Iometer Passed all other requirements Isilon Cluster NAS
Summary Scale-out NAS well suited to  Large or dynamic environments—many VMs Smaller environments requiring simplicity Reduce storage management costs by 35% over traditional NAS Rapidly deploy and consolidate storage Non-disruptively scale performance and capacity, without changes to host servers Maximize efficiency—30% over traditional NAS Protect all Virtual Machines cost-effectively Fine grained data protection  Choice of certified backup partners Optimize and right-size the system on the fly.
Backup Scenarios for Virtualization
Backup Options
Option 1: SyncIQ with VMware Could be used to replicate and restore VMs  Best practice:  Schedule snapshots in VirtualCenter on target Replicate snapshot delta files Extremely flexible: replicate single or multiple VMs VMware Site Recovery Manager (SRM) for NAS on VMware roadmap  Isilon will support SRM VM3 VM2 VM1 SyncIQ 2 transfers entire VMDK files SyncIQ 2.5 transfers only changed blocks
Option 2: VMware Tape BackupNDMP Backup full VMs directly from Isilon storage to tape Currently only 3-way NDMP Upcoming 2-way NDMP with Isilon IQ Backup Accelerator Use Isilon Snapshots to create point-in-time copies of VMs Compatible with all Isilon-certified NDMP backup applications Symantec, EMC, Commvault, Bakbone, Atempo Upcoming IBM TSM support with Isilon IQ Backup Accelerator VM3 VM2 VM1 NDMP file based incremental means entire VMDKs are always backed up
Option 3: VMware Consolidated Backup (VCB) Use Backup Vendor VCB proxy to coordinate VMware snapshots with backup Backup full VM images or individual VM files on Windows VMs only. True fullncremental VM backups – only backs up changed blocks Compatible with all vendors that supply VCB agents. So far have only tested with Symantec. Uses ESX server as a resource to move backup data to VCB proxy tape
Option 4: SnapshotIQ with VMware OneFS snapshots could be used to store VM snapshots Storage-based snapshots Not crash consistent The process could be automated to create application consistent VM snapshot with VMware scripts Take VM snapshot Isilon snapshot Delete VM snapshot No instant snapshot restore: customer needs to copy snapshots manually or write scripts 8:00 VM snapped 9:14 VM restored 9:10 VM deleted
Options 5 and 6: Backup Agents Leverage licenses already purchased Functionality depends on Backup and Restore Application Most support granular, object-based restore Requires knowledge of applications inside VMs Primary Site

More Related Content

Recently uploaded

Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
 
Speed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in MinutesSpeed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in Minutesconfluent
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform EngineeringJemma Hussein Allen
 
НАДІЯ ФЕДЮШКО БАЦ «Професійне зростання QA спеціаліста»
НАДІЯ ФЕДЮШКО БАЦ  «Професійне зростання QA спеціаліста»НАДІЯ ФЕДЮШКО БАЦ  «Професійне зростання QA спеціаліста»
НАДІЯ ФЕДЮШКО БАЦ «Професійне зростання QA спеціаліста»QADay
 
UiPath Test Automation using UiPath Test Suite series, part 2
UiPath Test Automation using UiPath Test Suite series, part 2UiPath Test Automation using UiPath Test Suite series, part 2
UiPath Test Automation using UiPath Test Suite series, part 2DianaGray10
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Frank van Harmelen
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualityInflectra
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
 
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptxUnpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptxDavid Michel
 
"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor TurskyiFwdays
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...Product School
 
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptxIOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptxAbida Shariff
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Product School
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsPaul Groth
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Product School
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfCheryl Hung
 

Recently uploaded (20)

Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
 
Speed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in MinutesSpeed Wins: From Kafka to APIs in Minutes
Speed Wins: From Kafka to APIs in Minutes
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
 
НАДІЯ ФЕДЮШКО БАЦ «Професійне зростання QA спеціаліста»
НАДІЯ ФЕДЮШКО БАЦ  «Професійне зростання QA спеціаліста»НАДІЯ ФЕДЮШКО БАЦ  «Професійне зростання QA спеціаліста»
НАДІЯ ФЕДЮШКО БАЦ «Професійне зростання QA спеціаліста»
 
UiPath Test Automation using UiPath Test Suite series, part 2
UiPath Test Automation using UiPath Test Suite series, part 2UiPath Test Automation using UiPath Test Suite series, part 2
UiPath Test Automation using UiPath Test Suite series, part 2
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
 
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptxUnpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
Unpacking Value Delivery - Agile Oxford Meetup - May 2024.pptx
 
"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
 
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptxIOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
IOS-PENTESTING-BEGINNERS-PRACTICAL-GUIDE-.pptx
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
 

Featured

PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024Neil Kimberley
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)contently
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024Albert Qian
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsKurio // The Social Media Age(ncy)
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Search Engine Journal
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summarySpeakerHub
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next Tessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentLily Ray
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best PracticesVit Horky
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project managementMindGenius
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...RachelPearson36
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Applitools
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at WorkGetSmarter
 
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...DevGAMM Conference
 

Featured (20)

Skeleton Culture Code
Skeleton Culture CodeSkeleton Culture Code
Skeleton Culture Code
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work
 
ChatGPT webinar slides
ChatGPT webinar slidesChatGPT webinar slides
ChatGPT webinar slides
 
More than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike RoutesMore than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike Routes
 
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
 

Scale out NAS for VMware Virtualization by Isilon

  • 1. Eliminating Storage Sprawl: Scale-out NAS for Virtualization
  • 2. ASP WEB Linux DEV HR Legacy Legacy SQL LOB File Servers SQL Finance CAD / CAM Random Application and Server Sprawl Many underutilized servers and storage devices Costly to Manage Software updates and patches OS Versions Maintenance releases Security upgrades Backups Power consumption Underutilized Low CPU, RAM, and Disk usage In the 2 to 20% range Sub-optimal Availability Drives and storage components fail Traditional clustering unreliable
  • 3. Physical Storage VMware Solves the Server Sprawl Problem Servers are virtualized and stacked Isilon’s Focus Run applications side-by-side VMware safely partitions servers into shared resource pools Stack applications within server Reduce physical server footprint Fewer servers to manage and backup Increase server utilization Since Virtual Machines (VMs) share server resources, each effectively can run at a higher utilization rate Server resources shared Centralize server management Example: backup multiple VMs (within one server) from a single point
  • 4.
  • 6. Trade-offs in protection levels, backups, and performance
  • 12.
  • 13. File Server Sprawl on NAS Easy to Buy—not soEasy to Own, Scale, and Manage LUN sprawl (hidden complexity) “SAN”: RAID groups > Aggregates > Volumes > LUNs > File Systems > HBAs > Host File Systems (VMFS) NAS: all of the above except HBAs and VMFS File system sprawl (complexity at scale) Other issues: availability, cost, etc. /fs/01, /fs/02 RAID Groups & LUNs Storage Device #1 /fs/03, /fs/04 RAID Groups & LUNs Storage Device #2 /fs/05, /fs/06 RAID Groups & LUNs Storage Device #3
  • 14. Scale-out NAS for Virtualization Reduce the cost of deploying and managing storage for large-scale virtual environments by over 35% Non-disruptive scalability Performance Capacity Maximize efficiency Higher utilization Pay-as-you-grow Volume-free provisioning Protect all Virtual Machines Cost-effectively Variable protection levels Clustered: NO SPOF All-Active HA failover Right-size on-the-fly Re-balance VMs across nodes and SmartConnect performance zones Rapidly deploy and consolidate storage for hundreds of Virtual Machines in minutes Setup and deploy a multi-terabyte cluster in minutes! Single File System Isilon’s OneFS Storage Device #1 Storage Device #2 Storage Device #3
  • 15. Isilon IQ Enterprise-class hardware OneFS™intelligent software complete storage system Rapidly Deploy and Consolidate Storage Unprecedented simplicity Easy to setup, provision, manage, and change! Build a cluster in 30 minutes Enterprise-class, integrated storage system Storage nodes: performance and capacity Expansion nodes: pure capacity Accelerators: pure performance Deploy virtual machines in minutes
  • 16. Core Innovation The Virtualization behind Clustered Storage Creates one giant Datastore Single file system, single volume Highest performance, fully symmetric cluster Easy to manage and grow Single unified platform across all products 9
  • 17. Non-disruptive Scalability platform nodes Pure Performance Accelerator S-Series Backup Accelerator X-Series Linear Scaling of Performance & Capacity Independent Performance Scaling Capacity nodes EX-Series NL-Series Performance Independent Capacity Scaling Capacity
  • 18. Maximize Storage EfficiencyScale-up vs. Scale-out Architecture Considerations Source: The Total Economic Impact of Isilon’s Clustered Storage System, Forrester 2008
  • 19. 100% AVAILABILITY 100% AVAILABILITY 100% AVAILABILITY 100% AVAILABILITY 100% AVAILABILITY 100% AVAILABILITY 100% AVAILABILITY 100% AVAILABILITY FAILED FAILED Comprehensive Data Protection Protect all Virtual Machines–at the Right Protection Level VMs stored on OneFS directory. For example:/ifs/farm1/vmachines OneFS protects all data, across all nodes in cluster All VMs striped across all nodes N+1  N+4 set on various levels File (individual VMs), Directory (multiple VMs), or Cluster (all VMs) 12 12
  • 20. Reducing Acquisition Cost through Precision Right-Sizing "Large organizations feel the pain of traditional SANs in large VMware deployments. With horizontal scaling of Isilon storage, we can right-size storage and performance for VMware, literally on the fly. -- Storage Architect, World Leader in Jet Aircraft Engine Manufacturing and Testing Start small From 10 TBs to 250 TBs Pay-as-you-grow Single file systems image never change Non-disruptively scale capacity up to 3.4 PB in a single cluster Add pure capacity independently of performance Easy to scale Add performance in minutes Add capacity nodes in minutes Core platform nodes S-Series X-Series NL-Series Linear Scaling of Performance & Capacity “Isilon’s scale-out file storage is inherently more power efficient than NAS silos—adding what you need in granular increments, versus the gross over-provisioning that normally accompanies monolithic infrastructure silos. Adding processing power independently also saves floor and rack space, improves performance, and significantly reduces power consumption.”
  • 21. Scale-up vs. Scale-out NAS: TCOIf traditional NAS hardware were free – Isilon still offers a better 3-year TCO Why this happens: Staffing – ease of management Storage utilization Effectively scale reliably Business Impact – Isilon is a better way to spend corporate money – freeing money to fund innovation and sustain the business Source:The Total Economic Impact of Isilon’s Clustered Storage System, Forrester 2008
  • 22. VMware on Isilon Customers
  • 23. Server & Storage Consolidation Background Risk, financial and management consulting firm. Also provides compliance and litigation support, data analysis, e-discovery, and data archiving services. We love what both VMware and Isilon do; the solutions are exceptionally complimentary. We’ve been able to streamline our entire IT operations, provide reliability and high availability—all by standardizing on clustered VMware servers and clustered storage from Isilon. We even moved a mission critical VMware application off of our Hitachi SAN and found it performed better on the Isilon. --IT Director Infrastructure Challenge Managing storage for entire VMware environment Backing up multiple virtual machines quickly Managing more data with fewer people Solution Four Isilon IQ clusters in two locations—for production, e-discovery, archiving, and R&D SnapshotIQ used to clone virtual machines More than 70 virtual machines hosted on Isilon, including mission critical litigation app Only four people manage entire IT department, including all applications and 75TBs of storage.
  • 24. Virtual Test Labs for Management Automation Background The market leader in self-service virtualization automation and lab management. Cloud hosting provider for test, development, and LOB application staging services. Delivers end-products to name-brand accounts for IT professionals, business users, and testers/developers. Benefits Easy of installation and management High availability Performance: exceeded goals by 2x: 4Gb/sec reads from 70 VMs Rapid provisioning: single point of management for batch-deployment of many Virtual Machines. Cloud Hosting Challenge Support dynamic, large scale cloud hosting environment for 1800+ Virtual Machines, reliably, at the right price-performance. Pass strict Surgient compliance testing. Performance on traditional NAS topped out—and scalability proved impossible. Required 2Gbps+ which traditional NAS could not provide Solution 5 IQ12000X, 1 Accelerator X with redundant IB switches Achieved 4Gb/sec reads from 70 VMs running Iometer Passed all other requirements Isilon Cluster NAS
  • 25. Summary Scale-out NAS well suited to Large or dynamic environments—many VMs Smaller environments requiring simplicity Reduce storage management costs by 35% over traditional NAS Rapidly deploy and consolidate storage Non-disruptively scale performance and capacity, without changes to host servers Maximize efficiency—30% over traditional NAS Protect all Virtual Machines cost-effectively Fine grained data protection Choice of certified backup partners Optimize and right-size the system on the fly.
  • 26. Backup Scenarios for Virtualization
  • 28. Option 1: SyncIQ with VMware Could be used to replicate and restore VMs Best practice: Schedule snapshots in VirtualCenter on target Replicate snapshot delta files Extremely flexible: replicate single or multiple VMs VMware Site Recovery Manager (SRM) for NAS on VMware roadmap Isilon will support SRM VM3 VM2 VM1 SyncIQ 2 transfers entire VMDK files SyncIQ 2.5 transfers only changed blocks
  • 29. Option 2: VMware Tape BackupNDMP Backup full VMs directly from Isilon storage to tape Currently only 3-way NDMP Upcoming 2-way NDMP with Isilon IQ Backup Accelerator Use Isilon Snapshots to create point-in-time copies of VMs Compatible with all Isilon-certified NDMP backup applications Symantec, EMC, Commvault, Bakbone, Atempo Upcoming IBM TSM support with Isilon IQ Backup Accelerator VM3 VM2 VM1 NDMP file based incremental means entire VMDKs are always backed up
  • 30. Option 3: VMware Consolidated Backup (VCB) Use Backup Vendor VCB proxy to coordinate VMware snapshots with backup Backup full VM images or individual VM files on Windows VMs only. True fullncremental VM backups – only backs up changed blocks Compatible with all vendors that supply VCB agents. So far have only tested with Symantec. Uses ESX server as a resource to move backup data to VCB proxy tape
  • 31. Option 4: SnapshotIQ with VMware OneFS snapshots could be used to store VM snapshots Storage-based snapshots Not crash consistent The process could be automated to create application consistent VM snapshot with VMware scripts Take VM snapshot Isilon snapshot Delete VM snapshot No instant snapshot restore: customer needs to copy snapshots manually or write scripts 8:00 VM snapped 9:14 VM restored 9:10 VM deleted
  • 32. Options 5 and 6: Backup Agents Leverage licenses already purchased Functionality depends on Backup and Restore Application Most support granular, object-based restore Requires knowledge of applications inside VMs Primary Site
  • 34.
  • 35.
  • 36. VMs are spread across all nodes
  • 37. All VMs protected from server and storage failures
  • 38. Rapid NFS failover provided for each ESX ServerSmartConnect All-active Storage High Availability OneFS NFS failover using SmartConnect takes 1 to 2 seconds
  • 39. Isilon SmartConnect Advanced Highly Differentiated, All-active NFS Failover Solution for Virtualization SmartConnect failover supported in VMware VirtualCenter 3.x Dynamic IP addresses used in lieu of DNS zone name VirtualCenter features such as VMotion fully supported Capabilities Datastore shared across multiple ESX servers All-active NFS failover
  • 41.
  • 42. Host-based replication solutions from Partners such as Vizioncore
  • 43. Certified Backup Partners: Symantec, Commvault, Bakbone, EMCPrimary Site Recovery Site VirtualCenter
  • 44. SyncIQ for VMware Update Replicate and restore VMs from site to site Best-practice: Replicate ESX-based snapshots from source Extremely flexible, could be used to replicate single or multiple VMs SyncIQ 2 transfers entire snapshot delta or VM VM3 VM2 VM1 Roadmap VMware Site Recovery Manager (SRM) for NAS (Q209). Participating in beta program. SyncIQ 2.5: transfers only changed blocks.

Editor's Notes

  1. SyncIQ could be used to replicate and restore VMs. It is always good to enable snapshot creation at destination so that we always have file system consistent snapshot at target. This option is present as part of SyncIQ job policy creation menu on WebGUI.SyncIQ 2.5 has major improvement to reduce the amount of data flowing from source to target. The new SyncIQ will only transfer changed blocks of files. The SyncIQ is extremely flexible as it supports replication at any directory level. This allows us to have policies where could replicate either single or specific set of VMs.The SyncIQ only provides data replication of VMs. But for complete DR we require support of host software which automates the process of DR. The VMware Site Recovery Manager is one such software. Currently it has roadmap to support NAS storage and we are working with VMware to integrate Isilon storage to work with VMware SRM software.
  2. Isilon snapshots could be used to store VM snapshots. This could give performance improvements since ESX server doesn’t have to to go through the snapshot tree to resolve block accesses. The entire process could be automated with VM scripts which could be written wither in perl, VB etc. More information could be gathered from VMware developer forum portal. One important thing to note is that we do not provide advanced restore, hence in case customer would like to revert to previous VM snapshot , then it would have to be done by copying the contents from ifs snapshot directory.
  3. SyncIQ could be used to replicate and restore VMs. It is always good to enable snapshot creation at destination so that we always have file system consistent snapshot at target. This option is present as part of SyncIQ job policy creation menu on WebGUI.SyncIQ 2.5 has major improvement to reduce the amount of data flowing from source to target. The new SyncIQ will only transfer changed blocks of files. The SyncIQ is extremely flexible as it supports replication at any directory level. This allows us to have policies where could replicate either single or specific set of VMs.The SyncIQ only provides data replication of VMs. But for complete DR we require support of host software which automates the process of DR. The VMware Site Recovery Manager is one such software. Currently it has roadmap to support NAS storage and we are working with VMware to integrate Isilon storage to work with VMware SRM software.