Consolidate More: High Performance Primary Deduplication in the Age of Abundant Capacity
Upcoming SlideShare
Loading in...5
×
 

Consolidate More: High Performance Primary Deduplication in the Age of Abundant Capacity

on

  • 588 views

Increase productivity, efficiency and environmental savings by eliminating silos, preventing sprawl and reducing complexity by 50%. Using powerful consolidation systems, Hitachi Unified Storage or ...

Increase productivity, efficiency and environmental savings by eliminating silos, preventing sprawl and reducing complexity by 50%. Using powerful consolidation systems, Hitachi Unified Storage or Hitachi NAS Platform, lets you consolidate existing file servers and NAS devices on to fewer nodes. You can perform the same or even more work with fewer devices and lower overhead, while reducing floor space and associated power and cooling costs. View this webcast to learn how to: Shrink your primary file data without disrupting performance. Increase productivity and utilization of available capacity. Defer additional storage purchases. Save on power, cooling and space costs. For more information please visit: http://www.hds.com/products/file-and-content/network-attached-storage/?WT.ac=us_inside_rm_htchunfds

Statistics

Views

Total Views
588
Views on SlideShare
588
Embed Views
0

Actions

Likes
0
Downloads
2
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Consolidate More: High Performance Primary Deduplication in the Age of Abundant Capacity Consolidate More: High Performance Primary Deduplication in the Age of Abundant Capacity Presentation Transcript

  • CONSOLIDATE MORE: HIGH- PERFORMANCE PRIMARY DEDUPLICATION IN THE AGE OF ABUNDANT CAPACITY YONG KIM, TECHNICAL DIRECTOR, AMERICAS FILE AND CONTENT SOLUTIONS
  • Increase productivity, efficiency and environmental savings by eliminating silos, preventing sprawl and reducing complexity by 50%. Using powerful consolidation systems − Hitachi Unified Storage or Hitachi NAS Platform − lets you consolidate existing file servers and NAS devices onto fewer nodes. You can perform the same or even more work with fewer devices and lower overhead, while reducing floor space and associated power and cooling costs. Attend this webcast to learn how to  Shrink your primary file data without disrupting performance.  Increase productivity and utilization of available capacity.  Defer additional storage purchases.  Save on power, cooling and space costs. CONSOLIDATE MORE: HIGH-PERFORMANCE PRIMARY DEDUPLICATION IN THE AGE OF ABUNDANT CAPACITY WEBTECH EDUCATIONAL SERIES
  • UPCOMING WEBTECHS  Cloud and Object Store Series ‒ Environmental Pressures Driving an Evolution in File Storage, April 3, 9 a.m. PT, noon ET  Big Data Webcast Series Continues ‒ Big Data: Shining the Light on Enterprise Dark Data, April 17, 9 a.m. PT, noon ET ‒ HDS Big Data Roadmap, May 1, 9 a.m. PT, noon ET Check www.hds.com/webtech for  Links to the recording, the presentation, and Q&A (available next week)  Schedule and registration for upcoming WebTech sessions
  • CUSTOMER CHALLENGES Reduce the cost of storing data? Reduce the cost of protecting data? Manage distributed IT more effectively? Mitigate data risk? Gain IT agility? How do I Do more with less? Archive first Back up less Consolidate more
  • TIE IT ALL TOGETHER EDGE STORAGE ALTERNATE DATA CENTER REMOTE OFFICE APPLICATION APPLICATION APPLICATION HDDS SEARCH ACROSS THE POWER OF THE PORTFOLIO Reduce the cost of storing data Reduce the cost of protecting data Do more with less Back up less Consolidate more Reduce overall storage costs by reducing the load on primary storage by at least 40% Reduce licensing and management cost, complexity and backup by up to 75% CLOUD STORAGE MOBILE WORKFORCE HUS FILE MODULE
  • TIE IT ALL TOGETHER EDGE STORAGE ALTERNATE DATA CENTER REMOTE OFFICE APPLICATION APPLICATION APPLICATION HDDS SEARCH ACROSS THE POWER OF THE PORTFOLIO Reduce the cost of storing data Reduce the cost of protecting data Do more with less Consolidate more Streamline backup and restore operations by 50-60% Improve reliability with >24x improvement in RPO, >30x improvement in RTO Simplify management, improve data protection and reduce risk CLOUD STORAGE MOBILE WORKFORCE HUS FILE MODULE
  • TIE IT ALL TOGETHER EDGE STORAGE ALTERNATE DATA CENTER REMOTE OFFICE APPLICATION APPLICATION APPLICATION HDDS SEARCH ACROSS THE POWER OF THE PORTFOLIO Reduce the cost of storing data Reduce the cost of protecting data Do more with less Simplify management, improve data protection and reduce risk Reduce or eliminate CAPEX, simplify management, offload data from primary storage CLOUD STORAGE MOBILE WORKFORCE HUS FILE MODULE
  • DATA GROWTH CONTINUES UNABATED …  Data growth: Doubling every 18 months ‒ Unstructured data (files) growing even faster  Worldwide data creation exceeded 1 zettabyte in 2010 for the first time  40% projected growth in global data generated per year vs. 5% growth in global IT spend *
  • … FAR LESS OF THE DATA IS UNIQUE  75% duplicate data (IDC)  80% (McKinsey Global Institute)
  • DATA DEDUPLICATION  A storage-optimization technology ‒ Compression, SIS  Reduces data by eliminating multiple copies of redundant data and only keeping unique data  First made popular for backup (secondary) devices, the technology has been extended to support primary storage WHAT IS IT?
  • DATA DEDUPLICATION  Challenge for companies today continues to be the cost and associated cost of storage Data storage  Optimizing data in place, and reducing the on-disk footprint of data as it is stored provides immediate savings in capacity and new disk expenditures  Drive down the cost per gigabyte − store more information in the same gigabyte Data management  Reduces the volume of data that needs to be managed  Reduces the frequency of backups BUSINESS AND CUSTOMER BENEFITS
  • WHAT MARKET RESEARCH FIRMS ARE SAYING
  • WHAT MARKET RESEARCH FIRMS ARE SAYING “… the percentage of deployments with must- have primary dedupe ‘requirements’ will reach anywhere from 5% (conservative) to 22% (aggressive) by 2015”
  • WHAT HAPPENS DURING DEDUPLICATION After Dedupe
  • DEDUPE IN ACTION Owner: Steve File Name: homesteveworkReport.doc Size: 15 4K blocks Owner: Paul File Name: homepaulproforma.xls Size: 5 4K blocks Owner: John File Name: homejohntmpMyReport.doc Size: 17 4K blocks Owner: Mary File Name: homemarySteveReport.doc Size: 17 4K blocks Without Dedupe 54 4K Blocks Consumed With Dedupe Only 24 4K Blocks Consumed 30 4K Blocks (> 50%) Reclaimed
  • HITACHI NAS PLATFORM (HNAS) DEDUPLICATION OVERVIEW  Leverages HNAS unique hybrid core technology ‒ Indexing engine via CPU ‒ VLSI/FPGA technology  SHA256 hash of a data block detect duplicate  Up to 4 SHA calculators running in parallel  Post-processing ‒ File system data is analyzed and processed for dedupe after it is written to disk ‒ Not in data path – no risk of losing or being unable to access data  Dedupe index is used to store and identify duplicate blocks in a file system
  • IT’S ALL ABOUT POINTERS    Maximum (in theory) dedupe ratio is 239:1 ‒ A HNAS block can be shared up to 239 times ‒ For example, 478 duplicate blocks dedupe down to 2 blocks …
  • DEDUPE EFFICIENCY  Typical enterprises 2:1 to 5:1 data reduction  Higher in virtual environments 2:1 50% Savings 5:1 80% Savings 4:1 75% Savings 10:1 90% Savings 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
  • COMPETITIVE DIFFERENTIATION  Extreme performance ‒ Up to 450MB/sec post-ingest throughput rate  Dynamic quality of service (QoS) ‒ Avoid impacting application I/O ‒ Less degradation on I/O Performance  Simple to use ‒ Not a hardware appliance ‒ Little to no administration required
  • QOS / THROTTLING MECHANISMS  Automatic background process ‒ No complex scheduling process ‒ 24/7 operation ‒ No disruption to workflow  QoS/auto throttling ‒ When the file serving load passes beyond 50% (of available IOPS or throughput capacity), the engine throttles back
  • RESULTS FROM A LEADING MANUFACTURER REAL-WORLD RESULTS “The current HNAS algorithm appears to be far better than others (competitors) tested”
  • TIE IT ALL TOGETHER EDGE STORAGE ALTERNATE DATA CENTER REMOTE OFFICE APPLICATION APPLICATION APPLICATION CLOUD STORAGE HDDS SEARCH ACROSS THE POWER OF THE PORTFOLIO Reduce the cost of storing data Reduce the cost of protecting data Do more with less Archive first Back up less Consolidate more The intelligent archive is the strong foundation of the 21st Century data center
  • QUESTIONS AND DISCUSSION
  • UPCOMING WEBTECHS  Cloud and Object Store Series ‒ Environmental Pressures Driving an Evolution in File Storage, April 3, 9 a.m. PT, noon ET  Big Data Webcast Series Continues ‒ Big Data: Shining the Light on Enterprise Dark Data, April 17, 9 a.m. PT, noon ET ‒ HDS Big Data Roadmap, May 1, 9 a.m. PT, noon ET Check www.hds.com/webtech for  Links to the recording, the presentation, and Q&A (available next week)  Schedule and registration for upcoming WebTech sessions
  • THANK YOU