Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Storage School 1


Published on

Published in: Technology
  • Be the first to comment

Storage School 1

  1. 1. Storage School I An introduction to the world of storage
  2. 2. Storage School I: An introduction to the world of storage Presented by Stephen Foskett Director of the Data Practice Contoural [email_address]
  3. 3. The world of storage can be daunting the uninitiated. This session provides all of the background that you will need to get started in the world of storage. We will start with the basic concepts: SAN vs. NAS, block vs. file, RAID levels, and other basic topics. These are woven together in a lively lesson, explaining how we got here and why it all matters. We will finish up with a brief discussion of how storage fits within the big picture of enterprise IT.
  4. 4. WHAT I ASSUME YOU KNOW <ul><li>Storage School I assumes no prior knowledge of storage topics, but a basic comprehension of computing and networks would be helpful. </li></ul>
  5. 5. BY THE END OF THE SESSION, YOU’LL KNOW THE FOLLOWING: <ul><li>A bit of history and context </li></ul><ul><li>Five Important Concepts: </li></ul><ul><ul><li>Storage outside the computer </li></ul></ul><ul><ul><li>Blocks and files </li></ul></ul><ul><ul><li>The importance of SCSI </li></ul></ul><ul><ul><li>What RAID is and why it’s important </li></ul></ul><ul><ul><li>The three kinds of storage arrays </li></ul></ul><ul><li>How it all fits together in a storage architecture </li></ul>
  6. 6. How involved with storage are you? <ul><li>I’m soaking in it! (it’s my job) </li></ul><ul><li>Touch and go (I’m involved but not all the time) </li></ul><ul><li>I just stepped in quicksand! (I’m new to all this) </li></ul><ul><li>Cardboard boxes and tape! (what’s this all about?) </li></ul>
  7. 7. NIL NOVI SUB SOLE (There Is Nothing New Under The Sun) <ul><li>The basic concepts of storage are not new and most are easy to grasp once the reasoning and history behind them is understood </li></ul><ul><li>Simply put, the storage world of today is the result of consolidation, networking, and sharing of resources </li></ul><ul><li>We mostly talk about open systems now, but much of the work was pioneered in the world of mainframes and minicomputers </li></ul>
  8. 8. Important Concept #1: Storage is Outside the Computer <ul><li>Mainframe storage has always been located in a separate cabinet </li></ul><ul><ul><li>IBM introduced the first disk drive system in 1956, the 350 disk storage unit </li></ul></ul><ul><ul><li>The storage industry was born with “plug-compatible” storage for the System/360’s 2311 and 2314 DAS in the 1960s </li></ul></ul><ul><ul><li>Bus-and-tag became ESCON in 1990 </li></ul></ul><ul><li>Open systems storage moved outside later </li></ul><ul><ul><li>Seagate’s 1980 introduction of the ST506 brought hard disk storage to the personal computer </li></ul></ul><ul><ul><li>Introduced in 1986, SCSI allowed personal computers and servers to access external storage </li></ul></ul>IBM 350 IBM 2314 ST506 ESCON SCSI
  9. 9. We’re Used to External Storage Today <ul><li>External disks are common from PCs to servers </li></ul><ul><ul><li>FireWire and USB storage is used on PCs </li></ul></ul><ul><ul><li>External Serial ATA (eSATA) is becoming more common </li></ul></ul><ul><ul><li>Servers still use SCSI, but also commonly use Fibre Channel </li></ul></ul><ul><li>Networked storage is also gaining attention </li></ul><ul><ul><li>NAS and iSCSI use common Ethernet and IP protocols </li></ul></ul><ul><li>Enterprise storage generally consists of SCSI, Fibre Channel, and Ethernet </li></ul>FireWire and USB eSATA Ethernet Fibre Channel
  10. 10. Important Concept #2: Blocks and Files <ul><li>Disk drives (and things like disk drives) organize data in blocks </li></ul><ul><ul><li>Equal-sized units have unique addresses on the disk </li></ul></ul><ul><li>People (and most applications) organize data as files in folder hierarchies </li></ul><ul><li>Filesystem drivers in the operating system translate file requests to block addresses </li></ul>
  11. 11. Most Enterprise Storage Systems and Protocols are Block or File Based <ul><li>Block protocols require a filesystem driver in the computer to locate files </li></ul><ul><ul><li>SCSI, Fibre Channel, and iSCSI </li></ul></ul><ul><ul><li>Also USB, FireWire, thumb drives – anything that acts like a disk drive </li></ul></ul><ul><li>File-based devices handle the file translation and organization themselves </li></ul><ul><ul><li>File servers and NAS arrays return data based on directory location and filename </li></ul></ul><ul><li>Content-addressable storage (CAS) is something else altogether </li></ul><ul><ul><li>CAS uses a hash of the content itself (block or file) to create a unique address for data </li></ul></ul>
  12. 12. SAN and NAS <ul><li>A storage area network (SAN) is a block storage network </li></ul><ul><ul><li>SCSI “initiators” (servers) talk to “targets” (disks or arrays) and request access to logical sets of block storage (LUNs) </li></ul></ul><ul><ul><li>SAN implies FC or iSCSI storage </li></ul></ul><ul><li>Network-attached storage (NAS) is a file storage network </li></ul><ul><ul><li>Clients request files from file servers or NAS arrays (“filers”) </li></ul></ul><ul><ul><li>Common NAS protocols include CIFS/SMB for Windows and NFS for UNIX </li></ul></ul><ul><ul><li>A network of NAS devices has been dubbed a file area network (FAN) </li></ul></ul>
  13. 13. Important Concept #3: Most Enterprise Block Storage Uses SCSI <ul><li>SCSI is the foundation of all current enterprise block storage protocols </li></ul><ul><ul><li>“ SCSI” is both a command set and physical specification </li></ul></ul><ul><li>Thick parallel SCSI cables of old have been replaced by new connections </li></ul><ul><ul><li>“ Fibre Channel” = SCSI commands over Fibre Channel Protocol on optical fiber or copper cables </li></ul></ul><ul><ul><li>iSCSI = SCSI commands over TCP/IP, commonly over Ethernet </li></ul></ul><ul><ul><li>SAS = SCSI commands over some FCP services and a serial transport based on Serial ATA (SATA) </li></ul></ul><ul><li>Mainframes now use FICON which is like ESCON over FCP (not SCSI) </li></ul>SCSI commands FCP Optical/Copper “ Fibre Channel” SCSI commands Partial FCP SATA Copper Serial Attached SCSI (SAS) SCSI commands TCP/IP Optical/Copper iSCSI Ethernet/other
  14. 14. … But other protocols are used by disk drives <ul><li>Serial ATA (SATA) is used in lower-end drives </li></ul><ul><ul><li>Replaced parallel ATA, also called IDE </li></ul></ul><ul><ul><li>SATA is quick, common, and cheap </li></ul></ul><ul><li>Serial-Attached SCSI (SAS) is the next tier </li></ul><ul><ul><li>Replaced parallel SCSI as higher-end drive </li></ul></ul><ul><ul><li>Shares common components with SATA but adds SCSI command set (and “command queueing”) </li></ul></ul><ul><li>Native Fibre Channel drives are still tops </li></ul><ul><ul><li>Have non-optical FC interconnect </li></ul></ul><ul><li>Enterprise drives versus desktop drives </li></ul><ul><ul><li>Enterprise are more sturdy and pass more rigorous tests </li></ul></ul><ul><ul><li>Spinning speed (RPM) has huge impact on performance </li></ul></ul>
  15. 15. Important Concept #4: RAID Combines Disks <ul><li>A Redundant Array of Independent Disks (RAID) is a combination of disk drives acting as one </li></ul><ul><ul><li>RAID can improve performance and reliability </li></ul></ul><ul><li>RAID is as old as storage </li></ul><ul><ul><li>IBM patented the general concept in 1978 </li></ul></ul><ul><ul><li>David Patterson, Garth Gibson, and Randy Katz defined five idealized RAID “levels” in 1988 </li></ul></ul><ul><ul><li>The “I” originally stood for “inexpensive”, but this proved to be inaccurate once arrays were produced for sale! </li></ul></ul><ul><li>Today there are literally dozens of different implementations of the RAID concept </li></ul>
  16. 16. Common RAID Levels <ul><li>RAID 0 “Stripe” </li></ul><ul><li>Poor reliability – no data protection and double the chance of failure! </li></ul><ul><li>No “wasted” space </li></ul><ul><li>Fast reads and writes – 2x! </li></ul><ul><li>RAID 1 “Mirror” </li></ul><ul><li>Good reliability </li></ul><ul><li>50% overhead for data protection </li></ul><ul><li>50% “wasted” space </li></ul><ul><li>2x fast reads but slower writes </li></ul>
  17. 17. Common RAID Levels <ul><li>RAID 4 “Dedicated parity” </li></ul><ul><li>Good data protection </li></ul><ul><li>Less “wasted” space (N-1) </li></ul><ul><li>Nx faster reads but slower writes </li></ul><ul><li>Parity across blocks means lots of recalculation if they’re not written at the same time </li></ul><ul><li>RAID 5 “Striped parity” </li></ul><ul><li>Good data protection </li></ul><ul><li>Less “wasted” space (N-1) </li></ul><ul><li>Nx faster reads but slower writes </li></ul><ul><li>Parity for each block means they can easily be written individually </li></ul>P P P P P P P P
  18. 18. RAID Mashups <ul><li>It is common to “stack” RAID levels as “RAID X+Y” where “X” is laid over top of “Y” </li></ul><ul><ul><li>RAID 0+1 (or RAID 01) is mirrored stripes </li></ul></ul><ul><ul><li>RAID 1+0 (or RAID 10) is striped mirrors </li></ul></ul><ul><ul><li>RAID 5+0 (or RAID 50) is striped RAID 5 </li></ul></ul><ul><li>RAID 6 or RAID DP has two parity slots – either a duplicate or an alternate calculation </li></ul><ul><li>RAID E mixes a hot spare disk into the striping </li></ul><ul><li>Some vendors use RAID on a region of a disk instead of a whole disk drive </li></ul>
  19. 19. Important Concept #5: There are Three Kinds of Storage Array <ul><li>Monolithic arrays are large cabinets with many disk slots, controllers, and I/O paths </li></ul><ul><ul><li>IBM, EMC, and HDS started with the mainframe </li></ul></ul><ul><li>Modular arrays use a 1- or 2-controller “head” and generic disk shelves that can be added as needed </li></ul><ul><ul><li>3Com was followed by NetApp, CLARiiON, etc… </li></ul></ul><ul><ul><li>Clustered heads and SAN storage can be used </li></ul></ul><ul><li>Grid arrays have small nodes with a few drives that team up in flexible clusters for performance and reliability </li></ul><ul><ul><li>Upstart CAS and iSCSI arrays were first to use this concept </li></ul></ul>Grid array Monolithic array Modular array
  20. 20. Choices Abound for Networked Enterprise Storage <ul><li>No matter if you’re looking for SAN, NAS, iSCSI, or CAS there are lots of options </li></ul><ul><ul><li>There are monolithic, modular, and grid devices that support most protocols </li></ul></ul><ul><li>Every type of equipment and protocol could support every type of application </li></ul><ul><ul><li>Databases can run great on NAS or RAID 5 </li></ul></ul><ul><ul><li>You can build a cheap SAN with Fibre Channel or iSCSI </li></ul></ul><ul><ul><li>NAS filers can make great archiving targets </li></ul></ul><ul><ul><li>Workstations can share SAN storage </li></ul></ul><ul><ul><li>CAS can be accessed with NFS or CIFS </li></ul></ul><ul><ul><li>You can put tier-3 bulk storage on an enterprise array </li></ul></ul><ul><ul><li>Modular arrays can outrun their big brothers </li></ul></ul>
  21. 21. Mixing Up the Right SAN <ul><li>The best choice is the one that makes the most sense in your environment </li></ul><ul><li>Select the right tool for the job instead of using a wrench as a hammer </li></ul><ul><ul><li>Just because something can work doesn’t make it a good idea </li></ul></ul><ul><ul><li>Always pick the simplest and most straightforward solution </li></ul></ul><ul><li>Look for the best fit for your budget and scale </li></ul><ul><ul><li>If you only have a few terabytes, buy just one networked array that will work for most of your applications </li></ul></ul><ul><li>Match your chosen technologies with the platforms and applications you have </li></ul>
  22. 22. Architecture Example: Small Web Company <ul><li>A small but growing business focused on a web-based product </li></ul><ul><ul><li>Wants stability, flexibility, scalability, low cost, and DR </li></ul></ul><ul><ul><li>All Windows, mostly file but with some block storage </li></ul></ul><ul><li>Selected a modular NAS/iSCSI array </li></ul><ul><ul><li>NAS replaced all current Windows file servers </li></ul></ul><ul><ul><li>iSCSI replaced internal storage for email and database </li></ul></ul><ul><ul><li>Picked a midrange device with lots of growth potential </li></ul></ul><ul><ul><li>Used SATA drives with RAID 6 for reliability and “good enough” performance </li></ul></ul><ul><ul><li>Built-in snapshots and replication of both file and block data from a single interface </li></ul></ul>
  23. 23. Architecture Example: Large Financial Company <ul><li>A household name in the world of finance </li></ul><ul><ul><li>Wanted to implement tiered storage to save money </li></ul></ul><ul><ul><li>Hundreds of TB, mixed Windows, UNIX, and mainframe </li></ul></ul><ul><li>Selected a modular FC SAN device </li></ul><ul><ul><li>Sufficient staff and money to bring in a new storage platform </li></ul></ul><ul><ul><li>Spent time and money on data classification to move less critical apps off Tier 1 </li></ul></ul><ul><ul><li>Decided to consolidate Windows systems with virtualization and blades rather than use iSCSI </li></ul></ul><ul><ul><li>Deferred all enterprise storage purchases for two years </li></ul></ul><ul><ul><li>Kept all mainframe data on Tier 1 enterprise storage for now </li></ul></ul>
  24. 24. Closing Thoughts <ul><li>Bring in the storage that is right for you </li></ul><ul><ul><li>Don’t let “rules of thumb” and bogus “best practices” prejudice your choice </li></ul></ul><ul><li>All storage devices work pretty well these days - but none are perfect </li></ul><ul><ul><li>Don’t try to do anything exotic with basic devices </li></ul></ul><ul><ul><li>Use the right tool for the job </li></ul></ul><ul><li>Make the vendors prove it works </li></ul><ul><ul><li>Talk to references who are doing what you want to do </li></ul></ul><ul><ul><li>Create a proof of concept before buying </li></ul></ul><ul><li>Remember that it’s not all about the technology – even the best storage can’t fill an uncertain need! </li></ul>
  25. 25. Questions? <ul><li>Audience Q&A: 10-15 minutes </li></ul><ul><li>Contact me at [email_address] </li></ul><ul><li>Come talk to me after the session or at lunch </li></ul><ul><li>I'll be available at the Ask-the-Expert booth today and tomorrow from 5 PM to 6 PM </li></ul>
  26. 26. For More Information <ul><li>Contact me: </li></ul><ul><ul><li>Stephen Foskett – [email_address] </li></ul></ul><ul><li>Visit and read Storage magazine </li></ul><ul><li>Get SNIA’s &quot;Network Storage Terms and Acronyms&quot; book </li></ul><ul><li>Ask others here at the show or at user groups </li></ul><ul><ul><li>Storage Networking User Group (SNUG) </li></ul></ul><ul><ul><ul><li> </li></ul></ul></ul><ul><ul><li>Association of Storage Networking Professionals (ASNP) </li></ul></ul><ul><ul><ul><li> </li></ul></ul></ul><ul><li>Ask the vendors (really!) </li></ul>