Orchestrating  Open Source Components  for Home SANs Abhinav Jawadekar
Agenda <ul><li>Networked Storage Requirements for Home </li></ul><ul><li>Options and Approaches </li></ul><ul><li>Open Sou...
Home Compute and Communication Environment <ul><li>Desktop PCs </li></ul><ul><li>Laptop PCs </li></ul><ul><li>Netbook PCs ...
Sharing <ul><li>Share data among compute and communication devices </li></ul><ul><li>Share storage devices among compute a...
Features <ul><li>Data Repository </li></ul><ul><ul><li>Compute and communication device backup </li></ul></ul><ul><li>Stor...
Usability <ul><li>Easy to understand and intuitive to use </li></ul><ul><li>Default options should suffice common usage </...
<ul><li>File and underlying storage infrastructure sharing  </li></ul><ul><li>File (folder/share) level access control </l...
Home Networked Storage Environment
Approaches <ul><li>Network Based </li></ul><ul><li>Network router as the intelligence and gatekeeper of the home IT infras...
Linux Storage Components for SAN <ul><li>Linux raw device access </li></ul><ul><ul><li>/dev/sd x </li></ul></ul><ul><li>So...
Orchestration considerations: Software RAID - MD <ul><li>Disk redundancy with RAID levels 1, 4, 5, 6, 10 etc. </li></ul><u...
Orchestration considerations: Logical Volume Manager - LVM <ul><li>Aggregate raw disk devices as well as md devices </li><...
Orchestration considerations: iSCSI Enterprise Target - iET <ul><li>Present block devices and file based raw data as iSCSI...
Orchestration Glue and  User Interface <ul><li>Essential but missing parts </li></ul><ul><li>Orchestration Glue </li></ul>...
Challenges and TBDs <ul><li>Simple language that is appropriate for intended audience </li></ul><ul><li>iSCSI Initiators f...
Technology Options <ul><li>FreeNAS </li></ul><ul><li>OpenSolaris </li></ul>
Conclusion <ul><li>Homes need SAN, NAS and Cloud Storage </li></ul><ul><li>IP based protocols and open source software com...
Q & A <ul><li>Thanks! </li></ul><ul><li>Abhinav Jawadekar </li></ul><ul><li>[email_address] </li></ul><ul><li>www.soundpar...
Upcoming SlideShare
Loading in...5
×

Orchestrating Open Source Components For Home SANs

399

Published on

Homes already have huge amounts of data and multiple networked computers/ devices. The need for consolidation and central management is pressing. While a number of open source components are available to put together cheap SANs, their orchestration remains a challenge. This session discusses how different Linux components (MD - Software RAID, LVM, iSCSI Enterprise Target) can be put together and made usable as an iSCSI SAN storage array (or appliance).

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
399
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Edit Notes: Suggest we drop the clip-art on this slide. Adds nothing, looks more professional without it.
  • Transcript of "Orchestrating Open Source Components For Home SANs"

    1. 1. Orchestrating Open Source Components for Home SANs Abhinav Jawadekar
    2. 2. Agenda <ul><li>Networked Storage Requirements for Home </li></ul><ul><li>Options and Approaches </li></ul><ul><li>Open Source Components </li></ul><ul><li>Orchestration Considerations </li></ul><ul><li>Challenges </li></ul>
    3. 3. Home Compute and Communication Environment <ul><li>Desktop PCs </li></ul><ul><li>Laptop PCs </li></ul><ul><li>Netbook PCs </li></ul><ul><li>Handheld Mobile Devices </li></ul><ul><li>Multimedia Devices </li></ul><ul><li>Many compute and communication systems with a lot of data </li></ul><ul><li>Huge need for consolidation and central management </li></ul>
    4. 4. Sharing <ul><li>Share data among compute and communication devices </li></ul><ul><li>Share storage devices among compute and communication devices </li></ul><ul><ul><li>USB disks (pen drives, USB hard disks) </li></ul></ul><ul><ul><li>CD/DVD drives </li></ul></ul><ul><ul><li>Device attached hard disks </li></ul></ul><ul><li>Access management </li></ul><ul><li>Connectivity </li></ul>
    5. 5. Features <ul><li>Data Repository </li></ul><ul><ul><li>Compute and communication device backup </li></ul></ul><ul><li>Storage Tiers </li></ul><ul><ul><li>Solid state disk </li></ul></ul><ul><ul><li>High capacity hard disk </li></ul></ul><ul><ul><li>Cloud storage </li></ul></ul><ul><li>Data protection, backup to secondary device and cloud </li></ul><ul><li>Expandability </li></ul><ul><li>Recovery Point more important than Recovery Time </li></ul><ul><ul><li>High Availability NOT a requirement </li></ul></ul><ul><li>Performance only moderately important </li></ul>
    6. 6. Usability <ul><li>Easy to understand and intuitive to use </li></ul><ul><li>Default options should suffice common usage </li></ul><ul><li>Should work well with removable devices </li></ul>
    7. 7. <ul><li>File and underlying storage infrastructure sharing </li></ul><ul><li>File (folder/share) level access control </li></ul><ul><li>IP based file sharing protocols </li></ul><ul><li>Backup + much more </li></ul><ul><li>Data/file sharing over internet </li></ul><ul><li>High capacity data repository </li></ul><ul><li>Internet APIs </li></ul><ul><li>Raw device (block) access </li></ul><ul><li>Storage infrastructure sharing </li></ul><ul><li>Pass-through access to external devices such as USB drives, CD/DVD drives etc. </li></ul><ul><li>Device level access control based on computer system </li></ul><ul><li>Enabled by iSCSI technology </li></ul>Options Network Attached Storage Cloud Storage Storage Area Network SAN, NAS and Cloud storage – A Home needs it all!
    8. 8. Home Networked Storage Environment
    9. 9. Approaches <ul><li>Network Based </li></ul><ul><li>Network router as the intelligence and gatekeeper of the home IT infrastructure </li></ul><ul><li>May or may not have native storage </li></ul><ul><li>Device interfaces such as USB </li></ul><ul><li>Ideal for home and low end SMBs </li></ul><ul><li>Storage Appliance </li></ul><ul><li>A low-end storage array based on industry standard server </li></ul><ul><li>Has native storage </li></ul><ul><li>Device interfaces such as USB </li></ul><ul><li>Suitable for SMBs and high-end tech savvy homes </li></ul>
    10. 10. Linux Storage Components for SAN <ul><li>Linux raw device access </li></ul><ul><ul><li>/dev/sd x </li></ul></ul><ul><li>Software RAID – MD </li></ul><ul><ul><li>Disk redundancy </li></ul></ul><ul><li>Logical Volume Manager - LVM </li></ul><ul><ul><li>Aggregation </li></ul></ul><ul><ul><li>Provisioning </li></ul></ul><ul><li>iSCSI Enterprise Target – iET </li></ul><ul><ul><li>Device and storage presentation </li></ul></ul>
    11. 11. Orchestration considerations: Software RAID - MD <ul><li>Disk redundancy with RAID levels 1, 4, 5, 6, 10 etc. </li></ul><ul><li>Dynamic resizing, hot replacement, hot spares – many sophisticated and complex features </li></ul><ul><li>Focus on Mirroring or RAID – 1 </li></ul><ul><li>Easy to understand </li></ul><ul><li>More granular redundancy not required </li></ul><ul><li>Ability to move disks easily is crucial </li></ul><ul><li>All RAID levels provided by MD </li></ul><ul><li>Features such as hot spares, remove and replace drives </li></ul><ul><li>Dynamic expansion and changes </li></ul>Relevant Features Network Based Storage Appliance
    12. 12. Orchestration considerations: Logical Volume Manager - LVM <ul><li>Aggregate raw disk devices as well as md devices </li></ul><ul><li>Provision required sizes of logical volumes </li></ul><ul><li>Striping, mirroring and concatenation </li></ul><ul><li>Dynamic expansion, snapshots etc. </li></ul><ul><li>Tight coupling with md for simplicity with either raw or value added shared disks </li></ul><ul><li>Only concatenation </li></ul><ul><li>Dynamic expansion </li></ul><ul><li>Snapshots only for applications such as backup </li></ul><ul><li>Allowing user the choice of coupling with md </li></ul><ul><li>Concatenation and striping </li></ul><ul><li>Dynamic expansion </li></ul><ul><li>Snapshots </li></ul>Relevant Features Network Based Storage Appliance
    13. 13. Orchestration considerations: iSCSI Enterprise Target - iET <ul><li>Present block devices and file based raw data as iSCSI LUs </li></ul><ul><li>Target level access control </li></ul><ul><li>CHAP Authentication </li></ul><ul><li>Dynamic Target and LUN creation </li></ul><ul><li>Block device (pass through or LV) presentation </li></ul><ul><li>Only one LUN (0) per target to ensure simplicity </li></ul><ul><li>Integration with DHCP/DNS to know potential hosts </li></ul><ul><li>Target level access control </li></ul><ul><li>Dynamic Target creation </li></ul><ul><li>Block device (pass through or LV) presentation </li></ul><ul><li>Target and LUN hierarchy </li></ul><ul><li>Integration with DHCP/DNS to know potential hosts </li></ul><ul><li>Target level access control </li></ul><ul><li>CHAP Authentication </li></ul><ul><li>Dynamic Target and LUN creation </li></ul>Relevant Features Network Based Storage Appliance
    14. 14. Orchestration Glue and User Interface <ul><li>Essential but missing parts </li></ul><ul><li>Orchestration Glue </li></ul><ul><ul><li>Programmatic logic required for systematic coordination of raw devices, MD, LVM and iET </li></ul></ul><ul><li>Web UI </li></ul><ul><ul><li>Simple and Intuitive </li></ul></ul><ul><ul><li>Must provide easy to understand big picture </li></ul></ul><ul><ul><ul><li>Should differentiate between Network Based and Storage Approaches in terms of details and sophistication </li></ul></ul></ul>
    15. 15. Challenges and TBDs <ul><li>Simple language that is appropriate for intended audience </li></ul><ul><li>iSCSI Initiators for hand held and mobile devices </li></ul><ul><li>More thought to iSCSI based plug-n-play </li></ul><ul><li>Better pass-through device support </li></ul><ul><li>Plug-ins requiring no direct client involvement </li></ul><ul><ul><li>Cloud backup </li></ul></ul><ul><ul><li>Cloud storage applications </li></ul></ul><ul><ul><li>Storage Tier applications </li></ul></ul><ul><li>Glue logic to coordinate among SAN, NAS and Cloud application </li></ul>
    16. 16. Technology Options <ul><li>FreeNAS </li></ul><ul><li>OpenSolaris </li></ul>
    17. 17. Conclusion <ul><li>Homes need SAN, NAS and Cloud Storage </li></ul><ul><li>IP based protocols and open source software components provide the vehicle and functionality </li></ul><ul><li>Orchestrating glue, an intuitive Web UI and most importantly simple language that can be easily understood by a layperson are the main challenges </li></ul>
    18. 18. Q & A <ul><li>Thanks! </li></ul><ul><li>Abhinav Jawadekar </li></ul><ul><li>[email_address] </li></ul><ul><li>www.soundparadigm.com </li></ul>

    ×