JetStor ZFS DUAL NAS introduction
•Download as PPTX, PDF•
0 likes•161 views
This document introduces the JetStor NXT hybrid unified storage solution. It has an active-active controller architecture that provides high availability, with one controller able to take over if the other fails. Hardware and software upgrades can be done non-disruptively without stopping services. The system protects its memory cache using M.2 flash modules so data is not lost if power fails. It provides data integrity and protection features like snapshots, replication, compression, encryption and write once read many storage.
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to JetStor ZFS DUAL NAS introduction
Similar to JetStor ZFS DUAL NAS introduction (20)
More from Gene Leyzarovich
More from Gene Leyzarovich (16)
Recently uploaded
Recently uploaded (20)
JetStor ZFS DUAL NAS introduction
- 2. High-performance NAS Solution for SMB & Enterprise ZFS NAS for SMB and Enterprise & An introduction to Unified Storage Gene Leyzarovich President, AC&NC gene@acnc.com
- 3. ZFS Introduction ▌ Pooled storage ▌ Almost unlimited file size and capacity expansion ▌ Fast Rebuild ▌ Data integrity ▌ Checksum ▌ Copy on Write ▌ Advanced features ▌ Clone, Replication, Deduplication, Compression, Thin Provisioning… 3
- 4. ZFS Pool Disk File System ZVOL (Block device) ZFS architecture ZFS use the concept of storage pool to manage physical drives by itself. 128 bit File System Almost no limit to file size, directory entries, disk drives, and pool/volume size. Fast Rebuild ZFS Introduction ZFS EXT4 + LVM 128 bit 48 bit Max volume size 16 Exabyte 1 Exabyte Max single file size 16 Exabyte 16 Terabytes Only rebuild necessary block 4
- 5. ▌ ZFS Checksum Checksum for every read/write to prevent data corruption LBA Checksum Data Memory Data LBA Checksum ZFS Data integrity ▌ Copy on Write – COW Find free blocks to write new content. No data corruption during a write operation 5
- 6. 6 Many Advanced Features Instant RAID 128Bit File System Replication Inline Deduplication Compression Thin provision Caching Clone Snapshot User Quota
- 7. 7 Storage Manager (QSM) ZFS on JetStorUnified storage Cloud Sync and Backup ZFS CIFS/AFP/NFS/FTP/We bDAV/XMirror WORM SED Anti-Virus & Firewall Access control Virtualization Thunderbolt 310GbE/25GbE iSCSI/Ethernet 16Gb/32Gb Fibre Channel RSync Auto-tiering VPN Time machine
- 8. 8
- 9. 9 RTO and RPO Business Backup Recovery Point Objective (RPO) Maximum allowable amount of loss data Recovery Time Objective (RTO) The period of time allowed to recovery from a service downtime Service back onlineLast backup Recovery point Recovery TimeHow long Failure How far
- 10. 10 Measure the potential RTO and RPO requirement for every business Business Backup Online Financial service Real-time Streaming Office File Server Multimedia Database Archiving and Backup Digital Archive
- 11. 11 Complete Backup Solution for Storage Infrastructure from Local, Edge to Cloud Business Backup Clone Cloud Sync & Backup XReplicator Time Machine XMirrorRsync Replication Snapshot
- 12. NAS Series Ground breaking ZFS NAS
- 13. RE XN8024R XN8016R 2 Bay 4 Bay 8-12 Bay 16-24 Bay XN8012R XN8008R/T XN5004R/T XN3004T XN8000R Series Rack Models: Intel Kaby Lake Xeon E3, Tower Models: Intel Kaby Lake i5 XN5000R/T Series Rack Models: Intel Kaby Lake Celeron Tower Models: Intel Kaby Lake Celeron XN3000T Series Tower Models: Intel Apollo Lake Celeron NAS Product Line XN5012R XN5008R/T XN3002T 6 62 N Rack models are equipped with N-number of additional SSD bays T All tower models are equipped with 1 additional SSD bay XN7004R/T XN7012R XN7008R/T XN7024R XN7016R 2 6XN7000R/T Series Rack Models: Intel Kaby Lake i3 Tower Models: Intel Kaby Lake i3 * All Rack models come with redundant PSUs 13
- 14. N : Large Form Factor Large form factor slots offer support for both 3.5 inch and 2.5 inch drives without any additional accessories required. E : Small Form Factor 2.5 inch slots are provided for SSD disks to enable advanced features without sacrificing storage capacity. Apart from SATA, PCI-e interface is also delivered that provides lightning speeds at 32Gb/s. Besides being used for SSD caching to boost up data access performance, if enabled, auto-tiering will continuously optimize NAS for better performance. Front View Rear View NAS Hardware Features 14
- 16. XN8024D JETSTOR NXT - NEXT GENERATION HYBRID UNIFIED STORAGE ENTERPRISE-GRADE FOR MID-RANGE ENTERPRISE OVERVIEW XN8016D XN8012D XN8026D 16
- 17. 17 Always-on architecture JetStor NXT - Hybrid Unified Storage ▌ Active-Active architecture If one controller fails, the other controller can transparently seamlessly take over all storage services. Before Failover After Failover Switch Host Switch Host Controller 1
- 18. 18 Always-on architecture JetStor NXT - Hybrid Unified Storage ▌ Non Disruptive upgrade No need to stop the service for hardware and software upgrade Done!Upgrade Controller1 hardware Switch HostSwitch Host Controller 1 Upgrade Controller2 hardware Controller 2 Switch Host Service Service Service
- 19. 19 Always-on architecture JetStor NXT - Hybrid Unified Storage ▌ Memory Cache Protection Safely transfer the memory cache data to a non-volatile flash device Power ON Power Off NXT Memory Cache Protection NXT M.2 Flash Module System Memory Cache Power Fail Detect Power resume NXT M.2 Flash Module System Pool
- 20. ZFS File System Silent Corruption Prevention Multi-Backup Options Rsync, Snapshot, XMirror, Cloud Sync & Backup Intuitive Load Balancing Best Path Selection Scale-up Scale up to 7PB with JBOD solution SmartSimple Inline Data Reduction Compression /Dedup WORM Write Once Read Many Data Retention File/Folder Auto Removal AES-256 Pool Encryption and SED Support Secure Intuitive UI Easy setup, management Active – Active Controller Design Online Hardware Upgrades PO/PI for RAM, Host Cards Built-In Cache Protection 256GB wo SC or Battery Always-on JetStor NXT - Hybrid Unified Storage 20
Editor's Notes
- The basic ZFS unit is a pool that is created using multiple disks, and from the pool we can create both the file system and block device. The special part of the ZFS is that it has its own volume manager, it has the ability to create software RAID by itself. And it is designed as a 128bit file system, compared to 48-bit for EXT4 there is almost no practical limit to a single file size, directory entries, and the pool size, that means it allows you to use as many disks as you like and create an extremely huge pool. When there is a disk failure in a RAID, you will need to replace it with a new disk, and the system will do the calculation and write all data to this new disk, this process is called RAID rebuild. And it usually takes a long time to finished the rebuild, depending on the size of the disk. ZFS uses a new approach, it only rebuilds the minimum amount of necessary data. For example, replacing a 1TB disk can take seconds if a pool has only a few gigabytes of used disk space.
- ZFS is very reliable and has a very strong design to prevent data corruption. In ZFS, all data are checksumed, and when a data is read, ZFS will calculate the checksum and compare with the original checksum, if it doesn’t match, it automatically repairs the damage, using data from the other mirror. And ZFS uses copy on write method to save data. That is, when you have a data to write, ZFS will find free blocks to write new content. Only after write finished, will ZFS re-index to use the new blocks. If the storage faces power loss during a write operation -> No data corruption, since the data structure has not changed yet.
- Data is the most important asset for business. Disaster happens everyday, and the last thing you want is that the important data are loss because of these disasters. You need a standard to weigh how important your data is, and build a backup plan based on the value of it. We use RTO and RPO to evaluate how important your data is. Let’s start from RPO, RPO stands for Recovery Point Objective, It means how much data loss is acceptable to your business. If you setup your backup schedule once a day, and that means the worse case is that you will loss 24 hour amount of data and you need to think if this is acceptable to you. If it is, your RPO is 24 hours, and if you find out that this is not acceptable, then you need to change your backup plan and make it stronger. The next is RTO, - Recovery Time Objective. This is how long of service downtime do you allow if your server is shutdown, and needs 24 hours to repair. therefore you will not be able to use the service for 24 hours, will it ruin your business or the job your are working on? These two factors are good keys to check how you are going to prepare you data backup strategy.
- Different type of application accept different RTO and RPO. For example, key service like online financial service and real-time streaming need near-zero RTO and RPO, while cold data may accept 1 day offline before the service come back. So it is important to think about how you use your data, what kind of service is running , the potential loss to business value when you are facing service downtime, Then you can evaluate RTO and RPO of it, and make an appropriate backup plan.
- JetStor provides a variety of functions to meet different RTO & RPO requirement. From the chart you can see a complete backup eco-system that protect your information from local, edge and Cloud For local users who need to have backup, the storage support MAC time machine and a backup tool called XReplicator that can be installed in their computer to backup data to JetStor NAS, and in NAS storage you can take snapshot, or clone to help you to backup data to another place in the local NAS. and depend on your RTO/RPO requirement you can setup proper schedule in NAS for local backup plan And for edge node backup there are Rsync, snapshot replication and XMirror for a NAS to backup to another NAS. You can use Rsync for file backup and you can even use it to backup data from servers using standard Rsync protocol. Replication will send snapshot to a remote JetStor NAS, one feature is that snapshot works for both file-level and block-level, so the performance is usually better comparing to file-level backup. Because it is snapshot based, so the backup is incremental greatly save your storage space. XMirror is another unique QSNA software feature, it is a file-based synchronization tool that you can sync your data up to 8 JetStor NAS devices. It is very good for branch office and small group file synchronization from long distances. And version control is support so you can reverse a file to a previous version if necessary. QSM also supports Cloud sync and backup, currently we can connect to google, dropbox, onedrive and S3 cloud. You will be able to share information using public cloud, and go back to office and use local NAS to continuously access the same file.
- Take a look at the picture of our NAS product, you can see that there are extra SSD slots in every devices so you can use them to improve the storage performance by using SSD as cache or auto-tiering. And extra PCIe slots can be used to insert high speed ethernet card, fibre channel and thunderbolt3 card and help you to get the performance boost.
- NXT series has intel XEON CPU build-in and have 4core and 8 core selection. It integrates QSM into the hardware platform and use active-active and hardware redundancy design to provide non-disruptive storage service Build-in 10GbE network and hybrid SSD design and very suitable for users who needs strong performance requirement.
- When your business is growing, service interruption is unacceptable. Besides a backup strategy, NXT bring a dual-active controllers design to guarantee business continuity. In active-active design, both controllers share the same disk pools, both controllers can access to the same data and if there is one controller hardware failure, another will take over and continue all the service. Meanwhile you can just unplug the failure controller and replace it with a good one. The system will go back to normal and the user will not feel the difference.
- NXT takes uninterrupted service to another level. Users can not only replace the failure hardware components without interruption, but can also have hardware upgrades without shutting down the storage device. When there is more and more data coming to the storage, you will start considering upgrading the memory or the network speed. JetStor helps you to make this painful process much easier and time saving. There is no need to shut down the service when you want to have the memory or network card upgraded in NXT. You can simply unplug one controller, upgrade the network card or memory size, then plug it back into the system, after the service comes back, you can start upgrading another controller using the same procedure. There is no need to announce service down to the whole company, no need to wait until the weekend or midnight to have storage upgraded.
- For storage to provide high availability, it needs to protect the memory cache even when there is a power outrage. When the data is written into the disk, usually it will be cached to a memory cache and later sync back to the disk. Therefore to speed up the write performance. However, if the cache data does not write back to the disk because of a disaster, the data in the disk will be corrupted. NXT syncs memory cache to a M.2 flash module, after a power loss, the NXT will write all cache from M.2 to the disk pool, so the data is complete and without any corruption. Some other vendors also support such a feature, but NXT does not need a battery module to support this memory protection feature while most other vendors need it. This will save you big trouble on airline transportation.