The JetStor NAS 724UXD is a unified / hybrid NAS storage system that consolidates NAS and IP-based iSCSI SAN in one chassis. Featuring the newest Intel Haswell platform to lower power consumption and 7x 1Gb Ethernet host ports per controller, all encompassed in a small 4U enclosure. The JetStor NAS 724UXD offers SSD Caching to boost random I/O intensive application, Snapshot, Thin Provisioning, Online Capacity Expansion and Controller-based cable-less design for excellent manageability.
In computing, ZFS is a combined file system and logical volume manager designed by Sun Microsystems, a subsidiary of Oracle Corporation. The features of ZFS include support for high storage capacities, integration of the concepts of file system and volume management, snapshots and copy-on-write clones, continuous integrity checking and automatic repair, RAID-Z and native NFSv4 ACLs. Unlike traditional file systems, which reside on single devices and thus require a volume manager to use more than one device, ZFS file systems are built on top of virtual storage pools called zpools. A zpool is constructed of virtual devices (vdevs), which are themselves constructed of block devices: files, hard drive partitions, or entire drives, with the last being the recommended usage.[7] Thus, a vdev can be viewed as a group of hard drives. This means a zpool consists of one or more groups of drives.
In addition, pools can have hot spares to compensate for failing disks. In addition, ZFS supports both read and write caching, for which special devices can be used. Solid State Devices can be used for the L2ARC, or Level 2 ARC, speeding up read operations, while NVRAM buffered SLC memory can be boosted with supercapacitors to implement a fast, non-volatile write cache, improving synchronous writes. Finally, when mirroring, block devices can be grouped according to physical chassis, so that the filesystem can continue in the face of the failure of an entire chassis. Storage pool composition is not limited to similar devices but can consist of ad-hoc, heterogeneous collections of devices, which ZFS seamlessly pools together, subsequently doling out space to diverse file systems as needed. Arbitrary storage device types can be added to existing pools to expand their size at any time. The storage capacity of all vdevs is available to all of the file system instances in the zpool. A quota can be set to limit the amount of space a file system instance can occupy, and a reservation can be set to guarantee that space will be available to a file system instance.
In computing, ZFS is a combined file system and logical volume manager designed by Sun Microsystems, a subsidiary of Oracle Corporation. The features of ZFS include support for high storage capacities, integration of the concepts of file system and volume management, snapshots and copy-on-write clones, continuous integrity checking and automatic repair, RAID-Z and native NFSv4 ACLs. Unlike traditional file systems, which reside on single devices and thus require a volume manager to use more than one device, ZFS file systems are built on top of virtual storage pools called zpools. A zpool is constructed of virtual devices (vdevs), which are themselves constructed of block devices: files, hard drive partitions, or entire drives, with the last being the recommended usage.[7] Thus, a vdev can be viewed as a group of hard drives. This means a zpool consists of one or more groups of drives.
In addition, pools can have hot spares to compensate for failing disks. In addition, ZFS supports both read and write caching, for which special devices can be used. Solid State Devices can be used for the L2ARC, or Level 2 ARC, speeding up read operations, while NVRAM buffered SLC memory can be boosted with supercapacitors to implement a fast, non-volatile write cache, improving synchronous writes. Finally, when mirroring, block devices can be grouped according to physical chassis, so that the filesystem can continue in the face of the failure of an entire chassis. Storage pool composition is not limited to similar devices but can consist of ad-hoc, heterogeneous collections of devices, which ZFS seamlessly pools together, subsequently doling out space to diverse file systems as needed. Arbitrary storage device types can be added to existing pools to expand their size at any time. The storage capacity of all vdevs is available to all of the file system instances in the zpool. A quota can be set to limit the amount of space a file system instance can occupy, and a reservation can be set to guarantee that space will be available to a file system instance.
Slides from the S8 File Systems Tutorial at USENIX LISA'13 conference in Washington, DC. The topic covers ext4, btrfs, and ZFS with an emphasis on Linux implementations.
An Introduction to the Implementation of ZFS by Kirk McKusickeurobsdcon
Abstract
Much has been documented about how to use ZFS, but little has been written about how it is implemented. This talk pulls back the covers to describe the design and implementation of ZFS. The content of this talk was developed by scouring through blog posts, tracking down unpublished papers, hours of reading through the quarter-million lines of code that implement ZFS, and endless email with the ZFS developers themselves. The result is a concise description of an elegant and powerful system.
Speaker bio
Dr. Marshall Kirk McKusick's work with Unix and BSD development spans over four decades. It begins with his first paper on the implementation of Berkeley Pascal in 1979, goes on to his pioneering work in the eighties on the BSD Fast File System, the BSD virtual memory system, the final release of 4.4BSD-Lite from the UC Berkeley Computer Systems Research Group, and carries on with his work on FreeBSD. A key figure in Unix and BSD development, his experiences chronicle not only the innovative technical achievements but also the interesting personalities and philosophical debates in Unix over the past thirty-five years.
This presentation is from the ZFS Tutorial presented at the USENIX LISA09 Conference at Baltimore, Maryland in November 2009.
Later versions are available on slideshare.net, too.
Spinning Brown Donuts: Why Storage Still CountsSparkhound Inc.
Storage, next to server hardware, is pretty commoditized and probably the least exciting thing in your datacenter. However, not properly assessing your storage needs and requirements can be the difference between a great app or resume generating event. This session will cover topics such as: Why you may not need all flash, SAN is not just NAS spelled backwards, leveraging cloud storage, why RAID is not a sound backup solution, and cutting through the marketing to make sense of it all.
План вебинара:
##Что такое Storage Spaces Direct?
##Сценарии использования Storage Spaces.
##Описание минимальных требований для Storage Spaces.
##Как настроить Windows Server 2016 Spaces Direct для работы с локальными дисками сервера?
##Что такое Storage Replica?
##Разница подходов синхронной и асинхронной репликации.
##Какие технологии репликации для каких задач использовать (DFS-R, Hyper-V Repica, SQL AlwaysOn, Exchange DAG) - и как это комбинируется с новыми возможностями Windows Server 2016?
##Что такое ReFS и чем она отличается в Server 2016 от предыдущих изданий ОС?
##Что даёт использование ReFS для виртуальных машин Hyper-V. Сценарии и возможности.
##Общие изменения Storage технологий в Windows Server 2016.
Btrfs and Snapper - The Next Steps from Pure Filesystem Features to Integrati...Gábor Nyers
These are the slides of our SUSECon 2013 presentation with Arvin (the inventor of Snapper)
Btrfs as technology has been getting a lot of attention over the past few years. While interesting for its feature set alone, like checksums, copy on write, snapshots and built-in device management, without proper management tooling and integration with other parts of the operating system, it is difficult for the average user to use Btrfs to its full potential.
This session will help you understand the features of Btrfs and how Snapper can be used for snapshot management in SUSE Linux Enterprise. We also will provide use cases and an outlook for future functionality.
Filesystem Showdown: What a Difference a Decade MakesPerforce
In the last 10 years, Ext4 has risen in prominence, ReiserFS has fallen to the wayside, ZFS has been ported to Linux, XFS keeps plugging along, and there's a new kid: Btrfs. NTFS has evolved, too. It's now 2016. How do these filesystems stack up against each other? Does it really make that much of a difference? We’ll show you the results of standard, consistent tests across platforms (Linux vs. Windows) and filesystems to see if the differences are worth choosing one over the other. For simplicity's sake, the tests are performed on identical hardware with out-of-the-box settings.
Slides from the S8 File Systems Tutorial at USENIX LISA'13 conference in Washington, DC. The topic covers ext4, btrfs, and ZFS with an emphasis on Linux implementations.
An Introduction to the Implementation of ZFS by Kirk McKusickeurobsdcon
Abstract
Much has been documented about how to use ZFS, but little has been written about how it is implemented. This talk pulls back the covers to describe the design and implementation of ZFS. The content of this talk was developed by scouring through blog posts, tracking down unpublished papers, hours of reading through the quarter-million lines of code that implement ZFS, and endless email with the ZFS developers themselves. The result is a concise description of an elegant and powerful system.
Speaker bio
Dr. Marshall Kirk McKusick's work with Unix and BSD development spans over four decades. It begins with his first paper on the implementation of Berkeley Pascal in 1979, goes on to his pioneering work in the eighties on the BSD Fast File System, the BSD virtual memory system, the final release of 4.4BSD-Lite from the UC Berkeley Computer Systems Research Group, and carries on with his work on FreeBSD. A key figure in Unix and BSD development, his experiences chronicle not only the innovative technical achievements but also the interesting personalities and philosophical debates in Unix over the past thirty-five years.
This presentation is from the ZFS Tutorial presented at the USENIX LISA09 Conference at Baltimore, Maryland in November 2009.
Later versions are available on slideshare.net, too.
Spinning Brown Donuts: Why Storage Still CountsSparkhound Inc.
Storage, next to server hardware, is pretty commoditized and probably the least exciting thing in your datacenter. However, not properly assessing your storage needs and requirements can be the difference between a great app or resume generating event. This session will cover topics such as: Why you may not need all flash, SAN is not just NAS spelled backwards, leveraging cloud storage, why RAID is not a sound backup solution, and cutting through the marketing to make sense of it all.
План вебинара:
##Что такое Storage Spaces Direct?
##Сценарии использования Storage Spaces.
##Описание минимальных требований для Storage Spaces.
##Как настроить Windows Server 2016 Spaces Direct для работы с локальными дисками сервера?
##Что такое Storage Replica?
##Разница подходов синхронной и асинхронной репликации.
##Какие технологии репликации для каких задач использовать (DFS-R, Hyper-V Repica, SQL AlwaysOn, Exchange DAG) - и как это комбинируется с новыми возможностями Windows Server 2016?
##Что такое ReFS и чем она отличается в Server 2016 от предыдущих изданий ОС?
##Что даёт использование ReFS для виртуальных машин Hyper-V. Сценарии и возможности.
##Общие изменения Storage технологий в Windows Server 2016.
Btrfs and Snapper - The Next Steps from Pure Filesystem Features to Integrati...Gábor Nyers
These are the slides of our SUSECon 2013 presentation with Arvin (the inventor of Snapper)
Btrfs as technology has been getting a lot of attention over the past few years. While interesting for its feature set alone, like checksums, copy on write, snapshots and built-in device management, without proper management tooling and integration with other parts of the operating system, it is difficult for the average user to use Btrfs to its full potential.
This session will help you understand the features of Btrfs and how Snapper can be used for snapshot management in SUSE Linux Enterprise. We also will provide use cases and an outlook for future functionality.
Filesystem Showdown: What a Difference a Decade MakesPerforce
In the last 10 years, Ext4 has risen in prominence, ReiserFS has fallen to the wayside, ZFS has been ported to Linux, XFS keeps plugging along, and there's a new kid: Btrfs. NTFS has evolved, too. It's now 2016. How do these filesystems stack up against each other? Does it really make that much of a difference? We’ll show you the results of standard, consistent tests across platforms (Linux vs. Windows) and filesystems to see if the differences are worth choosing one over the other. For simplicity's sake, the tests are performed on identical hardware with out-of-the-box settings.
Telemedicine seems to be the cheapest way to bridge the urban- rural divide in access to health
care in India. Telemedicine has been successfully inplemented in many villages in India, but it is
only the tip of the ice berg. India being a Hub of IT, there is very good scope for further growth
of telemedicine, with support of greater technology, standardization and regulations.
Making tele-healthcare more accessible is possible only by the active involvement of all stakeholders
Government, hospitals, Technology providers, Support staff, Educational & Research Institutes, Insurance, Financiers and Patients
Operative instruments in Conservative Dentistry & EndodonticsAshok Ayer
Operative Instruments in Endodontics including hand and power driven instruments. Recent advances in instruments in conservative dentistry and endodontics.
In this video from SC15, Larry Jones from Seagate provides an overview of the company's revamped HPC storage product line. At SC15, Seagate announced a major expansion of its HPC product portfolio including the ClusterStor HPC hard disk drive designed for Big Data applications.
Learn more: http://www.seagate.com/products/enterprise-servers-storage/enterprise-storage-systems/clustered-file-systems/
Watch the video presentation: http://wp.me/p3RLHQ-eMC
Sign up for our insideHPC Newsletter
TrioNAS LX U300 consolidate NAS and SAN offers multiple enterprise-level features including DeDup & Compression, Unlimited Snapshot, Thin Provisioning, Online Capacity Expansion and SSD caching.
For years Qsan has won plenty of proven records in enterprise markets and numerous vertical industries. Based on expertise in delivering in-house iSCSI & RAID stack, TrioNAS LX U300 deliver the best price-performance value to meet enterprise IT budget and specific needs.
For more detail please visit: http://www.qsantechnology.com/en/raidsystem_view.php?RSTID=AQ000108
This presentation gives an overview of physical storage technologies and the various ways of accessing storage on a computer or a server. Presented at School of Engineering and Applied Science, Ahmedabad University as a part of Software Engineering course.
The Pendulum Swings Back - Understanding Converged and Hyperconverged Integrated Systems, presented Oct 17, 2017 at IBM Systems Technical University, New Orleans LA
AC&NC provides full product line up of Network Attached Storage (NAS) systems that are all built for reliability and ease of use. AC&NC also offers combined NAS and Storage Area Networks (SAN) into a single system, allowing for a consolidated storage and network environment.
Focused intently on storage without distractions of tape backup or bundled servers, AC&NC manufacturers in-house and delivers complete solutions in 24-48 hours from in-stock JetStor RAID, iSCSI, FC, NAS / Unified, All Flash and JBOD SAS systems that set the bar for performance.
High-Density Top-Loading Storage for Cloud Scale Applications Rebekah Rodriguez
In this webinar, we will discuss how high-capacity Top-Loading Storage systems are being used for enterprise and cloud scale applications and will identify the key features of the modular architecture for use in today’s software defined storage (SDS) environments. - https://www.brighttalk.com/webcast/17278/527798
2018 Infortrend All Flash Arrays Introduction (GS3025A)infortrendgroup
Infortrend All Flash Array Storages deliver lightning speed performance and enable users to optimize SSDs and energy efficiency. It also provides all the benefits of SAN, NAS and Cloud Gateway storage together in one single system, making it the ideal choice for enterprise applications (such as database, virtualization, video editing, file sharing, backup, and cloud data integration). For hardware, all flash array storage features a 2U-25bay form factor, flexible host boards to choose from, and stable, reliable modular design with high expandability; as for software, it comes with complete data services and simple, intuitive management interfaces.
More Information:
https://www.infortrend.com/global/products/FS
Recommended Product:
https://www.infortrend.com/global/products/families/fs/all-flash-arrays
Windows Server 2012 R2 Software-Defined StorageAidan Finn
In this presentation I taught attendees how to build a Scale-Out File Server (SOFS) using Windows Server 2012 R2, JBODs, Storage Spaces, Failover Clustering, and SMB 3.0 Networking, suitable for storing application data such as Hyper-V and SQL Server.
Automated and orchestrated hybrid cloud platform built on secure and dedicated JetStor storage.
This architecture allows for the seamless movement of applications between public and private cloud.
JetStor X Storage Products 2017! New HOT products!Gene Leyzarovich
JetStor Brand new 12, 16, 24 and 26bay AFA, Hybrid Storage!
JetStor FX series features a Dual-Active controller architecture, both controllers concurrently provide storage services in real time. Active-Active architecture doubles the available host bandwith and cache hit ratio, ensuring maximum utilization of system resources and maximized throughput. If one controller fails, the other controller can transparently take over all storage services. In addition to storage services, management service can transparently pass to the secondary controller.
The JetStor FX series is a highly-available SAN storage system. All of the critical components in the FX series are hot pluggable and designed with full redundancy. This design allows the FX series to withstand multiple component failures and achieve 99.999% availability.
JetStor 8 Series FC units 16G FC Active-Active 12G SAS
Features & Highlights
DataBolt™ Bandwidth Optimizer for balancing faster host & slower SAS or SATA devices
Supports SSD automatic monitor clone (AMC) to extend SSD lifetime
Supports Self-Encryption Drive (SED)
Supports Clone disk
Encryption at Rest Support ISE, TCG, SED, SSD with Block Erase & Password Protect
JetStor NAS 724uxd 724uxd 10g - technical presentationGene Leyzarovich
The JetStor NAS 724UXD is a unified / hybrid NAS storage system that consolidates NAS and IP-based iSCSI SAN in one chassis. Featuring the newest Intel Haswell platform to lower power consumption and 7x 1Gb Ethernet host ports per controller, all encompassed in a small 4U enclosure. The JetStor NAS 724UXD offers SSD Caching to boost random I/O intensive application, Snapshot, Thin Provisioning, Online Capacity Expansion and Controller-based cable-less design for excellent manageability.
The JetStor SAS 780JH is a ultra high density 19-inch 4U rackmount JBOD unit. It features the latest SAS2 (6Gb/s) or SAS3 (12Gb/s) interface and designed to fit in with environments that need highly reliable and relentless data growth. The JetStor SAS 780JH is also a versatile Disk Expansion system, ideal for high capacity and scalability storage in IT demands. Based on 6G SAS2.0 or 12G SAS3.0 technology, the JetStor SAS 780JH supports the choice of SAS2 or SAS3 and SATA3 drive configurations to deliver the best cost-performance index with higher bandwidth.
JetStor SAS 780JH comes with a single controller, 80 hot-swappable bays and is perfect for Big Data, Hadoop, HPC (High Performance Computing), ZFS and Microsoft Windows Server 2012 projects.
JetStor NAS 724UX and 724UX 10G ZFS appliance. The JetStor NAS 724UX is a ZFS based Unified Storage System that integrates NAS (Network Attached Storage) and SAN (Storage Area Network) into one chassis. Featuring the newest Intel Haswell platform to lower power consumption and 7x 1Gb Ethernet ports using iSCSI or NFS/CIFS protocol host connections, all encompassed in a small 4U enclosure. The JetStor NAS 724UX offers SSD Caching to boost random I/O intensive application, DeDup & Compression, Snapshot, Thin Provisioning, Online Capacity Expansion and Controller-based cable-less design for excellent manageability.
Adjusting primitives for graph : SHORT REPORT / NOTESSubhajit Sahu
Graph algorithms, like PageRank Compressed Sparse Row (CSR) is an adjacency-list based graph representation that is
Multiply with different modes (map)
1. Performance of sequential execution based vs OpenMP based vector multiply.
2. Comparing various launch configs for CUDA based vector multiply.
Sum with different storage types (reduce)
1. Performance of vector element sum using float vs bfloat16 as the storage type.
Sum with different modes (reduce)
1. Performance of sequential execution based vs OpenMP based vector element sum.
2. Performance of memcpy vs in-place based CUDA based vector element sum.
3. Comparing various launch configs for CUDA based vector element sum (memcpy).
4. Comparing various launch configs for CUDA based vector element sum (in-place).
Sum with in-place strategies of CUDA mode (reduce)
1. Comparing various launch configs for CUDA based vector element sum (in-place).
Show drafts
volume_up
Empowering the Data Analytics Ecosystem: A Laser Focus on Value
The data analytics ecosystem thrives when every component functions at its peak, unlocking the true potential of data. Here's a laser focus on key areas for an empowered ecosystem:
1. Democratize Access, Not Data:
Granular Access Controls: Provide users with self-service tools tailored to their specific needs, preventing data overload and misuse.
Data Catalogs: Implement robust data catalogs for easy discovery and understanding of available data sources.
2. Foster Collaboration with Clear Roles:
Data Mesh Architecture: Break down data silos by creating a distributed data ownership model with clear ownership and responsibilities.
Collaborative Workspaces: Utilize interactive platforms where data scientists, analysts, and domain experts can work seamlessly together.
3. Leverage Advanced Analytics Strategically:
AI-powered Automation: Automate repetitive tasks like data cleaning and feature engineering, freeing up data talent for higher-level analysis.
Right-Tool Selection: Strategically choose the most effective advanced analytics techniques (e.g., AI, ML) based on specific business problems.
4. Prioritize Data Quality with Automation:
Automated Data Validation: Implement automated data quality checks to identify and rectify errors at the source, minimizing downstream issues.
Data Lineage Tracking: Track the flow of data throughout the ecosystem, ensuring transparency and facilitating root cause analysis for errors.
5. Cultivate a Data-Driven Mindset:
Metrics-Driven Performance Management: Align KPIs and performance metrics with data-driven insights to ensure actionable decision making.
Data Storytelling Workshops: Equip stakeholders with the skills to translate complex data findings into compelling narratives that drive action.
Benefits of a Precise Ecosystem:
Sharpened Focus: Precise access and clear roles ensure everyone works with the most relevant data, maximizing efficiency.
Actionable Insights: Strategic analytics and automated quality checks lead to more reliable and actionable data insights.
Continuous Improvement: Data-driven performance management fosters a culture of learning and continuous improvement.
Sustainable Growth: Empowered by data, organizations can make informed decisions to drive sustainable growth and innovation.
By focusing on these precise actions, organizations can create an empowered data analytics ecosystem that delivers real value by driving data-driven decisions and maximizing the return on their data investment.
3. DAS
Why Dual Controller NAS?
LAN LAN
Two-node server cluster
in one box
SAN
Heartbeat
iSCSI FC
JetStor NAS
4. Why Dual Controller NAS?
2 Servers + 2 HBAs + OS license
+ SAN > JetStor NAS 724UXD
2 NAS > JetStor NAS 724UXD
Unified storage for business
processing application where high
performance SAN is not required
Active – Active architecture
Support ALUA, both controllers
can deliver IO at the same time
Zero business downtime
99.999% availability
Hybrid storage. Support file-level and block-level I/O, structured and
unstructured data
Thin provisioning, compression
5. Active-Active vs Active-Standby
Active – active Active – standby
Fast failover
Inter-process communication and heartbeat is achieved
using high speed bus on backplane protected by the
enclosure.
Slow failover
IPC and heartbeat is carried out using 1Gb Ethernet
external cable. It is slow and prone to external errors.
Efficiency
Support all RAID levels in the storage pool. Support
global namespace. Both controllers see the same HDD
configuration and storage pool.
Waste of resources
Limited to RAID 1 for HDD mirroring.
Because you need to set aside the same HDD capacity in
the passive system, it’s a waste of HDD capacity.
Performance scaling
Both controllers can deliver I/O and services at the same
time. IOPS can scale 1.5 times.
No performance scaling
Passive controller will not deliver I/O. The resource is
idle and wasted.
Consistent data after recovery
After recovery from controller failure, all disk data
remain intact and consistent.
Inconsistent data after recovery
After recovery from controller failure, the failed system
doesn’t have the latest disk data. Synchronization
process is needed and it is time consuming.
6. Hardware Specs
Model JetStor NAS 724UXD JetStor NAS 724UXD 10G
NAS Controller Active-active dual controllers
Host interfaces
per controller
7x 1GbE ports
3x 1GbE ports
2x 10GbE ports (SFP+ or RJ45)
Processor Intel Xeon dual cores
Memory 16GB DDR3 ECC
Hard Drive Interface 6Gb/s, 12Gb/s SAS, SSD (3.5" and 2.5")
Expansion Enclosure 6Gb/s, 12Gb/s SAS series
Max. No. of Hard Drives 256
Form Factors 4U 24bays : 446.0 x 499.5 x 176.0mm (W x D x H)
Power Supply 4U 24bays : 550W 3x (80 PLUS Gold)
Fan Module 4U 24bays : redundant fan modules 2x
7. Modular Design
• Major components are
customer replaceable units.
(fan, PSU, controller)
• RAID controller can be easily
plugged out for maintenance
• Clean and friendly design for
simple service
8. • Cascaded up to 256 drives
• Raw capacity > 1 Peta Byte
• High bandwidth 24Gbits/s SAS
wide port
• Supports JBOD cable hotplug
• Automatic enclosure detection
Flexible Capacity Expansion
JetStor NAS 724UXD
SAS
wide
port
24Gb/sINOUT
11. Customer Environment 3/3
• VMware Ready, Hyper-V, Citrix
Ready certified
• Supports iSCSI and Fibre
Channel block storage for
hypervisors
• Uses thin provisioning to gain
maximum storage efficiency
for VDI application
• Server virtualization for storage
consolidation
VM
VM
VM
VM
iSCSI, NFS, SMB
13. ZFS
Storage Manager Architecture
Hardware
EMS HAC
SMB
(CIFS)
SOE
AFP Web
DAV
FTP
FTPS
SFTP
iSCSI
UMS (Unified Management System)
FC
ZVIOS
NFS
Backup
Anti
Virus
UnifiedAUTH (AD / LDAP)
Data Cache
Mirroring
Rsync S3 Replica
14. ZFS
Hardware
EMS HAC
SMB
(CIFS)
SOE
AFP Web
DAV
FTP
FTPS
SFTP
iSCSI
UMS (Unified Management System)
FC
ZVIOS
NFS
Backup
Anti
Virus
UnifiedAUTH (AD / LDAP)
Data Cache
Mirroring
Rsync S3 Replica
SOE
UnifiedAUTH (AD / LDAP)
Controller 1 Controller 2
SMB
(CIFS)
AFP Web
DAV
FTP
FTPS
SFTP
iSCSI FC
ZVIOS
NFS
Backup
Anti
VirusRsync S3 Replica
ZFS
Hardware
EMSHAC
Data Cache
Mirroring
UMS (Unified Management System)
Backplane
15. Genuine active-active HA
• Supports ALUA (asymmetric logic unit
access)
– Storage pool ownership is implemented
• Both controllers can deliver I/O at the
same time
• Inter-process communication
through high speed bus on backplane
– NTB (PCI Express Gen2, 16x lanes)
• Fast failover < 10 seconds
– Tested with 4 storage pools
Backplane
Client/Host
Switch
Ctlr1 Ctlr2
Ownership: Ctrlr1
Straight I/O
Ownership: Ctrlr2
Cross I/O
JetStor NAS
724UXD
16. Storage Pool, Share, Volume
Local enclosure Expansion enclosure(JBOD)
Storage pool Hard spare
dedicated
Share1
Hard drives
Share2 Volume1 Volume2Share/Volume
Host interface
iSCSI Fibre Channel
LUN1 … LUNn LUN1 … LUNn
RAID set m
RAID5
RAID set 2
RAID5
RAID set 1
RAID0
17. Storage Pool
• Flexibility & Scalability
– Different types of RAID sets in the same group
– Up to 512 pools, up to 192 HDDs in one pool
• Security
– Password protected locking mechanism
Local enclosure Expansion enclosure(JBOD)
Hard spare
dedicated
Pool 1 Pool n
RAID set
RAID6
RAID set m
RAID5
RAID set 2
RAID5
RAID set 1
RAID0
18. RAID Set
• Supports RAID 0, 1, 5, 6, 10, 50, 60
• Dedicated hot spares (RAID sets in the same pool)
• Auto rebuilding
• Online RAID expansion
• Instant readiness (no RAID initialization, fast resilvering)
• Hot swappable disk drives
Hard spare
dedicated
Pool
RAID set m
RAID6
RAID set 2
RAID5
RAID set 1
RAID5
19. Hybrid Storage Pool – SSD Caching
ST3600057SS SAS
12x pcs
600GB 15K rpm
Intel S3500 SSD
4x pcs 240GB
ST33000650NS SATA
8x pcs 3TB 7.2K rpm
Read IOPS Write IOPS Cost Power (Watts) Capacity
12% 48%
3x
18x
10%
20. SSD Caching
• Improves random read/write IOPS
over 20x times
• Supports up to 6x SSD drives per
storage pool (4x read, 2x write)
• Supports RAID 1 for write cache
• All shares/LUNs can boost
performance
Applications
ZFS
Read
cache
Write
cache
Storage pool
Cache hit!!
L2ARC
ZIL
21. SSD Caching
• Accelerates random IOPS for file
access and block access
• Each storage pool has its own SSD
read cache and SSD write cache.
All volumes and LUNs in the same
pool can benefit from SSD cache.
• RAID 1 support for write cache
• SSD cache is hot swappable
SSD cache
OFF
SSD cache
ON
1x
> 20x
22. ZFS Benefits – Break Bottlenecks
Storage size is ever-
increasing
Storage efficiency is
low
Data integrity and data
protection become
more critical
Data management
costs are high
23. ZFS Benefits - Comparison
ZFS Ext4 NTFS HFS+
Address bits 128 48 64 32
File system type Transactional Journaling Journaling
Max volume size 16 EB (264) 1 EB(260) 16 EB < 8EB
Max file size 16 EB (264) 16 TB 16 EB < 8EB
Max # of files 248 232 232
Max filename length 255 bytes 255 bytes 255 bytes 255 bytes
License type GDDL, CDDL Open source Proprietary
Metadata checksum Yes Yes No No
Variable block size Yes No No No
Copy On Write Yes No No No
Snapshot Yes No Yes No
Hot spare Yes No No
RAID5, RAID6 Yes No No No
Defragmentation No Yes Yes
Compression Yes No Yes
Encryption Yes No Yes No
25. ZFS Benefits – Data Integrity
ZFS
EXT3
EXT4
Most SMB NAS use ext3/ext4 Journal file system, but any
unexpected shutdown may crash the Journal file system. This
causes some data loss or data inconsistency; the worse case will be
the file system crashing and whole data gone …
With JetStor NAS ZFS file system (that once belonged only to very
high-end products), there is 0% file system crash possibility and
always end-to-end protection of disk data consistency due to its
copy-on-write transactional model and self-healing architecture.
26. ZFS Benefits – Copy on Write
• All or nothing, always on-disk consistent
• Immune to power failure
27. ZFS Benefits – Silent Corruption
Data
Checksum
Data
Checksum
● ● ●
Data Data
Pointer
Checksum
Pointer
Checksum
Pointer
Checksum
Pointer
Checksum
• Checksum in data block
• Disk block checksum only validates media
• Can only detect bit error Checksum and data are separated
Hierarchical checksum tree to validate the
entire IO path
Can detect any form of silent data corruption
Other filesystems ZFS
30. Instant Readiness
• Starts I/O right after share or LUN is created
• Fast rebuild time
– Intelligent resilvering
– Only rebuild actual data blocks
– The less the data, the faster it takes
Volume
initialization
Formatting
Long
rebuilding
0min 1min 2min 3min 4min 5min 10min
JetStor NAS 724UXD
(ZFS)
Other NAS
(Ext3,Ext4)
Setup wizard (pool->share)
Setup wizard (pool->share)
Connect NAS share
Formatting Formatting
Copy a 8GB video
Formatting Connect NAS share
Editing a video
33. Compression
• Block-level, inline real time
operation
• LZJB algorithm : lossless and
good balance between speed
and efficiency
• Both files and LUNs can be
compressed
• Efficient and almost no
performance impact
Lossless
Original RestoredCompressed
Lossy
Original RestoredCompressed
35. Powerful Network Settings
• Supports all 7 aggregation types
(round-robin, active-backup, trunking, broadcast,
LACP, TLB, ALB)
• Supports VLAN
• Supports jumbo frame (9000 bytes)
• Cluster IP for SMB and NFS
• Policy-based IP filtering
36. Fail-Safe Networking
• Network ports from both
controllers are mirrored to form
cluster IP for file services (SMB
and NFS)
• A cluster IP always contains two
paths (redundant)
• Any path in the cluster IP fails. I/O
will automatically switch to
another path transparently.
Switch
38. UnifiedAUTH is Simple
• All data services (CIFS, FTP, AFP, iSCSI, webDAV) adopt the same set of
account & password for authentication.
• No more – forgot password?
iSCSI
CHAP
By AD, LDAP, or Local Account
iSCSI
CHAP
39. Client OS Interoperability
• Host Operating Systems
– Microsoft Windows
– Linux : Red Hat, SUSE, CentOS
– Unix : Solaris
– VMware
– Hyper-V
– Citrix XenServer
• Backup Applications
– Symantec
– Veeam
– Acronis
40. Performance – 724UXD 10G
ASUS TS500-E6 4x hosts
OS: Windows Server 2012 R2
10GbE(SFP+) HBA in each host
JetStor NAS 724UXD 10G
16G RAM per controller
FW V1.0.0
2x 10GbE ports per controller
Seagate Cheetah 15K.7
ST3300657SS 300GB
SAS6G HDD x48
Dell PowerConnect 8132F
(SFP+)
NAS settings:
RAID 0, 5
CIFS, iSCSI
Dedicated storage pool to
individual host server
Iometer settings:
Iometer ver1.1.0-RC1
512B, 512K
Read/Write Sequential
Read/Write Random
Non-Cache Hit (20GB)
Queue Depths: 256
10GbE Switch
43. File-level Snapshot
• Simple and easy to recover
valuable files from virus attack or
accidental deletion and
modification.
• Copy-on-write technology to
record differential data only
• Supports rollback and clone
functions
• Supports scheduled tasks
• Supports up to 4096 file-level
snapshots
T1 T2 Now
44. Block-level Snapshot
• Simple and easy to protect
valuable data
• Copy-on-write technology to
record differential data only
• Supports rollback and clone
functions
• Supports scheduled tasks
• Supports up to 4096 block-level
snapshots
T1 T2 Now
LUN 1
LUN 2
45. Backup – Replication
• Block-level replication using copy-
on-write snapshot technology
• Efficient differential data
replication
• Same technology for file and
block data
• Support up to 16 replication tasks
• Connection is established through
SSH protocol
JetStor 724UXD
JetStor 724UX JetStor 724UX
ZFS storage devices
46. Amazon S3 Backup
• Backup folders and files to public cloud storage
• Allows scheduled tasks and folder synchronization
47. JetStor Turbo Offload Engine
• Includes SOE (Samba Offload
Engine) and ZVIOS (ZFS Volume
IO Scheduler)
• Linux kernel modules
• Command coalescing
• Process multiple commands at
a time
• Support more outstanding I/O
• ZVIOS accelerates sequential
IOPS (small IO size)
8K 4K 4K 4K 4K
4K4K 4K 4K 4K
8K 16K
4K4K 8K 8K 8K
4K
8K 4K (x3) 4K (x2)
4K (x7)
8K 16K
8K (x3)
4K (x10)8K (x2)
48. JetStor Turbo Offload Engine
SOE ZVIOS
Before After
Read
Write
Before After
Read
Write
1x
1x 1x
1.5x
2.5x
1x
1.2x
2.5x
* Best scenario
49. Windows ACL Support
• Supports Windows ACL
• Set folder access permission in Windows environment
read
50. Intel ISA-L Support
• Supports Intel Xeon processor
(Nehalem microarchitecture and
beyond)
• JetStor integrates ISA-L into
kernel mode codes in operating
system
• Faster XOR P+Q parity write
operations
• Multi-buffer hashing (MbH)
increases secure hash algorithm
speed by parallelism
51. Backup – Rsync
• Rsync client : replicate files to any
devices that support rsync server
• Rsync server : TrioNAS U300 can
act as a destination for any rsync-
compatible device to set up
connection
• Support up to 16 replication tasks
• Connection is established through
SSH protocol
JetStor 724UXD
JetStor 724UX JetStor 724UX
Rsync-compatible devices
52. 20 Year Reputation
Design team with multiple product lifecycle experience
Citable deployment success for almost every application
Extensive knowledge of all storage technologies
Outstanding, readily available support staff
Online knowledge base and customer portal
VMware Technology Alliance Partner since 2004
www.acnc.com
53. Warranty and Support
3 years advanced replacement on all components
5 years drive replacement
Onsite service plans 24x7x4 and next day
Spare parts kits
Free phone and e-mail support
24x7x4 optional phone support
Optional 5 years warranty
Professional Onsite installation
Storage, SAN and connectivity design & consulting
www.acnc.com
54. Research Application
JetStor RAID Arrays Support Cutting-edge Physics Research
• Theoretical nuclear physics experimental data
• High-speed cameras investigate particle flows, saving over 20,000 high-resolution images
• Storing large data sets locally expedites research analysis
• JetStor SAS 516iS iSCSI RAID arrays
• JetStor SATA 416iS iSCSI RAID arrays
“JetStor RAID solutions enable us to quickly adapt storage to our very fluid
research environment.”
- Senior IT Manager
www.acnc.com
55. Multimedia Production
JetStor Delivers Performance Needed for
High-definition, 3D Film Production
• Secure, cost-effective solution for storing hundreds of terabytes of
production data
• High density, power efficient platforms deployed in a robust storage area
network (SAN)
• Four JetStor SAS 742F 42-bay FC RAID Arrays
• Two JetStor SAS 716F 16-bay RAID Arrays
• One JetStor SAS 724F 24-bay FC RAID Array
• Two Brocade 5300 SAN Switches
“JetStor arrays provide value, especially compared to costlier
enterprise-class solutions. They offer massive storage with
outstanding throughput at a much better price point.”
- Post Production Manager for Evergreen Studios
www.acnc.com
56. Education
JetStor RAID Arrays Enable Flawless Delivery
of On-line Courses
• ANGEL learning management suite delivers on-line courses to Penn State’s 96,000
students
• JetStor RAID arrays deliver content for repeated simulations of thousands of users
• JetStor SAS 516F 16 bay RAID array
• JetStor SATA 516F 16 bay RAID array
• Dell PowerEdge servers
“Our JetStors perform without incident, letting us focus on testing rather than
managing our storage.”
- Systems Administrator
www.acnc.com
57. VDI Application
School District Lowers Costs & Improves Performance with
JetStor
• Serves over 2,000 students with 286 employees
• An innovative combination of flash, solid-state, and mechanical storage used to virtualize
1,200 desktops, laptops, and tablets
• Boot up devices and log into class assignments without the latency of boot storms.
• JetStor SAS 724iFD FC SAN 24 bay RAID array
“When we ran a pilot with 250 virtualized desktops and just one JetStor 724iFD
chassis, the device never broke a sweat and we knew we made the right
decision.”
- Technical Services Manager
www.acnc.com
58. Telecom Provider Connects with an Economical & Reliable
Storage Solution
• JetStor & DataCore support the most demanding applications in SANsymphony-V
virtualized storage environments
• JetStor arrays are configured for RAID 5, ensuring data is protected even if a disk fails
• High-density solutions offer 42 bays for up to 168 terabytes of capacity in a 4U chassis
• JetStor 724S SAS units with 600GB drives VOIP projects
• JetStor units running in five states PA, IL, KY, TX and CA
“JetStor products give us rock-solid reliability and the freedom to choose cost-
effective disks that meet our needs, not the vendor’s.”
- Network Engineer
Telecom Application
www.acnc.com
59. JetStor® RAID Arrays Deliver Vital Software-as-a-Service to the
Construction Industry
• Barryhund provides its solution, called Online Plan Service, via hosting services and
software-as-a-service.
• Qty 4 JetStor 742S arrays link via a SAS switch to 3 servers, providing the benefits
of DAS with all the capabilities of shared storage.
• The JetStors are configured for RAID Level 0+1. RAID 0+1 delivers the same fault
tolerance as RAID level 5 & offers high I/O rates thanks to multiple stripe segments.
“If you need simple, reliable, fast, and clustered storage that takes very little
time to manage, then your answer is simple—JetStor.”
- Founder and CEO
Software-as-a-Service
www.acnc.com
60. Server Consolidation
JetStor RAID Arrays Enable Consolidation of Engineering &
Administration Servers
• Consolidated numerous legacy servers onto 75 virtual machines
• Support 1,900 employees at 32 facilities worldwide
• JetStor 516iS 16 bay RAID arrays
• JetStor 716iS 16bay RAID arrays
• JetStor 760iSD 60bay RAID arrays
• RAID 10
• Dell PowerEdge servers
“Thanks to JetStor, we can incrementally expand our storage capacity
quickly, easily, and very cost-effectively.”
- Technology Manager
www.acnc.com
61. Video Processing Backup
JetStor RAID Arrays Provide Continuous Backup
to 27 SAN & NAS Servers
• 500 GB projects are restored in just minutes, on demand
• Primary and off-site backup mirrored over 10Gb fibre channel
• 20 JetStor 516F RAID arrays
• ZFS public-domain file system
“By relying on ZFS and JetStor, we’ve met our business and IT needs well into
the future.”
- Studio Engineer
Leading Digital Video
Production Studio
Primary
Storage
Backup
Storage
www.acnc.com