The rapid development of unstructured data applications is necessitating products that can provide services for sharing data effectively.
1900 $M 1976 PB Huawei Symantec launches the N8000 Clustered NAS System to overcome the limitations of traditional NAS architectures in terms of performance, reliability, extensibility, and cost. 2006 322 PB 2010 Growth of the amount of unstructured data Revenues on the global market of data sharing Digital entertainment Internet Oil exploration Medical research Other fields 2008 20 $M 2012
Switchover CIFS NFS Unix users Windows users CIFS NFS Windows users Unix users IP
Traditional NAS (2): l ow p erformance and e xtensibility
The expansion of capacity is limited.
The performance can not be scaled.
Close coupling of the storage management system and the host ports
The service performance is further restricted.
Fixed single/dual head architecture.
The configuration of individual set of devices is fixed.
The performance can be enhanced only by adding multiple sets of devices. The multiple sets of devices, however, cannot share storage resources and several copies of backup data is required. Thus, the data consistency cannot be ensured.
Head JBOD Traditional NAS
Traditional NAS (3): Failure in Sharing Data Between the Active and Standby Controllers
Single head failure
When a normal head takes over the memory of a faulty head, the switchover costs a long time.
Low usage of head resources.
Heads access their own memory.
Free heads cannot share loads for busy heads.
Traditional NAS (4): No Support for Hierarchical Storage
All the data is stored as the first-level storage, imposing great financial pressure upon enterprises.
The cost for protecting the data is increasing.
The yearly growth rate of the requirement for storing data resources by enterprises is 70%.
The amount of files is soaring, doubling itself every 12 to 18 months.
2/8 principle: mixed distribution of frequently-accessed data and rarely-accessed data.
Large amount of rarely-accessed files makes the retrieval rate gradually low.
Rapid growth of data Mixed distribution of data resources High IT cost
Traditional NAS (5): complex backing up network Traditional NAS equipment Service hosts Production network Tape/disk network Backup Backup server
Integration of the NBU client to implement the server-free backup
Multi-dimensional and flexible expansion
Automatic failover and failback
Install/Upgrade CIFS/NFS Client NAS Engines Storage Units IP FC Add/Delete N8000 Clustered NAS System
Introduction of N8000 Oceanspace N8300 clustered NAS storage system Oceanspace N8500 clustered NAS storage system SAS, FC,SATA Disk type 15PB 7.68PB Max. capacity RAID 0, 1,10, 5, 6 RAID 2*4Gb per NAS engine Interface of FC Active-Active Clustering mode 8/16GB per NAS engine Cache 4/6 per NAS engine 2-6 N8300 Interface of network 4-16 Num of NAS engine N8500 Item
Specifications N8000 ISM GUI, Command Line Interface(CLI) Management interfaces NAS management Dynamic storage tiering 、 Snapshot 、 Mirror 、 Clustered Veritas NetBackup Client Standard Features RAID controller management System management yes NDMP support Support Clustered symantec netbackup client for SAN and LAN Connectivity Backup type Backup attributes Automated Parallel RAID Striping and Multi-Pathing RAID striping Simultaneous CIFS and NFS Multi-protocol support 256TB Maximum file system size File system attributes FC, iSCSI, CIFS, NFS, NDMP, Network protocol support SSH, SNMP,NIS, DNS, NTP,Email Alerts Management protocols Protocols supported N8500 N8300 Item Up to 200 million Maximum files per system
Unified storage NAS FC SAN N8000 Cluster NAS File servers Database servers Application servers Applicable to requirements that requires lots of bandwidth IP SAN File-level access Block-level access iSCSI FC NFS/CIFS
To integrate storage based on the different requirements that services have on the performance
Bandwidth intensive applications
To protect the service performance through the storage network of FC fiber-optic channels.
Non-key services and data sharing services
To reduce the construction cost and deployment cost through the IP-SAN and NAS ports.
To store all service data to the N8000 uniformly
Support for the dynamic expansion of 2-16 engine nodes and the linear expansion of performance
To protect the investment of users.
To meet the performance requirements of all service hosts.
A maximum usable storage capacity of 15PB
To meet the storage requirements of next ten years.
To reduce the management cost of users
Service LAN IP FC IP IP FC FC IP IP IP IP IP IP IP IP IP IP IP IP Manager IP Data center FC IP IP IP N8000 FC-SAN IP-SAN NAS
(2) Centralized backup of remote data:s cenario
All production centers are located independently from each other.
All production centers are based on different storage networks, including SAN, NAS, DAS.
Some production centers have set up backup systems with backup software from different vendors.
The data of all production centers is backed up to the disaster backup center uniformly.
Unit N Unit 3 Unit 2 IP IP IP IP Backup server LEGATO IP Backup server BackupEXEC IP FC FC FC FC IP IP IP IP Backup server CommVault Unit 1 IP-SAN NAS FC-SAN
(2) Centralized backup of remote data: solution
The high reliability of the N8000 ensure the security of data.
The existing backup networking architecture is not changed.
All units set up their own backup policies.
The high performance of the N8000 ensures that the bandwidth is enough for the networking.
The performance in backing up data by multiple sub-units is not restricted.
A maximum storage capacity of 15PB is provided to meet the requirements of disaster backup.
Manager IP N8000 Disaster backup center IP IP Unit N Unit 1 Unit 2 Unit N Unit 3 Unit 2 IP IP IP IP Backup server LEGATO IP Backup server BackupEXEC IP IP-SAN FC FC FC FC-SAN FC IP IP IP IP Backup server CommVault Unit 1 IP Backup server BackupEXEC NAS IP Network
(3) Storage of high performance computing:scenario
Bottleneck in the performance of the disk I/O for high performance computers
Single NAS storage array cannot meet the performance requirement of large numbers of computing nodes.
The CPU usage by computing nodes is 30%–50%
Low reliability of the traditional NAS storage array
The traditional NAS storage array controller works in Active-Standby mode, and thus the computing is interrupted when any one controller fails.
NAS storage solution with super high performance
NAS storage equipment with high reliability
The computing is not affected when a storage controller fails.
(3) Storage of high performance computing: solution
Support for 2–16 Engine nodes.
Overall performance grows linearly as the number of nodes increases.
All storage nodes work in Active-Active mode, and thus the computing is not affected when a single node fails.
Support for the automatic failback without affecting the computing.
The NFS- or CIFS-based network sharing protocol allows all computing nodes to share the same file.
IP Manager IP IP IP N8000 Computing center IP IP IP IP IP IP IP IP IP IP IP IP IP IP IP IP IP IP IP IP IP Gigabit IP Network Computing nodes
The backup process does not affect the performance of the service host
The coupling of the N8000 and the NetBackup helps to transfer data to the disaster backup center without occupying any storage transfer network.
To scale down the backup window
Flexible backup policy: The daily incremental backup and monthly aggregate backup greatly reduce the usage of the backup network.
To reduce the cost of users and to simplify the deployment
No backup client is installed on the host.
Service LAN IP FC IP IP FC FC IP IP IP IP IP IP IP IP IP IP IP Data center FC N8000 FC IP IP Disaster backup center FC/IP storage array /Virtual tape library (VTL) /Physical tape library Symantec Netbackup IP IP Manager IP IP FC-SAN NAS WAN
(7) Extension of storage performance: scenario
Large amount of services for enterprises
Services hosts, distributed in different geographical locations, are connected through the IP network.
Service types are increasing and the amount of service access is soaring.
Multiple storage devices are managed on central basis.
Requirement: The performance and capacity of storage devices can be scaled.
To expand the I/O performance of individual storage devices linearly by adding more components.
To expand the storage capacity from the TB level to the PB level.
(7) Extension of storage performance: solution
To meet the performance requirement of increasing services
The online expansion of a maximum sixteen clustered NAS engine nodes is supported.
The overall performance is scaled linearly along with the expansion of nodes.
To meet the capacity requirement of increasing data
The online expansion of storage capacity for service hosts is supported.
More storage arrays can be added online.
A maximum of 64 storage arrays is supported.
A maximum of 15PB storage capacity is supported.
Data center N8000 Service LAN IP IP IP IP IP IP IP IP IP IP NAS FC FC FC FC FC FC IP IP IP IP FC FC IP IP IP IP IP IP IP IP IP IP
Taobao is the largest network retailer in the Asia-Pacific region and is founded in 2003 by Alibaba Group. By the end of 2008, Taobao had over 98 million registered members covering most of online procurement crowd in China. The trading volume in 2008 amounted to 99.96 billion yuan, accounting for 80% market share of China's online shopping market.
Provide non-structural file mass data storage for Taobao trade platform.
Data sharing: Over 500 servers can access the network sharing storage space.
The storage system is highly reliable, flexible, and scalable, and can reduce the pressure of boosting data.
High-speed data backup, decrease the backup windows.
Huawei Symantec solution
Adopt the cluster NAS N8500 storage solution. Configure two sets of N8500 cluster storage systems to meet the storage requirements for high reliability, performance, and scalability.
Each N8500 storage system is configured with 12 cluster NAS servers. In total, 1496 TB storage capacity is configured.
Through the NBU backup software built-in the N8500, the backup efficiency is improved.
Mass File Storage System on Taobao Equipment Room-A Equipment Room-B 4×4Gb FC HuaSy N8500 Cluster NAS NBU Master server SUN SL500 Physical Tape Library HuaSy N8500 Cluster NAS Backup data stream WAN IP Network IP Network
The NAS servers adopt the Active-Active mode to eliminate single point failure and ensure the stable operation of user business systems.
The measured performance of each N8500 is over 3 GB/s, meeting the storage throughput of multiple business servers of the user.
The maximum storage capacity of single N8500 is up to 960 TB, meeting the data growth of Taobao in 5 years.
Effective data backup system
Build in NBU Media backup media software on four NAS servers of the N8500 to implement the parallel data backup.
Compared with the traditional NDMP protocol backup mode, the backup efficiency is increased nearly 4 times.
Case 3: Cluster Storage System of Virtual Community of Shanghai Shengda Network
80 servers with each loading five virtual servers.
Each virtual server stores 30 GB files.
Files of virtual servers can be saved in the NAS storage system.
Feature high reliability, flexibility, and scalability.
Can fast deploy files on virtual servers.
Easy to manage, reduce the management cost.
Huawei Symantec solution
Adopt the Clustered storage system N8300.
Configure five N8300 NAS servers. Configure the NAS network sharing interface protocol and 12 TB available storage capacity.
Arrange 80 servers in five groups.
Each NAS server is configured with four Gigabit Ethernet interfaces, which are accessed in one group of servers through the redundant path in network convergence mode to implement the performance balancing.
Cluster Storage System of Virtual Community of Shanghai Shanda Network App App OS OS ESX Server NAS server Storage unit IP Switch IP Switch IP Switch Community servers Group 1 Group 2 Group 3 Group 4 Group 5 HS N8300 Cluster NAS GE GE×2 GE×2
High reliability: no single point failure
Faults on any NAS server do not affect services, thus ensuring the 7x24 sustainable operation.
Storage performance: scalable
Expand the storage performance by adding NAS servers or back-end storage arrays.
Reducing management cost
Work closely with the ActiveDirectory, reduce the complexity of the authority management.
Batch clone files of virtual servers through the N8300. Able to clone files of a virtual server in 3 m.
VM VM Files of virtual server VM VM VM VM Advantages
Since 2006, CCTV had began to build new media services based on the existing TV programs to provide brand-new interactive programs to computer, TV and mobile phone users through the Internet, cable TV, wireless transmission networks, broadband networks, and mobile networks .
Adopt one high-performance NAS storage device for synthesis, transcoding, and distribution services.
Excellent performance: Provide stable, fast, and simple data storage, search, sharing, and access services for multiple workstations, and increase the data switching speed.
Sustainable access services: The storage system ensures 7x24 uninterrupted services.
Data sharing: Multiple workstations can edit media in one file system at the same time.
Stable I/O performance: Ensure that frame loss does not occur during the media data processing.
Huawei Symantec solution
Adopt the cluster NAS N8300 storage solution to meet the requirements for high reliability, performance, and scalability.
Configure two NAS servers, CIF, NAS network sharing interface protocol, and 48 TB storage capacity.
Active-Active working mode. Faults on any NAS server do not affect the service operation, thus ensuring the 7x24 sustainable service operation.
N8300 cluster storage structure meets the storage performance requirements of various media production services.
Storage performance can be scaled with NAS servers.
The maximum storage capacity can be scaled to 7PB.
Stable I/O performance ensures zero frame loss during the media production.
Database server Data migration server Recording workstation Convergence workstation Editing workstation Application management workstation Transcoding workstation N8300 Clustered NAS Media Production Platform Advantages IP Network
Case 5: Clustered Storage System on Digital Campus of Shanghai Ocean University
Ensure the high availability of data, implement the sustainable operation of data services.
Clustered data storage and simplified data management improves the application system performance.
Key database systems require high I/O performance and low delay.
Partial services require information sharing.
Implement the effective disk-based Clustered automatic data backup.
Huawei Symantec solution
Adopt the Clustered storage system N8500.
Configure four N8500 NAS servers. Configure FC-SAN, IP-SAN, and NAS storage interfaces, and use 120 TB for online storage and 60 TB for backup storage.
Configure snapshot, DTS, Server Free backup client.
Work with the Symantec NetBackup to implement the data backup management.
Clustered Storage System on Digital Campus of Shanghai Ocean University
The Clustered system provides the FC-SAN, IP-SAN, and NAS at the same time. Clustered storage eases the storage planning and saves user investment.
High reliability: The Active-Active mode ensures the 7x24 sustainable operation on campus.
High performance: The N8500 cluster storage structure meets the storage performance requirements for various services on campus.
Data access frequency-based DTS: The FC disk data are automatically moved to near line SATA disk, thus reducing the user investment.
Adopt the advanced snapshot and built-in NBU backup software, thus implementing the effective data backup.
Advantages: Backup Server N8500 Unified Storage Linux Windows Unix Linux Windows Unix Linux Windows Unix Backup Media S5500 DR site IP Network FC SAN IP SAN NAS