Presentation sun stor edge 9990 system technical

StorEdge 9900 Series
Speakers Name
Title

Dialing-in the Right-Sized Storage!
The SE 9900 Combination
Rated by importance to customer's application SLA (low-medium-high)
✔ Data Availability
VERY HIGH
✔IO Performance
HIGH
✔Service Costs (Installation and Management)
LOW
✔Data Scalability
VERY HIGH
✔Data Protection
VERY HIGH
✔Implementation Price
MEDIUM
✔Flexibility of Server Support
VERY HIGH Sun Confidential: Internal Only 2

Sun StorEdge 9990 System
The Ultimate Storage Platform
● For the high end data center

● Unparalleled performance,

availability, scalability,
manageability, connectivity
● Application-oriented storage

– Massive consolidation
– High volume OLTP
– Business intelligence, large scale
– Regulatory compliance
– Data and information lifecycle
management
– Service provider business models
– E-mail archiving

Sun Confidential: Internal Only 3

Performance, Capacity, Scalability, Connectivity
● 81 GB per second aggregate system bandwidth
(68 GB per second data and 13 GB per second control)
● Performance scales with capacity
● 336 TB internal capacity (300 GB drives)
● 1152 drive slots
● 256 GB data cache
● 12 GB shared memory
● Up to 192 direct connections (FC)
● 2 Gbps FC backend loops
● Multi-platform connectivity
– FC/FICON/ESCON/NAS
● 73 GB 15K, 146 GB 10K and 15K, 300 GB 10K
dual-ported FC drives

StorEdge 9985 System
The Ultimate Entry System for the Data Center
 Scaled Down Version of the SE 9990
 Excellent Performance for its Class
● 12 GB/Sec Aggregate System Bandwidth

● Scalability
● From 1 to 72TB (per Subsystem)

● Does not grow into an SE9990

● Centralized Storage Management
● Common Platform for Multi-Vendor Support

● Virtualize and manage up to 16PB

● Active Workload Analysis & Tuning

● Flexible Connectivity Options
● FC, ESCON, FICON, NAS


SE9990
Architecture


SE 9990 Architecture


Architecture — Third Generation Supercomputer
Crossbar Switch
●Supercomputer Crossbar Switch

81 GB per second
– 4 switches with a parallel switch fabric
– 64 paths on both processor and cache sides
– 128 concurrent
cache operations
– Non-blocking


SE 9900 Family Adapter Design
● Each Adapter actually consists of
two PCBs
●Even though they are one adapter,

Two PCBs are actually placed
in two different HW clusters
●Sixteen slots in two HW clusters

● A pair of PCBs are symmetrical which

Means “active/active and load balanced.”

Adapter 1 Adapter 1 prime
C1 C2
Adapter 2 Adapter82ports
BED = prime


Architecture — I/O
● Total of 16 slots accommodate

– Front-end directors (FEDs — AKA channel host adapters, or CHAs)
– Back-end directors (BEDs — AKA array control processors, or ACPs)
– Each FED or BED occupies two slots
– Of the 16 slots, 4 are reserved for FEDs
● Up to 6 FEDs, with 16 or 32 FC ports, up to a max of 192 FC ports

● Up to 96 ESCON and 48 FICON ports are supported
● Up to 4 BEDs, each supporting sixteen 2 Gbps FC-AL
connections to drives
– Each BED supports up to 256 drives. End result is 64

FCAL loops


SE 9900 FamilyFED
●Each FED has two PCB,
each PCB has 8 MPs for a
total of 16 MPs per FED
●Each MP has flash memory

associated with it, where
microcode is stored.
● 32 port adapter = 2 port

per MP
● 16 port adapter = 1 port

per MP

PCB = Printed Circuit Board
MP = Microprocessor

4 Gbit Front End Director
● 255 MB/sec: GA October 2005
● 355 MB/sec: Future (Estimated May 2006)
● Expected configuration (subject to change)
● 32 and 16 port versions

● Each port operates at 4 Gbit/sec


Non-Disruptive Upgrade of
Microcode –

MP 1
●Path control is transferred
to MP partner
●Data path is kept online

while flash memory updated
●Dialogue asks if to

MP 2 continue if data path
saturation exceeds 50%

MP = Microprocessor w/Flash Memory; 16 MPs/FED
@ 400MHz; Mps are dedicated

Server Support/LDEVS/Virtual Ports/Sparing
● 625 server support example, assuming 10 switches
– Each switch supports 144 ports = 1440 ports
– 1440 ports divided by two for redundancy = 720 ports pairs
– 720 port pairs less 95 port pairs (for back-end storage connectivity) =
625 ports to support servers
– Example only, actual implementation will vary according to
workload
● 16,384 logical devices Sparing
● 24,576 virtual ports
Drives Spares
Sun StorEdge 9990 100 (Entry) 5 – 256 1–4
Sun StorEdge 9990 600 (Enhanced) 97 – 512 1–8
Sun StorEdge 9990 1100 (Ultra) 129 – 1152 1 – 16
Note: These are pricing reference configurations, not separate and distinct models

SE 9900 NAS Blade Feature
● Fits in the same slot of the FED
● Eight 1Gbps Ethernet ports per blade
● Up to 4 blades per SE 9990, for a total of 32 Ethernet ports
● Blades are active-active failure
● Supports CIFS and NFS
● Works with ShadowImage and Truecopy, and other storage
mgmt software
● Snapshot capability, Supports Active Directory and OpenLDAP
● Symantec anti-virus agent; purchase anti-virus server
seperately
● File Shared/blade: 256 for both CIFS and NFS


Battery Backup/Data Destage


SE 9990 Warranty
Warranty
Warranty Period 3yrs
4hr response on-site support
Service Level Telephone Support 24 3 years
X7
Install Service Included in
Yes
Purchase Price


SE9985
Architecture


Phase 2 Architecture Completed
Additional Capacity, Cache and Mainframe Support
Primary Secondary
Rack Rack

Optional Disk Chassis

Initial Disk 12U
Chassis Required

SVP
12U

Optional Disk Chassis
Logic/Power Supply Box 12U
1U
• Cache/Shared Memory Package: 2
slots
• Mix Adapter - Includes 16-port FED
and 8-port BED: 2 slots 15U
• Optional Package (i.e. Fibre 12U
Channel, NAS): 2 slots
• Power supply
• Battery

Primary/Secondary racks are identical components.
Sun Confidential: Internal Only rack space = 42U (1U = 1.75-inches)
Total available 19

Physical Rack


Third Generation Crossbar Switch
● Non-blocking supercomputer switch architecture for
outstanding performance and scalability
● 32 concurrent cache operations (not including shared
memory)
● 12 GB/sec aggregate MIX PK CHA2 MIX PK CHA3
system bandwidth
● Larger cache, improved
algorithms, faster Hi-Star
processors
CSW0 CSW1
● Ability to aggregate CACHE (SM) CACHE (SM)
controllers, capacity


Feature Overview
Min/Max ports 16/48 FC, 16 FICON, 16 ESCON 8 NAS
Minimum HDD 4 Data + 1 Spare
Maximim HDD 240 HDD
Drive Types 73 GB 15K, 146 GB 10K & 15K, 300 GB 10K
Max External Capacity 16PB
Min/Max Data Cache 4GB/64 GB
Min/Max Shared Memory 2GB/6GB
Rack 19” Industry Standard Rack
ShadowImage Open System and Mainframe Support
TrueCopy Sync/Async Open System and Mainframe Support
Universal Replicator Yes
Copy on Write Snapshot Yes
Data Retention Utility Yes
Business Continuity Manager Yes
HiCommand Device Manager Yes
Volume Migration Yes
Virtual Partition Manager Yes
Server Priority Manager Yes
Universal Volume Manager Yes
FlashCopy V2 Yes


Key Differences Options Slot
● 6 slots instead of 16

● Integration of functions
MIX PK CHA2 MIX PK CHA3
● Mixed PK = Mixed FED/BED Combo

Adapter Hi-Star
● Data Cache/Shared Memory/Cache

Switch are now on the same board. CSW0 CSW1
● One Service Processor CACHE (SM) CACHE (SM)

Integrated data cache,
share memory, switch
PCB


SE 9985 I/0
● Six slots in two HW clusters
- Slots 1A & 2F = Mixed adapter
- Slots 1C & 2D – Cache/Shared/
Switch
Hi-Star
- Slot 1B & 2E “Options Slot” for
FED, NAS, FICON, ESCON CSW0 CSW1
CACHE (SM) CACHE (SM)
● Mixed Adapter

FED = 8 ports FED = 8 ports
C1 C2
BED = 4 ports BED = 4 ports
BED = 8 ports
● A pair of boards deployed into two HW clusters
- Total of 16 FED and 8 BED ports

SE 9985 I/0 -Board Summary

●FED = 16 or 32 ports MIX PK CHA2 MIX PK CHA3
●Mixed Adapter = 16 FED/8 BED

●NAS Blade = 8 Gigabit Ethernet Hi-Star
●FICON = 16 ports

●ESCON 16 Ports
CSW0 CSW1
CACHE (SM) CACHE (SM)


Power
● Single Phase 30 AMP and 50 AMP available
Worldwide
● 60 Hz: 200V, 208V, 230 V at 30 Amps
● 50 Hz: 200V, 220V, 240 V at 50 Amps


Minimum/ Maximums/RAID/Spares
● MIN/MAX
● 4 GB to 64 GB Data Cache
● 2 GB to 6 GB Shared Memory
● 3D +1 P to 240 HDD
● FC Ports 16-48
● RAID
● RAID5 (3D + 1P)
● RAID5 (7D + 1P) – w/o 100 % data availability guarantee
● RAID1 (2D + 2D)
● RAID6 (6D + 2P)
● Global Spares: MAX = 16 27
Sun Confidential: Internal Only

Battery Backup
● If power failure is less than 20 milliseconds, full
operation is maintained (e.g. Disks keep spinning)
● If longer than 20 milliseconds, the operation ceases
and battery maintains data in data cache and
shared memory up to 36 hours.
● Manual de-stage of data to disk required


SE 9985 Warranty
Warranty Period 3yrs
4hr response on-site support
Service Level Telephone Support 24 1st year
X7
Return to factory 2nd year
Return to factory 3rd year
Install Service Included in
Yes
Purchase Price

http://www.sun.com/service/warranty/network.html#diskstorage

Note: Warranty may change March-end 2006, so check this URL


Comparison
Within SE 9900
Family


Visual Comparison
SE 9985 SE 9990


SE 9985 and SE 9990
● Similarities ● Differences
● Similar architecture ● Mixed Adapter
● Same microcode ● # of SVPs
● Runs same software ● Enclosure
● Virtualization ● Power/Batteries
● Partitioning ● Internal Layout
● Replication ● Expandability
● Management, ect
● Same upgrade parts
● HDD, FED


Schedules
● “Phase 2” Completed February 2006
● HDD capacity increased to 240 HDDs with 2nd rack
● Data Cache increased to 64 GB
● Mainframe Support; ESCON/FICON


SE 9985/SE 9990 Comparison
Feature SE 9985 SE 9990
Packaging 19"Rack Multi-Cabinet
Architecture Crossbar Crossbar
Aggregate internal bandwidth 12GB/s 81GB/s
Maximum Raw Capacity (Internal) 72 TB 332 TB
Internal and External 16 PB 32 PB
Max # of HDDS 240 1152
Max # of LUNs 8192 16384
Max data cache 64 GB 256GB
Partitions 8 32
Mirrored cache boards Yes Yes
Max shared memory 6GB 12GB
FC Connectivity Performance 2Gb/s or 4 Gb/s 2Gb/sor 4 Gb/s
Max theoretical host support 6144 24576
Fibre Channel Connectivity 48 192
Multi-protocol support FC/NAS/FICON/ESCON FC/NAS/FICON/ESCON
73 GB 15K, 146GB 10K, 146 15K 73 GB 15K, 146GB 10K,146 GB
HDD Support
300 GB 10K* 300 GB 10K
RAID RAID 1,10,5, 6 RAID 1,10,5, 6
* RAID 6 and RAID 5 (7D+1P) are available with 300 GB at this time on the SE 9990
* RAID 5 (7D + 1P) is available on the SE 9985 but the 100% data availb guarantee is not provided
ility


Summary Comparison: SE 9985 vs
others
Feature SE 9985 SE 99970 SE 9980 SE9990
Aggregate internal
12GB/s 150% greater 25% less 85% less
bandwidth
Maximum Raw Capacity
72 TB 380% greater 48% less 79% less
(Internal)
Max # of HDDS 240 180% less 8 76% less 79% less
Max # of LUNs 8192 50% less 50% less 50% less
Max data cache 64 GB Equal 50 % less 75.00%
Max theoretical host
6144 6144 8192 24576
support
48 Equal 25% less 75% less
Fibre Channel Connectivity
FC/NAS/FICON/ FC/NAS/FICON/ FC/NAS/FICON/ FC/NAS/FICON/
Multi-protocol support ESCON ESCON ESCON ESCON
73 GB 15K, 73 GB 15K,
146GB 10K and No 300 GB, no No 300 GB, no 146GB 10K and
HDD Support
15K, 300 GB 146 GB 15K 146 GB 15K 15K, 300 GB
10K 10K


SE 9985/SE 9970/80 Comparison
Feature SE 9985 SE 99970 SE 9980
Packaging 19"Rack Multiple cabinets Multiple cabinet
Architecture Crossbar Crossbar Crossbar
Aggregate internal bandwidth 12GB/s 7.9GB/s 15.9GB/s
Maximum Raw Capacity (Internal) 72 TB 18.5 TB 149.5 TB
Internal and External 16 PB N/A N/A
Max # of HDDS 120 128 1024
Max # of LUNs 8192 16384 16384
Max data cache 32 (64 later) 64 GB 128 GB
Mirrored cache boards Yes Yes Yes
Max shared memory 6GB 6GB 6GB
FC Connectivity Performance 2Gb/s 1Gb/s 1Gb/s
Max theoretical host support 6144 6144 8192
Fibre Channel Connectivity 48 48 64
Multi-protocol support FC/NAS FC/NAS/ESCON/FICON FC/NAS/ESCON/FICON
73 GB 15K, 146GB 10K, 73 GB 10K, 73 GB 15K, 73 GB 10K, 73 GB
HDD Support
300 GB 10K 146GB 10K 15K, 146GB 10K
RAID RAID 1,10,5, 6 RAID 1,10,5 RAID 1,10,5


Key Differences Options Slot
● 6 slots instead of 16

● Integration of functions
● Mixed PK = Mixed FED/BED Combo

Adapter Hi-Star
● Data Cache/Shared Memory/Cache

Switch are now on the same board. CSW0 CSW1
● One Service Processor CACHE (SM) CACHE (SM)

Integrated data cache,
share memory, switch
PCB



Switches, data cache, shared memory, BED on seperate
PCBs

Four Key
Software
Packages


Example:Universal Volume Manager
● Customer Topology
● SE 9900 and EMC and HP EVA
● Use Universal Volume Manager (UVM) to virtualize
EMC, EVA, SE 3511
● Use ShadowImage or Volume Migrator to copy or
migrate data to virtualized external storage.
● Use HDS storage management software to
administer all storage
● Investments are protected
● Consistent management and tools

Storage Virtualization
Implementation — Universal Volume Manager

HOST
ELUN — LUN that is
HBA Port mapped to a LUN in an
external storage device
Target Port ELUN

Host View
Devices LUN LUN LUN LUN LUN LUN LUN
StorEdge 9990
VDEV Controller
VDEV
LDEV LDEV
Internal LDEV
LDEV
Devices LDEV
LDEV
LDEV
External Port
Mapped Mapped
Target Port

StorEdge 9990 array
External Storage
Array
HDD LUN LUN
Group


Virtual Partitioning Manager
● Purpose
● Dedicate/isolate specific resources to an
application or customer
● Disk, Data Cache, I/O
● Data cache allocated in 4GB increments
● Facilitates dedicating resources to several
applications or internal/external customers in a SE
9985 or SE 9990.
● This is consolidation in context of this software package.
● While flexible enough to change resource over
time, in practice, partitions are not expected to be
changed frequently.


VSPM’s – Basic Concepts
Storage Logical
Partitioning

… A B C D …
Assigned Port Port
Cache Logical
Assigned
Cache … Partitioning
xGB Cache
Partition Partitioned Memory
Cache

Assigned PG …
Parity Group
Cache Logical Partition (CLPR)
• Assign specific cache capacity and assign one or …
more parity groups to use that dedicated cache Parity Group
Storage Logical Partition (SLPR)
• Assign one or more Target Ports to use Physical Configuration
the Cache Logical Partitions
• Administrators and User level authority
maintained in Access Control Lists

Access Control – Four Levels
User Types SLPR0 SLPR1~31
User , Configuration Copy operation User, Configuration management Copy operation
management
SLPR/CLPR management
management

Super SA OK OK OK OK OK OK
General SA No OK OK No OK OK
Super PSA No No No OK (OK)*1 No*3
General PSA No No No No (OK)*2 No*3

SA:Storage Administrator *1: Depend on the specification by Storage Admin
*2: Depend on the specification by Partition Storage Admin
PSA:Partition Storage Administrator *3: Supported at 3rd GA

Super PSA Super PSA Super SA
/General PSA /General PSA /General SA

SLPR1 SLPR2

CLPR CLPR2 CLPR0

SI/
Volume Migration


Universal Replicator (UR)
● Conceptually: TrueCopy plus more capability:
● Disk Journaling
● In case of WAN-link failure, data is written to disk,
and copy suspension and recovery is avoided
● Need to plan for space to accommodate expected
outtage. Threshholds are settable
● Remote site polls primary site SE 9990/85to pull
data off the production site, decreasing cycles
consumed on at production site.
● UR is asynch; combine with TrueCopy Synch for
data currency
● Use only with SE 9985 and SE 9990.

Universal Replicator (UR)
-Universal Replictor is more stable than TrueCopy Asynch (TCA) in addressing link
issues. 26% of issue are link related:HDS/TRC analysis 04Q/2004
- Engineering tests suggest UR help manage expensive, limited, and unreliable links
- TCA could not maintain Remote Copy due to 45 seconds Link down
- UR could provide reliable Remote Copy during 5 minutes Link down

TCA starts host I/O throttle Universal Replicator maintains Remote Copy
to reduce input to cache over cache 30% during link down until JNL full

Response time(ms) Link down Link up
5 minutes
UR guarantees data consistency
during Link down
TC Async TCA Suspend
(Cannot maintain remote copy after Suspend
After Suspend, TCA receives host I/O)

45 sec UR Time

Example: Universal Replicator
● Before
● WAN-link fails; transactions overflow cache
● Suspend copy and initiate re-synch operations
● After (e.g with Universal Replicator)
● WAN-link fails and transactions are written to disk
● WAN-link is restored, copy operation resumes, no copy
suspend, no re-synch operation
● Pull technology polls central to transmit data according
to bandwidth capacity
● Customer can by smaller pipe
● Benefits: Lower WAN costs and reduced
operational disruptions

Tiered Storage Manager Details
● “Volume Migrator” is the underlying engine
● Search capability enables collection of application data to be
grouped and migrated
● Example:
Condition is: RAIDLevel IS RAID5 AND DriveType IS FC-AL AND ArrayGroup IS NOT 2-1
● Groups of volumes can be migrated at the same time
(migration groups)
● A group of volumes can serve as migration targets
(storage tiers)


Example Tiered Storage Manager

● Customer topology
● SE9900 with SE3511 and EMC
● Use Tiered Storage Manager (TSM) to select
several volumes and migrate them to specific
target volumes
● Result: automated movement of data according to
its value
● Reduced DLM costs


Continuity
Example


ShadowImage In-System Replication
Up to 9 Full Duplicate Copies of Any Data Volume

Secondary
Volume

Secondary
Volume

Secondary Secondary
Volume
Non-stop Volume

Production Secondary
Primary Secondary
Volume Volume
Volume

Secondary
Secondary
Volume
Volume
Secondary
Volume

9 Copies Total Open Systems

SE 9900 ShadowImage Operations
● R/W operations continue during creation of S-Vol.
● R/W operations buffered in data cache
● Pair status monitored to ensure completion of copy
operations
● Meta data about changed/new data kept in differential
bitmap in shared memory to support resynch operations
● R/W operations may also be performed on S-Vols. S-
Vols need not be fully populated before other copy
software begin operations on S-Vol. Writes can be held
in cache while other copy operations are executed
against the S-Vol.
● TrueCopy Remote Replication and Universal Replicator
use SI P-vol. Sun Confidential: Internal Only 52

Copy On Write
● Copies Changes only
● Create Primary Volume (P-Vol) from the Production DB.

● Create a Secondary Volume (S-Vol) from the P-Vol.

● This is a Copy on Write Snapshot Pair

● The S-Vol is carved out of a pool of allocated physical
storage called a “Pool-Vol”
● Pool-Vol can dynamically grow; thresholds settable

● Cannot snap off of a snap (e.g. No S-Vol to S-Vol)
● A snap can be taken off of a P-Vol

● TrueCopy (TC) and SI can operate off of a P-Vol.

● Use for write oriented applications: 60% W, 40% R is

rough limit.


TrueCopy to Remote DR site.
● S-Vol copied by TC to Remote DR site may be
re-mounted as a P-Vol.
● COW Snaps can be taken off this P-Vol
● Tape would use use a SI S-Vol created from P-Vol
in order to avoid write contention.
● Updates to remote DR site occur realtime,
assuming cache write through


SnapBack Operations
● Snapback
● Can now snapback to any version
● Do not have to delete later versions


Summary
● The SE 9985 and SE 9990 represent the highest
levels of:
● Availability
● Managability
● Scalability
● Connectivity
● Performance


Thank You
Name of Speaker
Title

Presentation sun stor edge 9990 system technical

More Related Content

What's hot

Similar to Presentation sun stor edge 9990 system technical

More from xKinAnx

Recently uploaded

Presentation sun stor edge 9990 system technical