More Related Content
Similar to iLab nPath v2 (20)
iLab nPath v2
- 1. iSER
Target
Instances
instan
incset
a0n
Icnes
t1a
inncseta
2n
incset
a3n
incset
a4n
instcaen
5c
e
6
instance
7
FLASH
Volume
Group
Physical
Disks
4x640GB
SSD
Logical
Disks
8x128GB
RAID-‐0
HDD
Volume
Group
Physical
Disks
6x300GB
SAS
Logical
Disks
2x900GB
RAID-‐0
iSER
Target
Instances
instan
incset
a0n
Icnes
t1a
inncseta
2n
incset
a3n
incset
a4n
instcaen
5c
e
6
instance
7
FLASH
Volume
Group
Physical
Disks
4x640GB
SSD
Logical
Disks
8x128GB
RAID-‐0
HDD
Volume
Group
Physical
Disks
6x300GB
SAS
Logical
Disks
2x900GB
RAID-‐0
iSER
Target
Instances
instan
incset
a0n
Icnes
t1a
inncseta
2n
incset
a3n
incset
a4n
instcaen
5c
e
6
instance
7
FLASH
Volume
Group
Physical
Disks
4x640GB
SSD
Logical
Disks
8x128GB
RAID-‐0
HDD
Volume
Group
Physical
Disks
6x300GB
SAS
Logical
Disks
2x900GB
RAID-‐0
iSER
Target
Instances
instan
incset
a0n
Icnes
t1a
inncseta
2n
incset
a3n
incset
a4n
instcaen
5c
e
6
instance
7
FLASH
Volume
Group
Physical
Disks
4x640GB
SSD
Logical
Disks
8x128GB
RAID-‐0
HDD
Volume
Group
Physical
Disks
6x300GB
SAS
Logical
Disks
2x900GB
RAID-‐0
iSER
Target
Instances
instan
incset
a0n
Icnes
t1a
inncseta
2n
incset
a3n
incset
a4n
instcaen
5c
e
6
instance
7
FLASH
Volume
Group
Physical
Disks
4x640GB
SSD
Logical
Disks
8x128GB
RAID-‐0
HDD
Volume
Group
Physical
Disks
6x300GB
SAS
Logical
Disks
2x900GB
RAID-‐0
iSER
Target
Instances
instan
incset
a0n
Icnes
t1a
inncseta
2n
incset
a3n
incset
a4n
instcaen
5c
e
6
instance
7
FLASH
Volume
Group
Physical
Disks
4x640GB
SSD
Logical
Disks
8x128GB
RAID-‐0
HDD
Volume
Group
Physical
Disks
6x300GB
SAS
Logical
Disks
2x900GB
RAID-‐0
iSER
Target
Instances
instan
incset
a0n
Icnes
t1a
inncseta
2n
incset
a3n
incset
a4n
instcaen
5c
e
6
instance
7
FLASH
Volume
Group
Physical
Disks
4x640GB
SSD
Logical
Disks
8x128GB
RAID-‐0
HDD
Volume
Group
Physical
Disks
6x300GB
SAS
Logical
Disks
2x900GB
RAID-‐0
iSER
Target
Instances
instan
incset
a0n
Icnes
t1a
inncseta
2n
incset
a3n
incset
a4n
instcaen
5ce
6
instance
7
FLASH
Volume
Group
Physical
Disks
4x640GB
SSD
Logical
Disks
8x128GB
RAID-‐0
HDD
Volume
Group
Physical
Disks
6x300GB
SAS
Logical
Disks
2x900GB
RAID-‐0
iSER
Target
Instances
instan
incset
a0n
Icnes
t1a
inncseta
2n
incset
a3n
incset
a4n
instcaen
5ce
6
instance
7
FLASH
Volume
Group
Physical
Disks
4x640GB
SSD
Logical
Disks
8x128GB
RAID-‐0
HDD
Volume
Group
Physical
Disks
6x300GB
SAS
Logical
Disks
2x900GB
RAID-‐0
iSER
Target
Instances
instan
incset
a0n
Icnes
t1a
inncseta
2n
incset
a3n
incset
a4n
instcaen
5ce
6
instance
7
FLASH
Volume
Group
Physical
Disks
4x640GB
SSD
Logical
Disks
8x128GB
RAID-‐0
HDD
Volume
Group
Physical
Disks
6x300GB
SAS
Logical
Disks
2x900GB
RAID-‐0
iSER
Target
Instances
instan
incset
a0n
Icnes
t1a
inncseta
2n
incset
a3n
incset
a4n
instcaen
5ce
6
instance
7
FLASH
Volume
Group
Physical
Disks
4x640GB
SSD
Logical
Disks
8x128GB
RAID-‐0
HDD
Volume
Group
Physical
Disks
6x300GB
SAS
Logical
Disks
2x900GB
RAID-‐0
iSER
Target
Instances
instan
incset
a0n
Icnes
t1a
inncseta
2n
incset
a3n
incset
a4n
instcaen
5ce
6
instance
7
FLASH
Volume
Group
Physical
Disks
4x640GB
SSD
Logical
Disks
8x128GB
RAID-‐0
HDD
Volume
Group
Physical
Disks
6x300GB
SAS
Logical
Disks
2x900GB
RAID-‐0
iSER
Target
Instances
instan
incset
a0n
Icnes
t1a
inncseta
2n
incset
a3n
incset
a4n
instcaen
5ce
6
instance
7
FLASH
Volume
Group
Physical
Disks
4x640GB
SSD
Logical
Disks
8x128GB
RAID-‐0
HDD
Volume
Group
Physical
Disks
6x300GB
SAS
Logical
Disks
2x900GB
RAID-‐0
iSER
Target
Instances
instan
incset
a0n
Icnes
t1a
inncseta
2n
incset
a3n
incset
a4n
instcaen
5ce
6
instance
7
FLASH
Volume
Group
Physical
Disks
4x640GB
SSD
Logical
Disks
8x128GB
RAID-‐0
HDD
Volume
Group
Physical
Disks
6x300GB
SAS
Logical
Disks
2x900GB
RAID-‐0
ib0:10.255.241.1/24
ib2:10.255.242.1/24
ib1:10.255.243.1/24
ib3:10.255.244.1/24
S1
(RHEL
5.4x64)
vs1.dev.ilabs.net
Industry-‐Standard
Storage
Brick
ib0:10.255.241.3/24
ib2:10.255.242.3/24
ib1:10.255.243.3/24
ib3:10.255.244.3/24
S3
(RHEL
5.4x64)
vs3.dev.ilabs.net
Industry-‐Standard
Storage
Brick
ib0:10.255.241.5/24
Ib2:10.255.242.5/24
ib1:10.255.243.5/24
ib3:10.255.244.5/24
S5
(RHEL
5.4x64)
vs5.dev.ilabs.net
Industry-‐Standard
Storage
Brick
ib0:10.255.241.7/24
ib2:10.255.242.7/24
ib1:10.255.243.7/24
ib3:10.255.244.7/24
S7
(RHEL
5.4x64)
vs7.dev.ilabs.net
Industry-‐Standard
Storage
Brick
ib0:10.255.241.9/24
ib2:10.255.242.9/24
ib1:10.255.243.9/24
ib3:10.255.244.9/24
S9
(RHEL
5.4x64)
vs9.dev.ilabs.net
Industry-‐Standard
Storage
Brick
ib0:10.255.241.11/24
ib2:10.255.242.11/24
ib1:10.255.243.11/24
ib3:10.255.244.11/24
S11
(RHEL
5.4x64)
vs11.dev.ilabs.net
Industry-‐Standard
Storage
Brick
ib0:10.255.241.13/24
ib2:10.255.242.13/24
ib1:10.255.243.13/24
ib3:10.255.244.13/24
S13
(RHEL
5.4x64)
vs13.dev.ilabs.net
Industry-‐Standard
Storage
Brick
ib0:10.255.241.2/24
ib2:10.255.242.2/24
ib1:10.255.243.2/24
ib3:10.255.244.2/24
S2
(RHEL
5.4x64)
vs2.dev.ilabs.net
Industry-‐Standard
Storage
Brick
ib0:10.255.241.4/24
ib2:10.255.242.4/24
ib1:10.255.243.4/24
ib3:10.255.244.4/24
S4
(RHEL
5.4x64)
vs4.dev.ilabs.net
Industry-‐Standard
Storage
Brick
ib0:10.255.241.6/24
ib2:10.255.242.6/24
ib1:10.255.243.6/24
ib3:10.255.244.6/24
S6
(RHEL
5.4x64)
vs6.dev.ilabs.net
Industry-‐Standard
Storage
Brick
ib0:10.255.241.8/24
ib2:10.255.242.8/24
ib1:10.255.243.8/24
ib3:10.255.244.8/24
S8
(RHEL
5.4x64)
vs8.dev.ilabs.net
Industry-‐Standard
Storage
Brick
ib0:10.255.241.10/24
ib2:10.255.242.10/24
ib1:10.255.243.10/24
ib3:10.255.244.10/24
S10
(RHEL
5.4x64)
vs10.dev.ilabs.net
Industry-‐Standard
Storage
Brick
ib0:10.255.241.14/24
ib2:10.255.242.14/24
ib1:10.255.243.14/24
ib3:10.255.244.14/24
S12
(RHEL
5.4x64)
vs12.dev.ilabs.net
Industry-‐Standard
Storage
Brick
ib0:10.255.241.14/24
ib2:10.255.242.14/24
ib1:10.255.243.14/24
ib3:10.255.244.14/24
S14
(RHEL
5.4x64)
vs14.dev.ilabs.net
Industry-‐Standard
Storage
Brick
ib0:10.255.241.50/24
ib2:10.255.242.50/24
ib4:10.255.243.50/24
Storage
Clustering
ConfiguraRon
SSD/HDD
via
iSER/Infiniband
or
iSCSI/Ethernet
ib6:10.255.244.50/24
Industry-‐Standard
Storage
“Bricks”
Oracle
RAC
Front-‐End
Voltaire
IB
QDR
36-‐port
Switch
Private
Subnets:
10.255.243.0/24
10.255.244.0/24
10.255.245.8.0/30
10.255.245.12/30
ib7:
10.255.245.14/30
ib5:
10.255.245.10/30
ib3:
10.255.245.6/30
ib1:
10.255.245.2/30
LUN
PresentaRon
Notes
1. Each
RAC
node
will
see:
• 112
FLASH-‐based
LUNs
(8
per
storage
server
x
14
storage
servers
• 28
HDD-‐based
LUNs
(2
per
storage
server
x
14
storage
servers)
2. Persistent
LUN
names
(/dev/iscsi/…)
will
embed
the
storage
server
and
path
for
ease
of
ASM
administraZon
when
choosing
mirror
pairs,
for
example:
• s1-‐data1-‐path-‐1
Oracle
RAC
Front-‐End
ConnecRvity
(1/10Gbps
Ethernet)
(ib0
path)
• s2-‐data1-‐path-‐2
(ib2
path)
• s3-‐data4-‐path-‐3
(ib4
path)
• s4-‐data4-‐path-‐4
(ib6
path)
3. (4)
IB
ports
will
be
used
for
RDS
protocol.
LEGEND
RDS
Subnet
1A:
10.255.245.0/30
RDS
Subnet
1B:
10.255.245.4/30
RDS
Subnet
2A:
10.255.245.8/30
RDS
Subnet
2B:
10.255.245.12/30
ib1:
10.255.245.1/30
ib3:
10.255.245.5/30
ib5:
10.255.245.9/30
ib7:
10.255.245.13/30
RAC-‐DB1
(RHEL
5.4x64)
rac-‐db1.dev.ilabs.net
iSER/QDR-‐based
Storage
Client
ib6:
10.255.244.51/24
ib4:
10.255.243.51/24
ib2:
10.255.242.51/24
ib0:
10.255.241.51/24
RAC-‐DB2
(RHEL
5.4x64)
rac-‐db2.dev.ilabs.net
iSER/QDR-‐based
Storage
Client
Path
1A:
Subnet
10.255.241.0/24
Path
1B:
Subnet
10.255.242.0/24
Path
2A:
Subnet
10.255.243.0/24
Path
2B:
Subnet
10.255.244.0/24
Voltaire
IB
QDR
36-‐port
Switch
Private
Subnets:
10.255.241.0/24
10.255.242.0/24
10.255.245.0/30
10.255.245.4/30
