FlexPod driven by OpenStack

akos.kuczi@nextiraone.eu
What is FlexPod?

(blue)
What is FlexPod?

FlexPod
Upbringing FlexPod
Be Flexible!
Be Multitenant!
Be high available!
Use multi protocol!
Use the force FlexPod!
There is no spoon Flexpod!
OpenStack is your best friend!
The friendship
How can I do that?
NFS & iSCSI both 7mode
and Cluster mode
Direct and Managed
cinder drivers in Grizly
Unified cinder driver in
Havana
My drivers (C-mode Direct iSCSI)

cinder.volume.drivers.netapp.common.NetAppDriver
netapp_storage_protocol=iscsi
netapp_storage_family=ontap_cluster
My drivers (C-mode Direct iSCSI)
Volume provisioning

Calling cinder volume
create API

NetApp SSC
&
NetApp volume
driver

Cinder scheduler

FlexVol & LUN

Cinder volume manager
My drivers (C-mode Direct iSCSI)
Attach volume (in build state)

2

1

4

Nova Compute

Cinder Volume driver

Cinder API
3

FlexVol & LUN

Cinder volume manager
My drivers (C-mode Direct NFS)
Volume provisioning

2

1
Calling cinder volume
create API

5
NetApp SSC
&
NetApp volume
driver

Cinder scheduler

Cinder volume manager

4
FlexVol & volume mount
6

6

Thin provisioned file
7
My drivers (C-mode Direct NFS)
Attach volume (in build state)

2

1

4

Nova Compute

Cinder Volume driver

Cinder API
3

NFS mount

Cinder volume manager
The real life
The real life 1/9
On NetApp VSM – Create Volumes
vserver-iscsi::> vol create -volume cinder_nfs01 -aggregate aggr1_n1 -size 4G
(volume create)
[Job 68] Job succeeded: Successful

vserver-iscsi::> volume efficiency on -volume cinder_nfs01
vserver-iscsi::> volume efficiency modify -volume cinder_nfs01 -compression true
vserver-iscsi::> efficiency policy create -policy nfs_schedule -schedule daily -enabled true comment "Daily schedule for NFS Cinder volumes"
vserver-iscsi::> vol create -volume vs_iscsi_luns -aggregate aggr1_n1 -size 14G
(volume create)
[Job 69] Job succeeded: Successful

Switch to OpenStack – Create Volume types & NFS volume
root@un2:~# cinder type-create NFS_TYPE
root@un2:~# cinder type-create iSCSI_TYPE
root@un2:~# cinder type-key NFS_TYPE set storage_protocol=nfs
root@un2:~# cinder type-key iSCSI_TYPE set storage_protocol=iSCSI
root@un2:~# cinder create --volume-type NFS_TYPE --display-name NFS_VOL01 1
The real lifeVolume types & NFS volume continue
2/9
On OpenStack node– Create
The real life 3/9
On OpenStack node – Check NFS mount on Cinder Vol. Node & File base Volume
root@un4:~# mount |grep -i nfs
192.168.130.244:/jproot/cinder_nfs01 on
/var/cinder/mnt/9ee86d8d8bea25386f3fb64bf071bcf7 type nfs (rw,addr=192.168.130.244)
root@un4:~# ls -la /var/cinder/mnt/9ee86d8d8bea25386f3fb64bf071bcf7
total 12
drwxr-xr-x 2 root daemon
4096 Jan 29 11:16 .
drwxr-xr-x 4 cinder cinder
4096 Jan 29 01:33 ..
drwxrwxrwx 9 root root
4096 Jan 29 11:05 .snapshot
-rw-rw-rw- 1 root root 1073741824 Jan 29 11:16 volume-94d1428f-427f-43e7-91010408e472c1a8
The real life 4/9

On OpenStack node – Create iSCSI VOL
The real life 5/9
On NetApp VSM - Checking of new LUN

vserver-iscsi::> lun show
Vserver Path
State Mapped Type
Size
--------- ------------------------------- ------- -------- -------- -------vserver-iscsi
/vol/vs_iscsi_luns/volume-3db5339c-0116-4328-a2d2-dfb156f0c761
online unmapped linux
1GB
The real life 6/9

On NOVA compute node – Attach NFS
volume
The real life 7/9
On NOVA Compute node – Checking of attached vdisk backend
root@un2:/# virsh domblklist 2
Target Source
-----------------------------------------------vda
/var/lib/nova/instances/c5b51cf8-869d-4a60-a859-c429fd1aa64b/disk
vdb
/var/lib/nova/mnt/9ee86d8d8bea25386f3fb64bf071bcf7/volume-94d1428f-427f43e7-9101-0408e472c1a8
The real life 8/9
No iSCSI disk:
root@un2:~# lsscsi
[1:0:0:0] cd/dvd QEMU
Select volume to attach :

Attach volume:

On NOVA compute node – Attach iSCSI
volume

QEMU DVD-ROM

1.5. /dev/sr0
The real life 9/9

On NOVA compute node – Attach iSCSI
volume

New iSCSI disk:
root@un2:~# lsscsi
[1:0:0:0] cd/dvd QEMU QEMU DVD-ROM 1.5. /dev/sr0
[2:0:0:0] disk NETAPP LUN C-Mode
8200 /dev/sda
Attached volumes:

On NOVA Compute node – Checking of attached iSCSI backend
root@un2:~# virsh domblklist 2
Target Source
-----------------------------------------------vda
/var/lib/nova/instances/c5b51cf8-869d-4a60-a859-c429fd1aa64b/disk
vdb
/var/lib/nova/mnt/9ee86d8d8bea25386f3fb64bf071bcf7/volume-94d1428f-427f-43e7-9101-0408e472c1a8

vdc
/dev/disk/by-path/ip-192.168.130.243:3260-iscsi-iqn.199208.com.netapp:sn.37846a355b6f11e3ad89123478563412:vs.3-lun-0
THA

K YOU!

akos.kuczi@nextiraone.eu

Flex pod driven by Openstack

  • 1.
    FlexPod driven byOpenStack akos.kuczi@nextiraone.eu
  • 2.
  • 3.
  • 4.
    Upbringing FlexPod Be Flexible! BeMultitenant! Be high available! Use multi protocol! Use the force FlexPod! There is no spoon Flexpod! OpenStack is your best friend!
  • 5.
  • 6.
    How can Ido that? NFS & iSCSI both 7mode and Cluster mode Direct and Managed cinder drivers in Grizly Unified cinder driver in Havana
  • 7.
    My drivers (C-modeDirect iSCSI) cinder.volume.drivers.netapp.common.NetAppDriver netapp_storage_protocol=iscsi netapp_storage_family=ontap_cluster
  • 8.
    My drivers (C-modeDirect iSCSI) Volume provisioning Calling cinder volume create API NetApp SSC & NetApp volume driver Cinder scheduler FlexVol & LUN Cinder volume manager
  • 9.
    My drivers (C-modeDirect iSCSI) Attach volume (in build state) 2 1 4 Nova Compute Cinder Volume driver Cinder API 3 FlexVol & LUN Cinder volume manager
  • 10.
    My drivers (C-modeDirect NFS) Volume provisioning 2 1 Calling cinder volume create API 5 NetApp SSC & NetApp volume driver Cinder scheduler Cinder volume manager 4 FlexVol & volume mount 6 6 Thin provisioned file 7
  • 11.
    My drivers (C-modeDirect NFS) Attach volume (in build state) 2 1 4 Nova Compute Cinder Volume driver Cinder API 3 NFS mount Cinder volume manager
  • 12.
  • 13.
    The real life1/9 On NetApp VSM – Create Volumes vserver-iscsi::> vol create -volume cinder_nfs01 -aggregate aggr1_n1 -size 4G (volume create) [Job 68] Job succeeded: Successful vserver-iscsi::> volume efficiency on -volume cinder_nfs01 vserver-iscsi::> volume efficiency modify -volume cinder_nfs01 -compression true vserver-iscsi::> efficiency policy create -policy nfs_schedule -schedule daily -enabled true comment "Daily schedule for NFS Cinder volumes" vserver-iscsi::> vol create -volume vs_iscsi_luns -aggregate aggr1_n1 -size 14G (volume create) [Job 69] Job succeeded: Successful Switch to OpenStack – Create Volume types & NFS volume root@un2:~# cinder type-create NFS_TYPE root@un2:~# cinder type-create iSCSI_TYPE root@un2:~# cinder type-key NFS_TYPE set storage_protocol=nfs root@un2:~# cinder type-key iSCSI_TYPE set storage_protocol=iSCSI root@un2:~# cinder create --volume-type NFS_TYPE --display-name NFS_VOL01 1
  • 14.
    The real lifeVolumetypes & NFS volume continue 2/9 On OpenStack node– Create
  • 15.
    The real life3/9 On OpenStack node – Check NFS mount on Cinder Vol. Node & File base Volume root@un4:~# mount |grep -i nfs 192.168.130.244:/jproot/cinder_nfs01 on /var/cinder/mnt/9ee86d8d8bea25386f3fb64bf071bcf7 type nfs (rw,addr=192.168.130.244) root@un4:~# ls -la /var/cinder/mnt/9ee86d8d8bea25386f3fb64bf071bcf7 total 12 drwxr-xr-x 2 root daemon 4096 Jan 29 11:16 . drwxr-xr-x 4 cinder cinder 4096 Jan 29 01:33 .. drwxrwxrwx 9 root root 4096 Jan 29 11:05 .snapshot -rw-rw-rw- 1 root root 1073741824 Jan 29 11:16 volume-94d1428f-427f-43e7-91010408e472c1a8
  • 16.
    The real life4/9 On OpenStack node – Create iSCSI VOL
  • 17.
    The real life5/9 On NetApp VSM - Checking of new LUN vserver-iscsi::> lun show Vserver Path State Mapped Type Size --------- ------------------------------- ------- -------- -------- -------vserver-iscsi /vol/vs_iscsi_luns/volume-3db5339c-0116-4328-a2d2-dfb156f0c761 online unmapped linux 1GB
  • 18.
    The real life6/9 On NOVA compute node – Attach NFS volume
  • 19.
    The real life7/9 On NOVA Compute node – Checking of attached vdisk backend root@un2:/# virsh domblklist 2 Target Source -----------------------------------------------vda /var/lib/nova/instances/c5b51cf8-869d-4a60-a859-c429fd1aa64b/disk vdb /var/lib/nova/mnt/9ee86d8d8bea25386f3fb64bf071bcf7/volume-94d1428f-427f43e7-9101-0408e472c1a8
  • 20.
    The real life8/9 No iSCSI disk: root@un2:~# lsscsi [1:0:0:0] cd/dvd QEMU Select volume to attach : Attach volume: On NOVA compute node – Attach iSCSI volume QEMU DVD-ROM 1.5. /dev/sr0
  • 21.
    The real life9/9 On NOVA compute node – Attach iSCSI volume New iSCSI disk: root@un2:~# lsscsi [1:0:0:0] cd/dvd QEMU QEMU DVD-ROM 1.5. /dev/sr0 [2:0:0:0] disk NETAPP LUN C-Mode 8200 /dev/sda Attached volumes: On NOVA Compute node – Checking of attached iSCSI backend root@un2:~# virsh domblklist 2 Target Source -----------------------------------------------vda /var/lib/nova/instances/c5b51cf8-869d-4a60-a859-c429fd1aa64b/disk vdb /var/lib/nova/mnt/9ee86d8d8bea25386f3fb64bf071bcf7/volume-94d1428f-427f-43e7-9101-0408e472c1a8 vdc /dev/disk/by-path/ip-192.168.130.243:3260-iscsi-iqn.199208.com.netapp:sn.37846a355b6f11e3ad89123478563412:vs.3-lun-0
  • 22.