Openstack Testbed_ovs_virtualbox_devstack_single node

Single Server 실험망
Single Server를 사용하는 이유
• I have no OpenFlow Switch
 I can’t use SDN Controller
 SDN Controller는 OF SW를 제어하는데…
• Just private testbed
 I want very simple test
 개인적으로 간단하게 구성해서 테스트 하고 싶은데…
• How can I use OF SW
 It’s OpenvSwitch
 OS는 ubuntu로 정해야 되겠군…

시스템 구성
• Server
 Ubuntu 14.04 LTS
 OpenvSwitch를 설치하여야 하기 때문
 Eclipse
 Java 1.7
 OpenIRIS
 VirtualBox
 OpenvSwitch
 OpenFlow Enable Switch 대체
 물리망을 대체하기 위함

구성도
Ubuntu 14.04
OpenIRIS
virtualbox
OVS OVS OVS
Control/Network
Node
vnet1-1
ovs-1 ovs-3
ovs-2
openvswitch
Compute Node
#01
Compute Node
#02
eth0 eth1 eth0 eth1 eth0 eth1
OVS
Compute Node
#03
eth0 eth1
ovs-4
P1-2
vnet2-1
vnet3-1
vnet4-1
P2-1 P2-3
P3-2 P3-4
P4-3

Single Server OS 설치
• OS Install
 Ubuntu 12.04 or 14.04 LTS desktop version
 Using CD img
• Ubuntu configuration
 Network
$ sudo apt-get purge network-manager
$ sudo apt-get autoremove
$ sudo vi /etc/network/interfaces
$ sudo /etc/init.d/networking restart
 OS update
$ sudo apt-get update
$ sudo apt-get upgrade
$ sudo apt-get dist-upgrade
$ sudo reboot
auto eth0
Iface eth0 inet static
address <your public ip>
netmask 255.255.255.0
gateway <your gw ip>
dns-nameservers 8.8.8.8 8.8.4.4

Single Server 필수 프로그램 설치
• Must Install and Downloads
 git/vim/java1.7 Install
$ sudo apt-get –y git
$ sudo apt-get –y vim
$ sudo apt-get –y openjdk-7-jeadless
 OpenIRIS download
$ git clone https://github.com/bjlee72/IRIS.git
 Download Eclipse
 http://eclipse.org/downloads/?osType=linux&release=undefined
 압축해제
 Download Ubuntu Img
 Using VirtualBox VM (DevStack install)

Single Server OpenvSwitch 설치 (1/2)
• OpenvSwitch Download
 2.0.1 Version
 http://openvswitch.org/pipermail/announce/2014/March/0000059.html

Single Server OpenvSwitch 설치 (2/2)
• OpenvSwitch Install
 Must Read : openvswitch 디렉토리 (INSTALL.Debian)
$ cd openvswitch-2.0.1
$ sudo apt-get install build-essential fakeroot
# dpkg-checkbuilddeps 명령을 통하여 dependency 내용을 확인할 수 있다.
$ sudo apt-get install debhelper autoconf automake libssl-dev
$ sudo apt-get install python-all python-qt4 python-twisted-conch
$ fackroot debian/rules binary
# home directory에 .deb 파일들이 생성된다.
$ cd~
$ sudo apt-get install dkms
$ sudo dpkg –i openvswitch-datapath-dkms_2.0.1.1_all.deb
$ sudo apt-get install module-assistant
$ sudo dpkg –i openvsiwtch-datapath-source_2.0.1-1_all.deb
$ sudo dpkg –i openvswitch-common_2.0.1-1_amd64.deb
$ sudo dpkg –i openvswitch-switch_2.0.1-1_amd64.deb

Single Server VirtualBox 설치
• VirtualBox Download and install
 Ubuntu Software Center
 Find : virtualbox

Single Server OpenvSwitch 설정 (1/5)
• OpenvSwitch Configuration
 Make 4 Bridges : ovs-1, ovs-1, ovs-3, ovs-4
$ sudo ovs-vsctl add-br ovs-1

 Make tuntap : vnet1-1, vnet2-1, vnet3-1, vnet4-1
$ sudo ip tuntap add mode tap vnet1-1
$ sudo ip link set vnet1-1 up

 Connect Bridge to tuntap : ovs-1:vnet1-1, ovs-2:vnet2-1, ovs-3:vnet3-1, ovs-4:vnet4-1
$ sudo ovs-vsctl add-port ovs-1 vnet1-1

 Make patch : p1-2, p2-1, p2-3, p3-2, p3-4, p4-3
$ sudo ovs-vsctl add-port ovs-1 p1-2 -- set Interface p1-2 type=patch options:peer=p2-1

 Conntction OpenIRIS : ovs-1, ovs-2, ovs-3, ovs-4
$ sudo ovs-vsctl set-controller ovs-1 tcp:<your public ip>:6633

Single Server VirtualBox 설정 (1/3)
• VirtualBox Basic Configuration
 Make 4 VMs : controlnode, com01, com02, com03, com04
 Memory Size : over 4G
 Hard Drive Size : over 32G

• VirtualBox Network Configuration
 VMs Network Setting
 eth0 : NAT / eth1 : Bridge Adapter (tuntap select)
 Warning
 controlnede – vnet1-1 / com01 – vnet2-1 / com02 – vnet3-1 / com03 – vnet4-1
com01 -> vnet2-1
com02 -> vnet3-1
com03 -> vnet4-1

• VirtualBox Configuration Complete
 You can have OpenFlow Switchs
 ovs-1, ovs-2, ovs-3, ovs-4
 You can have Hosts
 controlnede / com01 / com02 / com03

Single Server DevStack Install (1/10)
• controlnode
 OS Install : ubuntu 14.04
 Already downloaded ubuntu

• controlnode
 Must Configuration
auto lo
iface lo inet loopback
# Public Network, NAT
auto eth0
iface eth0 inet static
address <NAT IP> # may be default is 10.0.2.15
netmask 255.255.255.0
gateway <GW IP> # may be default is 10.0.2.2
# Data Network, Private IP
auto eth1
address <private ip>
netmaks 255.255.255.0

• controlnode
$ sudo reboot
$ sudo su
$ echo “stack ALL=(ALL:ALL) NOPASSWD:ALL” >> /etc/sudoers
$ sudo vi /etc/hosts
…
<controlnode private IP> controlnode
<com01 private IP> com01
…
$ sudo apt-get install –y git vim
 DevStack Download
$ git clone –b stable/icehouse https://github.com/openstack-dev/devstack.git

• controlnode
$ cd devstack
$ vim local.conf
[[local|localrc]]
GIT_BASE=${GIT_BASE:-https://git.openstack.org}
# Credentials
DATABASE_PASSWORD=openstack
ADMIN_PASSWORD=openstack
SERVICE_PASSWORD=openstack
SERVICE_TOKEN=admin
RABBIT_PASSWORD=openstack
# Services
ENABLED_SERVICES=rabbit,mysql,key
ENABLED_SERVICES+=,n-api,n-crt,n-obj,n-cond,n-sch,n-novnc,n-cauth
ENABLED_SERVICES+=,neutron,q-svc,q-agt,q-dhcp,q-l3,q-meta
ENABLED_SERVICES+=,g-api,g-reg
ENABLED_SERVICES+=,cinder,c-api,c-vol,c-sch,c-bak
ENABLED_SERVICES+=,horizon
# MULTI_HOST
MULTI_HOST=True
# Services IP
HOST_IP=<controlnode private ip>
# Use this image when creating test instances
IMAGE_URLS+=",http://cdn.download.cirros-cloud.net/0.3.2/cirros-0.3.2-
x86_64-disk.img"
# vnc
VNCSERVER_LISTEN=0.0.0.0
VNCSERVER_PROXYCLIENT_ADDRESS=$HOST_IP
# Branches
KEYSTONE_BRANCH=stable/icehouse
NOVA_BRANCH=stable/icehouse
NEUTRON_BRANCH=stable/icehouse
SWIFT_BRANCH=stable/icehouse
GLANCE_BRANCH=stable/icehouse
CINDER_BRANCH=stable/icehouse
HEAT_BRANCH=stable/icehouse
TROVE_BRANCH=stable/icehouse
HORIZON_BRANCH=stable/icehouse
# Enable Logging
LOGFILE=/opt/stack/logs/stack.sh.log
VERBOSE=True
LOG_COLOR=True
SCREEN_LOGDIR=/opt/stack/logs

• controlnode
 Start DevStack
$ ./stack.sh

• com01, com02, com03
 OS Install : ubuntu 14.04
 Already downloaded ubuntu

auto lo
iface lo inet loopback
# Public Network, NAT
auto eth0
address <NAT IP> # may be default is 10.0.2.15
netmask 255.255.255.0
gateway <GW IP> # may be default is 10.0.2.2
# Data Network, Private IP
auto eth1
address <private ip>
netmaks 255.255.255.0

$ sudo reboot
$ sudo su
$ echo “stack ALL=(ALL:ALL) NOPASSWD:ALL” >> /etc/sudoers
$ sudo vi /etc/hosts
…
<controlnode private IP> controlnode
…
$ sudo apt-get install –y git vim
$ git clone –b stable/icehouse https://github.com/openstack-dev/devstack.git

$ cd devstack
$ vim local.conf
[[local|localrc]]
DATABASE_PASSWORD=openstack
ADMIN_PASSWORD=openstack
SERVICE_PASSWORD=openstack
SERVICE_TOKEN=admin
RABBIT_PASSWORD=openstack
# Services
ENABLED_SERVICES=rabbit
ENABLED_SERVICES+=,n-cpu,n-novnc,n-cauth
ENABLED_SERVICES+=,neutron,q-agt
# MULTI_HOST
MULTI_HOST=True
# Services IP
HOST_IP=<com01 private IP>
SERVICE_HOST=<controlnode private IP>
MYSQL_HOST=<controlnode private IP>
RABBIT_HOST=<controlnode private IP>
GLANCE_HOSTPORT=<controlnode private IP>:9292
Q_HOST=<controlnode private IP>
# Neutron OVS (vxlan)
Q_PLUGIN=ml2
Q_ML2_TENANT_NETWORK_TYPE=vxlan
Q_ML2_PLUGIN_TYPE_DRIVERS=vxlan
Q_ML2_PLUGIN_VXLAN_TYPE_OPTIONS=(vni_ranges=1001:2000)
Q_AGENT_EXTRA_AGENT_OPTS=(tunnel_types=vxlan
vxlan_udp_port=8472)
Q_USE_NAMESPACE=True
Q_USE_SECGROUP=True
# vnc
VNCSERVER_LISTEN=0.0.0.0
VNCSERVER_PROXYCLIENT_ADDRESS=$HOST_IP
# Branches
KEYSTONE_BRANCH=stable/icehouse
NOVA_BRANCH=stable/icehouse
NEUTRON_BRANCH=stable/icehouse
SWIFT_BRANCH=stable/icehouse
GLANCE_BRANCH=stable/icehouse
CINDER_BRANCH=stable/icehouse
HEAT_BRANCH=stable/icehouse
TROVE_BRANCH=stable/icehouse
HORIZON_BRANCH=stable/icehouse
# Enable Logging
LOGFILE=/opt/stack/logs/stack.sh.log
VERBOSE=True
LOG_COLOR=True
SCREEN_LOGDIR=/opt/stack/logs

• controlnode
 Start DevStack
$ ./stack.sh

Single Server Test
• OpenIRIS to OpenvSwitch
 OpenIRIS connection to OVS (ovs-1, ovs-2, ovs-3, ovs-4)
 Run OpenIRIS using Eclipse
 You must edit ‘torpedo.properties’
 SimpleOFController = false
 BasicOFController = true
Connected OVS -> ovs-1, ovs-2, ovs-3, ovs-4
OpenIRIS console

Single Server Test
• OpenIRIS to OpenvSwitch
 Web page
 Single Server ip:8080
ovs-1, ovs-2, ovs-3, ovs-4
controlnode, com01, com02, com03
controlnode, com01, com02, com03 ovs-1, ovs-2, ovs-3, ovs-4

Single Server Test
• DevStack (create Network and VM)
 Create Network (2 Networks)
 Net01 : 30.0.0.0/24, Net02 : 40.0.0.0/24
 Create VM (4VMs)
 Net01: vm01, vm03 / Net02: vm02, vm04

Single Server Test
• DevStack (Node OVS)
 networknode
 Net01 : 30.0.0.0/24, Net02 : 40.0.0.0/24
 com01, com02, com03
 Net01: vm01, vm03 / Net02: vm02, vm04
controlnode : sudo ovs-vsctl show com01 : sudo ovs-vsctl show
vxlan configuration vxlan configuration
com01 : create vm02 port
controlnode : Net01, Net02

Single Server Test
• DevStack (Ping)
 Net01: vm01, vm03 / Net02: vm02, vm04
 Ping : vm01 to vm03 (It’s same subnet)
vm01, vm03 Same Network : connected

Single Server Test
• DevStack (Ping)
 Net01: vm01, vm03 / Net02: vm02, vm04
 Ping : vm01 to vm02 (It’s different subnet)
vm01, vm02 Different Network :
Not connected

Single Server Test
• DevStack (create Virtual Router)
 Connected Net01 to Net02 : Router01
 Net01: vm01, vm03 <-> Router01 <-> Net02: vm02, vm04

Single Server Test
• DevStack (create Router Node OVS)
 networknode
 Virtual Router
 Routing Net01 to Net02
controlnode : sudo ovs-vsctl show
controlnode : virtual router port
Net01, Net02

Single Server Test
• DevStack (check Virtual Router)

Single Server Test
• DevStack (Ping)
 Ping : vm01 to vm02 (It’s different subnet)
vm01, vm02 Different Network :
Connected (Router01)

Multi Nodes 실험망
Todo Multi Node
• OpenIRIS Controller
 Ubuntu 14.04 server/cloud
 LAN port 3
• Control Node
 Ubuntu 14.04 LTS or Ubuntu 14.04 server/cloud
 LAN port 2
 For Migration
• Network Node
 LAN port 3
• Compute Node (over 2 systems)
 LAN port 2
• Switch (OpenFlow SW : 6 ea, SW : 3 ea)
 OpenFlow Switch (Data Network)
 Switch (Public Network, Management Network, Aggregation)

OpenFlow Switch Spec. (1/2, NEC PF5240)
• NEC PF5240(2ea)
 Hardware
 Interface : 1GbE(1000base-T) 48 port
 10G Ethernet(SFP) 4port
 Switch Capacity
 176Gbps switching capacity
 OpenFlow Mode Func.
 OpenFlow 1.0
 160,000 Flow entries
 L2/L3 Mode Func.
 L3: OSPF, BGP, RIP, VRRP, PIM, MLD
 L2: STP, RSTP, MSTP, PVST, IGMP

OpenFlow Switch Spec. (2/2, NetVision)
• NetVision (4ea)
 Hardware
 Interface : 1GbE(1000base-T) 48 port
 10G Ethernet(SFP) 4port
 Switch Capacity
 132Gbps switching capacity
 Broadcom switch chip
 OpenFlow Mode Func.
 OpenFlow 1.0/1.3
 OF-Config 1.0
 2048 Flow tables
 L2/L3 Mode Func.
 RIP/OSPF routing protocol
 PIM-SM multicast routing

간략 구성도
eth0
Control
Node
OpenIRIS Network Node
Compute Node
#01
Compute Node
#02
eth1
eth1
eth0
eth2 eth1
eth2 eth1 eth1
eth0
eth2:1
eth0
eth1:1
eth0
eth1:1
물리 NIC
OVS
Management Network
(IP: 10.0.0.0/24)
Public Network
(IP: 129.254.197.0/254,
GW: 129.254.197.1)
Management Net
129.254.197.184,
129.254.197.182 129.254.197.183 external
Data Network
(IP: 10.0.10.0/24,
OpenFlow)
가상 연결
10.0.0.11
management
10.0.0.21
management
10.0.0.31
management
10.0.0.41
management
10.0.0.51
10.0.10.31 management
Instance tunnel
10.0.10.41
Instance tunnel
10.0.10.51
Instance tunnel
10.0.10.21
Data Net
Data Net

세부 구성도
Data Network
(IP: 10.0.10.0/24)
NEC#02
Netvision#03 Netvision#04
Netvision#01 Netvision#02
eth0 eth2 eth2 eth2 eth2 eth2 eth2 eth2 eth2
eth0 eth2
OpenIRIS
Network
Node
Control
Node
OVS OVS OVS OVS OVS OVS OVS
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
VM
eth1 eth1 eth1 eth1 eth1 eth1 eth1 eth1 eth1
Management Network
(IP: 10.0.0.0/24)
eth1
Public
Network
eth0
Compute Nodes (#01 ~ #n)
Aggregation SW
NEC#01
OVS
VM
VM
VM

Mechanism Driver
Develop Mechanism Driver
• OpenStack plugin
 ML2 plugin
 Mechanism Driver for OpenIRIS : v0.1 dev. Complete
 Network REST : create_network, update_network, delete_network
 Subnet REST : create_subnet, update_subnet, delete_subnet
 Port REST : create_port, update_port, delete_port
 Now testing
 Mechanism Driver for OpenIRIS v1.0
 OVS Bridge and Port create
 We want managed OVS from OpenIRIS
 Sync. (Network, Subnet, Port, … info.)
 We want managed network type(gre, vxlan, …) from OpenIRIS

Mechanism Driver
Develop OpenIRIS Module
• OpenIRIS Module
 ML2 Manager
 REST call from mechanism_iris (openstack plugin)
 Now testing
 Tunnel Manager
 Create Port to OVS using Network type (gre, vxlan, …)
 Support overlay network
 L3 Routing Manager
 Support L3 Router (ex: virtual router)
 …

Openstack Testbed_ovs_virtualbox_devstack_single node

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (17)

Similar to Openstack Testbed_ovs_virtualbox_devstack_single node

Similar to Openstack Testbed_ovs_virtualbox_devstack_single node (20)

More from Yongyoon Shin

More from Yongyoon Shin (9)

Recently uploaded

Recently uploaded (20)

Openstack Testbed_ovs_virtualbox_devstack_single node