Presentation for KICS Mobile + Cloud DIY Workshop

1. Playing with
OF@TEIN SDN-enabled
Virtual Playgrounds
Aris C. Risdianto & TaeHeum Na
OF@TEIN Project Team
TEIN-GIST@nm.gist.ac.kr
KICS Mobile + Cloud DIY Workshop
September 25th 2014 @ Seoul

2. Testbed: Wild &
Organized Playground Play (Experiment)
• Configuration
• Control
• Visibility
(Power
Users)
(Provider)
Provide Playground
with Resources
DevOps

3. Organized Playground: Play & Operation
“Resources” Provision
(Owner/Provider)
Stop
“Experiment”
(Visitors/Users)
“Resources”
Clean Up
(Provider) Playground
Operation
Start
“Experiment”
(Visitors/Users)
“Visibility”
(Visitors/Users)

4. OF@TEIN Experiment LifeCycle
Design Stage
Execute StageFinish Stage
Account
Credential
&
Working
Environment
Box Inst. &
Conf.
Templates
Function Inst.
& Conf.
Templates
Resources
Allocation
Configure
& Initialize
Services
Box & Function
Interconnect
Templates
Resources
List
Logging
File
Resources
&
Experiment
Status
Experiment
UI Display
Data & Logging
Result Analysis
Context-Based
Information
Data and Resources
Clean Up Status
Experiment
Description
Resources Check &
Execute
Experiment
Data &
Resource
Clean Up
Box &
FlowSpace
Register
Provision Stage
Experiments
Monitoring
(Visibility)
Establish
Management
Environment
Experiment
Data
Infrastructure
UI Display
Resources
Monitoring
(Visibility)
Archived
Experiment Data
Services/Workload/Resources
Description
Design
Experiment
Experiment
Analysis
Version 1.4 : Last Update Sept 2014

5. Experiments over Shared Testbed:
DevOps Challenges
Developer
Experiment
Operator
Provision
Preparation/Experiment
Problem/Repetition
Provision/Monitoring
Problem/Recovery
Physical/Resources
Problem
Report
Troubleshot/Solve
Problem
Response
Time Consuming ! Inefficient Tasks !

6. NIA(Seoul)
OF@TEIN Testbed Infrastructure
(2012~2014)
Indonesia
Malaysia
(UM)
Vietnam
Philippines
Networked
Tiled Display
SmartX Box
(Type B+)
EU (SmartFIRE)
Japan or USA
OF@TEIN
OpenFlow Switch
Exp. Node (with HD camera)
Exp. Node (traffic generator)
Exp. Node
OpenFlow Production Switch
OpenFlow FlowVisor
OpenFlow Controller
OF@TEIN Portal
OF@TEIN SDN Tools
SmartX Rack (Box)
Jeju (Jeju)
Thailand
GIST
(Gwangju)
VoD
Korea U
(Seoul)
Postech
(Pohang)
OF@KOREN
SmartX
Box
(Type C)
Last Update: 2014-05-01
Malaysia
(MYREN)
Pakistan
A Shared &
Organized Virtual
Playground

7. TEIN-HK
AS 24489
APAN-JP
AS7660
PREGINET
AS9821
Vinaren
AS24175
THAIREN
AS24475
ASTI@Manila
Vietnam
Philippines
HUT@Hanoi
Inherent
AS18007
Indonesia
ITB@Bandung
Thailand
CU@Bangkok
Myren
AS24514
Malaysia
UM@Kuala Lumpur
GIST@Gwangju
KOREA622M
622M
OF@TEIN Infrastructure:
Network Connectivity
10G
TEIN-JP
AS 24287
TEIN-SG
AS 24490
10G
10G
KU@Seoul
Jeju-U@Jeju
Postec@Pohang
NIA@SeoulPERN@PK
KOREN
MYREN@MY

8. Experiment
Software & Scripts
VM
VM
VM
A Pool of SmartX Boxes
Supporting OF@TEIN Experiments
Resource
Allocation
Operator
Slice
L2
L3
L2
VMVM VMVM
A Virtual
Playgroud
FlowSpace / Resource
Management & Visibility
FlowVisor
SmartX Control Center
(Configuration/Control/
Visibility)
FlowSpace /
Resource
Visibility
Experiment
Visibility
Developer
Slice

9. Providing A Shared &
Organized Virtual
Playground?

10. Physical Network
Overlay Tunnels
Box/Functions/Topology
Templates
VMVMVM
L2
A Virtual Playground
L2
L3
VM
Installation
&
Configuration
Configuration
Control
Visibility
OF@TEIN Virtual Playground Configuration
SmartX
Box
(Type
B+)
Management VM
(SmartX-Box /
OpenStack /
Monitoring Agents)
Worker VM #1
Worker VM #2
Worker VM #3
OpenvSwitch
Management Switch
Remote Power
Management
Storage
Manageme
nt
SmartX Control Center

11. SmartX Rack Type B vs SmartX Box Type B+
Worker VM #1
Monitoring
Agent
Worker VM #2
Worker VM #3
Remote Power Mng.
NF/OVS Capsulator Node
VM
#2
OpenFlow
Agent
SmartX-
Rack Agent
MediaX-VT
Agent
VM
#1
Dataplane OF Switch
Data Manag.
Management
VM (SmartX-Rack
/ OpenStack /
Monitoring Agents)
Worker VM #1
Worker VM #2
Worker VM #3
Open
vSwitch
Management Switch
Remote Power
Management
Storage
Manage
ment
Worker
OF Switch
Capsulator
P
• 3 Tier Nodes (Capsulator, OF Switch, Worker)
• 3 Network Planes: Power + Management / Control / Data
M
C D
SmartX Rack (Type B)
VM
VM
VM
O
F
S
VM
VM
VM
O
F
S
SmartX Box (Type B+)
VM
VM
VM
O
V
S
VM
VM
VM
O
V
S

12. OF@TEIN SDN Lifecycle Experiments Tools
OF@TEIN Underlay
Network
OF@TEIN Lifecycle Experiment
Scripts
VM Configuration
VM Image
Data
Repository
Visibility / Monitoring
Management Plane Tunneled Data Plane Worker VM
Data Plane Logical Connection Management VM
SCP
(TCP)
HTTP
Remote Power Management
OVS Capsulator Node
Dataplane OF Switch
Data Management
Control
Worker Node
(XEN DomU-1)
(XEN DomU-2)
Ubuntu
Experimenter
Data Management
Data
SSH
(TCP)
Control
Management
Control
(Start, Stop, and
Verify)
SSH
(TCP)
Configuration
(Install and
Configure)
Provision and
Configuration
OF@TEIN Lifecycle
Experiment Tools
XEN Dom 0
Worker VM #1
Worker VM #2
Worker VM #3
OpenvSwitch
Management Switch
IBM IMM
Remote
Management
GRE
Management
Data
Control
SmartX Box
SmartX Rack Type B SmartX Rack Type B+

13. Script-based and Chef-based Configuration

14. OF@TEIN Site (Virtual) Overlay Networking
with NVGRE Tunneling
GIST
PK
PH
ID
MY
TH
VN
MYREN
Semi-Automation for
Site Virtual Overlay
Networking

15. FlowVisor (v1.4)
OF@TEIN
Admin Script
VLAN-based
FlowRange
VLAN-based
FlowRange
VLAN-based
FlowRange
VLAN-based
FlowRange
NOX
Controller
Floodlight
Controller
Floodlight
Controller
FlowSpace
ManagementFloodlight
Controller
OF
Switch
OF
Switch
OF
Switch
DPID-
PortRanges FlowRanges
OF@TEIN Networking & FlowSpace Resources
VLAN
ID
Supporting Multiple SDN Users with their own
Controllers via FlowVisor

16. WAN
Operator vs Users Topology (Type A*/B+)
OpenFlow
Network
SmartX Rack
Type A* Site
VM
VM
VM
SmartX Box
Type B+ Site
Admin SDN Controller
[Overlay Networking via OpenFlow +
OVSDB]
(Floodlight)
User SDN Controllers
[OpenFlow + OVSDB]
(Any controllers under FlowVisor)
FlowSpace-UI SDN Controller
[OpenFlow + LAVI + Translator]
(NOX under FlowVisor)
VM
VM
VM
SmartX Box
Type B+ Site
FlowVisor
Last Update: 2013-10-31
User #1 User #2 User #n
NVGRE OVS
(L2/L3 Network)
Capsulator
OpenFlow Switch
Virtual Switch
OVS
OVS
OF
Switch
OF
Switch
OVS
VM
VM
VM
OVS
OVS
Gateway
Router
Gateway
Router
Gateway
Router

17. WAN
Operator vs Users Topology (Type A*/B+)
OpenFlow
Network
SmartX Rack
Type A* Site
VM
VM
VM
SmartX Box
Type B+ Site
FlowSpace-UI SDN Controller
[OpenFlow + LAVI + Translator]
(NOX under FlowVisor)
VM
VM
VM
SmartX Box
Type B+ Site
FlowVisor
Last Update: 2013-10-31
NVGRE
(L2/L3 Network)
Capsulator
OpenFlow Switch
Virtual Switch
OVSOF
Switch
OF
Switch
VM
VM
VM
Gateway
Router
Gateway
Router
Gateway
Router OVS
OVS
H
H O
O H
O
O
VM
VM
VM
VM
VM
VM
VM
VM
VM
User SDN Controllers
[OpenFlow + OVSDB]
(Any controllers under FlowVisor)
User #1 User #2 User #n

18. Demo: Operator vs User Topology View

19. Playing with Virtual
Playground &
Visualizing the Plays

20. Playground Preparation and Playing
Tools
Working ToolBox
Design/Plan/Procedure
Playing Tool
Playing Plan
“Script/Configuration”
“Provisioning Tools”
“Experiment Script”
“Experiment Tools”

21. Application-Level
Visibility
Resources-Level
Visibility
Automated Execution & Visibility for
Lifecycle Experiment
Automated Experiment
Execution and Resource
Provisioning
Provide Visibility
for User and Operator
Experiment
Execution
Resources
Preparation
Provision

22. Open Software and Demo
Running Experiments with OF@TEIN
Shared & Organized Playground
Demo
Visual
OF@TEIN
Network
Monitoring
22
OF@TEIN
System
Monitoring
User
Experiment
Console
User
Experiment
Visibility
OF@TEIN
FlowSpace
Monitoring
OF@TEIN
SmartX Box
(Type B+)
Play SDN-enabled experiments over your own virtual playground!
Resources
Monitoring
Software

23. OF@TEIN Lifecycle Experiment Example
(Video Streaming)
System, Network,
FlowSpace
Monitoring*
Resources
Request
SmartX Boxes
Network & FlowSpace
(Datapath, Tunnel, IP Subnet)
Resource Preparation Script
and Experiment Command
Experimenter UI
& Video Client
Box
Compute
(VMs & Encoder)
Configuration ControlVirtual
Playground
Resources Request
and Verification
Admin
User
Resource
Allocation
Topology
FlowVisor
Function
Storage
(Streaming Media)
Provision
Visibility
Resources

24. Demo: Automated Experiment Execution
ICMP & IPerf
(TCP Traffic)

25. Demo: Automated Experiment Execution

26. Experiment:
Automated Streaming
& Playout of Video
Streams

27. Initial Stage
Experiment Check
& Execution
Experiment
Preparation
Experiment
Stop/Finish
OF@TEIN Lifecycle Experiments
(Operator vs User Cycle)
Version 1.1 : Last Update April 2014
Operator
Lifecycle
Users
Lifecycle
Resource/Infrastructure
Monitoring (Visibility)
Experiment
Analysis
Initial Stage
Box Installation and
Configuration
Topology
Configuration
Function Installation
and Configuration
Experiments
Monitor (Visibility)

28. OF@TEIN Lifecycle Experiment Example
(Video Streaming)
System, Network,
FlowSpace
Monitoring*
Resources
Request
SmartX Boxes
Network & FlowSpace
(Datapath, Tunnel, IP Subnet)
Resource Preparation Script
and Experiment Command
Experimenter UI
& Video Client
Box
Compute
(VMs & Encoder)
Configuration ControlVirtual
Playground
Resources Request
and Verification
Admin
User
Resource
Allocation
Topology
FlowVisor
Function
Storage
(Streaming Media)
Provision
Visibility
Resources

29. Experiment Scenario
Two sites will run VLC video server and stream
through HTTP Protocol
Video Stream
(TCP/UDP Traffic)
Video Source #1
Video Source #2
Video Client
Video Display
GIST
TEST
ID

30. Experiment Steps
1. Open SDN Experimenter UI
2. Check the PING experiment still running
3. Execute Automatic Video Experiment
4. Check Verification result
5. Check again SDN UI Dashboard
6. Check Experiment Result (Video Display)

31. SDN Experimenter UI
31
The video packet flows between Video Server and Client will
start to flow as shown in the picture

32. Experiment:
Automated Recovery
of Resources
Computing Resource
(XEN Hypervisor) Recovery

33. Initial Stage
Experiment Check
& Execution
Experiment
Preparation
Experiment
Stop/Finish
OF@TEIN Lifecycle Experiments
(Operator vs User Cycle)
Version 1.1 : Last Update April 2014
Operator
Lifecycle
Users
Lifecycle
Resource/Infrastructure
Monitoring (Visibility)
Experiment
Analysis
Initial Stage
Box Installation and
Configuration
Topology
Configuration
Function Installation
and Configuration
Experiments
Monitor (Visibility)

34. Experiment Scenario
XEN Management tools at GIST-TEST site will
uninstall and recover automatically
PING
(ICMP Traffic)
XEN
TEST
GIST

35. Experiment Steps
1. Check SDN Experimenter UI and verify ping
experiment still running
2. Interrupt experiment (Destroy GIST VM)
3. Break the XEN Hypervisor Service/Package (Uninstall
XEN Management Tools)
4. Execute PING Experiment Script
5. Check experiment verification result
6. Execute Admin Check Script
7. Check the verification result of problem and recovery
8. Execute again PING experiment script
9. Check experiment verification result
10. Check SDN Experimenter UI

36. Demo: Automated Checking for Resource
Problems

37. Demo: Automated Recovery of Resource
Problems
automated resources
checking
with interactive recovery
tasks
automated
resources
provision
(recovery)
resources checking
and recovery report

38. Demo: Automated Repetition of Experiments

39. Thank you!
• Send Inquiry to jongwon@gist.ac.kr
• http://netmedia.gist.ac.kr
Contact us!
TEIN-GIST@nm.gist.ac.kr