Session ID: SFO17-119 Session Name: Performance Evaluation for Containerized NFV-I on Arm via OPNFV Yardstick - SFO17-119 Speaker: Herbert Guan Track: LNG ★ Session Summary ★ As we know, container technology are the most eminent virtualization technology today. For ARM NFVI infrastructure, Kubernetes is used as the container orchestration engine with DPDK data plane acceleration for container networking. How to evaluate the performance metrics(throughput, latency, jitter) automatically with a built-in mechanism of the whole NFVI infrastructure is an important problem. On the other hand, for CI-CD purpose of our NFVI development work, how to efficiently measure, collect and analyze the performance data of the container networking environment for ARM container based NFVI infrastructure is also an important issue to deal with. --------------------------------------------------- ★ Resources ★ Event Page: http://connect.linaro.org/resource/sfo17/sfo17-119/ Presentation: Video: https://www.youtube.com/watch?v=kZX1GedKKEQ --------------------------------------------------- ★ Event Details ★ Linaro Connect San Francisco 2017 (SFO17) 25-29 September 2017 Hyatt Regency San Francisco Airport --------------------------------------------------- Keyword: 'http://www.linaro.org' 'http://connect.linaro.org' --------------------------------------------------- Follow us on Social Media https://www.facebook.com/LinaroOrg https://twitter.com/linaroorg https://www.youtube.com/user/linaroorg?sub_confirmation=1 https://www.linkedin.com/company/1026961

1. © 2017 Arm Limited
September 25, 2017
Linaro Connect SFO17
Performance Evaluation
for Containerized NFV-I on
Arm via OPNFV Yardstick
Herbert Guan, Staff Software Engineer
Trever Tao, Staff Software Engineer

2. © 2017 Arm Limited2
Agenda
• Background
• OPNFV Test Community & Yardstick Introduction
• What We Have Done
• Yardstick Test Results on Arm Containerized NFV-I
• Next Steps

3. © 2017 Arm Limited3
Background
• Containerized NFV-I on Arm aligns with OPNFV Container4NFV architecture
• Container networking is the basis of Containerized NFV-I
• How to evaluate the networking performance on Arm Containerized NFV-I efficiently?
Source: https://wiki.opnfv.org/pages/viewpage.action?spaceKey=OpenRetriever&title=Container%27s+Architecture+for+Cloud+Native+NFV
Containerized NFV-I on Arm

4. © 2017 Arm Limited4
OPNFV Testing Community
Source: https://wiki.opnfv.org/display/testing/Testing+Ecosystem

5. © 2017 Arm Limited5
Yardstick Introduction
• Yardstick is an OPNFV Project. It is a test framework with test cases and test stimuli to
enable NFV-I performance verification
• Includes test cases for: Throughput, Latency, Protocol RTT, etc.
• Kubernetes support is added recently
VSPerf CPerf StorPerf QTIP
Yardstick
Scenario Context
Runner Dispatcher
Plugin
Performance
Testing
Http
Influxdb
File

6. © 2017 Arm Limited6
Yardstick Test Workflow on Arm Containerized NFV-I
1. Request to deploy PODs
2. Create host POD
3. Create target POD
4. Send test script
5. Run perf test
6. Dispatch test result
7. Undeploy PODs
Kubernetes MASTER
API SERVER
SCHEDULER
CONTROLLER
MANAGER
etcd
NODE1
NODE2
NODE3
Host
POD
Target
POD
Flannel Network
NODE1
Yardstick
Docker
NODE2
Jump
Host k8s-adminconf
NODE3
Bare-metal
Bare-metal VM
Note: some test images should be prepared with
certain test software pre-installed
Grafana
Influxdb
1
2
4
37
5
POD3
6

7. © 2017 Arm Limited7
What We Have Done
• Enabled Yardstick test framework for containerized NFV-I on Arm
• Enabled test cases and scenarios for container
• Ping RTT, IPerf3, Netperf
• Collected and analyzed testing results
• Identified functional limitations of Yardstick when interacting with Kubernetes
• Lack of Node Selector for hybrid deployment
• Lack of user defined network selection
• Issue on cross-host Netperf UDP stream test

8. © 2017 Arm Limited8
Yardstick Test Results – Ping RTT
Host
POD
Bare-metal
Target
POD
Host
POD
Bare-metal 1
Target
POD
VM
Flannel Network
Host
POD
Bare-metal 1
Target
POD
Bare-metal 2
Flannel Network

9. © 2017 Arm Limited9
Yardstick Test Results – Netperf
• Flannel with overlay
solution impacts
networking performance
• Test result diffs between
platforms. Data values in
screenshots are for
qualitative reference
only.
Throughput
Latency
Host & target
container
on 2 Bare-metals
Host & target
container
on 1 Bare-metal
Host & target
container
on 1 Bare-metal
Host & target
container
on 2 Bare-metals

10. © 2017 Arm Limited10
Next Steps
• Add Yardstick function extensions for Kubernetes context
• NodeSelector, user defined networks selection
• Enable test cases on data plane acceleration in container
• DPDK, ODP
• Enable more test scenarios for Containerized NFV-I
• HTTP requests processing performance
• Enable test cases between VM and Container networking

11. © 2017 Arm Limited11
• Resources
• Wiki: https://wiki.opnfv.org/display/yardstick/yardstick
• Gerrit: https://gerrit.opnfv.org/gerrit/yardstick