The document describes various use cases for the iLab technical facilities: 1) Testing quality of experience for triple play services including voice, video, and web performance. 2) Developing a test suite for xDSL customer premise equipment as part of a European research project. 3) Conducting performance analysis and optimization for several Belgian government broadband projects involving file transfer, e-paper, and wireless crisis management networks. 4) Providing international connectivity via a VPN to a US university and access to the PlanetLab testbed. 5) Sharing expertise with community networks for setting up efficient web servers.

1. iLab - Technical
Use cases
Brecht Vermeulen

2. Contents
Triple play Quality of experience
xDSL CPE test suite
IBBT GBO projects
FIPA, ePaper, Geobips
International connectivity
VPN to City University of New York (CUNY)
Planetlab
Communities
16+
2

3. Use case I: Triple play QoE
Quality of Experience for user
Audio/voice
Video
Data
Projects:
Cantata: Barco, IBBT
Champ: Alcatel, UA, IBBT
OSLU: Newtec, IBBT
Scone: Alcatel, IBBT
3

4. Triple play Quality of Experience: voice
VoIP comparison
Skype
SJPhone (soft phone, SIP/H.323)
IP phones (Siemens, Cisco)
4

5. Voice quality: lab setup
Compares outgoing and incoming signal MOS Score
PESQ: voice over packet based networks
PSQM: voice over networks with a fixed delay
PEAQ: for hifi audio testing
SJPhone SJPhone 5

6. Voice quality: lab setup
Compares outgoing and incoming signal MOS Score
PESQ: voice over packet based networks
PSQM: voice over networks with a fixed delay
PEAQ: for hifi audio testing
250
MOS MOS MOS MOS
200 <3.9 <3.9 G.711 4.3 G.711 4.3
G.729 3.9
Delay (ms)
150
100
50
0
Skype Direct (138 Skype P2P (160 ms) SJPhone (220 ms) Siemens/Cisco IP
ms) Phone (70-93 ms)
Program / Device
MOS PSTN 3.8
SJPhone SJPhone 6

7. Voice quality: Skype direct vs. P2P
Skype Login server
Ordinary Host
Direct Connection
Not Possible
Use of P2P Network
Supernode
Direct Connection 7
Possible

8. Telenet to skynet (P2P and direct): 24h
4,5
MOS 2500 Delay
4 4
3,5
2000
2000ms
3
3 1500
Delay Max (within 1
MOS Score
2,5
Delay (ms)
conversation) [ms]
Delay Avg (within 1
conversation) [ms]
2
P2P
1000ms
Delay Min (within 1
1000 conversation) [ms]
1,5
1
500
0,5
0 0
Time Time
4,5
2500
4 4
3,5
2000
2000ms
3
3
1500
2,5
MOS Score
Delay (ms)
Delay Max (within 1
conversation) [ms]
Direct
2
Delay Avg (within 1
1,5
1000
1000ms conversation) [ms]
Delay Min (within 1
conversation) [ms]
1
500
0,5
8
0 0

9. Triple play: webserver performance
AMD Athlon 1GHz AMD Athlon 64
3000+
CPU Linux 2.4
AMD dual Opteron Windows server
OS
1,6GHz 2003
Linux 2.6
HTTP/1.0 HTTP HTTP/1.1
Apache 1.3 Apache 2.0
Small static page: Large static page:
Google static CNN Webserver
Content
IIS 6.0
Dynamic page
9

10. Webserver performance
Apache1.3 Apache2.0
Linux 2.4 Linux 2.4
AMD Athlon 64 3000+
Apache2.0 Windows server 2003
14000 Linux 2.6 IIS 6.0
12000
10000
Transactions/s
8000
6000
4000
2000
0
Google CNN CNN/1.0 Date Company
Apache 1.3 + Linux 2.4 Apache 2.0/prefork + Linux 2.4
Apache 2.0/worker + Linux 2.4 Apache 2.0/perchild + Linux 2.4
Apache 2.0/prefork + Linux 2.6 Apache 2.0/worker + Linux 2.6
Apache 2.0/perchild + Linux 2.6 Apache 2.0/winNT + Windows Server 2003
IIS 6.0 + W2K3 IIS 6.0 + W2K3 (ASP + MS Access)
10

11. Webserver: overload behavior
Linux/Apache 2.0 worker – Linux/Apache 2.0 perchild
HTTP 1.1 static – HTTP 1.0 static
Linux/Apache 2.0 prefork –
simple PHP
Windows 2003 server – IIS
6.0
11

12. Webserver performance: bandwidth
Off the shelf PC hardware: Athlon 3000, socket 754
OS BW (Mb/s)
Small static page (google) W2K3 + IIS 6.0 319
Linux 2.4 + Apache 2.0/Worker 320
Large static page HTTP/1.0 Linux 2.4 + Apache 2.0/Worker 282
(CNN)
Large static page HTTP/1.1 W2K3 + IIS 6.0 352
(CNN) Linux 2.4 + Apache 2.0/Worker 318
Tux + Linux 2.6 510
Dynamic PHP Linux 2.4 or 2.6 + Apache 1.3 12
Dynamic ASP W2K3 + IIS 6.0 12,7
PHP + MySQL Linux 2.6 + Apache 1.3 20,6
12

13. Triple play: video QoE – testbed
• Linux servers • Network emulation (multi-platform)
• Clients
• Windows servers • Different technologies
• Quality analysis
• In-house streamers
• Automatic capturing
Packet testruns
Mirrored Port
Mirrored Port
during streaming
• In-house developed
• See demonstration
SmartBits 6000B Perform ance Analysis System
R
13

14. Contents
Triple play Quality of experience
xDSL CPE test suite
IBBT GBO projects
FIPA, ePaper, Geobips
International connectivity
VPN to City University of New York (CUNY)
Planetlab
Communities
16+
14

15. Use case II: xDSL CPE test suite in Muse
Multi Service Access Everywhere (www.ist-muse.org)
The overall objective of MUSE is the
research and development of a future, low
cost, multi-service access network
European IST (Information Society
Technologies) research program
Belgian partners: Alcatel, Thomson, IBBT
IBBT iLab:
Development of a test suite for CPEs (with
requirements of DSLforum, IETF, Muse)
15

16. Muse: xDSL CPE tests overview
Multicast (49 tests for 70 requirements)
IGMPv3 Requirements
Packet Requirements
Group Membership Requirements
Multicast Router Requirements
IGMPv3-Proxy Requirements
DSLForum Multicast Requirements
General Requirements
Immediate Leave
Upstream interfaces without an IP address
Multiple upstream interfaces
Filtering
Forwarding
DHCP (+/-25 tests dhcp client, 25 tests dhcp server, > 60
requirements)
VLAN
Ethernet OAM
General
16
Security

17. Example output of a DHCP test
TEST: TestServer_AllocateAddress
Reset DHCP server
Broadcast a DHCPDISCOVER message
Wait for an ARP request from the server
failed: Did not receive an ARP request from 10.0.1.5
Wait for a DHCPOFFER message
passed: Server 10.0.1.5 offered the 10.0.1.20 IP Addr
Broadcast a DHCPREQUEST message
Wait for a DHCPACK message
passed: received a valid DHCPACK message
Adding ARP entry for 10.0.1.20 at 45:87:e7:57:ee:13
Stop DHCP server
Finish test
Test score for TestServer_AllocateAddress: good
17

18. Contents
Triple play Quality of experience
xDSL CPE test suite
IBBT GBO projects
FIPA, ePaper, Geobips
International connectivity
VPN to City University of New York (CUNY)
Planetlab
Communities
16+
18

19. Use case III: IBBT GBO: FIPA
File based Integrated Production Architecture
IP based architecture to share storage and
computing power on single or multiple sites
For digital media production, eHealth, ...
Partners:
VRT
IBM
Porthus
Video promotion
IBBT
iLab involvement: performance analysis and
optimization of network/storage
19

20. FIPA: Research goal
In the IP network:
Transfer of large media files
1 hour: 25 GB
Bitstream: 50 Mb/s
On high performance low delay
LAN
Research goal :
Find the optimal
setup/configuration to achieve
maximal throughput
Variables to play with:
Network Card: normal NIC, TCP
offload engine
TCP + Ethernet parameters
FTP, NFS, SMB/CIFS parameters
20

21. TCP offload engines
Normal NIC TCP offload engine
21

22. FIPA Tests & results: setup
Back-to-back tests between AMD dual Opteron systems
(Opteron 246 @ 2GHz)
Intel PRO/1000 NIC (4 x 1 Gbps)
TCP checksum & segm offload
Chelsio T204 TOE (4 x 1 Gbps)
full TCP offload (= TCP Offload Engine)
TCP throughput measured with Iperf
Generates TCP streams on different interfaces
Transfers are memory-to-memory
Limitations
PCI-X bus: 64 bit @ 133 MHz ~ 1GB/s
PCI-X is a half-duplex bus, PCI Express is a full-duplex point-
to-point connection
Maximal (unidir) TCP efficiency: 94.1% 941 Mbps per link
22
99% for 9000 byte MTU

23. Tests & results: effect of offload and
jumbo frames
Chelsio TOE vs. Intel Pro 1000 (MTU 1500)
4 links unidir: 3.7 Gb/s vs. Intel NIC 2.7 Gb/s
4 links bidir: 7 Gb/s vs. Intel NIC 3.2 Gb/s
Jumbo frames on Intel: throughput +, CPU -
8 Gb/s 100%
MTU MTU
1500 9000
4 Gb/s 50%
Chelsio
Chelsio
Intel
Intel
23

24. IBBT GBO e-Paper
Partners:
Philips
De Tijd
Hypervision
I-Merge
Belgacom
IBBT
iLab involvement: performance analysis of
webservers for simultaneous content download
24

25. Web server CPU load with encryption
File 2MB, HP DL 145, dual opteron 1.6GHz
CPU Load - SimUsers/sec - SSL CipherSuites
120
100
CPU Load (%)
80
60
40
20
0
10 20 30 40 50 60 70 80 90 100 110 120 130 140 150 160
SimUsers/sec
DES-CBC-SHA EXP-DES-CBC-SHA
EXP-RC4-MD5 EXP-RC2-CBC-MD5
EDH-RSA-DES-CBC3-SHA1 DES-CBC3-SHA
No HTTPS
25

26. Influence of SSL offload
File 2MB
AMD Athlon 3000
26

27. IBBT GBO: Geobips
GeoBIPS = Geographical Broadbrand
Integration for Public Services
Mobile crisis management system
Real-time overview of a disaster area
Collect, process, display and distribute static
and dynamic information on top of a
Geographical Information System (GIS)
Dynamically build-up a network in the ‘crisis
area’
Partners: Aventiv, Abiware, Capvidia,
Cisco, Digipolis, Stad Antwerpen,
Videohouse, IBBT
iLab involvement: optimization of wireless
“cubes”
27

28. Geo-BIPS use case
1. While going to the site, intervention plans can be viewed.
2. Fire truck arrives at the disaster site.
3. Team enters the building, and places relay stations on
the go
IP
Se
c
c
Se
IP
IP
Se
c
28

29. GeoBIPS - demo
: Video-stream
DVD-player (camera)
Tablet CO
Axis video
server
MAR
WLTP
Reconnaissance team Relay Network Fire Truck
29

30. Contents
Triple play Quality of experience
xDSL CPE test suite
IBBT GBO projects
FIPA, ePaper, Geobips
International connectivity
VPN to City University of New York (CUNY)
Planetlab
Communities
16+
30

31. Use case IV: International connectivity
CUNY:
VPN: 100Mb/s guaranteed
For dynamic reservation of VLANs with
guaranteed BW for grid, conferencing, ...
Current status:
UDP throughput=80Mb/s, TCP very low
(Unexpected) packet loss somewhere
Planetlab:
www.planet-lab.org
Distributed experiments 708 nodes in 340 sites
31
2 nodes in iLab

32. Contents
Triple play Quality of experience
xDSL CPE test suite
IBBT GBO projects
FIPA, ePaper, Geobips
International connectivity
VPN to City University of New York (CUNY)
Planetlab
Communities
16+
32

33. Use case V: Communities
iLab provides know-how to
community site setup
E.g. 16+: webserver performance
measurement, hardware setup
33