SlideShare a Scribd company logo
1 of 14
Janet-hosted test tools
Duncan Rand
Research Network Engineering Meeting
Online, 9th December 2022
Testing connectivity
RNE - Janet-hosted test tools
• What we provide:
• Ad hoc throughput testing with iperf3 or ethr
• Collecting measurements of network characteristics over time with
perfSONAR; allows historic comparisons and analysis (for changes)
• Ad hoc disk to disk copying to/from data transfer nodes (DTN)
• Librespeed browser-based test tool
• A RIPE Atlas anchor, for bespoke RIPE Atlas tests
• Note: our NOC have additional tools, such as hardware line testers
Ad-hoc throughput testing: iperf3
RNE - Janet-hosted test tools
• There is a 10G iperf3 server at the Jisc Slough data centre:
iperf-slough-10g.perf.ja.net (accessible over both IPv4 and IPv6)
• Will have a 100G iperf server which will be available on request
• iperf3 software installation:
• CentOS7: sudo yum install iperf3
• Using from Windows
• Microsoft guide to iperf usage
• Compiling iperf/iperf3 from source
• Example of Windows usage
Example of using iperf3 (from a MacBook)
RNE - Janet-hosted test tools
$ iperf3 -4 -t 4 -c iperf-slough-10g.perf.ja.net
Connecting to host iperf-slough-10g.perf.ja.net, port 5201
[ 6] local 192.168.1.128 port 54403 connected to 194.81.18.231 port 5201
[ ID] Interval Transfer Bitrate
[ 6] 0.00-1.00 sec 2.49 MBytes 20.9 Mbits/sec
[ 6] 1.00-2.00 sec 2.24 MBytes 18.8 Mbits/sec
[ 6] 2.00-3.00 sec 2.26 MBytes 19.0 Mbits/sec
[ 6] 3.00-4.00 sec 2.21 MBytes 18.5 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate
[ 6] 0.00-4.00 sec 9.20 MBytes 19.3 Mbits/sec sender
[ 6] 0.00-4.00 sec 8.98 MBytes 18.8 Mbits/sec receiver
iperf Done.
• Add –R to reverse the direction
• iperf (rather than iperf3) works better with multiple streams
Ad-hoc throughput testing: ethr
• ethr is a “comprehensive network measurement tool for TCP, UDP & ICMP”
from Microsoft
• Natively cross platform thanks to golang
• Available for CentOS7 with ‘snap’ & installed on our 10G server at Slough
$ ethr -d 4s -c iperf-slough-10g.perf.ja.net
Connecting to host [2001:630:3c:f803::12], port 9999
[ 6] local 2001:630:3c:f803::6 port 51706 connected to 2001:630:3c:f803::12 port 9999
- - - - - - - - - - - - - - - - - - - - - - -
[ ID] Protocol Interval Bits/s
[ 6] TCP 000-001 sec 6.67G
[ 6] TCP 001-002 sec 9.77G
[ 6] TCP 002-003 sec 7.49G
[ 6] TCP 003-004 sec 9.45G
Ethr done, duration: 4s.
RNE - Janet-hosted test tools
Persistent measurement over time: perfSONAR
RNE - Janet-hosted test tools
• Free, open source: https://www.perfsonar.net
• Easy to download and install on CentOS7 (and Debian)
• Very useful to have persistent testing: collect history of network
characteristics – throughput, loss, latency, path
• Test against our 10Gbps node in the Jisc Slough data centre
• Bandwidth: https://ps-slough-10g.perf.ja.net
• Latency: https://ps-slough-1g.perf.ja.net
• We also are testing 1Gbps small nodes (including RPi) and Docker versions
• We have a GÉANT PMP small node (Gigabyte Brix):
• https://pmp-central.geant.org/maddash-webui/
Persistent measurement over time: 100G perfSONAR
RNE - Janet-hosted test tools
• We have installed a 100G perfSONAR host
in London
• Available for on demand testing
• Added it to the WLCG 100G mesh
• After some tuning it shows rates up to about
15 Gb/s with one stream to several pS
nodes around the world
• Bandwidth https://ps-london-bw.perf.ja.net
• Latency: https://ps-london-bw.perf.ja.net
• Uses 9000 MTU
10G Data Transfer Node (DTN) & Globus endpoint
RNE - Janet-hosted test tools
•We have a DTN in the Jisc Slough data centre: dtn-slough-10g.perf.ja.net (dual-stack)
•A number of files are available: 1M.dat, 2M.dat, 10M.dat, 50M.dat, 1G.dat, 10G.dat,
20G.dat, 100G.dat, 1000G.dat accessible with globus-url-copy
•Can copy to /dev/null or to the file system, e.g. copying a 10GB file to /dev/null
$ globus-url-copy -vb ftp://dtn-slough-10g.perf.ja.net:2811/space00/10G.dat /dev/null
•There is also a directory with 100 x 1GB files for more sustained testing:
$ globus-url-copy -r -vb ftp://dtn-slough-10g.perf.ja.net:2811/space00/small/ file:///tmp/
100G Data Transfer Node (DTN) & Globus endpoint
RNE - Janet-hosted test tools
•We are installing a 100G DTN facility in the Jisc London centre
•This will use a distributed files system – most likely Ceph or BeeGFS with multiple DTNs
•One goal is to provide a Globus endpoint to enable Janet connected sites to test their own
Globus endpoints up to 100G
•However, other transfer tools can be made available on request to netperf@jisc.ac.uk
Browser-based speed tests
The devil you know!
•Easy to use, familiar to most of us
•Provide a useful first assessment from a browser
•But often not accurate and generally have a limited performance
•Generally insufficient to demonstrate full connectivity
•We have installed a Librespeed instance as it allows us to offer this service from
facilities that we control and understand
•We will publish it with appropriate text about its limitations
•People will be directed to contact us for iperf or perfSONAR tests and advice
•Planning to include a URL for test results, and a CLI/API to the tool
RNE - Janet-hosted test tools
Librespeed instance
Likely to be at https://speedtest.perf.ja.net
RNE - Janet-hosted test tools
https://github.com/librespeed/speedtest
RIPE Atlas anchor
•See https://atlas.ripe.net/
•Supports measurements from RIPE Atlas nodes
•Hardware (available from RIPE) or software probes
•The RIPE Atlas ecosystem is mature
•Over 11,000 probes around the world
•Our anchor node is deployed at Slough
•See https://atlas.ripe.net/probes/6695/
•Useful for loss and latency, but can do more bespoke tests
RNE - Janet-hosted test tools
Open questions
•What performance problems are you facing?
•What help might Jisc be able to provide?
•What other backbone-hosted tools would be useful for you?
•Any other suggestions for areas we should be covering?
•WiFi performance?
•Residential quality of experience (to campus and cloud)?
•Low latency (and jitter) applications?
•Experiments with (say) TCP BBR, or 9000 MTU?
•Disk to disk testing at >100G
RNE - Janet-hosted test tools
Thank you
•Please feel free to get in touch
•Email: netperf@jiscmail.ac.uk
RNE - Janet-hosted test tools

More Related Content

Similar to Janet-hosted test tools

[OpenStack Day in Korea 2015] Track 1-6 - 갈라파고스의 이구아나, 인프라에 오픈소스를 올리다. 그래서 보이...
[OpenStack Day in Korea 2015] Track 1-6 - 갈라파고스의 이구아나, 인프라에 오픈소스를 올리다. 그래서 보이...[OpenStack Day in Korea 2015] Track 1-6 - 갈라파고스의 이구아나, 인프라에 오픈소스를 올리다. 그래서 보이...
[OpenStack Day in Korea 2015] Track 1-6 - 갈라파고스의 이구아나, 인프라에 오픈소스를 올리다. 그래서 보이...OpenStack Korea Community
 
Cloud Native ORAN Testing in Your Pipeline
Cloud Native ORAN Testing in Your PipelineCloud Native ORAN Testing in Your Pipeline
Cloud Native ORAN Testing in Your PipelineW Watson
 
Install FD.IO VPP On Intel(r) Architecture & Test with Trex*
Install FD.IO VPP On Intel(r) Architecture & Test with Trex*Install FD.IO VPP On Intel(r) Architecture & Test with Trex*
Install FD.IO VPP On Intel(r) Architecture & Test with Trex*Michelle Holley
 
Using RARE/FreeRtr for the Janet network performance test facility
Using RARE/FreeRtr for the Janet network performance test facility Using RARE/FreeRtr for the Janet network performance test facility
Using RARE/FreeRtr for the Janet network performance test facility Jisc
 
Integrating Active Networking and Commercial-Grade Routing Platforms
Integrating Active Networking and Commercial-Grade Routing PlatformsIntegrating Active Networking and Commercial-Grade Routing Platforms
Integrating Active Networking and Commercial-Grade Routing PlatformsTal Lavian Ph.D.
 
NFV Infrastructure Manager with High Performance Software Switch Lagopus
NFV Infrastructure Manager with High Performance Software Switch Lagopus NFV Infrastructure Manager with High Performance Software Switch Lagopus
NFV Infrastructure Manager with High Performance Software Switch Lagopus Hirofumi Ichihara
 
Cisco CSIRT Case Study: Forensic Investigations with NetFlow
Cisco CSIRT Case Study: Forensic Investigations with NetFlowCisco CSIRT Case Study: Forensic Investigations with NetFlow
Cisco CSIRT Case Study: Forensic Investigations with NetFlowLancope, Inc.
 
Introduction to NBL
Introduction to NBLIntroduction to NBL
Introduction to NBLFei Ji Siao
 
Sanger, upcoming Openstack for Bio-informaticians
Sanger, upcoming Openstack for Bio-informaticiansSanger, upcoming Openstack for Bio-informaticians
Sanger, upcoming Openstack for Bio-informaticiansPeter Clapham
 
Deploying flash storage for Ceph without compromising performance
Deploying flash storage for Ceph without compromising performance Deploying flash storage for Ceph without compromising performance
Deploying flash storage for Ceph without compromising performance Ceph Community
 
DPDK Summit - 08 Sept 2014 - NTT - High Performance vSwitch
DPDK Summit - 08 Sept 2014 - NTT - High Performance vSwitchDPDK Summit - 08 Sept 2014 - NTT - High Performance vSwitch
DPDK Summit - 08 Sept 2014 - NTT - High Performance vSwitchJim St. Leger
 
Monitoring federation open stack infrastructure
Monitoring federation open stack infrastructureMonitoring federation open stack infrastructure
Monitoring federation open stack infrastructureFernando Lopez Aguilar
 
Adding IEEE 802.15.4 and 6LoWPAN to an Embedded Linux Device
Adding IEEE 802.15.4 and 6LoWPAN to an Embedded Linux DeviceAdding IEEE 802.15.4 and 6LoWPAN to an Embedded Linux Device
Adding IEEE 802.15.4 and 6LoWPAN to an Embedded Linux DeviceSamsung Open Source Group
 
OVS and DPDK - T.F. Herbert, K. Traynor, M. Gray
OVS and DPDK - T.F. Herbert, K. Traynor, M. GrayOVS and DPDK - T.F. Herbert, K. Traynor, M. Gray
OVS and DPDK - T.F. Herbert, K. Traynor, M. Grayharryvanhaaren
 
OpenKilda: Stream Processing Meets Openflow
OpenKilda: Stream Processing Meets OpenflowOpenKilda: Stream Processing Meets Openflow
OpenKilda: Stream Processing Meets OpenflowAPNIC
 
Security defined routing_cybergamut_v1_1
Security defined routing_cybergamut_v1_1Security defined routing_cybergamut_v1_1
Security defined routing_cybergamut_v1_1Joel W. King
 
SF-TAP: Scalable and Flexible Traffic Analysis Platform (USENIX LISA 2015)
SF-TAP: Scalable and Flexible Traffic Analysis Platform (USENIX LISA 2015)SF-TAP: Scalable and Flexible Traffic Analysis Platform (USENIX LISA 2015)
SF-TAP: Scalable and Flexible Traffic Analysis Platform (USENIX LISA 2015)Yuuki Takano
 

Similar to Janet-hosted test tools (20)

[OpenStack Day in Korea 2015] Track 1-6 - 갈라파고스의 이구아나, 인프라에 오픈소스를 올리다. 그래서 보이...
[OpenStack Day in Korea 2015] Track 1-6 - 갈라파고스의 이구아나, 인프라에 오픈소스를 올리다. 그래서 보이...[OpenStack Day in Korea 2015] Track 1-6 - 갈라파고스의 이구아나, 인프라에 오픈소스를 올리다. 그래서 보이...
[OpenStack Day in Korea 2015] Track 1-6 - 갈라파고스의 이구아나, 인프라에 오픈소스를 올리다. 그래서 보이...
 
Cloud Native ORAN Testing in Your Pipeline
Cloud Native ORAN Testing in Your PipelineCloud Native ORAN Testing in Your Pipeline
Cloud Native ORAN Testing in Your Pipeline
 
Iperf Tutorial
Iperf Tutorial Iperf Tutorial
Iperf Tutorial
 
Install FD.IO VPP On Intel(r) Architecture & Test with Trex*
Install FD.IO VPP On Intel(r) Architecture & Test with Trex*Install FD.IO VPP On Intel(r) Architecture & Test with Trex*
Install FD.IO VPP On Intel(r) Architecture & Test with Trex*
 
Using RARE/FreeRtr for the Janet network performance test facility
Using RARE/FreeRtr for the Janet network performance test facility Using RARE/FreeRtr for the Janet network performance test facility
Using RARE/FreeRtr for the Janet network performance test facility
 
Integrating Active Networking and Commercial-Grade Routing Platforms
Integrating Active Networking and Commercial-Grade Routing PlatformsIntegrating Active Networking and Commercial-Grade Routing Platforms
Integrating Active Networking and Commercial-Grade Routing Platforms
 
Building a Router
Building a RouterBuilding a Router
Building a Router
 
NFV Infrastructure Manager with High Performance Software Switch Lagopus
NFV Infrastructure Manager with High Performance Software Switch Lagopus NFV Infrastructure Manager with High Performance Software Switch Lagopus
NFV Infrastructure Manager with High Performance Software Switch Lagopus
 
Cisco CSIRT Case Study: Forensic Investigations with NetFlow
Cisco CSIRT Case Study: Forensic Investigations with NetFlowCisco CSIRT Case Study: Forensic Investigations with NetFlow
Cisco CSIRT Case Study: Forensic Investigations with NetFlow
 
Introduction to NBL
Introduction to NBLIntroduction to NBL
Introduction to NBL
 
Flexible compute
Flexible computeFlexible compute
Flexible compute
 
Sanger, upcoming Openstack for Bio-informaticians
Sanger, upcoming Openstack for Bio-informaticiansSanger, upcoming Openstack for Bio-informaticians
Sanger, upcoming Openstack for Bio-informaticians
 
Deploying flash storage for Ceph without compromising performance
Deploying flash storage for Ceph without compromising performance Deploying flash storage for Ceph without compromising performance
Deploying flash storage for Ceph without compromising performance
 
DPDK Summit - 08 Sept 2014 - NTT - High Performance vSwitch
DPDK Summit - 08 Sept 2014 - NTT - High Performance vSwitchDPDK Summit - 08 Sept 2014 - NTT - High Performance vSwitch
DPDK Summit - 08 Sept 2014 - NTT - High Performance vSwitch
 
Monitoring federation open stack infrastructure
Monitoring federation open stack infrastructureMonitoring federation open stack infrastructure
Monitoring federation open stack infrastructure
 
Adding IEEE 802.15.4 and 6LoWPAN to an Embedded Linux Device
Adding IEEE 802.15.4 and 6LoWPAN to an Embedded Linux DeviceAdding IEEE 802.15.4 and 6LoWPAN to an Embedded Linux Device
Adding IEEE 802.15.4 and 6LoWPAN to an Embedded Linux Device
 
OVS and DPDK - T.F. Herbert, K. Traynor, M. Gray
OVS and DPDK - T.F. Herbert, K. Traynor, M. GrayOVS and DPDK - T.F. Herbert, K. Traynor, M. Gray
OVS and DPDK - T.F. Herbert, K. Traynor, M. Gray
 
OpenKilda: Stream Processing Meets Openflow
OpenKilda: Stream Processing Meets OpenflowOpenKilda: Stream Processing Meets Openflow
OpenKilda: Stream Processing Meets Openflow
 
Security defined routing_cybergamut_v1_1
Security defined routing_cybergamut_v1_1Security defined routing_cybergamut_v1_1
Security defined routing_cybergamut_v1_1
 
SF-TAP: Scalable and Flexible Traffic Analysis Platform (USENIX LISA 2015)
SF-TAP: Scalable and Flexible Traffic Analysis Platform (USENIX LISA 2015)SF-TAP: Scalable and Flexible Traffic Analysis Platform (USENIX LISA 2015)
SF-TAP: Scalable and Flexible Traffic Analysis Platform (USENIX LISA 2015)
 

More from Jisc

Jisc's value to HE: the University of Sheffield
Jisc's value to HE: the University of SheffieldJisc's value to HE: the University of Sheffield
Jisc's value to HE: the University of SheffieldJisc
 
Towards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxTowards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxJisc
 
Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jisc
 
Wellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptxWellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptxJisc
 
Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Jisc
 
Procuring digital preservation CAN be quick and painless with our new dynamic...
Procuring digital preservation CAN be quick and painless with our new dynamic...Procuring digital preservation CAN be quick and painless with our new dynamic...
Procuring digital preservation CAN be quick and painless with our new dynamic...Jisc
 
International students’ digital experience: understanding and mitigating the ...
International students’ digital experience: understanding and mitigating the ...International students’ digital experience: understanding and mitigating the ...
International students’ digital experience: understanding and mitigating the ...Jisc
 
Digital Storytelling Community Launch!.pptx
Digital Storytelling Community Launch!.pptxDigital Storytelling Community Launch!.pptx
Digital Storytelling Community Launch!.pptxJisc
 
Open Access book publishing understanding your options (1).pptx
Open Access book publishing understanding your options (1).pptxOpen Access book publishing understanding your options (1).pptx
Open Access book publishing understanding your options (1).pptxJisc
 
Scottish Universities Press supporting authors with requirements for open acc...
Scottish Universities Press supporting authors with requirements for open acc...Scottish Universities Press supporting authors with requirements for open acc...
Scottish Universities Press supporting authors with requirements for open acc...Jisc
 
How Bloomsbury is supporting authors with UKRI long-form open access requirem...
How Bloomsbury is supporting authors with UKRI long-form open access requirem...How Bloomsbury is supporting authors with UKRI long-form open access requirem...
How Bloomsbury is supporting authors with UKRI long-form open access requirem...Jisc
 
Jisc Northern Ireland Strategy Forum 2023
Jisc Northern Ireland Strategy Forum 2023Jisc Northern Ireland Strategy Forum 2023
Jisc Northern Ireland Strategy Forum 2023Jisc
 
Jisc Scotland Strategy Forum 2023
Jisc Scotland Strategy Forum 2023Jisc Scotland Strategy Forum 2023
Jisc Scotland Strategy Forum 2023Jisc
 
Jisc stakeholder strategic update 2023
Jisc stakeholder strategic update 2023Jisc stakeholder strategic update 2023
Jisc stakeholder strategic update 2023Jisc
 
JISC Presentation.pptx
JISC Presentation.pptxJISC Presentation.pptx
JISC Presentation.pptxJisc
 
Community-led Open Access Publishing webinar.pptx
Community-led Open Access Publishing webinar.pptxCommunity-led Open Access Publishing webinar.pptx
Community-led Open Access Publishing webinar.pptxJisc
 
The Open Access Community Framework (OACF) 2023 (1).pptx
The Open Access Community Framework (OACF) 2023 (1).pptxThe Open Access Community Framework (OACF) 2023 (1).pptx
The Open Access Community Framework (OACF) 2023 (1).pptxJisc
 
Are we onboard yet University of Sussex.pptx
Are we onboard yet University of Sussex.pptxAre we onboard yet University of Sussex.pptx
Are we onboard yet University of Sussex.pptxJisc
 
JiscOAWeek_LAIR_slides_October2023.pptx
JiscOAWeek_LAIR_slides_October2023.pptxJiscOAWeek_LAIR_slides_October2023.pptx
JiscOAWeek_LAIR_slides_October2023.pptxJisc
 
UWP OA Week Presentation (1).pptx
UWP OA Week Presentation (1).pptxUWP OA Week Presentation (1).pptx
UWP OA Week Presentation (1).pptxJisc
 

More from Jisc (20)

Jisc's value to HE: the University of Sheffield
Jisc's value to HE: the University of SheffieldJisc's value to HE: the University of Sheffield
Jisc's value to HE: the University of Sheffield
 
Towards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxTowards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptx
 
Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)
 
Wellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptxWellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptx
 
Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)
 
Procuring digital preservation CAN be quick and painless with our new dynamic...
Procuring digital preservation CAN be quick and painless with our new dynamic...Procuring digital preservation CAN be quick and painless with our new dynamic...
Procuring digital preservation CAN be quick and painless with our new dynamic...
 
International students’ digital experience: understanding and mitigating the ...
International students’ digital experience: understanding and mitigating the ...International students’ digital experience: understanding and mitigating the ...
International students’ digital experience: understanding and mitigating the ...
 
Digital Storytelling Community Launch!.pptx
Digital Storytelling Community Launch!.pptxDigital Storytelling Community Launch!.pptx
Digital Storytelling Community Launch!.pptx
 
Open Access book publishing understanding your options (1).pptx
Open Access book publishing understanding your options (1).pptxOpen Access book publishing understanding your options (1).pptx
Open Access book publishing understanding your options (1).pptx
 
Scottish Universities Press supporting authors with requirements for open acc...
Scottish Universities Press supporting authors with requirements for open acc...Scottish Universities Press supporting authors with requirements for open acc...
Scottish Universities Press supporting authors with requirements for open acc...
 
How Bloomsbury is supporting authors with UKRI long-form open access requirem...
How Bloomsbury is supporting authors with UKRI long-form open access requirem...How Bloomsbury is supporting authors with UKRI long-form open access requirem...
How Bloomsbury is supporting authors with UKRI long-form open access requirem...
 
Jisc Northern Ireland Strategy Forum 2023
Jisc Northern Ireland Strategy Forum 2023Jisc Northern Ireland Strategy Forum 2023
Jisc Northern Ireland Strategy Forum 2023
 
Jisc Scotland Strategy Forum 2023
Jisc Scotland Strategy Forum 2023Jisc Scotland Strategy Forum 2023
Jisc Scotland Strategy Forum 2023
 
Jisc stakeholder strategic update 2023
Jisc stakeholder strategic update 2023Jisc stakeholder strategic update 2023
Jisc stakeholder strategic update 2023
 
JISC Presentation.pptx
JISC Presentation.pptxJISC Presentation.pptx
JISC Presentation.pptx
 
Community-led Open Access Publishing webinar.pptx
Community-led Open Access Publishing webinar.pptxCommunity-led Open Access Publishing webinar.pptx
Community-led Open Access Publishing webinar.pptx
 
The Open Access Community Framework (OACF) 2023 (1).pptx
The Open Access Community Framework (OACF) 2023 (1).pptxThe Open Access Community Framework (OACF) 2023 (1).pptx
The Open Access Community Framework (OACF) 2023 (1).pptx
 
Are we onboard yet University of Sussex.pptx
Are we onboard yet University of Sussex.pptxAre we onboard yet University of Sussex.pptx
Are we onboard yet University of Sussex.pptx
 
JiscOAWeek_LAIR_slides_October2023.pptx
JiscOAWeek_LAIR_slides_October2023.pptxJiscOAWeek_LAIR_slides_October2023.pptx
JiscOAWeek_LAIR_slides_October2023.pptx
 
UWP OA Week Presentation (1).pptx
UWP OA Week Presentation (1).pptxUWP OA Week Presentation (1).pptx
UWP OA Week Presentation (1).pptx
 

Recently uploaded

PLAI - Acceleration Program for Generative A.I. Startups
PLAI - Acceleration Program for Generative A.I. StartupsPLAI - Acceleration Program for Generative A.I. Startups
PLAI - Acceleration Program for Generative A.I. StartupsStefano
 
AI revolution and Salesforce, Jiří Karpíšek
AI revolution and Salesforce, Jiří KarpíšekAI revolution and Salesforce, Jiří Karpíšek
AI revolution and Salesforce, Jiří KarpíšekCzechDreamin
 
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...CzechDreamin
 
Microsoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - QuestionnaireMicrosoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - QuestionnaireExakis Nelite
 
Using IESVE for Room Loads Analysis - UK & Ireland
Using IESVE for Room Loads Analysis - UK & IrelandUsing IESVE for Room Loads Analysis - UK & Ireland
Using IESVE for Room Loads Analysis - UK & IrelandIES VE
 
Designing for Hardware Accessibility at Comcast
Designing for Hardware Accessibility at ComcastDesigning for Hardware Accessibility at Comcast
Designing for Hardware Accessibility at ComcastUXDXConf
 
Salesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
Salesforce Adoption – Metrics, Methods, and Motivation, Antone KomSalesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
Salesforce Adoption – Metrics, Methods, and Motivation, Antone KomCzechDreamin
 
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo DiehlFuture Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo DiehlPeter Udo Diehl
 
Optimizing NoSQL Performance Through Observability
Optimizing NoSQL Performance Through ObservabilityOptimizing NoSQL Performance Through Observability
Optimizing NoSQL Performance Through ObservabilityScyllaDB
 
Demystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John StaveleyDemystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John StaveleyJohn Staveley
 
How we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdfHow we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdfSrushith Repakula
 
Breaking Down the Flutterwave Scandal What You Need to Know.pdf
Breaking Down the Flutterwave Scandal What You Need to Know.pdfBreaking Down the Flutterwave Scandal What You Need to Know.pdf
Breaking Down the Flutterwave Scandal What You Need to Know.pdfUK Journal
 
A Business-Centric Approach to Design System Strategy
A Business-Centric Approach to Design System StrategyA Business-Centric Approach to Design System Strategy
A Business-Centric Approach to Design System StrategyUXDXConf
 
Intro in Product Management - Коротко про професію продакт менеджера
Intro in Product Management - Коротко про професію продакт менеджераIntro in Product Management - Коротко про професію продакт менеджера
Intro in Product Management - Коротко про професію продакт менеджераMark Opanasiuk
 
Enterprise Knowledge Graphs - Data Summit 2024
Enterprise Knowledge Graphs - Data Summit 2024Enterprise Knowledge Graphs - Data Summit 2024
Enterprise Knowledge Graphs - Data Summit 2024Enterprise Knowledge
 
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdfHow Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdfFIDO Alliance
 
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdfLinux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdfFIDO Alliance
 
Free and Effective: Making Flows Publicly Accessible, Yumi Ibrahimzade
Free and Effective: Making Flows Publicly Accessible, Yumi IbrahimzadeFree and Effective: Making Flows Publicly Accessible, Yumi Ibrahimzade
Free and Effective: Making Flows Publicly Accessible, Yumi IbrahimzadeCzechDreamin
 
1111 ChatGPT Prompts PDF Free Download - Prompts for ChatGPT
1111 ChatGPT Prompts PDF Free Download - Prompts for ChatGPT1111 ChatGPT Prompts PDF Free Download - Prompts for ChatGPT
1111 ChatGPT Prompts PDF Free Download - Prompts for ChatGPTiSEO AI
 

Recently uploaded (20)

PLAI - Acceleration Program for Generative A.I. Startups
PLAI - Acceleration Program for Generative A.I. StartupsPLAI - Acceleration Program for Generative A.I. Startups
PLAI - Acceleration Program for Generative A.I. Startups
 
AI revolution and Salesforce, Jiří Karpíšek
AI revolution and Salesforce, Jiří KarpíšekAI revolution and Salesforce, Jiří Karpíšek
AI revolution and Salesforce, Jiří Karpíšek
 
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
Behind the Scenes From the Manager's Chair: Decoding the Secrets of Successfu...
 
Microsoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - QuestionnaireMicrosoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - Questionnaire
 
Using IESVE for Room Loads Analysis - UK & Ireland
Using IESVE for Room Loads Analysis - UK & IrelandUsing IESVE for Room Loads Analysis - UK & Ireland
Using IESVE for Room Loads Analysis - UK & Ireland
 
Overview of Hyperledger Foundation
Overview of Hyperledger FoundationOverview of Hyperledger Foundation
Overview of Hyperledger Foundation
 
Designing for Hardware Accessibility at Comcast
Designing for Hardware Accessibility at ComcastDesigning for Hardware Accessibility at Comcast
Designing for Hardware Accessibility at Comcast
 
Salesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
Salesforce Adoption – Metrics, Methods, and Motivation, Antone KomSalesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
Salesforce Adoption – Metrics, Methods, and Motivation, Antone Kom
 
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo DiehlFuture Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
 
Optimizing NoSQL Performance Through Observability
Optimizing NoSQL Performance Through ObservabilityOptimizing NoSQL Performance Through Observability
Optimizing NoSQL Performance Through Observability
 
Demystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John StaveleyDemystifying gRPC in .Net by John Staveley
Demystifying gRPC in .Net by John Staveley
 
How we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdfHow we scaled to 80K users by doing nothing!.pdf
How we scaled to 80K users by doing nothing!.pdf
 
Breaking Down the Flutterwave Scandal What You Need to Know.pdf
Breaking Down the Flutterwave Scandal What You Need to Know.pdfBreaking Down the Flutterwave Scandal What You Need to Know.pdf
Breaking Down the Flutterwave Scandal What You Need to Know.pdf
 
A Business-Centric Approach to Design System Strategy
A Business-Centric Approach to Design System StrategyA Business-Centric Approach to Design System Strategy
A Business-Centric Approach to Design System Strategy
 
Intro in Product Management - Коротко про професію продакт менеджера
Intro in Product Management - Коротко про професію продакт менеджераIntro in Product Management - Коротко про професію продакт менеджера
Intro in Product Management - Коротко про професію продакт менеджера
 
Enterprise Knowledge Graphs - Data Summit 2024
Enterprise Knowledge Graphs - Data Summit 2024Enterprise Knowledge Graphs - Data Summit 2024
Enterprise Knowledge Graphs - Data Summit 2024
 
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdfHow Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
How Red Hat Uses FDO in Device Lifecycle _ Costin and Vitaliy at Red Hat.pdf
 
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdfLinux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
Linux Foundation Edge _ Overview of FDO Software Components _ Randy at Intel.pdf
 
Free and Effective: Making Flows Publicly Accessible, Yumi Ibrahimzade
Free and Effective: Making Flows Publicly Accessible, Yumi IbrahimzadeFree and Effective: Making Flows Publicly Accessible, Yumi Ibrahimzade
Free and Effective: Making Flows Publicly Accessible, Yumi Ibrahimzade
 
1111 ChatGPT Prompts PDF Free Download - Prompts for ChatGPT
1111 ChatGPT Prompts PDF Free Download - Prompts for ChatGPT1111 ChatGPT Prompts PDF Free Download - Prompts for ChatGPT
1111 ChatGPT Prompts PDF Free Download - Prompts for ChatGPT
 

Janet-hosted test tools

  • 1. Janet-hosted test tools Duncan Rand Research Network Engineering Meeting Online, 9th December 2022
  • 2. Testing connectivity RNE - Janet-hosted test tools • What we provide: • Ad hoc throughput testing with iperf3 or ethr • Collecting measurements of network characteristics over time with perfSONAR; allows historic comparisons and analysis (for changes) • Ad hoc disk to disk copying to/from data transfer nodes (DTN) • Librespeed browser-based test tool • A RIPE Atlas anchor, for bespoke RIPE Atlas tests • Note: our NOC have additional tools, such as hardware line testers
  • 3. Ad-hoc throughput testing: iperf3 RNE - Janet-hosted test tools • There is a 10G iperf3 server at the Jisc Slough data centre: iperf-slough-10g.perf.ja.net (accessible over both IPv4 and IPv6) • Will have a 100G iperf server which will be available on request • iperf3 software installation: • CentOS7: sudo yum install iperf3 • Using from Windows • Microsoft guide to iperf usage • Compiling iperf/iperf3 from source • Example of Windows usage
  • 4. Example of using iperf3 (from a MacBook) RNE - Janet-hosted test tools $ iperf3 -4 -t 4 -c iperf-slough-10g.perf.ja.net Connecting to host iperf-slough-10g.perf.ja.net, port 5201 [ 6] local 192.168.1.128 port 54403 connected to 194.81.18.231 port 5201 [ ID] Interval Transfer Bitrate [ 6] 0.00-1.00 sec 2.49 MBytes 20.9 Mbits/sec [ 6] 1.00-2.00 sec 2.24 MBytes 18.8 Mbits/sec [ 6] 2.00-3.00 sec 2.26 MBytes 19.0 Mbits/sec [ 6] 3.00-4.00 sec 2.21 MBytes 18.5 Mbits/sec - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate [ 6] 0.00-4.00 sec 9.20 MBytes 19.3 Mbits/sec sender [ 6] 0.00-4.00 sec 8.98 MBytes 18.8 Mbits/sec receiver iperf Done. • Add –R to reverse the direction • iperf (rather than iperf3) works better with multiple streams
  • 5. Ad-hoc throughput testing: ethr • ethr is a “comprehensive network measurement tool for TCP, UDP & ICMP” from Microsoft • Natively cross platform thanks to golang • Available for CentOS7 with ‘snap’ & installed on our 10G server at Slough $ ethr -d 4s -c iperf-slough-10g.perf.ja.net Connecting to host [2001:630:3c:f803::12], port 9999 [ 6] local 2001:630:3c:f803::6 port 51706 connected to 2001:630:3c:f803::12 port 9999 - - - - - - - - - - - - - - - - - - - - - - - [ ID] Protocol Interval Bits/s [ 6] TCP 000-001 sec 6.67G [ 6] TCP 001-002 sec 9.77G [ 6] TCP 002-003 sec 7.49G [ 6] TCP 003-004 sec 9.45G Ethr done, duration: 4s. RNE - Janet-hosted test tools
  • 6. Persistent measurement over time: perfSONAR RNE - Janet-hosted test tools • Free, open source: https://www.perfsonar.net • Easy to download and install on CentOS7 (and Debian) • Very useful to have persistent testing: collect history of network characteristics – throughput, loss, latency, path • Test against our 10Gbps node in the Jisc Slough data centre • Bandwidth: https://ps-slough-10g.perf.ja.net • Latency: https://ps-slough-1g.perf.ja.net • We also are testing 1Gbps small nodes (including RPi) and Docker versions • We have a GÉANT PMP small node (Gigabyte Brix): • https://pmp-central.geant.org/maddash-webui/
  • 7. Persistent measurement over time: 100G perfSONAR RNE - Janet-hosted test tools • We have installed a 100G perfSONAR host in London • Available for on demand testing • Added it to the WLCG 100G mesh • After some tuning it shows rates up to about 15 Gb/s with one stream to several pS nodes around the world • Bandwidth https://ps-london-bw.perf.ja.net • Latency: https://ps-london-bw.perf.ja.net • Uses 9000 MTU
  • 8. 10G Data Transfer Node (DTN) & Globus endpoint RNE - Janet-hosted test tools •We have a DTN in the Jisc Slough data centre: dtn-slough-10g.perf.ja.net (dual-stack) •A number of files are available: 1M.dat, 2M.dat, 10M.dat, 50M.dat, 1G.dat, 10G.dat, 20G.dat, 100G.dat, 1000G.dat accessible with globus-url-copy •Can copy to /dev/null or to the file system, e.g. copying a 10GB file to /dev/null $ globus-url-copy -vb ftp://dtn-slough-10g.perf.ja.net:2811/space00/10G.dat /dev/null •There is also a directory with 100 x 1GB files for more sustained testing: $ globus-url-copy -r -vb ftp://dtn-slough-10g.perf.ja.net:2811/space00/small/ file:///tmp/
  • 9. 100G Data Transfer Node (DTN) & Globus endpoint RNE - Janet-hosted test tools •We are installing a 100G DTN facility in the Jisc London centre •This will use a distributed files system – most likely Ceph or BeeGFS with multiple DTNs •One goal is to provide a Globus endpoint to enable Janet connected sites to test their own Globus endpoints up to 100G •However, other transfer tools can be made available on request to netperf@jisc.ac.uk
  • 10. Browser-based speed tests The devil you know! •Easy to use, familiar to most of us •Provide a useful first assessment from a browser •But often not accurate and generally have a limited performance •Generally insufficient to demonstrate full connectivity •We have installed a Librespeed instance as it allows us to offer this service from facilities that we control and understand •We will publish it with appropriate text about its limitations •People will be directed to contact us for iperf or perfSONAR tests and advice •Planning to include a URL for test results, and a CLI/API to the tool RNE - Janet-hosted test tools
  • 11. Librespeed instance Likely to be at https://speedtest.perf.ja.net RNE - Janet-hosted test tools https://github.com/librespeed/speedtest
  • 12. RIPE Atlas anchor •See https://atlas.ripe.net/ •Supports measurements from RIPE Atlas nodes •Hardware (available from RIPE) or software probes •The RIPE Atlas ecosystem is mature •Over 11,000 probes around the world •Our anchor node is deployed at Slough •See https://atlas.ripe.net/probes/6695/ •Useful for loss and latency, but can do more bespoke tests RNE - Janet-hosted test tools
  • 13. Open questions •What performance problems are you facing? •What help might Jisc be able to provide? •What other backbone-hosted tools would be useful for you? •Any other suggestions for areas we should be covering? •WiFi performance? •Residential quality of experience (to campus and cloud)? •Low latency (and jitter) applications? •Experiments with (say) TCP BBR, or 9000 MTU? •Disk to disk testing at >100G RNE - Janet-hosted test tools
  • 14. Thank you •Please feel free to get in touch •Email: netperf@jiscmail.ac.uk RNE - Janet-hosted test tools