TP3/ACE measurementandperfSONAR update John Hicks International Networking Indiana University firstname.lastname@example.org
PerfSONAR & IRIS & DyGIR
DLT & High Performance storage/transfer hosts
Perfsonar Current versions perfSONAR-PS (PS-PS) v3.2 perfSONAR MDM v3.3 (Java) The following ideas are potential longer term roadmap issues Circuit Monitoring Lookup service enhancements (higher performance, integration of misc other metrics, utilize new summarization algorithm, etc.) Cross domain latency variation visualization tools End-to-End path visualization tools that integrate multiple measurements (ping, traceroute, partial path bwctl, etc) Alarm/notification generation & management Authentication & Authorization (AA)
Perfsonar Here is a suggested list of baseline data that networks should make available: Ping (round-trip latency) OWAMP (One-way latency) BWCTL/IPERF (TCP Throughput) Traceroute SNMP (Utilization, Errors) Link-Status (Up/Down, AdminUp, AdminDown) Circuit-Status (Logical mapping of multi-domain)
PerfSonar Here is a recommended list of tools to have available in an on-demand diagnostic sense: Reverse-Ping (round-trip latency) OWAMP (One-way latency) BWCTL/IPERF (TCP Throughput) Reverse-Traceroute The set of Metrics and on-demand diagnostic tools for specific networks will vary based on the type of infrastructure they are providing. For example, some will not have the ability to inject traffic into the networks they are providing which would make the active tools unavailable.
Dynamic Circuits Internet2 is engaged in standardization effort within the Open Grid Forum (OGF) NSI WG (signal circuit creation) NML WG (topology support of circuits and monitoring) NMC WG (performance middleware) NM WG (measurement definition) Internet2 is engaged in GLIF experimental networks perfSONAR Demos Automated GOLE Demos
IRIS & DYGir Internet2 is engaged in a common service definition of a dynamic circuit networking service with DICE partners. Internet2 plans to deploy and operate a separate IDC instance at MAN LAN in 2011 Built with OSCARS/DRAGON over Ciena Core Director, perfSONAR‐ps Three NSF awards of interest (total $3.5 million) IRIS (International Research Instrumentation System): develop perfSONAR‐ps based performance monitoring package for use by IRNC PRONET awardees (~$1 million) DyGIR (Dynamic Gateways for International Research): develop OSCARS (and DRAGON) based dynamic circuit networking package for use by IRNC PRONET awardees (~$750k) DYNES: develop OSCARS (DRAGON) and perfSONAR‐ps based distributed virtual
IRIS Objective: provide the infrastructure necessary for the identification, diagnosis and eventual correction of network performance problems for paths traversing IRNC links IRIS will provide a software framework to enable performance monitoring services on IRNC links Produce a set of easy‐to‐install, tailored software packages of the perfSONAR‐PS software suite for use by the IRNC link operators Develop new functionality specific to international exchange points Work with the IRNC link awardees to help them deploy the software
DyGir Objective: enable researchers to reserve dedicated bandwidth over IRNC links Allow for more distributed collaboration DyGIR will provide a prototype software framework to enable dynamic circuit services for a pair of IRNC links Produce a set of easy‐to‐install, tailored software packages for the OSCARS software suite Prototype new functionality specific to international exchange points Work with 2+ of the IRNC link awardees to help them deploy the prototype software
Archipelago (Ark) CAIDA’s measurement infrastructure Built on decade of achievements, from SIGCOMM to MOMA Launch 12 Sept 2007 54 active IPv4 probers 18 in US 16 active IPv6 probers collaborators can run vetted measurements on security-hardened platform publish analyses of views from individual monitors support for meta-data mgt, analysis, and infoviz
summary of the expected traffic Outgoing: ntp (123/udp) to your local NTP server, to CAIDA's NTP server, or to the nearest NTP Pool server dns (53/udp) to your local DNS server(s) or to CAIDA's DNS server TCP connection to CAIDA's tuple-space server from any local (ephemeral) port (for Ark's tuple space communication) ICMP echo request, echo reply, port unreachable to any host (for ICMP-based topology measurements to and from the monitor) no ICMP rate limiting UDP probes from any local port to any host and any port (for UDP-based topology measurements from the monitor) TCP probes from any local port to any host and any port regardless of connection state (for non-SYN based TCP measurements such as sending a TCP ACK probe, which won't establish a connection nor be part of an existing connection) Incoming: NTP and DNS responses ssh (22/tcp) from only CAIDA's /24 prefix ICMP echo request, echo reply, time exceeded, and destination unreachable (type 3, code any) from any host no ICMP rate limiting TCP packets (SYN, ACK, RST, etc.) from any host and any port regardless of connection state (for TCP-based topology measurements)
IPv4 Routed /24 Topology (and AS Links)
DNS Names & Query/Response Traffic
All measurements are active probes with low rate of probing.
Data: IPv4 Routed /24 Topology Ongoing large-scale topology measurements ICMP Paris traceroute to every routed /24 (8.25 million) about 126 /8-equivalents of routed space (as of Oct 2009) running scamper written by Matthew Luckie of WAND, University of Waikato Dynamically divide up the measurement work among members of monitor teams 3 teams active 13-member team probes every /24 in 2-3 days at 100pps only one monitor probes each /24 per cycle (=one pass through all /24’s)
Other Links IRNC-SP: Sustainable data-handling and analysis methodologies for the IRNC networks http://www.caida.org/funding/irnc/ Archipelago (Ark) network measurement platformhttp://www.caida.org/projects/ark/ Archipelago Monitor Statisticshttp://www.caida.org/projects/ark/statistics/ Please send questions and comments to email@example.com.
Network Services TransPAC3 & ACE will provide high performance (HP) research & education network connectivity between the US, Asia, & Europe. We want to do more: Develop documentation to increase the ease of use Dedicated infrastructure for data movement Install HP data movers in PoP’s Through IRIS & DyGIR we will provide advanced monitoring and dynamic circuit services
Data Logistics Toolkit (DLT) The Data Logistics Toolkit (DLT) integrates a set of storage and networking technologies to create WAN-enabled storage nodes that can dramatically improve the ability of data intensive research communities to collaborate in the wide area. A key DLT service is implementing a global “drop box” that supports automatic data postitioning. This will enable automation and optimization of rapid movement and timely placement of data, across a wide range of scenarios, through policy-controlled sharing, replication, caching, control loop optimization and overlay multicast. The DLT's global data system will help collaborators leverage the tremendous power of the international fabric of Research and Education (R&E) networks, encircling the globe and enabling unprecented potential for collaboration.
Dlt (Cont.) The DLT is comprised of various software systems: IBP: The Internet Backplane Protocol allows for the creation of storage “depots” throughout the network. This software, along with file managers like L-Store and LoDN, powers the NSF-funded Research and Education Data Depot Network (REDDnet). REDDnet is a funded set of storage infrastructure in the US (and at CERN in support of the LHC). The goal of the DLT is to broaden the participation in this infrastructure as well as to make logistical storage available internationally. perfSONAR: perfSONAR is a network measurement and topology system that can monitor and optimize the DLT network. The perfSONAR system has been jointly developed by an international consortium of R&E networks and researchers and is the center of a growing community interested in making networks more effective. Phoebus: Phoebus is a session-layer based network “inlay” that optimizes end-to-end throughput for high-demand applications and users. Phoebus can dynamically allocate circuits from systems such as Internet2’s ION and GÉANT’s AutoBAHN. UNIS: The Unified Network Information Service stems from the perfSONAR Lookup and Topology Services and is now used by the OSCARS interdomain controller (IDC) software, which underlies Internet2’s ION and the ESnet OSCARS service for dynamic circuits. It is a key part of the DLT’s discovery and coordination service.
Dlt (Cont.) The DLT will be implemented on TransPAC3. Disk arrays will be installed at the current circuit landing points in Los Angeles and Tokyo. This along with dynamic circuit technologies will provide a foundation for collaborative activities between researchers in the US and the AP Region. Similar plans are being worked on between the US and Europe and will be implemented when the ACE circuits are in place.
TransPAC3 (TP3) update TP3 will look similar to TP2 Install MX480 Upgrade existing (1 & 10 Gig) hosts Install more 10G host in cooperation with KDDI Install DLT resources Continue support of perfSONAR & Dynamic Circuit services
TransPAC3 (TP3) update ACE will provide new R&E connectivity between the US & Europe Install (1 & 10 Gig) hosts Install DLT resources Continue support of perfSONAR & Dynamic Circuit service Work with the DICE group to integrate authentication & authorization (AA) services Modular approach with OSCARS 0.6 (Target Q2,2011) Work with the DICE group to design a system compatible with the ESnet Science Data Network, the Internet2 ION Service, and GÉANT’s Autobahn virtual circuit services
Questions John Hicks Indiana University firstname.lastname@example.org