TransPAC3/ACE Measurement & PerfSONAR Update


Published on

Published in: Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

TransPAC3/ACE Measurement & PerfSONAR Update

  1. 1. TP3/ACE measurementandperfSONAR update<br />John Hicks<br />International Networking<br />Indiana University<br /><br />
  2. 2. Overview<br /><ul><li>PerfSONAR & IRIS & DyGIR
  3. 3. ARK project
  4. 4. Network Services</li></ul>DLT & High Performance storage/transfer hosts<br /><ul><li>TransPAC3 update
  5. 5. ACE update</li></li></ul><li>Perfsonar<br />Current versions<br />perfSONAR-PS (PS-PS) v3.2<br />perfSONAR MDM v3.3 (Java) <br />The following ideas are potential longer term roadmap issues<br />Circuit Monitoring <br />Lookup service enhancements (higher performance, integration of misc other metrics, utilize new summarization algorithm, etc.) <br />Cross domain latency variation visualization tools <br />End-to-End path visualization tools that integrate multiple measurements (ping, traceroute, partial path bwctl, etc) <br />Alarm/notification generation & management<br />Authentication & Authorization (AA)<br />
  6. 6. Perfsonar<br />Here is a suggested list of baseline data that networks should make available:<br />Ping (round-trip latency)<br />OWAMP (One-way latency)<br />BWCTL/IPERF (TCP Throughput)
Traceroute<br />SNMP (Utilization, Errors)<br />Link-Status (Up/Down, AdminUp, AdminDown)<br />Circuit-Status (Logical mapping of multi-domain)<br />
  7. 7. PerfSonar<br />Here is a recommended list of tools to have available in an on-demand diagnostic sense:<br />Reverse-Ping (round-trip latency)<br />OWAMP (One-way latency)<br />BWCTL/IPERF (TCP Throughput)<br />Reverse-Traceroute<br />The set of Metrics and on-demand diagnostic tools for specific networks will vary based on the type of infrastructure they are providing. For example, some will not have the ability to inject traffic into the networks they are providing which would make the active tools unavailable.<br />
  8. 8. Dynamic Circuits<br />Internet2 is engaged in standardization effort within the Open Grid Forum (OGF)<br />NSI WG (signal circuit creation)<br />NML WG (topology support of circuits and monitoring)<br />NMC WG (performance middleware)<br />NM WG (measurement definition)<br />Internet2 is engaged in GLIF experimental networks<br />perfSONAR Demos<br />Automated GOLE Demos<br />
  9. 9. IRIS & DYGir<br />Internet2 is engaged in a common service definition of a dynamic circuit networking service with DICE partners.<br />Internet2 plans to deploy and operate a separate IDC instance at MAN LAN in 2011<br />Built with OSCARS/DRAGON over Ciena Core Director, perfSONAR‐ps<br />Three NSF awards of interest (total $3.5 million)<br />IRIS (International Research Instrumentation System): develop perfSONAR‐ps based performance monitoring package for use by IRNC PRONET awardees (~$1 million)<br />DyGIR (Dynamic Gateways for International Research): develop OSCARS (and DRAGON) based dynamic circuit networking package for use by IRNC PRONET awardees (~$750k)<br />DYNES: develop OSCARS (DRAGON) and perfSONAR‐ps based distributed virtual<br />
  10. 10. IRIS<br />Objective: provide the infrastructure necessary for the identification, diagnosis and eventual correction of network performance problems for paths traversing IRNC links<br />IRIS will provide a software framework to enable performance monitoring services on IRNC links<br />Produce a set of easy‐to‐install, tailored software packages of the perfSONAR‐PS software suite for use by the IRNC link operators<br />Develop new functionality specific to international exchange points<br />Work with the IRNC link awardees to help them deploy the software<br />
  11. 11. DyGir<br />Objective: enable researchers to reserve dedicated bandwidth over IRNC links<br /> Allow for more distributed collaboration<br />DyGIR will provide a prototype software framework to enable dynamic circuit services for a pair of IRNC links<br />Produce a set of easy‐to‐install, tailored software packages for the OSCARS software suite<br />Prototype new functionality specific to international exchange points<br />Work with 2+ of the IRNC link awardees to help them deploy the prototype software<br />
  12. 12. Archipelago (Ark) <br />CAIDA’s measurement infrastructure<br />Built on decade of achievements, from SIGCOMM to MOMA <br />Launch 12 Sept 2007<br />54 active IPv4 probers<br />18 in US<br />16 active IPv6 probers<br />collaborators can run vetted measurements on security-hardened platform<br />publish analyses of views from individual monitors<br />support for meta-data mgt, analysis, and infoviz<br />
  13. 13. summary of the expected traffic <br />Outgoing: <br />ntp (123/udp) to your local NTP server, to CAIDA's NTP server, or to the nearest NTP Pool server<br />dns (53/udp) to your local DNS server(s) or to CAIDA's DNS server<br />TCP connection to CAIDA's tuple-space server from any local (ephemeral) port (for Ark's tuple space communication)<br />ICMP echo request, echo reply, port unreachable to any host (for ICMP-based topology measurements to and from the monitor)<br />no ICMP rate limiting<br />UDP probes from any local port to any host and any port (for UDP-based topology measurements from the monitor)<br />TCP probes from any local port to any host and any port regardless of connection state (for non-SYN based TCP measurements such as sending a TCP ACK probe, which won't establish a connection nor be part of an existing connection)<br />Incoming: <br />NTP and DNS responses<br />ssh (22/tcp) from only CAIDA's /24 prefix<br />ICMP echo request, echo reply, time exceeded, and destination unreachable (type 3, code any) from any host<br />no ICMP rate limiting<br />TCP packets (SYN, ACK, RST, etc.) from any host and any port regardless of connection state (for TCP-based topology measurements)<br />
  14. 14. Active Measurements<br /><ul><li>IPv4 Routed /24 Topology (and AS Links)
  15. 15. IPv6 Topology
  16. 16. DNS Names & Query/Response Traffic
  17. 17. Alias Resolution
  18. 18. All measurements are active probes with low rate of probing.</li></li></ul><li>Data: IPv4 Routed /24 Topology<br />Ongoing large-scale topology measurements<br />ICMP Paris traceroute to every routed /24 (8.25 million)<br />about 126 /8-equivalents of routed space (as of Oct 2009)<br />running scamper<br />written by Matthew Luckie of WAND, University of Waikato<br />Dynamically divide up the measurement work among members of monitor teams<br />3 teams active<br />13-member team probes every /24 in 2-3 days at 100pps<br />only one monitor probes each /24 per cycle (=one pass through all /24’s)<br />
  19. 19. Other Links<br />IRNC-SP: Sustainable data-handling and analysis methodologies for the IRNC networks<br />Archipelago (Ark) network measurement platform<br />Archipelago Monitor Statistics<br />Please send questions and comments to<br />
  20. 20. Network Services<br />TransPAC3 & ACE will provide high performance (HP) research & education network connectivity between the US, Asia, & Europe.<br />We want to do more:<br />Develop documentation to increase the ease of use<br />Dedicated infrastructure for data movement<br />Install HP data movers in PoP’s<br />Through IRIS & DyGIR we will provide advanced monitoring and dynamic circuit services<br />
  21. 21. Data Logistics Toolkit (DLT)<br />The Data Logistics Toolkit (DLT) integrates a set of storage and networking technologies to create WAN-enabled storage nodes that can dramatically improve the ability of data intensive research communities to collaborate in the wide area. A key DLT service is implementing a global “drop box” that supports automatic data postitioning. This will enable automation and optimization of rapid movement and timely placement of data, across a wide range of scenarios, through policy-controlled sharing, replication, caching, control loop optimization and overlay multicast. The DLT's global data system will help collaborators leverage the tremendous power of the international fabric of Research and Education (R&E) networks, encircling the globe and enabling unprecented potential for collaboration. <br />
  22. 22. Dlt (Cont.)<br />The DLT is comprised of various software systems: <br />IBP: The Internet Backplane Protocol allows for the creation of storage “depots” throughout the network. This software, along with file managers like L-Store and LoDN, powers the NSF-funded Research and Education Data Depot Network (REDDnet). REDDnet is a funded set of storage infrastructure in the US (and at CERN in support of the LHC). The goal of the DLT is to broaden the participation in this infrastructure as well as to make logistical storage available internationally.<br />perfSONAR: perfSONAR is a network measurement and topology system that can monitor and optimize the DLT network. The perfSONAR system has been jointly developed by an international consortium of R&E networks and researchers and is the center of a growing community interested in making networks more effective.<br />Phoebus: Phoebus is a session-layer based network “inlay” that optimizes end-to-end throughput for high-demand applications and users. Phoebus can dynamically allocate circuits from systems such as Internet2’s ION and GÉANT’s AutoBAHN.<br />UNIS: The Unified Network Information Service stems from the perfSONAR Lookup and Topology Services and is now used by the OSCARS interdomain controller (IDC) software, which underlies Internet2’s ION and the ESnet OSCARS service for dynamic circuits. It is a key part of the DLT’s discovery and coordination service.<br />
  23. 23. Dlt (Cont.)<br />The DLT will be implemented on TransPAC3.<br />Disk arrays will be installed at the current circuit landing points in Los Angeles and Tokyo. This along with dynamic circuit technologies will provide a foundation for collaborative activities between researchers in the US and the AP Region.<br />Similar plans are being worked on between the US and Europe and will be implemented when the ACE circuits are in place. <br />
  24. 24. ACE/TransPAC3 update<br />
  25. 25. TransPAC2<br />
  26. 26. TransPAC3 (TP3) update<br />TP3 will look similar to TP2<br />Install MX480<br />Upgrade existing (1 & 10 Gig) hosts<br />Install more 10G host in cooperation with KDDI<br />Install DLT resources<br />Continue support of perfSONAR & Dynamic Circuit services<br />
  27. 27. TransPAC3 (TP3) update<br />ACE will provide new R&E connectivity between the US & Europe<br />Install (1 & 10 Gig) hosts<br />Install DLT resources<br />Continue support of perfSONAR & Dynamic Circuit service<br />Work with the DICE group to integrate authentication & authorization (AA) services<br />Modular approach with OSCARS 0.6 (Target Q2,2011)<br />Work with the DICE group to design a system compatible with the ESnet Science Data Network, the Internet2 ION Service, and GÉANT’s Autobahn virtual circuit services <br />
  28. 28. Questions<br />John Hicks<br />Indiana University<br /><br />