Your SlideShare is downloading. ×
TransPAC3/ACE Measurement & PerfSONAR Update
Upcoming SlideShare
Loading in...5

Thanks for flagging this SlideShare!

Oops! An error has occurred.

Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

TransPAC3/ACE Measurement & PerfSONAR Update


Published on

Published in: Technology

  • Be the first to comment

  • Be the first to like this

No Downloads
Total Views
On Slideshare
From Embeds
Number of Embeds
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

No notes for slide


  • 1. TP3/ACE measurementandperfSONAR update
    John Hicks
    International Networking
    Indiana University
  • 2. Overview
    • PerfSONAR & IRIS & DyGIR
    • 3. ARK project
    • 4. Network Services
    DLT & High Performance storage/transfer hosts
    • TransPAC3 update
    • 5. ACE update
  • Perfsonar
    Current versions
    perfSONAR-PS (PS-PS) v3.2
    perfSONAR MDM v3.3 (Java)
    The following ideas are potential longer term roadmap issues
    Circuit Monitoring
    Lookup service enhancements (higher performance, integration of misc other metrics, utilize new summarization algorithm, etc.)
    Cross domain latency variation visualization tools
    End-to-End path visualization tools that integrate multiple measurements (ping, traceroute, partial path bwctl, etc)
    Alarm/notification generation & management
    Authentication & Authorization (AA)
  • 6. Perfsonar
    Here is a suggested list of baseline data that networks should make available:
    Ping (round-trip latency)
    OWAMP (One-way latency)
    BWCTL/IPERF (TCP Throughput)
    SNMP (Utilization, Errors)
    Link-Status (Up/Down, AdminUp, AdminDown)
    Circuit-Status (Logical mapping of multi-domain)
  • 7. PerfSonar
    Here is a recommended list of tools to have available in an on-demand diagnostic sense:
    Reverse-Ping (round-trip latency)
    OWAMP (One-way latency)
    BWCTL/IPERF (TCP Throughput)
    The set of Metrics and on-demand diagnostic tools for specific networks will vary based on the type of infrastructure they are providing. For example, some will not have the ability to inject traffic into the networks they are providing which would make the active tools unavailable.
  • 8. Dynamic Circuits
    Internet2 is engaged in standardization effort within the Open Grid Forum (OGF)
    NSI WG (signal circuit creation)
    NML WG (topology support of circuits and monitoring)
    NMC WG (performance middleware)
    NM WG (measurement definition)
    Internet2 is engaged in GLIF experimental networks
    perfSONAR Demos
    Automated GOLE Demos
  • 9. IRIS & DYGir
    Internet2 is engaged in a common service definition of a dynamic circuit networking service with DICE partners.
    Internet2 plans to deploy and operate a separate IDC instance at MAN LAN in 2011
    Built with OSCARS/DRAGON over Ciena Core Director, perfSONAR‐ps
    Three NSF awards of interest (total $3.5 million)
    IRIS (International Research Instrumentation System): develop perfSONAR‐ps based performance monitoring package for use by IRNC PRONET awardees (~$1 million)
    DyGIR (Dynamic Gateways for International Research): develop OSCARS (and DRAGON) based dynamic circuit networking package for use by IRNC PRONET awardees (~$750k)
    DYNES: develop OSCARS (DRAGON) and perfSONAR‐ps based distributed virtual
  • 10. IRIS
    Objective: provide the infrastructure necessary for the identification, diagnosis and eventual correction of network performance problems for paths traversing IRNC links
    IRIS will provide a software framework to enable performance monitoring services on IRNC links
    Produce a set of easy‐to‐install, tailored software packages of the perfSONAR‐PS software suite for use by the IRNC link operators
    Develop new functionality specific to international exchange points
    Work with the IRNC link awardees to help them deploy the software
  • 11. DyGir
    Objective: enable researchers to reserve dedicated bandwidth over IRNC links
    Allow for more distributed collaboration
    DyGIR will provide a prototype software framework to enable dynamic circuit services for a pair of IRNC links
    Produce a set of easy‐to‐install, tailored software packages for the OSCARS software suite
    Prototype new functionality specific to international exchange points
    Work with 2+ of the IRNC link awardees to help them deploy the prototype software
  • 12. Archipelago (Ark)
    CAIDA’s measurement infrastructure
    Built on decade of achievements, from SIGCOMM to MOMA
    Launch 12 Sept 2007
    54 active IPv4 probers
    18 in US
    16 active IPv6 probers
    collaborators can run vetted measurements on security-hardened platform
    publish analyses of views from individual monitors
    support for meta-data mgt, analysis, and infoviz
  • 13. summary of the expected traffic
    ntp (123/udp) to your local NTP server, to CAIDA's NTP server, or to the nearest NTP Pool server
    dns (53/udp) to your local DNS server(s) or to CAIDA's DNS server
    TCP connection to CAIDA's tuple-space server from any local (ephemeral) port (for Ark's tuple space communication)
    ICMP echo request, echo reply, port unreachable to any host (for ICMP-based topology measurements to and from the monitor)
    no ICMP rate limiting
    UDP probes from any local port to any host and any port (for UDP-based topology measurements from the monitor)
    TCP probes from any local port to any host and any port regardless of connection state (for non-SYN based TCP measurements such as sending a TCP ACK probe, which won't establish a connection nor be part of an existing connection)
    NTP and DNS responses
    ssh (22/tcp) from only CAIDA's /24 prefix
    ICMP echo request, echo reply, time exceeded, and destination unreachable (type 3, code any) from any host
    no ICMP rate limiting
    TCP packets (SYN, ACK, RST, etc.) from any host and any port regardless of connection state (for TCP-based topology measurements)
  • 14. Active Measurements
    • IPv4 Routed /24 Topology (and AS Links)
    • 15. IPv6 Topology
    • 16. DNS Names & Query/Response Traffic
    • 17. Alias Resolution
    • 18. All measurements are active probes with low rate of probing.
  • Data: IPv4 Routed /24 Topology
    Ongoing large-scale topology measurements
    ICMP Paris traceroute to every routed /24 (8.25 million)
    about 126 /8-equivalents of routed space (as of Oct 2009)
    running scamper
    written by Matthew Luckie of WAND, University of Waikato
    Dynamically divide up the measurement work among members of monitor teams
    3 teams active
    13-member team probes every /24 in 2-3 days at 100pps
    only one monitor probes each /24 per cycle (=one pass through all /24’s)
  • 19. Other Links
    IRNC-SP: Sustainable data-handling and analysis methodologies for the IRNC networks
    Archipelago (Ark) network measurement platform
    Archipelago Monitor Statistics
    Please send questions and comments to
  • 20. Network Services
    TransPAC3 & ACE will provide high performance (HP) research & education network connectivity between the US, Asia, & Europe.
    We want to do more:
    Develop documentation to increase the ease of use
    Dedicated infrastructure for data movement
    Install HP data movers in PoP’s
    Through IRIS & DyGIR we will provide advanced monitoring and dynamic circuit services
  • 21. Data Logistics Toolkit (DLT)
    The Data Logistics Toolkit (DLT) integrates a set of storage and networking technologies to create WAN-enabled storage nodes that can dramatically improve the ability of data intensive research communities to collaborate in the wide area. A key DLT service is implementing a global “drop box” that supports automatic data postitioning. This will enable automation and optimization of rapid movement and timely placement of data, across a wide range of scenarios, through policy-controlled sharing, replication, caching, control loop optimization and overlay multicast. The DLT's global data system will help collaborators leverage the tremendous power of the international fabric of Research and Education (R&E) networks, encircling the globe and enabling unprecented potential for collaboration.
  • 22. Dlt (Cont.)
    The DLT is comprised of various software systems: 
    IBP: The Internet Backplane Protocol allows for the creation of storage “depots” throughout the network. This software, along with file managers like L-Store and LoDN, powers the NSF-funded Research and Education Data Depot Network (REDDnet). REDDnet is a funded set of storage infrastructure in the US (and at CERN in support of the LHC). The goal of the DLT is to broaden the participation in this infrastructure as well as to make logistical storage available internationally.
    perfSONAR: perfSONAR is a network measurement and topology system that can monitor and optimize the DLT network. The perfSONAR system has been jointly developed by an international consortium of R&E networks and researchers and is the center of a growing community interested in making networks more effective.
    Phoebus: Phoebus is a session-layer based network “inlay” that optimizes end-to-end throughput for high-demand applications and users. Phoebus can dynamically allocate circuits from systems such as Internet2’s ION and GÉANT’s AutoBAHN.
    UNIS: The Unified Network Information Service stems from the perfSONAR Lookup and Topology Services and is now used by the OSCARS interdomain controller (IDC) software, which underlies Internet2’s ION and the ESnet OSCARS service for dynamic circuits. It is a key part of the DLT’s discovery and coordination service.
  • 23. Dlt (Cont.)
    The DLT will be implemented on TransPAC3.
    Disk arrays will be installed at the current circuit landing points in Los Angeles and Tokyo. This along with dynamic circuit technologies will provide a foundation for collaborative activities between researchers in the US and the AP Region.
    Similar plans are being worked on between the US and Europe and will be implemented when the ACE circuits are in place.
  • 24. ACE/TransPAC3 update
  • 25. TransPAC2
  • 26. TransPAC3 (TP3) update
    TP3 will look similar to TP2
    Install MX480
    Upgrade existing (1 & 10 Gig) hosts
    Install more 10G host in cooperation with KDDI
    Install DLT resources
    Continue support of perfSONAR & Dynamic Circuit services
  • 27. TransPAC3 (TP3) update
    ACE will provide new R&E connectivity between the US & Europe
    Install (1 & 10 Gig) hosts
    Install DLT resources
    Continue support of perfSONAR & Dynamic Circuit service
    Work with the DICE group to integrate authentication & authorization (AA) services
    Modular approach with OSCARS 0.6 (Target Q2,2011)
    Work with the DICE group to design a system compatible with the ESnet Science Data Network, the Internet2 ION Service, and GÉANT’s Autobahn virtual circuit services
  • 28. Questions
    John Hicks
    Indiana University