• Save
TransPAC3/ACE Measurement & PerfSONAR Update
Upcoming SlideShare
Loading in...5

TransPAC3/ACE Measurement & PerfSONAR Update






Total Views
Slideshare-icon Views on SlideShare
Embed Views



2 Embeds 5

http://internationalnetworking.iu.edu 3
http://internationalnetworking.indiana.edu 2



Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
Post Comment
Edit your comment

    TransPAC3/ACE Measurement & PerfSONAR Update TransPAC3/ACE Measurement & PerfSONAR Update Presentation Transcript

    • TP3/ACE measurementandperfSONAR update
      John Hicks
      International Networking
      Indiana University
    • Overview
      • PerfSONAR & IRIS & DyGIR
      • ARK project
      • Network Services
      DLT & High Performance storage/transfer hosts
      • TransPAC3 update
      • ACE update
    • Perfsonar
      Current versions
      perfSONAR-PS (PS-PS) v3.2
      perfSONAR MDM v3.3 (Java)
      The following ideas are potential longer term roadmap issues
      Circuit Monitoring
      Lookup service enhancements (higher performance, integration of misc other metrics, utilize new summarization algorithm, etc.)
      Cross domain latency variation visualization tools
      End-to-End path visualization tools that integrate multiple measurements (ping, traceroute, partial path bwctl, etc)
      Alarm/notification generation & management
      Authentication & Authorization (AA)
    • Perfsonar
      Here is a suggested list of baseline data that networks should make available:
      Ping (round-trip latency)
      OWAMP (One-way latency)
      BWCTL/IPERF (TCP Throughput)
      SNMP (Utilization, Errors)
      Link-Status (Up/Down, AdminUp, AdminDown)
      Circuit-Status (Logical mapping of multi-domain)
    • PerfSonar
      Here is a recommended list of tools to have available in an on-demand diagnostic sense:
      Reverse-Ping (round-trip latency)
      OWAMP (One-way latency)
      BWCTL/IPERF (TCP Throughput)
      The set of Metrics and on-demand diagnostic tools for specific networks will vary based on the type of infrastructure they are providing. For example, some will not have the ability to inject traffic into the networks they are providing which would make the active tools unavailable.
    • Dynamic Circuits
      Internet2 is engaged in standardization effort within the Open Grid Forum (OGF)
      NSI WG (signal circuit creation)
      NML WG (topology support of circuits and monitoring)
      NMC WG (performance middleware)
      NM WG (measurement definition)
      Internet2 is engaged in GLIF experimental networks
      perfSONAR Demos
      Automated GOLE Demos
    • IRIS & DYGir
      Internet2 is engaged in a common service definition of a dynamic circuit networking service with DICE partners.
      Internet2 plans to deploy and operate a separate IDC instance at MAN LAN in 2011
      Built with OSCARS/DRAGON over Ciena Core Director, perfSONAR‐ps
      Three NSF awards of interest (total $3.5 million)
      IRIS (International Research Instrumentation System): develop perfSONAR‐ps based performance monitoring package for use by IRNC PRONET awardees (~$1 million)
      DyGIR (Dynamic Gateways for International Research): develop OSCARS (and DRAGON) based dynamic circuit networking package for use by IRNC PRONET awardees (~$750k)
      DYNES: develop OSCARS (DRAGON) and perfSONAR‐ps based distributed virtual
    • IRIS
      Objective: provide the infrastructure necessary for the identification, diagnosis and eventual correction of network performance problems for paths traversing IRNC links
      IRIS will provide a software framework to enable performance monitoring services on IRNC links
      Produce a set of easy‐to‐install, tailored software packages of the perfSONAR‐PS software suite for use by the IRNC link operators
      Develop new functionality specific to international exchange points
      Work with the IRNC link awardees to help them deploy the software
    • DyGir
      Objective: enable researchers to reserve dedicated bandwidth over IRNC links
      Allow for more distributed collaboration
      DyGIR will provide a prototype software framework to enable dynamic circuit services for a pair of IRNC links
      Produce a set of easy‐to‐install, tailored software packages for the OSCARS software suite
      Prototype new functionality specific to international exchange points
      Work with 2+ of the IRNC link awardees to help them deploy the prototype software
    • Archipelago (Ark)
      CAIDA’s measurement infrastructure
      Built on decade of achievements, from SIGCOMM to MOMA
      Launch 12 Sept 2007
      54 active IPv4 probers
      18 in US
      16 active IPv6 probers
      collaborators can run vetted measurements on security-hardened platform
      publish analyses of views from individual monitors
      support for meta-data mgt, analysis, and infoviz
    • summary of the expected traffic
      ntp (123/udp) to your local NTP server, to CAIDA's NTP server, or to the nearest NTP Pool server
      dns (53/udp) to your local DNS server(s) or to CAIDA's DNS server
      TCP connection to CAIDA's tuple-space server from any local (ephemeral) port (for Ark's tuple space communication)
      ICMP echo request, echo reply, port unreachable to any host (for ICMP-based topology measurements to and from the monitor)
      no ICMP rate limiting
      UDP probes from any local port to any host and any port (for UDP-based topology measurements from the monitor)
      TCP probes from any local port to any host and any port regardless of connection state (for non-SYN based TCP measurements such as sending a TCP ACK probe, which won't establish a connection nor be part of an existing connection)
      NTP and DNS responses
      ssh (22/tcp) from only CAIDA's /24 prefix
      ICMP echo request, echo reply, time exceeded, and destination unreachable (type 3, code any) from any host
      no ICMP rate limiting
      TCP packets (SYN, ACK, RST, etc.) from any host and any port regardless of connection state (for TCP-based topology measurements)
    • Active Measurements
      • IPv4 Routed /24 Topology (and AS Links)
      • IPv6 Topology
      • DNS Names & Query/Response Traffic
      • Alias Resolution
      • All measurements are active probes with low rate of probing.
    • Data: IPv4 Routed /24 Topology
      Ongoing large-scale topology measurements
      ICMP Paris traceroute to every routed /24 (8.25 million)
      about 126 /8-equivalents of routed space (as of Oct 2009)
      running scamper
      written by Matthew Luckie of WAND, University of Waikato
      Dynamically divide up the measurement work among members of monitor teams
      3 teams active
      13-member team probes every /24 in 2-3 days at 100pps
      only one monitor probes each /24 per cycle (=one pass through all /24’s)
    • Other Links
      IRNC-SP: Sustainable data-handling and analysis methodologies for the IRNC networks http://www.caida.org/funding/irnc/
      Archipelago (Ark) network measurement platformhttp://www.caida.org/projects/ark/
      Archipelago Monitor Statisticshttp://www.caida.org/projects/ark/statistics/
      Please send questions and comments to ark-info@caida.org.
    • Network Services
      TransPAC3 & ACE will provide high performance (HP) research & education network connectivity between the US, Asia, & Europe.
      We want to do more:
      Develop documentation to increase the ease of use
      Dedicated infrastructure for data movement
      Install HP data movers in PoP’s
      Through IRIS & DyGIR we will provide advanced monitoring and dynamic circuit services
    • Data Logistics Toolkit (DLT)
      The Data Logistics Toolkit (DLT) integrates a set of storage and networking technologies to create WAN-enabled storage nodes that can dramatically improve the ability of data intensive research communities to collaborate in the wide area. A key DLT service is implementing a global “drop box” that supports automatic data postitioning. This will enable automation and optimization of rapid movement and timely placement of data, across a wide range of scenarios, through policy-controlled sharing, replication, caching, control loop optimization and overlay multicast. The DLT's global data system will help collaborators leverage the tremendous power of the international fabric of Research and Education (R&E) networks, encircling the globe and enabling unprecented potential for collaboration.
    • Dlt (Cont.)
      The DLT is comprised of various software systems: 
      IBP: The Internet Backplane Protocol allows for the creation of storage “depots” throughout the network. This software, along with file managers like L-Store and LoDN, powers the NSF-funded Research and Education Data Depot Network (REDDnet). REDDnet is a funded set of storage infrastructure in the US (and at CERN in support of the LHC). The goal of the DLT is to broaden the participation in this infrastructure as well as to make logistical storage available internationally.
      perfSONAR: perfSONAR is a network measurement and topology system that can monitor and optimize the DLT network. The perfSONAR system has been jointly developed by an international consortium of R&E networks and researchers and is the center of a growing community interested in making networks more effective.
      Phoebus: Phoebus is a session-layer based network “inlay” that optimizes end-to-end throughput for high-demand applications and users. Phoebus can dynamically allocate circuits from systems such as Internet2’s ION and GÉANT’s AutoBAHN.
      UNIS: The Unified Network Information Service stems from the perfSONAR Lookup and Topology Services and is now used by the OSCARS interdomain controller (IDC) software, which underlies Internet2’s ION and the ESnet OSCARS service for dynamic circuits. It is a key part of the DLT’s discovery and coordination service.
    • Dlt (Cont.)
      The DLT will be implemented on TransPAC3.
      Disk arrays will be installed at the current circuit landing points in Los Angeles and Tokyo. This along with dynamic circuit technologies will provide a foundation for collaborative activities between researchers in the US and the AP Region.
      Similar plans are being worked on between the US and Europe and will be implemented when the ACE circuits are in place.
    • ACE/TransPAC3 update
    • TransPAC2
    • TransPAC3 (TP3) update
      TP3 will look similar to TP2
      Install MX480
      Upgrade existing (1 & 10 Gig) hosts
      Install more 10G host in cooperation with KDDI
      Install DLT resources
      Continue support of perfSONAR & Dynamic Circuit services
    • TransPAC3 (TP3) update
      ACE will provide new R&E connectivity between the US & Europe
      Install (1 & 10 Gig) hosts
      Install DLT resources
      Continue support of perfSONAR & Dynamic Circuit service
      Work with the DICE group to integrate authentication & authorization (AA) services
      Modular approach with OSCARS 0.6 (Target Q2,2011)
      Work with the DICE group to design a system compatible with the ESnet Science Data Network, the Internet2 ION Service, and GÉANT’s Autobahn virtual circuit services
    • Questions
      John Hicks
      Indiana University