Published on

Published in: Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • The services register themselves to the LS and mention their capabilities. They can also leave or be removed from a LS if a service gets down (keepalives).
  • MPs SSH/Telnet (Looking Glass) – Belnet – Stijn Verstichel ABW (bandwidth packet capture cards) – Cesnet – Sven Ubik BWCTL – DFN – Verena Venus NMS (SDH status) – DANTE – Loukik Kudarimoti SNMP – DANTE – Loukik Kudarimoti Command line – RNP/Internet2 – Fausto Vetter/Jeff Boote OWAMP Ping Traceroute MAs RRD – PSNC – Roman Laplacz SQL – PSNC – Roman Laplacz TopS – RedIRIS – Ulisses Alonso BWCTL – DFN – Verena Venus Hades (owd, jitter, owpl) – DFN – Verena Venus Flow replicator Visualisation Clients CNM – DFN – Andreas Hanemann, David Schimtz perfsonarUI – ISTF – Vedrin Jeliazkov, Nina Jeliazkova visualperfsonar (traceroute base) – Carnet – Igor Velimirovic Looking glass (making use of the SSH/telnet MP) – Stijn Verstichel
  • End Slide
  • ppt

    1. 1. Performance Update Eric L. Boyd Director of Performance Architecture and Technologies Internet2
    2. 2. Vision: Performance Information is … <ul><li>Available </li></ul><ul><ul><li>People can find it (Discovery) </li></ul></ul><ul><ul><li>“ Community of trust” allows access across administrative domain boundaries (AA) </li></ul></ul><ul><li>Ubiquitous </li></ul><ul><ul><li>Widely deployed (Paths of interest covered) </li></ul></ul><ul><ul><li>Reliable (Consistently configured correctly) </li></ul></ul><ul><li>Valuable </li></ul><ul><ul><li>Actionable (Analysis suggests course of action) </li></ul></ul><ul><ul><li>Automatable (Applications act on data) </li></ul></ul>
    3. 3. Getting There: Build & Empower the Community <ul><li>Decouple the Problem Space: </li></ul><ul><li>Analysis and Visualization </li></ul><ul><li>Performance Data Sharing </li></ul><ul><li>Performance Data Generation </li></ul><ul><li>Grow the Footprint: </li></ul><ul><li>Clean APIs between each layer </li></ul><ul><li>Widespread deployment of measurement infrastructure </li></ul><ul><li>Widespread deployment of common performance measurement tools </li></ul>
    4. 4. Result: No more mystery … <ul><li>Increase network awareness </li></ul><ul><ul><li>Set user expectations accurately </li></ul></ul><ul><li>Reduce diagnostic costs </li></ul><ul><ul><li>Performance problems noticed early </li></ul></ul><ul><ul><li>Performance problems addressed efficiently </li></ul></ul><ul><ul><li>Network engineers can see & act outside their turf </li></ul></ul><ul><li>Transform application design </li></ul><ul><ul><li>Incorporate network intuition into application behavior </li></ul></ul>
    5. 5. BWCTL (Bandwidth Controller) <ul><li>What is it? </li></ul><ul><ul><li>A resource allocation and scheduling daemon for arbitration of iperf tests </li></ul></ul><ul><li>Typical Solution </li></ul><ul><ul><li>Run “iperf” or similar tool on two endpoints and hosts on intermediate paths </li></ul></ul><ul><li>Typical road blocks </li></ul><ul><ul><li>Need permissions on all systems involved </li></ul></ul><ul><ul><li>Need to coordinate testing with others </li></ul></ul><ul><ul><li>Need to run software on both sides with specified test parameters </li></ul></ul>
    6. 6. BWCTL: 3-Party Flow Diagram
    7. 7. NDT: Network Diagnostic Tool <ul><li>Web100 enhanced server handles testing and diagnostic services </li></ul><ul><li>Java based and command line clients allows testing from any client (local or remote) </li></ul><ul><li>Performance and configuration faults reported back to client </li></ul><ul><li>Drill-down functions provide more details & error reporting capabilities </li></ul><ul><li>Grant from NIH/NLM to explore duplex mismatch detection </li></ul>
    8. 8. NDT Flow Diagram Client Web Browser Java Applet NDT - Server Web Server Testing Engine Child Test Engine Spawn child Well Known NDT Server Web Request Redirect msg Web Page Request Web page response Test Request Control Channel Specific test channels
    9. 9. OWAMP: One-Way Active Measurement Protocol <ul><li>What is it? </li></ul><ul><ul><li>Measures one-way latency: 1-way ping </li></ul></ul><ul><ul><li>Control connection used to broker test request based upon policy restrictions and available resources. (Bandwidth/disk limits) </li></ul></ul><ul><li>Specification </li></ul><ul><ul><li>http://tools.ietf.org/wg/ippm/draft-ietf-ippm-owdp/draft-ietf-ippm-owdp-14.txt </li></ul></ul>
    10. 10. OWAMP Flow Diagram
    11. 11. Thrulay Overview <ul><li>Network capacity and delay tester </li></ul><ul><li>Same class of tools as iperf, netperf, nettest, nuttcp, ttcp, etc. </li></ul><ul><li>Unique features not found in other tools: </li></ul><ul><ul><li>TCP: measures round-trip delay along with goodput </li></ul></ul><ul><ul><li>UDP: measures: </li></ul></ul><ul><ul><ul><li>One-way delay, with quantiles </li></ul></ul></ul><ul><ul><ul><li>Packet loss </li></ul></ul></ul><ul><ul><ul><li>Packet duplication </li></ul></ul></ul><ul><ul><ul><li>Reordering </li></ul></ul></ul><ul><ul><li>UDP: ability to send precisely positioned true Poisson streams (microsecond errors in sending times) </li></ul></ul><ul><ul><li>Human and machine-readable (ready to be fed to gnuplot) </li></ul></ul>
    12. 12. Thrulay Update <ul><li>New release v0.8 </li></ul><ul><li>Tests with multiple TCP streams </li></ul><ul><li>Set DSCP (a.k.a. first 6 bits of the TOS byte) </li></ul><ul><li>Report MTU and/or MSS (whichever the OS makes available) </li></ul><ul><li>More UDP statistics: duplication, reordering, quantiles of delay </li></ul><ul><li>SPARC/Solaris support </li></ul><ul><li>Mac OS X support </li></ul><ul><li>IPv6 support </li></ul><ul><li>Non-busy-waiting UDP mode (less precise, but can run more concurrent tests) </li></ul><ul><li>Documentation: manual pages have been added </li></ul><ul><li>Basic client authorization based on IP address </li></ul><ul><li>Integration of TSC timekeeping projects for faster and more precise timestamping </li></ul>
    13. 13. Bulk Transport <ul><li>Build a library / tool for bulk transport that does not require kernel level modifications yet achieves the performance of such </li></ul><ul><li>VFER library </li></ul><ul><ul><li>Congestion control hooks </li></ul></ul><ul><ul><li>Implements loss-based congestion control </li></ul></ul><ul><ul><li>Working on delay-based version </li></ul></ul><ul><li>File transfer utility </li></ul><ul><ul><li>An initial version demoed </li></ul></ul>
    14. 14. How can you use them? <ul><li>Tools are open source, supported, well-documented </li></ul><ul><li>BWCTL/Iperf, OWAMP, NDT are deployed across Abilene backbone and at many partners </li></ul><ul><li>You can: </li></ul><ul><ul><li>See ongoing measurement results at the Abilene Observatory </li></ul></ul><ul><ul><li>Test to/from the Abilene backbone </li></ul></ul>
    15. 15. Network Performance Measurement Workshops <ul><ul><li>Example Course Materials: </li></ul></ul><ul><ul><ul><li>http://e2epi.internet2.edu/npw/presentations.html </li></ul></ul></ul><ul><li>Goals: </li></ul><ul><ul><li>Grow installed base of BWCTL/Iperf, OWAMP, and NDT at GigaPoP and regional campuses. </li></ul></ul><ul><ul><ul><li>http://e2epi.internet2.edu/pipes/pmp/pmp-dir.html </li></ul></ul></ul><ul><ul><li>Begin integration into IT support processes. </li></ul></ul><ul><ul><li>Create an installed base for perfSONAR deployment. </li></ul></ul><ul><ul><li>Give each participant tool-specific cookbooks. </li></ul></ul>
    16. 16. Network Performance Measurement Workshop Locations and Dates <ul><li>Completed </li></ul><ul><ul><li>SOX / GaTech (03/05) </li></ul></ul><ul><ul><li>CENIC / UCLA (06/05) </li></ul></ul><ul><ul><li>JT – Vancouver (07/05) </li></ul></ul><ul><ul><li>OARNet / OSU (09/05) </li></ul></ul><ul><ul><li>MAGPI / FMM (09/05) </li></ul></ul><ul><ul><li>MAX / College Park (12/05) </li></ul></ul><ul><ul><li>APAN (01/06) </li></ul></ul><ul><ul><li>JT - Albuquerque (02/06) </li></ul></ul><ul><ul><li>MERIT (02/06) </li></ul></ul><ul><ul><li>Columbia / NYSERNet (04/06) </li></ul></ul><ul><li>Planned </li></ul><ul><ul><li>University of Virginia (04/06) </li></ul></ul><ul><li>Under Consideration </li></ul><ul><ul><li>Wisconsin, Alaska, … </li></ul></ul>
    17. 17. Additional Outreach <ul><li>National Library of Medicine </li></ul><ul><ul><li>Presentation on end-user tools at NLM-centric Network Performance Monitoring Pilot-project Workshop (March 2006) </li></ul></ul><ul><li>New World Symphony </li></ul><ul><ul><li>Presentation on end-user tools at NWS Master Class Workshop (January 2006) </li></ul></ul><ul><ul><li>On-going dialog on end-user needs </li></ul></ul>
    18. 18. Collaboration <ul><li>Working Groups </li></ul><ul><ul><li>Bulk Transport (transport.internet2.edu) </li></ul></ul><ul><ul><li>GGF Network Measurement (nmwg.internet2.edu) </li></ul></ul><ul><ul><li>perfSONAR (www.perfsonar.net) </li></ul></ul><ul><li>Funded Research </li></ul><ul><ul><li>“ Bridging the Gap” (NSF) </li></ul></ul><ul><ul><li>Network Measurement for International Connections </li></ul></ul><ul><li>Google Summer of Code </li></ul><ul><ul><li>2005 very successful </li></ul></ul><ul><ul><li>2006 planned </li></ul></ul>
    19. 19. perfSONAR Overview <ul><li>What: Measurement infrastructure for exchanging data under development </li></ul><ul><li>How: Webservices network performance framework </li></ul><ul><ul><li>Network measurement tools </li></ul></ul><ul><ul><li>Network measurement archives </li></ul></ul><ul><ul><li>Distributed scheduling/authorization </li></ul></ul><ul><ul><li>Multi-domain policy </li></ul></ul><ul><ul><li>Common language (GGF NMWG Schema) </li></ul></ul><ul><li>Where: Deployed / to be deployed across: </li></ul><ul><ul><li>Network Backbones (Abilene, ESNet, G É ANT) </li></ul></ul><ul><ul><li>Regional Networks (NRENs, RONs, Gigapops) </li></ul></ul><ul><ul><li>Universities </li></ul></ul><ul><li>When: First product release early summer ‘06 </li></ul>
    20. 20. perfSONAR Credits <ul><li>perfSONAR is a joint effort: </li></ul><ul><ul><li>ESnet </li></ul></ul><ul><ul><li>Fermilab </li></ul></ul><ul><ul><li>G É ANT2 JRA1 </li></ul></ul><ul><ul><li>Internet2 </li></ul></ul><ul><ul><li>RNP </li></ul></ul><ul><li>Internet2 includes: </li></ul><ul><ul><li>University of Delaware </li></ul></ul><ul><ul><li>Georgia Tech </li></ul></ul><ul><ul><li>Internet2 staff </li></ul></ul><ul><li>G ÉANT2 JRA1 includes: </li></ul><ul><ul><li>Arnes </li></ul></ul><ul><ul><li>Belnet </li></ul></ul><ul><ul><li>Carnet </li></ul></ul><ul><ul><li>Cesnet </li></ul></ul><ul><ul><li>DANTE </li></ul></ul><ul><ul><li>DFN </li></ul></ul><ul><ul><li>FCCN </li></ul></ul><ul><ul><li>GRNet </li></ul></ul><ul><ul><li>ISTF </li></ul></ul><ul><ul><li>PSNC </li></ul></ul><ul><ul><li>Nordunet (Uninett) </li></ul></ul><ul><ul><li>Renater </li></ul></ul><ul><ul><li>RedIRIS </li></ul></ul><ul><ul><li>Surfnet </li></ul></ul><ul><ul><li>SWITCH </li></ul></ul>
    21. 21. How can you use it? <ul><li>perfSONAR Link Utilization and Capacity data available from Abilene, ESnet, G É ANT (prototype) </li></ul><ul><li>Build your own components to integrate into open source framework </li></ul>
    22. 22. perfSONAR: Project Activity Meter <ul><li>1-2 conf calls/week </li></ul><ul><li>1 new service/month (accelerating) </li></ul><ul><li>3-4 development workshops/year </li></ul><ul><li>3-4 paper submissions/year </li></ul>
    23. 23. perfSONAR: System Description <ul><li>Domains represented by a set of services </li></ul><ul><li>Each domain can deploy services important to the domain </li></ul><ul><li>Analysis clients interact with service across multiple domains </li></ul>
    24. 24. perfSONAR: Services (1) <ul><li>Lookup Service </li></ul><ul><ul><li>Allows the client to discover the existing services and other LS services. </li></ul></ul><ul><ul><li>Dynamic: services registration themselves to the LS and mention their capabilities, they can also leave or be removed if a service gets down. </li></ul></ul><ul><li>AuthN/Z Service </li></ul><ul><ul><li>Internet2 MAT, GN2-JRA5 (eduGAIN) </li></ul></ul><ul><ul><li>Authorization functionality for the framework </li></ul></ul><ul><ul><li>Users can have several roles, the authorisation is done based on the user role. </li></ul></ul><ul><ul><li>Trust relationships defined between users affiliated with different administrative domains. </li></ul></ul>
    25. 25. perfSONAR Services (2) <ul><li>Transformation Service </li></ul><ul><ul><li>Transform the data (aggregation, concatenation, correlation, translation, etc). </li></ul></ul><ul><li>Topology Service </li></ul><ul><ul><li>Make the network topology information available to the framework. </li></ul></ul><ul><ul><li>Find the closest MP, provide topology information for visualisation tools </li></ul></ul><ul><li>Resource protector </li></ul><ul><ul><li>Arbitrate the consumption of limited resources between multiple services. </li></ul></ul>
    26. 26. Inter-domain perfSonar example interaction Here is who I am, I’d like to access MA B Where Link utilisation along - Path a,b,c,d,e,f? a,b,c: Network A – LS A, c,d,e,f : Network B, MA B, AA B Client Network A Network B LS A LS B MA A MA B AA A AA B a b c d e f Where Link utilisation along - Path a,b,c? a,b,c : Network A, MA A, AA A Token MB Here is who I am, I’d like to access MA A Get link utilisation c,d,e,f Here you go Token MA Get Link utilisation a,b,c Here you go Useful graph
    27. 27. perfSONAR: Status Update <ul><li>Production release of base package expected by June (code freeze next week) </li></ul><ul><li>Will include: </li></ul><ul><ul><li>Single domain LS solution </li></ul></ul><ul><ul><li>RRD MA </li></ul></ul><ul><ul><li>(no AS) </li></ul></ul><ul><li>Additional services and client applications supporting this version will soon follow: </li></ul><ul><ul><li>BWCTL MP </li></ul></ul><ul><ul><li>perfSONAR UI </li></ul></ul>
    28. 28. perfSONAR: Hot Topics <ul><li>Multi-domain hierarchical LS </li></ul><ul><li>AuthN/Z development plan with JRA-5 (eduGAIN) </li></ul><ul><li>SSH MP (LookingGlass) service </li></ul><ul><li>Topology Services </li></ul><ul><li>L2 specific MA service </li></ul>
    29. 29. perfSONAR: Current Developments <ul><li>MPs </li></ul><ul><ul><li>SSH/Telnet (Looking Glass) </li></ul></ul><ul><ul><li>ABW (bandwidth packet capture cards) </li></ul></ul><ul><ul><li>BWCTL </li></ul></ul><ul><ul><li>NMS (SDH status) </li></ul></ul><ul><ul><li>SNMP </li></ul></ul><ul><ul><li>Command line (OWAMP, Ping, Traceroute) </li></ul></ul><ul><li>MAs </li></ul><ul><ul><li>RRD </li></ul></ul><ul><ul><li>SQL </li></ul></ul><ul><ul><li>TopS </li></ul></ul><ul><ul><li>BWCTL </li></ul></ul><ul><ul><li>Hades (owd, jitter, owpl) </li></ul></ul><ul><ul><li>Flow replicator </li></ul></ul><ul><li>Visualization Clients </li></ul><ul><ul><li>CNM </li></ul></ul><ul><ul><li>perfSONAR UI </li></ul></ul><ul><ul><li>Visual perfsonar </li></ul></ul><ul><ul><li>Looking glass </li></ul></ul>
    30. 30. Questions?
    31. 31. perfSONAR: authN/Z plans <ul><li>perfSONAR(JRA-1)/JRA-5 sub-group </li></ul><ul><li>Group tasked with determining how to leverage JRA-5 authentication system (eduGAIN) in perfSONAR infrastructure </li></ul><ul><ul><li>Jeff Boote (Internet2) </li></ul></ul><ul><ul><li>Diego Lopez (RedIRIS) </li></ul></ul><ul><ul><li>Maurizio Molina (Dante) </li></ul></ul><ul><ul><li>Andreas Solberg (Uninett) </li></ul></ul>
    32. 32. perfSONAR: Background <ul><li>Designed with Federated authentication in mind </li></ul><ul><li>AS becomes a ‘proxy’ for Authorization requests </li></ul>
    33. 33. eduGAIN: Background <ul><li>JRA-5 provided authentication “interface” </li></ul><ul><li>Provides “bridging” to other authentication systems </li></ul><ul><ul><li>Shibboleth </li></ul></ul><ul><ul><li>PAPI </li></ul></ul><ul><ul><li>Others… </li></ul></ul><ul><li>Designed mostly with web-browser interaction in mind </li></ul>
    34. 34. Current Status <ul><li>Group has come to general consensus on how this should work </li></ul><ul><li>Paper is currently underway describing interaction of perfSONAR with eduGAIN API </li></ul>
    35. 35. perfSONAR: Trust relationship entities <ul><li>Client </li></ul><ul><li>idP (identity provider) </li></ul><ul><li>pSR (perfSONAR resource “service”) </li></ul><ul><li>AS (perfSONAR AS service) </li></ul><ul><li>HLS (Home Location Service) </li></ul>
    36. 36. Automated Client Interaction
    37. 37. Normal User Interaction
    38. 38. Implications for JRA-5 <ul><li>Future extensibility for multiple X.509 root CA certificates </li></ul><ul><li>Non-web profile for authN attribute request </li></ul><ul><li>Current identity provider servers (attribute stores) may need to hold attributes for non-human clients </li></ul><ul><li>Others??? </li></ul>
    39. 39. Implications for JRA-1 <ul><li>AS has slightly different role </li></ul><ul><ul><li>Clients never directly interact with AS </li></ul></ul><ul><ul><li>AS is effectively a ‘proxy’ between services and the eduGAIN ‘bridging elements’ </li></ul></ul><ul><li>Attribute requests from services to RP’s and from RP’s to AS need to be made in a ‘boolean’ fashion to protect the privacy of clients </li></ul><ul><li>Automated clients MUST have X.509 client certificates </li></ul>
    40. 40. Questions/Concerns <ul><li>Let us know if you would like a copy of the ‘document’ when it is complete </li></ul><ul><li>Please feel free to send further questions/comments to Maurizio and Jeff </li></ul><ul><ul><li>[email_address] </li></ul></ul><ul><ul><li>[email_address] </li></ul></ul>
    41. 42. Deployment <ul><li>Network Performance Workshops </li></ul><ul><ul><li>Hands-on tool deployment training </li></ul></ul><ul><ul><li>GigaPoP/campus involvement </li></ul></ul><ul><ul><li>250+ participants/11 Workshops </li></ul></ul><ul><li>Global Deployments </li></ul><ul><ul><li>Infrastructure (G É ANT2, RNP, Internet2, & ESnet) </li></ul></ul><ul><ul><li>Individual Tools (e2epi.internet2.edu/pipes/pmp/pmp-dir.html) </li></ul></ul>
    42. 43. Performance Tools (1) <ul><li>OWAMP: One-Way Active Measurement Protocol </li></ul><ul><ul><li>One-way Delay </li></ul></ul><ul><li>BWCTL: Bandwidth Control </li></ul><ul><ul><li>Wraps NLANR / DAST-created Iperf </li></ul></ul><ul><ul><li>Measures throughput </li></ul></ul>
    43. 44. Performance Tools (2) <ul><li>NDT: Network Diagnostic Tool </li></ul><ul><ul><li>Diagnoses common performance problems between a server and your laptop </li></ul></ul><ul><ul><li>Downloaded java applet from the web runs the tests </li></ul></ul><ul><li>Thrulay </li></ul><ul><ul><li>Network capacity and delay tester </li></ul></ul><ul><ul><li>TCP: measures round-trip delay along with goodput </li></ul></ul><ul><ul><li>UDP: measures: one-way delay, with quantiles; packet loss; packet duplication; reordering </li></ul></ul>