Fusion of Bandwidth on Demand and Virtual Organizations



Harold Teunissen and Gerben van Malenstein — SURFnet
I2JTW12 — January 2012
Changing Behaviors




   Hierarchical                                                                            Self Organizing
     Secrecy                                                                                Transparency
 Loose Alliance                                                                             Collaboration
     Sluggish                                                                                  Urgency
     Novelty                                                                                 Innovation
  Tunnel Vision                                                                                Didactic
    Institution                                                                               Individual
Single Discipline                                     Source: Sir Ken Robison
                                                                                          Multi-Disciplinary




   Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA           2
Motive


• Cloud cloud cloud — data explosion
• Sharing sharing sharing — connectivity explosion
• Go go go — study + work + play + collaborate +
  organize + share + et cetera


• Collaboration is key to you and your team’s
  success!




                                                                         Source: AMD




Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA   3
New core business


• Modern universities are developing towards loose
  conglomerates of (inter)discipline expertise
• Collaboration is therefore a core business
• Scientific collaboration involves groups of people
  in multiple institutions, disciplines and countries
• Collaboration is about using shared services and
  resources



     Virtual Collaboration* = People + Groups +
     Resources + Services + Policies + Funding + ...
                                                                                                    *a.k.a. Virtual Organization




Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA                        4
Distributed landscape


• Modern science combines resources from multiple
  sources across multiple (administrative) domains



‣ The core resources are within one virtual
  collaboration domain, but within multiple
  institutions, and
‣ the generic collaboration services can be found
  in 'the cloud'




Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA   5
Virtual Collaborations and
Partnerships

• Virtual Research Team                                                                                  Virtual Laboratory

      - Focussed on doing research
                                                                                                           Virtual Project
      - Small scale
                                                                                                           Virtual Colla-
      - Temporary and elastic                                                                                boration


      - Little ICT awareness
      - Users                                                                                       Virtual Breeding Environment



• “Virtual” Infrastructure Provider
      - Focussed on providing infrastructure for specific discipline
      - Well-organized with grands and budgets
      - Longer term
      - Better ICT awareness
      - Not virtual (ESFRI projects, CLARIN, Lifewatch, LOFAR,
        NBIC)


Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA                                  6
Researchers are knocking on our
         door




   Radio Astronomy — Pulsar                            Climate Modeling for Scientist                        CineGRID — 4K+ Video
           Research                                        and Decision Makers                                Distribution Testbed




 Centralized Imaging for Large                        Jungle Computing and Multi-                            Next Generation DNA
Scale Population Imaging Studies                      Model Multi-Kernel Simulations                             Sequencing


         Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA                           7
Collaboration Environments




Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA   8
e-Research without limits




                                                                                                    ƒ




                                                                                  Network C

                            Network A
                                                      Network B




                                     Open Lightpath
                                       Exchange

Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA       9
Multi-Disciplinary Collaboration




                                                                                                    ƒ




                                  Virtual Collaboration A
                                                             Virtual Collaboration B




Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA       10
Circle of Pain...




                                                       Resources
                                                       & Services


                                                                            Access
                                          Authorization                     Control




                      Virtual                            Relationship                         Users
                   Collaboration




Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA     11
Multi-Domain Service Delivery


   Key words: trust, mutual understanding and standardization!


Domain I                                                                                                   Domain VII


                                                        Virtual Collaboration A
                                                                                                                S3




Domain II                         Domain III               Domain IV                            Domain V      Domain VI

      Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA                 12
SURFconext



     SURFconext allows you to create your own
     collaboration environment that organizes your
     applications, services and resources


• Provides the glue and lubrication middleware to
  make campus, cloud based services and resources
  usable for collaboration for both inter campus and
  virtual collaboration scenarios
• O er the platform as a service for smaller & ad-
  hoc team collaboration
• O er the platform software for large, virtual
  collaboration-type collaboration to run-you-own

Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA   13
Key Elements


• Federated Identity Management — SAML
• Groups Management — Grouper
• Social Network 'Portal' technology — OpenSocial
• Collaboration Services and Resources
      - Document Sharing
                                                                                      Virtual Collaboration
      - Video Collaboration
      - Learning Systems
      - Data Storage
      - Data Mining
      - Workspaces
      - Workflows
      - Et cetera



Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA             14
Eco-system and supply chain


 Collaboration Portal                                                                                         Research Data Storage




                                                                                                  ƒ




                                                                                                                    DNA Sequencer


Bandwidth on demand
                                                              Virtual
                                                                   Collaboration


  09     12        14


          Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA                   15
Dynamic Network Service 1.0




        NOC
     Engineer                             Users                                Application
                                                                                                    • User Management
                Admin GUI                              BoD GUI                Legacy API            • Resource Management
                                                                                                    • Topology & Discovery
 Network Management System                                                                          • Path finding
                                                                                                    • Scheduling & Reservation
                                                                                                    • Network Element
                                                                                                     Provisioning & Association




Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA                         16
Resource Reservation 101


                                           Bandwidth on Demand


                                         23                       25                 25
                                     8am-10pm                   10am-12pm        12.10pm-3pm




                                                                                                    ƒ


                                                                                  Network C

                            Network A
                                                        Network B




                                      Open Lightpath Exchange




Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA       17
Dynamic Network Service 2.0



• Group Management                                              NOC
• Resource Management                                        Engineer                                      Users   Applications

                                                                                          BoD GUI                    NSI
                                                                       Admin GUI
                                                                                                                           NSI    Inter Domain        NSI

                                               NOC                   Bandwidth on Demand Service
                                            Engineer                                            CIENA NMS


                                                    Admin GUI                  Network Management
•   Topology & Discovery
•   Path finding                                                                      System
•   Scheduling & Reservation
•   Network Element
    Provisioning & Association




             Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA                                   18
New SURFnet7 and BoD


• All Institutes are upgraded to a MultiService Port
• Allows for On Demand Lightpath Services
• Provide connectivity towards Cloud providers and
  Netherlight
• O ers fixed lightpath Quality of Service
  (bandwidth, latency, availability, et cetera)
• Separation of lightpaths through VLAN tagging


                                           10 Gbps MultiService Port

  Lightpath                   Lightpath                    On Demand Lightpath                      Available


       2 Gbps                     2 Gbps                                   4 Gbps                    2 Gbps




Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA               19
Fusion between users and services


                                                                                                                            Virtual Collaboration



                 BoD Admin Group
                                                                        Bandwidth on
                                              BoD Physical Ports
                                                                       Demand Service
                                                                                                                                                Admin


                 Physical Resource             Physical Resource              Physical Resource
                     Group X                       Group Y                        Group Z
  Ports are
allocated to
 Institutes...




                                                                                                                                                    Users


                     Institute’s                   Institute’s                    Institute’s
                                                     Admin                                                             Virtual Resource          Virtual
                       Admin                                                        Admin                                   Group              User Group

                   Institute X                    Institute Y                    Institute Z




                                                                                                                                               ...and can be
                                                                                                                                             combined into a
                                       +                              +                                 =                                    Virtual Resource
                                                                                                                                           Group and then used
                                                                                                                                           by the collaboration

                   Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA                                  20
Architecture




Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA   21
Simplified view


                                       SAML2       ADFS        TBD                   Identity Provider

                                                  SAML2                                     Federation

        Web Portal                                               Grouper                 Group Management

           Gadget                           Conext                   TBD               Attribute Management
                                            Engine
        OpenSocial                                                XACML                   Policy Management
        Container                  OpenSocial
                                   Rest
                                                                  JANUS                     Service Registry


       OpenSocial Rest                     SAML2 SP      XACML                                SAML2 Metadata
           OAuth                                                                                                      NSI
                                 Bandwidth on Demand Service                                            CIENA NMS



                                  Network Management System                                                 NGE



                                                  NGE / Network
                                                                                                     * Developed by SURFnet


Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA                             22
Share services with your team




Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA   23
Getting started




Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA   24
harold.teunissen@surfnet.nl   haroldteunissen

Fusion of Bandwidth on Demand and Virtual Organizations

  • 1.
    Fusion of Bandwidthon Demand and Virtual Organizations Harold Teunissen and Gerben van Malenstein — SURFnet I2JTW12 — January 2012
  • 2.
    Changing Behaviors Hierarchical Self Organizing Secrecy Transparency Loose Alliance Collaboration Sluggish Urgency Novelty Innovation Tunnel Vision Didactic Institution Individual Single Discipline Source: Sir Ken Robison Multi-Disciplinary Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA 2
  • 3.
    Motive • Cloud cloudcloud — data explosion • Sharing sharing sharing — connectivity explosion • Go go go — study + work + play + collaborate + organize + share + et cetera • Collaboration is key to you and your team’s success! Source: AMD Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA 3
  • 4.
    New core business •Modern universities are developing towards loose conglomerates of (inter)discipline expertise • Collaboration is therefore a core business • Scientific collaboration involves groups of people in multiple institutions, disciplines and countries • Collaboration is about using shared services and resources Virtual Collaboration* = People + Groups + Resources + Services + Policies + Funding + ... *a.k.a. Virtual Organization Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA 4
  • 5.
    Distributed landscape • Modernscience combines resources from multiple sources across multiple (administrative) domains ‣ The core resources are within one virtual collaboration domain, but within multiple institutions, and ‣ the generic collaboration services can be found in 'the cloud' Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA 5
  • 6.
    Virtual Collaborations and Partnerships •Virtual Research Team Virtual Laboratory - Focussed on doing research Virtual Project - Small scale Virtual Colla- - Temporary and elastic boration - Little ICT awareness - Users Virtual Breeding Environment • “Virtual” Infrastructure Provider - Focussed on providing infrastructure for specific discipline - Well-organized with grands and budgets - Longer term - Better ICT awareness - Not virtual (ESFRI projects, CLARIN, Lifewatch, LOFAR, NBIC) Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA 6
  • 7.
    Researchers are knockingon our door Radio Astronomy — Pulsar Climate Modeling for Scientist CineGRID — 4K+ Video Research and Decision Makers Distribution Testbed Centralized Imaging for Large Jungle Computing and Multi- Next Generation DNA Scale Population Imaging Studies Model Multi-Kernel Simulations Sequencing Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA 7
  • 8.
    Collaboration Environments Fusion ofBandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA 8
  • 9.
    e-Research without limits ƒ Network C Network A Network B Open Lightpath Exchange Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA 9
  • 10.
    Multi-Disciplinary Collaboration ƒ Virtual Collaboration A Virtual Collaboration B Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA 10
  • 11.
    Circle of Pain... Resources & Services Access Authorization Control Virtual Relationship Users Collaboration Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA 11
  • 12.
    Multi-Domain Service Delivery Key words: trust, mutual understanding and standardization! Domain I Domain VII Virtual Collaboration A S3 Domain II Domain III Domain IV Domain V Domain VI Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA 12
  • 13.
    SURFconext SURFconext allows you to create your own collaboration environment that organizes your applications, services and resources • Provides the glue and lubrication middleware to make campus, cloud based services and resources usable for collaboration for both inter campus and virtual collaboration scenarios • O er the platform as a service for smaller & ad- hoc team collaboration • O er the platform software for large, virtual collaboration-type collaboration to run-you-own Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA 13
  • 14.
    Key Elements • FederatedIdentity Management — SAML • Groups Management — Grouper • Social Network 'Portal' technology — OpenSocial • Collaboration Services and Resources - Document Sharing Virtual Collaboration - Video Collaboration - Learning Systems - Data Storage - Data Mining - Workspaces - Workflows - Et cetera Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA 14
  • 15.
    Eco-system and supplychain Collaboration Portal Research Data Storage ƒ DNA Sequencer Bandwidth on demand Virtual Collaboration 09 12 14 Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA 15
  • 16.
    Dynamic Network Service1.0 NOC Engineer Users Application • User Management Admin GUI BoD GUI Legacy API • Resource Management • Topology & Discovery Network Management System • Path finding • Scheduling & Reservation • Network Element Provisioning & Association Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA 16
  • 17.
    Resource Reservation 101 Bandwidth on Demand 23 25 25 8am-10pm 10am-12pm 12.10pm-3pm ƒ Network C Network A Network B Open Lightpath Exchange Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA 17
  • 18.
    Dynamic Network Service2.0 • Group Management NOC • Resource Management Engineer Users Applications BoD GUI NSI Admin GUI NSI Inter Domain NSI NOC Bandwidth on Demand Service Engineer CIENA NMS Admin GUI Network Management • Topology & Discovery • Path finding System • Scheduling & Reservation • Network Element Provisioning & Association Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA 18
  • 19.
    New SURFnet7 andBoD • All Institutes are upgraded to a MultiService Port • Allows for On Demand Lightpath Services • Provide connectivity towards Cloud providers and Netherlight • O ers fixed lightpath Quality of Service (bandwidth, latency, availability, et cetera) • Separation of lightpaths through VLAN tagging 10 Gbps MultiService Port Lightpath Lightpath On Demand Lightpath Available 2 Gbps 2 Gbps 4 Gbps 2 Gbps Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA 19
  • 20.
    Fusion between usersand services Virtual Collaboration BoD Admin Group Bandwidth on BoD Physical Ports Demand Service Admin Physical Resource Physical Resource Physical Resource Group X Group Y Group Z Ports are allocated to Institutes... Users Institute’s Institute’s Institute’s Admin Virtual Resource Virtual Admin Admin Group User Group Institute X Institute Y Institute Z ...and can be combined into a + + = Virtual Resource Group and then used by the collaboration Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA 20
  • 21.
    Architecture Fusion of Bandwidthon Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA 21
  • 22.
    Simplified view SAML2 ADFS TBD Identity Provider SAML2 Federation Web Portal Grouper Group Management Gadget Conext TBD Attribute Management Engine OpenSocial XACML Policy Management Container OpenSocial Rest JANUS Service Registry OpenSocial Rest SAML2 SP XACML SAML2 Metadata OAuth NSI Bandwidth on Demand Service CIENA NMS Network Management System NGE NGE / Network * Developed by SURFnet Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA 22
  • 23.
    Share services withyour team Fusion of Bandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA 23
  • 24.
    Getting started Fusion ofBandwidth on Demand and Virtual Organizations - ESCC/Internet2 JT 2012, Baton Rouge, LA 24
  • 25.