USP TeamFIBRE-BR Camp, 28-29 April 2012         Ouro Preto (MG), Brazil
USP Team members• General coordinator  – Tereza C. M. B. Carvalho – carvalho@larc.usp.br• Team members   – Marco A. Torrez...
Agenda• Part I - Emulab   • Emulab LARC/USP   • How does Emulab Works ?• Part II – ProtoGENI   • What is ProtoGENI   • Pro...
Agenda• Part I - Emulab   • Emulab LARC/USP   • How does Emulab Works ?• Part II – ProtoGENI   • What is ProtoGENI   • Pro...
Emulab• Experimental Facility   – Developed for perform experimental network and distributed systems     research that pro...
Emulab• Main Emulab Testbed  – University of Utah     • Around 500 PC nodes;     • Design to support research and educatio...
Emulab LARC/USP• Emulab LARC:   – Sponsors: Fapesp / Kyatera & Ericsson   – 24 nodes for experiments      • 17 Intel Penti...
Emulab LARC/USP                                          Internet                                                         ...
How does it work ?   11 User define the desired topology in a ns-2 file (directly or       through a Java apple) and submi...
How does it work ?                  22a Swap-in: control system allocates the physical nodes for the     experiment    •  ...
Experiment Creation Process                       Experiment             Virtual   Real    Hardware                       ...
How does it work ?                   22b   System sends an e-mail to the user notifying that the experiment      is ready ...
Resource Allocation Process                          13
How does it work ?                                   33   Resources remotelly accesible     Tipically through ssh and/or s...
How does it work ?                                               44   Swap-out: resources are freeded for other experiment...
Agenda• Part I - Emulab   • Emulab LARC/USP   • How does Emulab Works ?• Part II – ProtoGENI   • What is ProtoGENI   • Pro...
What is ProtoGENIProtoGENI was created to provide the integration of Emulab testbedsin order to build a GENI facility.The ...
ProtoGENI CMF• Enhanced version of the Emulab Control Framework:   • SFA Architecture: Aggregate Manager (AM), Clearing   ...
SFA ArchitectureThe Clearing House behaves as a central registry coordinating  the federation.Each Aggregate Manager (Comp...
FlackFlack is a Flash-based Google Map client that allows   visualization and manipulation of federated   resources.      ...
ProtoGENI Backbone•   Composed of 8 nodes connected by                                             Backbone node Example  ...
ProtoGENI FederationIntegration of Tesbeds                                            22
GENI Federation  Other GENI   Facilities(eg. PlanetLab)                                23
ConsiderationsProtoGENI CMF is installed over Emulab  infrastructure and is highly dependent on Emulab  source code.ProtoG...
Agenda• Part I - Emulab   • Emulab LARC/USP   • How does Emulab Works ?• Part II – ProtoGENI   • What is ProtoGENI   • Pro...
DemoPre-requisitesAn account setup on one of the Emulab aggregates.The account can be requested at www.emulab.net, clickin...
Log on to FlackFirst logging in to Flack on http://protogeni.net/flack.Flack uses the credentials from your issuing author...
Create a Slice             28
Experiment DefinitionNodes can be added to the slice by dragging from the aggregate where  you want to create the node.   ...
Experiment DefinitionNodes can be added to the slice by dragging from the aggregate where  you want to create the node.   ...
Experiment                                                DefinitiionLinks between nodes are created by dragging a line fr...
Experiment DefinitionOptionally load a RSpec description of the experiment.                                               ...
Slice CreationWhen the topology is ready the slice can be created.Nodes access is done by ssh (as in Emulab)              ...
Questions        34
Upcoming SlideShare
Loading in …5
×

Emulab and ProtoGENI

1,181
-1

Published on

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
1,181
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
12
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Emulab and ProtoGENI

  1. 1. USP TeamFIBRE-BR Camp, 28-29 April 2012 Ouro Preto (MG), Brazil
  2. 2. USP Team members• General coordinator – Tereza C. M. B. Carvalho – carvalho@larc.usp.br• Team members – Marco A. Torrez Rojas – matrojas@larc.usp.br – Marcos F. Schwarz – mschwarz@larc.usp.br – Fernando F. Redígolo – fernando@larc.usp.br – Cristina K. Dominicini – cdominic@larc.usp.br – Charles C. Miers – cmiers@larc.usp.br – Paulo H. Fertonani – pfertonani@larc.usp.br – Raphael Penteado – rpenteado@larc.usp.br 2
  3. 3. Agenda• Part I - Emulab • Emulab LARC/USP • How does Emulab Works ?• Part II – ProtoGENI • What is ProtoGENI • ProtoGENI Control Monitoring Framework • ProtoGENI Backbone • ProtoGENI Federation • Considerations• Part III – Demo 3
  4. 4. Agenda• Part I - Emulab • Emulab LARC/USP • How does Emulab Works ?• Part II – ProtoGENI • What is ProtoGENI • ProtoGENI Control Monitoring Framework • ProtoGENI Backbone • ProtoGENI Federation • Considerations• Part III – Demo 4
  5. 5. Emulab• Experimental Facility – Developed for perform experimental network and distributed systems research that provides: network emulators, simulators and live networks.• Design Principals – Transparency – Virtualization – Automation – Efficiency• Provided Resources – Local nodes (PCs) • Edge nodes, wireless nodes, software-defined radio (GNU Radio) – Virtual Network Links • Arbitrary topologies, local-area links and wide-area links 5
  6. 6. Emulab• Main Emulab Testbed – University of Utah • Around 500 PC nodes; • Design to support research and education (students and professors) 6
  7. 7. Emulab LARC/USP• Emulab LARC: – Sponsors: Fapesp / Kyatera & Ericsson – 24 nodes for experiments • 17 Intel Pentium 4 (3GHz), 3GB RAM (DDR2), 80GB HD • 7 Xeon Quad-Core 2.4Ghz, 4GB RAM, 500 GB HD • All with 3 x Gb Ethernet interfaces for experiments – 3 servers • Storage of user data / OS images / Clearinghouse – 5 Gigabit switches (Cisco and Juniper) 7
  8. 8. Emulab LARC/USP Internet pc1.emulab.larc.usp.br 200.144.187.130/26 200.144.187.61/30 Datacenter’s Network pc22.emulab.larc.usp.br x3 200.144.187.151/26 Rede LARC cs00 – Cisco 3750G-24TS – L3 192.168.189.x/24 200.144.187.62/30 200.144.186.225/29 200.144.187.241/29 pc23.emulab.larc.usp.br 200.144.187.129/2 200.144.187.152/26 x3 192.168.189.2/24 x5 pc24.emulab.larc.usp.br cs01 – Juniper EX3200 24 – L2 200.144.187.153/26 x5 192.168.189.3/24 Control Network Switch Stack with 48 x Gigabit Ethernet ports es00 es01 boss.emulab.larc.usp.br es02 200.144.186.226/29 (48+24+24 Stack) 96 port 192.168.189.5/24 Gigabit Ethernet kvm.emulab.larc.usp.br console.emulab.larc.usp.br 192.168.189.4/24 192.168.189.7/24 192.168.189.6/24 VM ops.emulab.larc.usp.br clrhouse.emulab.larc.usp.br 200.144.186.242/29 200.144.187.226/29Caption : Author(s): Network Connections Marcio / Fernando Control hardware (vlan44) Control net (vlan45) Experimental net External net (vlan42) Public net (vlan43) Private net (vlan46) Revisor(s): 26/10/11 V.2.0 1 de 3 8
  9. 9. How does it work ? 11 User define the desired topology in a ns-2 file (directly or through a Java apple) and submit it to Emulab control system 9
  10. 10. How does it work ? 22a Swap-in: control system allocates the physical nodes for the experiment • Virtual topology is mapped to the physical resources, according to what is available in any given moment • These nodes are loaded with the desired OS and some basic config is done • VLAN creation for the links • Experiment customization • Default images / Custom images • Software instalation / Script execution • Static routes definition / Dynamic routing enabling 10
  11. 11. Experiment Creation Process Experiment Virtual Real Hardware Patch Pannel Programável (snmp) Node Node NodeEmulab Web A A A pc 7 pc 7 Ethernet Switches VLAN 1 Traffic Traffic Latency Shapper Shapper 50 ms 50ms 50ms Ns File pc 12 pc 12 VLAN 2 Node Node Node B B B pc15 pc15 11
  12. 12. How does it work ? 22b System sends an e-mail to the user notifying that the experiment is ready for usage 12
  13. 13. Resource Allocation Process 13
  14. 14. How does it work ? 33 Resources remotelly accesible Tipically through ssh and/or serial console SSH nodes addresses 14
  15. 15. How does it work ? 44 Swap-out: resources are freeded for other experiments • Process of freeing allocated resources • 2 main limits for an automatic swap-out • Idle-Swap: number of hours that the resources haven´t been used (e.g.: 2hs) • Max-duration: number of hours that the resources have been allocated (e.g.: 16hs) • Usually defined at experiment creation time • Manual swap-out: researcher frees resources 15
  16. 16. Agenda• Part I - Emulab • Emulab LARC/USP • How does Emulab Works ?• Part II – ProtoGENI • What is ProtoGENI • ProtoGENI Control Monitoring Framework • ProtoGENI Backbone • ProtoGENI Federation • Considerations• Part III – Demo 16
  17. 17. What is ProtoGENIProtoGENI was created to provide the integration of Emulab testbedsin order to build a GENI facility.The integration consists of three key components:• CMF: Control and Monitoring Framework software from the University of Utah, based on an enhanced version of the Emulab testbed management software• Backbone: A USA nationwide, high-speed dedicated backbone on Internet2’s wave infrastructure• Federation: A set of federated testbeds, including a variety of wireless networks (CMULab), residential broadband (CMULab), and programmable edge clusters (Emulab) that are connected to the backbone 17
  18. 18. ProtoGENI CMF• Enhanced version of the Emulab Control Framework: • SFA Architecture: Aggregate Manager (AM), Clearing House (CH), Slice Authority (SA), RSpec; • XMLRPC Interface: to AM, CM, SA; • I&M Tools: INSTOOLS and LAMP (based on perfSONAR); • Flack GUI: a Flash-based interface that allows allows visualization and manipulation of federated resources. 18
  19. 19. SFA ArchitectureThe Clearing House behaves as a central registry coordinating the federation.Each Aggregate Manager (Component Manager) is responsible for the allocation, operation and control of one or more resources.Slice Authorities are responsible for coordination, accounting and mediation of resources provided by many aggregate managers.The RSpec is a data interchange format describing resources properties. It is used in four major contexts: advertisements, requests, tickets, and manifests. 19
  20. 20. FlackFlack is a Flash-based Google Map client that allows visualization and manipulation of federated resources. 20
  21. 21. ProtoGENI Backbone• Composed of 8 nodes connected by Backbone node Example 1Gbps waves on the Internet2 infrastructure;• The backbone runs Ethernet on these waves, and is sliced with VLANs;• Each node contains a set of sliceable, user-programmable components: • PCs with NetFPGA cards • Ethernet Switches (HP Procurve) with OpenFlow-capability under implementation. 21
  22. 22. ProtoGENI FederationIntegration of Tesbeds 22
  23. 23. GENI Federation Other GENI Facilities(eg. PlanetLab) 23
  24. 24. ConsiderationsProtoGENI CMF is installed over Emulab infrastructure and is highly dependent on Emulab source code.ProtoGENI @ USP: Integrate Emulab resources under FIBRE federationClearing House documentation and code/dependecies are not properly updated. 24
  25. 25. Agenda• Part I - Emulab • Emulab LARC/USP • How does Emulab Works ?• Part II – ProtoGENI • What is ProtoGENI • ProtoGENI Control Monitoring Framework • ProtoGENI Backbone • ProtoGENI Federation • Considerations• Part III – Demo 25
  26. 26. DemoPre-requisitesAn account setup on one of the Emulab aggregates.The account can be requested at www.emulab.net, clicking on the "Request Account" button.Note that account creation require approval and may take a while. 26
  27. 27. Log on to FlackFirst logging in to Flack on http://protogeni.net/flack.Flack uses the credentials from your issuing authority. Select your authority and download the credentials. 27
  28. 28. Create a Slice 28
  29. 29. Experiment DefinitionNodes can be added to the slice by dragging from the aggregate where you want to create the node. 29
  30. 30. Experiment DefinitionNodes can be added to the slice by dragging from the aggregate where you want to create the node. Common node types: • PC (exclusive physical machine); • VM (virtual machine shared with others). 30
  31. 31. Experiment DefinitiionLinks between nodes are created by dragging a line from one node to another. 31
  32. 32. Experiment DefinitionOptionally load a RSpec description of the experiment. 32
  33. 33. Slice CreationWhen the topology is ready the slice can be created.Nodes access is done by ssh (as in Emulab) 33
  34. 34. Questions 34
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×