FIBRE on AmLight
Enabling experimentation over a
production SDN backbone
Marcos Schwarz
Internet2 Global Summit, Washington DC, April 27th 2015
Evolution of FIBRE: a large-scale Future
Internet testbed facility
• Original objective: design, implement and validate a shared large-scale
testbed to support experimental research in Future Internet.
• Studies began in 2008, inspired by GENI (USA) and by the FIRE (Future
Internet Research and Experimentation) program of the EU
• Funding provided 2011-2014 through the 2010 1st Coordinated Call in
ICT between Brazil and the EU, supporting a single FI testbed project,
FIBRE (FI testbed/experimentation between Brazil and Europe).
• FIBRE includes 10 nodes in Brazil and 3 in the EU. The follow-on FIBRE2
project is being funded in Brazil to support the operation, maintenance
and expansion of the existing testbed, for use by the approved project
on “experimental platforms” selected in the 2014 3rd CC.
• On-going conversations were initiated in 2013 to promote the
international federation of the FI testbeds, including FIBRE.
Federation (international)
3
Federation (Brazil)
4
UFF
UFSCar
UNIFACS
UFPE
UFG
UFPA
RNP/NOC
USP
CPqD UFRJ
Wireless experimental facility
OFELIA Control Framework
OMF
UFRJ
UFF
RNP
UFPEUFPA UNIFACS
OMFOCF
UFG
OMFOCF
UFSCar
USP
CPqD
OMFOCF
OMFOCF
PoP-BA
PoP-PA
PoP-GO PoP-DF
PoP-RJ
PoP-Pe
PoP-SP
NOC
OMF
OCF
OCFOCF
OCF
OCF
USA
Spain
UK
OCF
OCF
AMPATH
OCF
Architecture
5
Situation as of Feb 2015
Europe Interconnection
6
VLAN Translation
PoP-DF
Barueri-SP (Terremark)
RedCLARA
Cisco Catalyst 3750
RedIRIS
Cisco Catalyst 3750
CESCA
Cisco Catalyst 3750
PoP-SP
RNP MX480 Internet2
Miami, USA (Terremark)
UnivBris
ANSP XMR
10.0.0.6/30
VLAN RNP - i2Cat (689)
Brocade CES 2024
RNP MX480
FIBRE SW
PoP-DF
FIBRE SW
RNP
10.0.0.5/30
AMPATH XMR
689
689
689
i2Cat
10.0.0.1/30
VLAN RNP <-> UnivBris (458 / 404 / 900)
Cisco
Catalyst 3750
Gateway
458 458 458
404
GÉANT
404
689 689
689
689
458
458
458
689
689
900
458
JANET 900
9004082
689689
10.0.0.2/30
3220
FIBRE-BR Islands
3220
Bristol Island
4082
i2cat Island
40824082
Routing
FIBRE Backbone @ RNP
7
Data Plane - March/2015
AMPATH
FIBRE-RJFIBRE-SP
FIBRE-GO
RNP-GO
RNP-RJ
FIBRE-DF
RNP-DF
FIBRE-BA
FIBRE-PE
RNP-PE
FIBRE-PA
RNP-SP
RNP-BA
RNP-PA
AMPATH Interconnection
8
FIBRE Backbone @ RNPFIBRE Backbone @ AmLightAMPATH Island
AMPATH1
AMPATH2
Chile1
Chile2
AmLight SDN
FIBRE Slice
VLAN Range:
100-400
ANSP
Pica8
VMs Server
FIBRE-SP
RNP-SP
Software Architecture
9
Technical details and issues
• Interconnection solutions
• RNP backbone: slice of dedicated OpenFlow switches interconnected through
L2VPNs (MPLS+QinQ) over a non-OpenFlow backbone
• AmLight backbone: slice of a production SDN backbone of virtualized Brocade
OpenFlow switches
• Production vs Experimentation mindset
• How to provide the same features and experience of a dedicated experimental
facility but keeping the stability and availability of a production environment?
• FIBRE slices on production OpenFlow Switches
• Packtins (Reactive mode) are disabled on AmLight switches
• Specific flows wre installed per slice to restore reactive behavior
• FlowVisor Topology Discovery service required untagged LLDP packets using reactive
mode of OpenFlow
• Layer 2 Tunnels vs SDN virtualization
• Moving the overhead from the data to the control plane
Thank you / Obrigado
Marcos Schwarz
marcos.schwarz @ rnp.br
RNP
www.facebook.com/fibre.project
www.fibre.org.br
FIBRE Overhead Comparison
12

FIBRE on AmLight

  • 1.
    FIBRE on AmLight Enablingexperimentation over a production SDN backbone Marcos Schwarz Internet2 Global Summit, Washington DC, April 27th 2015
  • 2.
    Evolution of FIBRE:a large-scale Future Internet testbed facility • Original objective: design, implement and validate a shared large-scale testbed to support experimental research in Future Internet. • Studies began in 2008, inspired by GENI (USA) and by the FIRE (Future Internet Research and Experimentation) program of the EU • Funding provided 2011-2014 through the 2010 1st Coordinated Call in ICT between Brazil and the EU, supporting a single FI testbed project, FIBRE (FI testbed/experimentation between Brazil and Europe). • FIBRE includes 10 nodes in Brazil and 3 in the EU. The follow-on FIBRE2 project is being funded in Brazil to support the operation, maintenance and expansion of the existing testbed, for use by the approved project on “experimental platforms” selected in the 2014 3rd CC. • On-going conversations were initiated in 2013 to promote the international federation of the FI testbeds, including FIBRE.
  • 3.
  • 4.
  • 5.
    Wireless experimental facility OFELIAControl Framework OMF UFRJ UFF RNP UFPEUFPA UNIFACS OMFOCF UFG OMFOCF UFSCar USP CPqD OMFOCF OMFOCF PoP-BA PoP-PA PoP-GO PoP-DF PoP-RJ PoP-Pe PoP-SP NOC OMF OCF OCFOCF OCF OCF USA Spain UK OCF OCF AMPATH OCF Architecture 5 Situation as of Feb 2015
  • 6.
    Europe Interconnection 6 VLAN Translation PoP-DF Barueri-SP(Terremark) RedCLARA Cisco Catalyst 3750 RedIRIS Cisco Catalyst 3750 CESCA Cisco Catalyst 3750 PoP-SP RNP MX480 Internet2 Miami, USA (Terremark) UnivBris ANSP XMR 10.0.0.6/30 VLAN RNP - i2Cat (689) Brocade CES 2024 RNP MX480 FIBRE SW PoP-DF FIBRE SW RNP 10.0.0.5/30 AMPATH XMR 689 689 689 i2Cat 10.0.0.1/30 VLAN RNP <-> UnivBris (458 / 404 / 900) Cisco Catalyst 3750 Gateway 458 458 458 404 GÉANT 404 689 689 689 689 458 458 458 689 689 900 458 JANET 900 9004082 689689 10.0.0.2/30 3220 FIBRE-BR Islands 3220 Bristol Island 4082 i2cat Island 40824082 Routing
  • 7.
    FIBRE Backbone @RNP 7 Data Plane - March/2015 AMPATH FIBRE-RJFIBRE-SP FIBRE-GO RNP-GO RNP-RJ FIBRE-DF RNP-DF FIBRE-BA FIBRE-PE RNP-PE FIBRE-PA RNP-SP RNP-BA RNP-PA
  • 8.
    AMPATH Interconnection 8 FIBRE Backbone@ RNPFIBRE Backbone @ AmLightAMPATH Island AMPATH1 AMPATH2 Chile1 Chile2 AmLight SDN FIBRE Slice VLAN Range: 100-400 ANSP Pica8 VMs Server FIBRE-SP RNP-SP
  • 9.
  • 10.
    Technical details andissues • Interconnection solutions • RNP backbone: slice of dedicated OpenFlow switches interconnected through L2VPNs (MPLS+QinQ) over a non-OpenFlow backbone • AmLight backbone: slice of a production SDN backbone of virtualized Brocade OpenFlow switches • Production vs Experimentation mindset • How to provide the same features and experience of a dedicated experimental facility but keeping the stability and availability of a production environment? • FIBRE slices on production OpenFlow Switches • Packtins (Reactive mode) are disabled on AmLight switches • Specific flows wre installed per slice to restore reactive behavior • FlowVisor Topology Discovery service required untagged LLDP packets using reactive mode of OpenFlow • Layer 2 Tunnels vs SDN virtualization • Moving the overhead from the data to the control plane
  • 11.
    Thank you /Obrigado Marcos Schwarz marcos.schwarz @ rnp.br RNP www.facebook.com/fibre.project www.fibre.org.br
  • 12.