SlideShare a Scribd company logo
José Augusto Suruagy (UFPE)
Joberto S. B. Martins (UNIFACS)
2nd perfSONAR Workshop
Arlington – February 20, 2014
Monitoring in Federated Future
Internet Testbeds: the FIBRE case
The FIBRE Project
The main objective of this project is to create a common space
between the EU and Brazil for Future Internet (FI)
experimental research into network infrastructure and
distributed applications, by building and operating a federated
EU-Brazil Future internet experimental facility
The project is designing, implementing and validating a shared Future Internet
research facility between Brazil and Europe, supporting joint Future Internet
experimentation of European and Brazilian researchers
2
FIBRE Partners
3
FIBRE Testbeds
4
Monitoring & Federation Context
• Monitoring Scope:
• Infrastructure:
• Objective: support NOC/administrators in FIBRE facility management and
experimenters in finding out alternatives in terms of available and usable
resources (links, machines, switches, …)
• Experiment (slice):
• Objective: support the experiment itself monitoring parameters like,
throughput, loss, … in a specific slice (experiment context)
• Monitoring Types:
• Active Measurements
• Passive Measurements
• Measurement tools per CMF:
• OCF: none native
• OMF: OML (-> GIMI)
• ProtoGENI: LAMP (pS) + INSTOOLS (-> GEMINI)
5
Monitoring & Federation Context
• Portal/Monitoring GUI and gateway(s) global view:
6
OCF OMF
Proto
GENI
Portal
/ Tool
GW
MDIP, TopHat GW, …
GW
FIBRE-BR I&M Portal,
TopHat, …
GW
CMFs (BR & EU;
communities)
Monitoring & Federation Context
(Related but Independent Solutions)
Monitoring Federation Use Cases
Measurement Configuration and Types
• Measurement Configuration:
• Intra-CMF
• Inter-CMF
• Measurement Use Cases
• Infrastructure measurements:
• UC 1: Active measurements
• UC 2: Passive measurements
• Experiment/Slice measurements
• UC 3: Intra-CMF
• UC 4: Inter-CMF
8
Monitoring Federation Use Cases
Measurement Configuration Alternatives
• “Intra” and “Inter”- CMF measurements
9
Monitoring Federation Use Cases
Infrastructure Measurements
• UC 1: Infrastructure active measurements
10
Monitoring Federation Use Cases
Infrastructure Measurements
UC 1: Infrastructure active measurements
• Proposal
– Install perfSONAR PS Toolkit nodes at each FIBRE island
– Provide a Dashboard at NOC with global view of the
testbed’s performance
– Develop a gateway to translate perfSONAR data to TopHat
standard (in progress)
11
Monitoring Federation Use Cases
Infrastructure Measurements
• perfSONAR Dashboard prototype implementation
12
Monitoring Federation Use Cases
Infrastructure Measurements
• UC 2: Infrastructure passive measurements
– Monitoring a variety of metrics (CPU, memory, NIC
utilization, etc.)
13
Monitoring Federation Use Cases
UC 3: Intra-CMF measurements
14
Portals
MI
Service
Data Plane
Control Plane
4
ii
2
MDA
iv
Portals
GUIs
A multi-CMF Slice
OCF
intra-CMF
measurement Experimenter
Gateway
A
P
I
1
3
i
iii
ProtoGENI
Gateway
A
P
I
• UC 3: Intra-CMF measurements
• Proposal:
– CMF’s native I&M software (e.g.: GEMINI on ProtoGENI) is
responsible for the measurement management and
configuration (the experimenter will use the CMF’s I&M
Portal)
– Gateways (such as MDIPs) are responsible for exposing the
measurement data collected by the CMF’s I&M software in
a standardized format
15
Monitoring Federation Use Cases
Experiment/Slice Measurements
16
Monitoring Federation Use Cases
UC3: ProtoGENI MDIP (Implemented)
17
Monitoring Federation Use Cases
UC3: ProtoGENI MDIP (Proposed)
Monitoring Federation Use Cases
UC3: OCF MDIP
19
Monitoring Federation Use Cases
UC 4: Inter-CMF measurements
Portals
MI
Service
Data Plane
Control Plane
MDA
Portals
GUIs
A multi-CMF Slice
Experimenter
Orch.
Service
1
2
4
OCF
ProtoGENI
Gateway
A
P
I
Gateway
A
P
I
M. Tool
M. Tool
3 inter-CMF
measurement
• UC 4: Inter-CMF measurements
• Proposal:
– Each node, regardless of “its CMF”, comes with a common
measurement tool pre-installed. This way, measurements
become possible between any node pair
– A gateway abstracts the configuration and data exposal
complexities of the common tool through a standard API, so:
– The experimenter can use ANY Portal to configure
measurements and retrieve data
• Alternatives:
– perfSONAR BUOY
– OML
20
Monitoring Federation Use Cases
Experiment/Slice Measurements
21
Monitoring Federation Use Cases
UC4: Instrumentation Phase
ProtoGENI slice
Orchestration
Service
Portals
Portals
Portals
RESTAPI
registerSlice()
addNode()
1
22
Monitoring Federation Use Cases
UC4: Measurement Configuration Phase
ProtoGENI slice
Orchestration
Service
Portals
Portals
Portals
1
Agent
GW API
BUOY
BUOY
measure!
Agent
GW
API
RESTAPI
addTest()
3
3 fetch data
Goal:
• Turn OML into a perfSONAR-enabled solution
• PS-like query for experiment data:
• NMWG measurement data format
• All communication will be made through Web Services to
receive and retrieve data
23
Monitoring Federation Use Cases
UC4: OML MDIP
Monitoring Federation Use Cases
UC4: OML MDIP
24
• Testbeds Federation x Multi-Domain
– Specially for Infrastructure measurements (each testbed uses its own
tools)
• Need for a common data measurement report format and
protocol
– Webservices, NMWG (XML x JSON), NML, extended with other
resources (servers, VMs, etc.) measurement report formats
• Need for measurement tool gateway in case of similar but
heterogeneous tools
– E.g., Owamp x ETOMIC
• Extend SFA with a sort of MSpec (Measurement Specification)
– To retrieve, reserve (if necessary), schedule tests, and fetch data from
available infrastructure measurement resources
25
Monitoring Federation in FI Testbeds
Challenges/Issues
• Universal Measurement Information?
• Measurement software tools deployed as experimenter own
software:
– Hopefully without requiring that the experimenter be a measurement expert
– Avoids heterogeneity problems
• Specialized Hardware Measurement Tools:
– E.g., DAG cards, wireless band interference monitors, etc.
– Availability and heterogeneity issues
• Persistent data archiving (format and location issues)
• Experiment repeatability issues:
– Specialized resources may not be always available
26
Monitoring Federation in FI Testbeds
Challenges/Issues
• Constraint based resource orchestration:
– Orchestration agent for each CMF and one summary agent for the island
27
Monitoring Federation in FI Testbeds
Challenges/Issues
Thank you
José Augusto Suruagy/UFPE
suruagy@cin.ufpe.br
Joberto S. B. Martins/UNIFACS
joberto@unifacs.br
twitter.com/FIBRE_project
www.facebook.com/fibre.project
www.fibre-ict.eu
28

More Related Content

Viewers also liked

Proyecto sinai ESPECIES FORESTALES AMAZONICAS
Proyecto sinai ESPECIES FORESTALES AMAZONICAS Proyecto sinai ESPECIES FORESTALES AMAZONICAS
Proyecto sinai ESPECIES FORESTALES AMAZONICAS
Jorge Barrera
 
Wings For Life F1 David Coulthard Presentation Dh
Wings For Life F1 David Coulthard Presentation DhWings For Life F1 David Coulthard Presentation Dh
Wings For Life F1 David Coulthard Presentation Dh
David Hornby
 
Greek red wines
Greek red wines Greek red wines
Greek red wines
Eleni Kabaraki
 
Xtranormal Cheat Sheet
Xtranormal Cheat SheetXtranormal Cheat Sheet
Xtranormal Cheat Sheet
The Daring Librarian Experience
 
qwest communications Q_1q08_er_attach_v2
qwest communications Q_1q08_er_attach_v2qwest communications Q_1q08_er_attach_v2
qwest communications Q_1q08_er_attach_v2
finance19
 
Monitor: Emerging Markets
Monitor:  Emerging  MarketsMonitor:  Emerging  Markets
Monitor: Emerging Markets
00shelly
 
Vuoi stare online?
Vuoi stare online?Vuoi stare online?
Vuoi stare online?
tagbologna lab
 
Winners of the
Winners of theWinners of the
Winners of the
Paola Padilla
 
Dominio Web 2003
Dominio Web 2003Dominio Web 2003
Dominio Web 2003
nathy xP
 
Azzist partner
Azzist partnerAzzist partner
Azzist partner
azzistmedia
 
Junar
JunarJunar
Donald kacsa magazin_2008._13.szam
Donald kacsa magazin_2008._13.szamDonald kacsa magazin_2008._13.szam
Donald kacsa magazin_2008._13.szam
Wyldebeest
 
Dominio4 comentarios
Dominio4 comentariosDominio4 comentarios
Dominio4 comentarios
1 2d
 
Rio tinto ca
Rio tinto caRio tinto ca
Rio tinto ca
Enku Enkhtsetseg
 
Proyecto sist informacion ii_esquema_avance - face de inicio
Proyecto sist informacion ii_esquema_avance - face de inicioProyecto sist informacion ii_esquema_avance - face de inicio
Proyecto sist informacion ii_esquema_avance - face de inicio
SoftwaresMasters
 
Trabalho Da Neide Rosa
Trabalho Da Neide RosaTrabalho Da Neide Rosa
Trabalho Da Neide Rosa
soniaitaalo
 
XWiki @ Jazoon 2009
XWiki @ Jazoon 2009XWiki @ Jazoon 2009
XWiki @ Jazoon 2009
Vincent Massol
 

Viewers also liked (18)

Proyecto sinai ESPECIES FORESTALES AMAZONICAS
Proyecto sinai ESPECIES FORESTALES AMAZONICAS Proyecto sinai ESPECIES FORESTALES AMAZONICAS
Proyecto sinai ESPECIES FORESTALES AMAZONICAS
 
Wings For Life F1 David Coulthard Presentation Dh
Wings For Life F1 David Coulthard Presentation DhWings For Life F1 David Coulthard Presentation Dh
Wings For Life F1 David Coulthard Presentation Dh
 
Greek red wines
Greek red wines Greek red wines
Greek red wines
 
Xtranormal Cheat Sheet
Xtranormal Cheat SheetXtranormal Cheat Sheet
Xtranormal Cheat Sheet
 
qwest communications Q_1q08_er_attach_v2
qwest communications Q_1q08_er_attach_v2qwest communications Q_1q08_er_attach_v2
qwest communications Q_1q08_er_attach_v2
 
Monitor: Emerging Markets
Monitor:  Emerging  MarketsMonitor:  Emerging  Markets
Monitor: Emerging Markets
 
Vuoi stare online?
Vuoi stare online?Vuoi stare online?
Vuoi stare online?
 
Winners of the
Winners of theWinners of the
Winners of the
 
Dominio Web 2003
Dominio Web 2003Dominio Web 2003
Dominio Web 2003
 
Azzist partner
Azzist partnerAzzist partner
Azzist partner
 
Outi kahkonen eworkingprojekti
Outi kahkonen eworkingprojektiOuti kahkonen eworkingprojekti
Outi kahkonen eworkingprojekti
 
Junar
JunarJunar
Junar
 
Donald kacsa magazin_2008._13.szam
Donald kacsa magazin_2008._13.szamDonald kacsa magazin_2008._13.szam
Donald kacsa magazin_2008._13.szam
 
Dominio4 comentarios
Dominio4 comentariosDominio4 comentarios
Dominio4 comentarios
 
Rio tinto ca
Rio tinto caRio tinto ca
Rio tinto ca
 
Proyecto sist informacion ii_esquema_avance - face de inicio
Proyecto sist informacion ii_esquema_avance - face de inicioProyecto sist informacion ii_esquema_avance - face de inicio
Proyecto sist informacion ii_esquema_avance - face de inicio
 
Trabalho Da Neide Rosa
Trabalho Da Neide RosaTrabalho Da Neide Rosa
Trabalho Da Neide Rosa
 
XWiki @ Jazoon 2009
XWiki @ Jazoon 2009XWiki @ Jazoon 2009
XWiki @ Jazoon 2009
 

Similar to Monitoring in Federated Future Internet Testbeds: the FIBRE case

FIT@BR – a Future Internet Testbed in Brazil
FIT@BR – a Future Internet Testbed in BrazilFIT@BR – a Future Internet Testbed in Brazil
FIT@BR – a Future Internet Testbed in Brazil
FIBRE Testbed
 
Education using FIRE
Education using FIRE Education using FIRE
Education using FIRE
FORGE project
 
FIBRE testbed
FIBRE testbed FIBRE testbed
FIBRE testbed
EUBrasilCloudFORUM .
 
FIBRE (legacy) testbed Future Perspectives
FIBRE (legacy) testbed Future PerspectivesFIBRE (legacy) testbed Future Perspectives
FIBRE (legacy) testbed Future Perspectives
FIBRE Testbed
 
Using Future Internet testbeds in the classroom
Using Future Internet testbeds in the classroomUsing Future Internet testbeds in the classroom
Using Future Internet testbeds in the classroom
FIBRE Testbed
 
01-06 OCRE Test Suite - Fernandes.pdf
01-06 OCRE Test Suite - Fernandes.pdf01-06 OCRE Test Suite - Fernandes.pdf
01-06 OCRE Test Suite - Fernandes.pdf
OCRE | Open Clouds for Research Environments
 
Florian Schreiner: Plans for open calls and offering by BonFIRE
Florian Schreiner: Plans for open calls and offering by BonFIREFlorian Schreiner: Plans for open calls and offering by BonFIRE
Florian Schreiner: Plans for open calls and offering by BonFIRE
FIA2010
 
FIBRE at a glance - TNC14
FIBRE at a glance - TNC14 FIBRE at a glance - TNC14
FIBRE at a glance - TNC14
FIBRE Testbed
 
FIBRE project updates
FIBRE project updatesFIBRE project updates
FIBRE project updates
FIBRE Testbed
 
FIBRE testbed: Future Perspectives
FIBRE testbed: Future PerspectivesFIBRE testbed: Future Perspectives
FIBRE testbed: Future Perspectives
FIBRE Testbed
 
Federated Cloud Computing
Federated Cloud ComputingFederated Cloud Computing
Federated Cloud Computing
David Wallom
 
System Testing and Integration: Test Strategy for Brahmaputra
System Testing and Integration: Test Strategy for BrahmaputraSystem Testing and Integration: Test Strategy for Brahmaputra
System Testing and Integration: Test Strategy for Brahmaputra
OPNFV
 
Design & Deployment of a Future Internet Testbed
Design & Deployment of a Future Internet Testbed Design & Deployment of a Future Internet Testbed
Design & Deployment of a Future Internet Testbed
FIBRE Testbed
 
FIBRE & beyond
FIBRE & beyondFIBRE & beyond
FIBRE & beyond
FIBRE Testbed
 
Semantically-Enabling the Web of Things: The W3C Semantic Sensor Network Onto...
Semantically-Enabling the Web of Things: The W3C Semantic Sensor Network Onto...Semantically-Enabling the Web of Things: The W3C Semantic Sensor Network Onto...
Semantically-Enabling the Web of Things: The W3C Semantic Sensor Network Onto...
Laurent Lefort
 
The MMI Device Ontology: Enabling Sensor Integration
The MMI Device Ontology: Enabling Sensor IntegrationThe MMI Device Ontology: Enabling Sensor Integration
The MMI Device Ontology: Enabling Sensor Integration
Carlos Rueda
 
Macintyre2011
Macintyre2011Macintyre2011
Macintyre2011
Macintyre2011Macintyre2011
Jacques Magen - Future Internet Research and Experimentation (FIRE): Successf...
Jacques Magen - Future Internet Research and Experimentation (FIRE): Successf...Jacques Magen - Future Internet Research and Experimentation (FIRE): Successf...
Jacques Magen - Future Internet Research and Experimentation (FIRE): Successf...
FIA2010
 
Education using FIRE
Education using FIREEducation using FIRE
Education using FIRE
FORGE project
 

Similar to Monitoring in Federated Future Internet Testbeds: the FIBRE case (20)

FIT@BR – a Future Internet Testbed in Brazil
FIT@BR – a Future Internet Testbed in BrazilFIT@BR – a Future Internet Testbed in Brazil
FIT@BR – a Future Internet Testbed in Brazil
 
Education using FIRE
Education using FIRE Education using FIRE
Education using FIRE
 
FIBRE testbed
FIBRE testbed FIBRE testbed
FIBRE testbed
 
FIBRE (legacy) testbed Future Perspectives
FIBRE (legacy) testbed Future PerspectivesFIBRE (legacy) testbed Future Perspectives
FIBRE (legacy) testbed Future Perspectives
 
Using Future Internet testbeds in the classroom
Using Future Internet testbeds in the classroomUsing Future Internet testbeds in the classroom
Using Future Internet testbeds in the classroom
 
01-06 OCRE Test Suite - Fernandes.pdf
01-06 OCRE Test Suite - Fernandes.pdf01-06 OCRE Test Suite - Fernandes.pdf
01-06 OCRE Test Suite - Fernandes.pdf
 
Florian Schreiner: Plans for open calls and offering by BonFIRE
Florian Schreiner: Plans for open calls and offering by BonFIREFlorian Schreiner: Plans for open calls and offering by BonFIRE
Florian Schreiner: Plans for open calls and offering by BonFIRE
 
FIBRE at a glance - TNC14
FIBRE at a glance - TNC14 FIBRE at a glance - TNC14
FIBRE at a glance - TNC14
 
FIBRE project updates
FIBRE project updatesFIBRE project updates
FIBRE project updates
 
FIBRE testbed: Future Perspectives
FIBRE testbed: Future PerspectivesFIBRE testbed: Future Perspectives
FIBRE testbed: Future Perspectives
 
Federated Cloud Computing
Federated Cloud ComputingFederated Cloud Computing
Federated Cloud Computing
 
System Testing and Integration: Test Strategy for Brahmaputra
System Testing and Integration: Test Strategy for BrahmaputraSystem Testing and Integration: Test Strategy for Brahmaputra
System Testing and Integration: Test Strategy for Brahmaputra
 
Design & Deployment of a Future Internet Testbed
Design & Deployment of a Future Internet Testbed Design & Deployment of a Future Internet Testbed
Design & Deployment of a Future Internet Testbed
 
FIBRE & beyond
FIBRE & beyondFIBRE & beyond
FIBRE & beyond
 
Semantically-Enabling the Web of Things: The W3C Semantic Sensor Network Onto...
Semantically-Enabling the Web of Things: The W3C Semantic Sensor Network Onto...Semantically-Enabling the Web of Things: The W3C Semantic Sensor Network Onto...
Semantically-Enabling the Web of Things: The W3C Semantic Sensor Network Onto...
 
The MMI Device Ontology: Enabling Sensor Integration
The MMI Device Ontology: Enabling Sensor IntegrationThe MMI Device Ontology: Enabling Sensor Integration
The MMI Device Ontology: Enabling Sensor Integration
 
Macintyre2011
Macintyre2011Macintyre2011
Macintyre2011
 
Macintyre2011
Macintyre2011Macintyre2011
Macintyre2011
 
Jacques Magen - Future Internet Research and Experimentation (FIRE): Successf...
Jacques Magen - Future Internet Research and Experimentation (FIRE): Successf...Jacques Magen - Future Internet Research and Experimentation (FIRE): Successf...
Jacques Magen - Future Internet Research and Experimentation (FIRE): Successf...
 
Education using FIRE
Education using FIREEducation using FIRE
Education using FIRE
 

More from FIBRE Testbed

WPEIF 2019 - Evolução do testbed FIBRE
WPEIF 2019 - Evolução do testbed FIBREWPEIF 2019 - Evolução do testbed FIBRE
WPEIF 2019 - Evolução do testbed FIBRE
FIBRE Testbed
 
Introdução ao Testbed FIBRE e visão de futuro
Introdução ao Testbed FIBRE e visão de futuroIntrodução ao Testbed FIBRE e visão de futuro
Introdução ao Testbed FIBRE e visão de futuro
FIBRE Testbed
 
Serviço para Experimentação FIBRE
Serviço para Experimentação FIBREServiço para Experimentação FIBRE
Serviço para Experimentação FIBRE
FIBRE Testbed
 
FIBRE presentation at GEC25
FIBRE presentation at GEC25FIBRE presentation at GEC25
FIBRE presentation at GEC25
FIBRE Testbed
 
Projeto de Elasticidade e Evolução do Projeto FIBRE
Projeto de Elasticidade e Evolução do Projeto FIBREProjeto de Elasticidade e Evolução do Projeto FIBRE
Projeto de Elasticidade e Evolução do Projeto FIBRE
FIBRE Testbed
 
Future Internet Brazilian Environment for Experimentation
Future Internet Brazilian Environment for ExperimentationFuture Internet Brazilian Environment for Experimentation
Future Internet Brazilian Environment for Experimentation
FIBRE Testbed
 
FIBRE testbed: passado, presente e perspectivas
FIBRE testbed: passado, presente e perspectivasFIBRE testbed: passado, presente e perspectivas
FIBRE testbed: passado, presente e perspectivas
FIBRE Testbed
 
Fibre legacy testbed cloudscape
Fibre legacy testbed cloudscapeFibre legacy testbed cloudscape
Fibre legacy testbed cloudscape
FIBRE Testbed
 
FIBRE on AmLight
FIBRE on AmLightFIBRE on AmLight
FIBRE on AmLight
FIBRE Testbed
 
Pilot Use Case 3: BoD services over the intercontinental FIBRE infrastructure
Pilot Use Case 3: BoD services  over the intercontinental FIBRE infrastructurePilot Use Case 3: BoD services  over the intercontinental FIBRE infrastructure
Pilot Use Case 3: BoD services over the intercontinental FIBRE infrastructure
FIBRE Testbed
 
SDN for Network Operators
SDN for Network OperatorsSDN for Network Operators
SDN for Network Operators
FIBRE Testbed
 
Approaching Content Delivery in Software Defined Networking
Approaching Content Delivery in Software Defined NetworkingApproaching Content Delivery in Software Defined Networking
Approaching Content Delivery in Software Defined Networking
FIBRE Testbed
 
Colt's SDN/NFV Vision
Colt's SDN/NFV VisionColt's SDN/NFV Vision
Colt's SDN/NFV Vision
FIBRE Testbed
 
Three years of OFELIA - taking stock
Three years of OFELIA - taking stockThree years of OFELIA - taking stock
Three years of OFELIA - taking stock
FIBRE Testbed
 
From GMPLS to OpenFlow Control & Monitoring of Optical Networks
From GMPLS to OpenFlow Control & Monitoring of Optical NetworksFrom GMPLS to OpenFlow Control & Monitoring of Optical Networks
From GMPLS to OpenFlow Control & Monitoring of Optical Networks
FIBRE Testbed
 
Route flow autoconf demo 2nd sdn world congress 2013
Route flow autoconf demo   2nd sdn world congress 2013Route flow autoconf demo   2nd sdn world congress 2013
Route flow autoconf demo 2nd sdn world congress 2013
FIBRE Testbed
 
Coexistence of GMPLS and OpenFlow: rationale & approaches
Coexistence of GMPLS and OpenFlow: rationale & approachesCoexistence of GMPLS and OpenFlow: rationale & approaches
Coexistence of GMPLS and OpenFlow: rationale & approaches
FIBRE Testbed
 
FIBRE Project Overview
FIBRE Project OverviewFIBRE Project Overview
FIBRE Project Overview
FIBRE Testbed
 
FIBRE Architecture
FIBRE Architecture FIBRE Architecture
FIBRE Architecture
FIBRE Testbed
 
Federating experimental platforms as a playground for the future internet
Federating experimental platforms as a playground for the future internetFederating experimental platforms as a playground for the future internet
Federating experimental platforms as a playground for the future internet
FIBRE Testbed
 

More from FIBRE Testbed (20)

WPEIF 2019 - Evolução do testbed FIBRE
WPEIF 2019 - Evolução do testbed FIBREWPEIF 2019 - Evolução do testbed FIBRE
WPEIF 2019 - Evolução do testbed FIBRE
 
Introdução ao Testbed FIBRE e visão de futuro
Introdução ao Testbed FIBRE e visão de futuroIntrodução ao Testbed FIBRE e visão de futuro
Introdução ao Testbed FIBRE e visão de futuro
 
Serviço para Experimentação FIBRE
Serviço para Experimentação FIBREServiço para Experimentação FIBRE
Serviço para Experimentação FIBRE
 
FIBRE presentation at GEC25
FIBRE presentation at GEC25FIBRE presentation at GEC25
FIBRE presentation at GEC25
 
Projeto de Elasticidade e Evolução do Projeto FIBRE
Projeto de Elasticidade e Evolução do Projeto FIBREProjeto de Elasticidade e Evolução do Projeto FIBRE
Projeto de Elasticidade e Evolução do Projeto FIBRE
 
Future Internet Brazilian Environment for Experimentation
Future Internet Brazilian Environment for ExperimentationFuture Internet Brazilian Environment for Experimentation
Future Internet Brazilian Environment for Experimentation
 
FIBRE testbed: passado, presente e perspectivas
FIBRE testbed: passado, presente e perspectivasFIBRE testbed: passado, presente e perspectivas
FIBRE testbed: passado, presente e perspectivas
 
Fibre legacy testbed cloudscape
Fibre legacy testbed cloudscapeFibre legacy testbed cloudscape
Fibre legacy testbed cloudscape
 
FIBRE on AmLight
FIBRE on AmLightFIBRE on AmLight
FIBRE on AmLight
 
Pilot Use Case 3: BoD services over the intercontinental FIBRE infrastructure
Pilot Use Case 3: BoD services  over the intercontinental FIBRE infrastructurePilot Use Case 3: BoD services  over the intercontinental FIBRE infrastructure
Pilot Use Case 3: BoD services over the intercontinental FIBRE infrastructure
 
SDN for Network Operators
SDN for Network OperatorsSDN for Network Operators
SDN for Network Operators
 
Approaching Content Delivery in Software Defined Networking
Approaching Content Delivery in Software Defined NetworkingApproaching Content Delivery in Software Defined Networking
Approaching Content Delivery in Software Defined Networking
 
Colt's SDN/NFV Vision
Colt's SDN/NFV VisionColt's SDN/NFV Vision
Colt's SDN/NFV Vision
 
Three years of OFELIA - taking stock
Three years of OFELIA - taking stockThree years of OFELIA - taking stock
Three years of OFELIA - taking stock
 
From GMPLS to OpenFlow Control & Monitoring of Optical Networks
From GMPLS to OpenFlow Control & Monitoring of Optical NetworksFrom GMPLS to OpenFlow Control & Monitoring of Optical Networks
From GMPLS to OpenFlow Control & Monitoring of Optical Networks
 
Route flow autoconf demo 2nd sdn world congress 2013
Route flow autoconf demo   2nd sdn world congress 2013Route flow autoconf demo   2nd sdn world congress 2013
Route flow autoconf demo 2nd sdn world congress 2013
 
Coexistence of GMPLS and OpenFlow: rationale & approaches
Coexistence of GMPLS and OpenFlow: rationale & approachesCoexistence of GMPLS and OpenFlow: rationale & approaches
Coexistence of GMPLS and OpenFlow: rationale & approaches
 
FIBRE Project Overview
FIBRE Project OverviewFIBRE Project Overview
FIBRE Project Overview
 
FIBRE Architecture
FIBRE Architecture FIBRE Architecture
FIBRE Architecture
 
Federating experimental platforms as a playground for the future internet
Federating experimental platforms as a playground for the future internetFederating experimental platforms as a playground for the future internet
Federating experimental platforms as a playground for the future internet
 

Recently uploaded

Recent Advancements in the NIST-JARVIS Infrastructure
Recent Advancements in the NIST-JARVIS InfrastructureRecent Advancements in the NIST-JARVIS Infrastructure
Recent Advancements in the NIST-JARVIS Infrastructure
KAMAL CHOUDHARY
 
How RPA Help in the Transportation and Logistics Industry.pptx
How RPA Help in the Transportation and Logistics Industry.pptxHow RPA Help in the Transportation and Logistics Industry.pptx
How RPA Help in the Transportation and Logistics Industry.pptx
SynapseIndia
 
Gen-AI in Telcos: Strategies, Challenges & Impact
Gen-AI in Telcos: Strategies, Challenges & ImpactGen-AI in Telcos: Strategies, Challenges & Impact
Gen-AI in Telcos: Strategies, Challenges & Impact
aejazahamed4
 
論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...
論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...
論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...
Toru Tamaki
 
Comparison Table of DiskWarrior Alternatives.pdf
Comparison Table of DiskWarrior Alternatives.pdfComparison Table of DiskWarrior Alternatives.pdf
Comparison Table of DiskWarrior Alternatives.pdf
Andrey Yasko
 
find out more about the role of autonomous vehicles in facing global challenges
find out more about the role of autonomous vehicles in facing global challengesfind out more about the role of autonomous vehicles in facing global challenges
find out more about the role of autonomous vehicles in facing global challenges
huseindihon
 
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
Bert Blevins
 
Three New Criminal Laws in India 1 July 2024
Three New Criminal Laws in India 1 July 2024Three New Criminal Laws in India 1 July 2024
Three New Criminal Laws in India 1 July 2024
aakash malhotra
 
Best Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdfBest Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdf
Tatiana Al-Chueyr
 
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyyActive Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
RaminGhanbari2
 
How to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptxHow to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptx
Adam Dunkels
 
BEGINNER’S GUIDE TO AI AGENTS (1).pptx...
BEGINNER’S GUIDE TO AI AGENTS (1).pptx...BEGINNER’S GUIDE TO AI AGENTS (1).pptx...
BEGINNER’S GUIDE TO AI AGENTS (1).pptx...
WriteMe
 
Observability For You and Me with OpenTelemetry
Observability For You and Me with OpenTelemetryObservability For You and Me with OpenTelemetry
Observability For You and Me with OpenTelemetry
Eric D. Schabell
 
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptxRPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
SynapseIndia
 
DealBook of Ukraine: 2024 edition
DealBook of Ukraine: 2024 editionDealBook of Ukraine: 2024 edition
DealBook of Ukraine: 2024 edition
Yevgen Sysoyev
 
Evolution of iPaaS - simplify IT workloads to provide a unified view of data...
Evolution of iPaaS - simplify IT workloads to provide a unified view of  data...Evolution of iPaaS - simplify IT workloads to provide a unified view of  data...
Evolution of iPaaS - simplify IT workloads to provide a unified view of data...
Torry Harris
 
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptxDublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
Kunal Gupta
 
Data Integration Basics: Merging & Joining Data
Data Integration Basics: Merging & Joining DataData Integration Basics: Merging & Joining Data
Data Integration Basics: Merging & Joining Data
Safe Software
 
ARTIFICIAL INTELLIGENCE (AI) IN MUSIC.pdf
ARTIFICIAL INTELLIGENCE (AI) IN MUSIC.pdfARTIFICIAL INTELLIGENCE (AI) IN MUSIC.pdf
ARTIFICIAL INTELLIGENCE (AI) IN MUSIC.pdf
Inglês no Mundo Digital
 
WhatsApp Image 2024-03-27 at 08.19.52_bfd93109.pdf
WhatsApp Image 2024-03-27 at 08.19.52_bfd93109.pdfWhatsApp Image 2024-03-27 at 08.19.52_bfd93109.pdf
WhatsApp Image 2024-03-27 at 08.19.52_bfd93109.pdf
ArgaBisma
 

Recently uploaded (20)

Recent Advancements in the NIST-JARVIS Infrastructure
Recent Advancements in the NIST-JARVIS InfrastructureRecent Advancements in the NIST-JARVIS Infrastructure
Recent Advancements in the NIST-JARVIS Infrastructure
 
How RPA Help in the Transportation and Logistics Industry.pptx
How RPA Help in the Transportation and Logistics Industry.pptxHow RPA Help in the Transportation and Logistics Industry.pptx
How RPA Help in the Transportation and Logistics Industry.pptx
 
Gen-AI in Telcos: Strategies, Challenges & Impact
Gen-AI in Telcos: Strategies, Challenges & ImpactGen-AI in Telcos: Strategies, Challenges & Impact
Gen-AI in Telcos: Strategies, Challenges & Impact
 
論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...
論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...
論文紹介:A Systematic Survey of Prompt Engineering on Vision-Language Foundation ...
 
Comparison Table of DiskWarrior Alternatives.pdf
Comparison Table of DiskWarrior Alternatives.pdfComparison Table of DiskWarrior Alternatives.pdf
Comparison Table of DiskWarrior Alternatives.pdf
 
find out more about the role of autonomous vehicles in facing global challenges
find out more about the role of autonomous vehicles in facing global challengesfind out more about the role of autonomous vehicles in facing global challenges
find out more about the role of autonomous vehicles in facing global challenges
 
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
Understanding Insider Security Threats: Types, Examples, Effects, and Mitigat...
 
Three New Criminal Laws in India 1 July 2024
Three New Criminal Laws in India 1 July 2024Three New Criminal Laws in India 1 July 2024
Three New Criminal Laws in India 1 July 2024
 
Best Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdfBest Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdf
 
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyyActive Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
 
How to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptxHow to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptx
 
BEGINNER’S GUIDE TO AI AGENTS (1).pptx...
BEGINNER’S GUIDE TO AI AGENTS (1).pptx...BEGINNER’S GUIDE TO AI AGENTS (1).pptx...
BEGINNER’S GUIDE TO AI AGENTS (1).pptx...
 
Observability For You and Me with OpenTelemetry
Observability For You and Me with OpenTelemetryObservability For You and Me with OpenTelemetry
Observability For You and Me with OpenTelemetry
 
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptxRPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
RPA In Healthcare Benefits, Use Case, Trend And Challenges 2024.pptx
 
DealBook of Ukraine: 2024 edition
DealBook of Ukraine: 2024 editionDealBook of Ukraine: 2024 edition
DealBook of Ukraine: 2024 edition
 
Evolution of iPaaS - simplify IT workloads to provide a unified view of data...
Evolution of iPaaS - simplify IT workloads to provide a unified view of  data...Evolution of iPaaS - simplify IT workloads to provide a unified view of  data...
Evolution of iPaaS - simplify IT workloads to provide a unified view of data...
 
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptxDublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
 
Data Integration Basics: Merging & Joining Data
Data Integration Basics: Merging & Joining DataData Integration Basics: Merging & Joining Data
Data Integration Basics: Merging & Joining Data
 
ARTIFICIAL INTELLIGENCE (AI) IN MUSIC.pdf
ARTIFICIAL INTELLIGENCE (AI) IN MUSIC.pdfARTIFICIAL INTELLIGENCE (AI) IN MUSIC.pdf
ARTIFICIAL INTELLIGENCE (AI) IN MUSIC.pdf
 
WhatsApp Image 2024-03-27 at 08.19.52_bfd93109.pdf
WhatsApp Image 2024-03-27 at 08.19.52_bfd93109.pdfWhatsApp Image 2024-03-27 at 08.19.52_bfd93109.pdf
WhatsApp Image 2024-03-27 at 08.19.52_bfd93109.pdf
 

Monitoring in Federated Future Internet Testbeds: the FIBRE case

  • 1. José Augusto Suruagy (UFPE) Joberto S. B. Martins (UNIFACS) 2nd perfSONAR Workshop Arlington – February 20, 2014 Monitoring in Federated Future Internet Testbeds: the FIBRE case
  • 2. The FIBRE Project The main objective of this project is to create a common space between the EU and Brazil for Future Internet (FI) experimental research into network infrastructure and distributed applications, by building and operating a federated EU-Brazil Future internet experimental facility The project is designing, implementing and validating a shared Future Internet research facility between Brazil and Europe, supporting joint Future Internet experimentation of European and Brazilian researchers 2
  • 5. Monitoring & Federation Context • Monitoring Scope: • Infrastructure: • Objective: support NOC/administrators in FIBRE facility management and experimenters in finding out alternatives in terms of available and usable resources (links, machines, switches, …) • Experiment (slice): • Objective: support the experiment itself monitoring parameters like, throughput, loss, … in a specific slice (experiment context) • Monitoring Types: • Active Measurements • Passive Measurements • Measurement tools per CMF: • OCF: none native • OMF: OML (-> GIMI) • ProtoGENI: LAMP (pS) + INSTOOLS (-> GEMINI) 5
  • 6. Monitoring & Federation Context • Portal/Monitoring GUI and gateway(s) global view: 6 OCF OMF Proto GENI Portal / Tool GW MDIP, TopHat GW, … GW FIBRE-BR I&M Portal, TopHat, … GW CMFs (BR & EU; communities)
  • 7. Monitoring & Federation Context (Related but Independent Solutions)
  • 8. Monitoring Federation Use Cases Measurement Configuration and Types • Measurement Configuration: • Intra-CMF • Inter-CMF • Measurement Use Cases • Infrastructure measurements: • UC 1: Active measurements • UC 2: Passive measurements • Experiment/Slice measurements • UC 3: Intra-CMF • UC 4: Inter-CMF 8
  • 9. Monitoring Federation Use Cases Measurement Configuration Alternatives • “Intra” and “Inter”- CMF measurements 9
  • 10. Monitoring Federation Use Cases Infrastructure Measurements • UC 1: Infrastructure active measurements 10
  • 11. Monitoring Federation Use Cases Infrastructure Measurements UC 1: Infrastructure active measurements • Proposal – Install perfSONAR PS Toolkit nodes at each FIBRE island – Provide a Dashboard at NOC with global view of the testbed’s performance – Develop a gateway to translate perfSONAR data to TopHat standard (in progress) 11
  • 12. Monitoring Federation Use Cases Infrastructure Measurements • perfSONAR Dashboard prototype implementation 12
  • 13. Monitoring Federation Use Cases Infrastructure Measurements • UC 2: Infrastructure passive measurements – Monitoring a variety of metrics (CPU, memory, NIC utilization, etc.) 13
  • 14. Monitoring Federation Use Cases UC 3: Intra-CMF measurements 14 Portals MI Service Data Plane Control Plane 4 ii 2 MDA iv Portals GUIs A multi-CMF Slice OCF intra-CMF measurement Experimenter Gateway A P I 1 3 i iii ProtoGENI Gateway A P I
  • 15. • UC 3: Intra-CMF measurements • Proposal: – CMF’s native I&M software (e.g.: GEMINI on ProtoGENI) is responsible for the measurement management and configuration (the experimenter will use the CMF’s I&M Portal) – Gateways (such as MDIPs) are responsible for exposing the measurement data collected by the CMF’s I&M software in a standardized format 15 Monitoring Federation Use Cases Experiment/Slice Measurements
  • 16. 16 Monitoring Federation Use Cases UC3: ProtoGENI MDIP (Implemented)
  • 17. 17 Monitoring Federation Use Cases UC3: ProtoGENI MDIP (Proposed)
  • 18. Monitoring Federation Use Cases UC3: OCF MDIP
  • 19. 19 Monitoring Federation Use Cases UC 4: Inter-CMF measurements Portals MI Service Data Plane Control Plane MDA Portals GUIs A multi-CMF Slice Experimenter Orch. Service 1 2 4 OCF ProtoGENI Gateway A P I Gateway A P I M. Tool M. Tool 3 inter-CMF measurement
  • 20. • UC 4: Inter-CMF measurements • Proposal: – Each node, regardless of “its CMF”, comes with a common measurement tool pre-installed. This way, measurements become possible between any node pair – A gateway abstracts the configuration and data exposal complexities of the common tool through a standard API, so: – The experimenter can use ANY Portal to configure measurements and retrieve data • Alternatives: – perfSONAR BUOY – OML 20 Monitoring Federation Use Cases Experiment/Slice Measurements
  • 21. 21 Monitoring Federation Use Cases UC4: Instrumentation Phase ProtoGENI slice Orchestration Service Portals Portals Portals RESTAPI registerSlice() addNode() 1
  • 22. 22 Monitoring Federation Use Cases UC4: Measurement Configuration Phase ProtoGENI slice Orchestration Service Portals Portals Portals 1 Agent GW API BUOY BUOY measure! Agent GW API RESTAPI addTest() 3 3 fetch data
  • 23. Goal: • Turn OML into a perfSONAR-enabled solution • PS-like query for experiment data: • NMWG measurement data format • All communication will be made through Web Services to receive and retrieve data 23 Monitoring Federation Use Cases UC4: OML MDIP
  • 24. Monitoring Federation Use Cases UC4: OML MDIP 24
  • 25. • Testbeds Federation x Multi-Domain – Specially for Infrastructure measurements (each testbed uses its own tools) • Need for a common data measurement report format and protocol – Webservices, NMWG (XML x JSON), NML, extended with other resources (servers, VMs, etc.) measurement report formats • Need for measurement tool gateway in case of similar but heterogeneous tools – E.g., Owamp x ETOMIC • Extend SFA with a sort of MSpec (Measurement Specification) – To retrieve, reserve (if necessary), schedule tests, and fetch data from available infrastructure measurement resources 25 Monitoring Federation in FI Testbeds Challenges/Issues
  • 26. • Universal Measurement Information? • Measurement software tools deployed as experimenter own software: – Hopefully without requiring that the experimenter be a measurement expert – Avoids heterogeneity problems • Specialized Hardware Measurement Tools: – E.g., DAG cards, wireless band interference monitors, etc. – Availability and heterogeneity issues • Persistent data archiving (format and location issues) • Experiment repeatability issues: – Specialized resources may not be always available 26 Monitoring Federation in FI Testbeds Challenges/Issues
  • 27. • Constraint based resource orchestration: – Orchestration agent for each CMF and one summary agent for the island 27 Monitoring Federation in FI Testbeds Challenges/Issues
  • 28. Thank you José Augusto Suruagy/UFPE suruagy@cin.ufpe.br Joberto S. B. Martins/UNIFACS joberto@unifacs.br twitter.com/FIBRE_project www.facebook.com/fibre.project www.fibre-ict.eu 28