1
Expanding OpenStack Use Cases with
FIWARE
OpenStack Summit Berlin – 14 Nov 2018
Deepak Kumar Gupta
NEC
Fernando López Aguilar
FIWARE Foundation, e.V.
2
Our Introduction
▌ KC ) CCN I RK O 0RN
▌ ,MKN LV) .,
▌ MA GML ) 2LBG
▌ MR KC
l ( VC OP CUNCOGCLAC GL GLRU NCL :MROAC
PMD T OC
l : O CB A OCCO P GLRU COLC CSC MNCO GL
GLRU COLC ,O PF RKN CKMOV K L ECO
/G CPVP CKP
l MOICB KMP V GL GO R GW GML UCL ISK
: MO EC NOMBRA BCSC MNKCL DG C MAI LB
M HCA NCL :MROAC :MD T OC
l 8OCPCL V TMOIGLE P 1C B MD .,
GL 2LBG
l PPMAG CB TG F NCLP AI PGLAC /M PMK OC C PC
▌ KC ) Fernando López Aguilar
▌ ,MKN LV) /2 . /MRLB GML
▌ MA GML ) 0COK LV
▌ MR KC
l ( VC OP CUNCOGCLAC GL GLRU NCL :MROAC PMD T OC
LB :MD T OC BCSC MNKCL
l ( VC OP CUNCOGCLAC GL 2M , MRB LB +GE
K L ECKCL
l GLLCO PCSCO GL COL GML NOGACP DOMK .
,MKKGPPGML LB MIG
l ,ML OG R MO MD NCL: AI RO LM LB CP CO M FCO
NCL: AI PCOSGACP 1C GP O
l 8OCPCL V TMOIGLE P
/2 . /MRLB GML
l PPMAG CB TG F NCL: AI PGLAC , A RP OC C PC
3
Background
▌OpenStack is becoming popular choice for IaaS and is being adopted by
many enterprises and Open source communities.
▌Being open cloud platform, it is ideal IaaS platform for other
communities around cloud/IoT/PaaS.
▌FIWARE is a framework of open source platform components allowing
the acceleration of Smart Solutions development.
▌FIWARE utilizes OpenStack as cloud backbone for IaaS and thus
expanding OpenStack use cases to Smart Solutions.
▌So far FIWARE and OpenStack communities are working in silos and
there is no formal collaboration between these communities.
▌This session is an attempt to bring both communities together on
common agenda.
FIWARE Introduction
5
6
What is FIWARE
FIWARE is a …
… curated
… framework
… of open source platform components
… which can be assembled together
and with other third-party platform
components,
... to accelerate the development of
Smart Solutions.
Data/APIManagementPublicationMonetization
Context
Management (Core)
Context
Processing, Analysis, Visualization
Interface to
IoT, Robotics and 3rd-party systems
Deploymenttools
7
FIWARE: The Open Source platform for smart solutions
Smart
Industry
Smart
Agrifood
Smart
Retail
Smart
Home
Smart
City
Virtual Shared Data Space
Smart
Servicesstandard
API
▌ Organizations in different domains can
interchange data based on a common
Context Information Management layer.
▌ Authorization and Access Control Policies
govern who can access what, when
(Sovereign of Data).
▌ Organizations may monetize the data they
offer (Economy of Data).
FIWARE NGSI and Context Broker
Technology has been selected to
become a CEF (Connecting Europe
Facility) Building Block.
8
FIWARE: The Open Source platform for smart solutions
FIWARE = OpenStack based Cloud + Generic Enablers
▌ FIWARE Generic Enablers (GE) are free open source
software of "reasonable" quality which are maintained
and have some connection to context data.
▌ Can be assembled together and with other 3rd-party
platform components to accelerate the development
of Smart Solutions.
▌ OpenStack offers the experimentation environment to
assembly the different components to create a smart
solution.
▌ FIWARE publishes all FIWARE GEs on FIWARE
Catalogue
(https://www.fiware.org/developers/catalogue/)
Data =
Context Information
Capture
Actuate Process
9
FIWARE Platform Architecture overview: FIWARE Catalogue
Data/APIManagement
PublicationMonetization
Core Context
Management
(Context Broker)
Context
Processing, Analysis,
Visualization
Interface to
IoT, Robotics and third
party systems
Deploymenttools
▌ The core component of any “Powered by
FIWARE” platform/solution is the FIWARE
Orion Context Broker GE.
▌ Around Orion there is a rich suite of
complementary FIWARE components:
l Core Context Management manipulates and stores
context data.
l Interfacing with the Internet of
Things, Robots and third-party systems, for
capturing updates on context information and
translating required actuations.
l Processing, analysis and visualization of context
information, implementing smart behaviour of
applications and/or making smart decisions.
l Context Data/API management, publication and
monetization, for usage control, publishing, and
monetizing of context data.
10
FIWARE Advantages
FIWARE advantages for Smart City, Smart Industry and Smart agro Projects
▌ Easy to implement & Ensure interoperability
l Easy development and deployment over cloud network
l Provides tools & standard data models which ease application creation
▌ Easily scalable
l Support ecosystem for easy scaling by utilizing existing component i.e. Generic Enablers GEs
▌ Open APIs standards
l Provide cloud capability hosting with OpenStack and support extensive library of component i.e. GEs which provide open
standard (NGSI) API
▌ Allows the development of powerful Apps and data fed in real-time
▌ Faster and more efficient launch
l In FIWARE, API specifications are public and free, exempt from royalties
l They are supported by an open source reference implementations i.e. GEri, so vendors can go to market faster.
▌ Provides context information massively
l Data is compiled in context by Context broker GE which supports generate, collect, analyze in real-time and publish
information
FIWARE Lab : OpenStack + FIWARE Integration
12
FIWARE Lab federated nodes
4 4
1 +
13
FIWARE Lab – Federated OpenStack Nodes
FIWARE Lab is hosted FIWARE Platform which provides development environment to
developers
▌Innovation and experiment based on FIWARE possible using this free sandbox
environment
l FIWARE Lab is distributed and arranged geographically on the network of synchronizing FIWARE Lab
Nodes.
l The IaaS base of FIWARE Lab is OpenStack.
14
FIWARE Lab distributed architecture
Authentication
Monitoring & Tools
Dashboard (GUI)
FIWARE Master Node
FIWARE Federated Node 1 FIWARE Federated Node n
…
15
FIWARE Lab Monitoring High Level Architecture
FIWARE Infographics
Master Node
Infrastructure owners
and subscribed usersFIHealth Tool
API
GET measurements
for visualization
POST sanity
measurements
NGSI
Adapter
API
change
notifications
. . .
Monasca API
InfluxDB
Metrics
database
BigData Analysis
(FIWARE Cosmos GE)
MD-VPN
POST monitoring
data from
Ceilometer & Agent
Internet
Node 1 Node n
Monasca Agent
Ceilosca
Monasca Agent
Ceilosca
16
FIWARE data flow
+
Host
pollster
Node
pollster
Node n
+
Ceilosca
Monasca API
Monasca
Agent
Cloud controller spread across multiple nodes
Database, API server, Network controller, Scheduler, Volume controller, Object Storage or Glance server
Computes nodes
Servers running virtual instances
+
*
*
*
Ceilometer*
FIWARE Lab Future Directions and Expectation
from OpenStack Components
18
The Road Ahead
▌Follow the Monasca architecture for Federated Monitoring data.
▌ELK for monitoring OpenStack log data.
▌Grafana dashboard in Monitoring system.
▌Integration of Federated identity management between different
keystone identities.
▌Docker deployment support over Baremetal and/or VMs
(Magnum, Ironic, or just nova-docker?).
▌HA of OpenStack Horizon.
Backup slides
21
FIWARE : Simple Application Reference Architecture
22
FIWARE Reference Architecture for System of Systems
23
FIWARE Reference Architecture for System of Systems
24
FIWARE Reference Architecture for System of Systems

Berlin OpenStack Summit'18

  • 1.
    1 Expanding OpenStack UseCases with FIWARE OpenStack Summit Berlin – 14 Nov 2018 Deepak Kumar Gupta NEC Fernando López Aguilar FIWARE Foundation, e.V.
  • 2.
    2 Our Introduction ▌ KC) CCN I RK O 0RN ▌ ,MKN LV) ., ▌ MA GML ) 2LBG ▌ MR KC l ( VC OP CUNCOGCLAC GL GLRU NCL :MROAC PMD T OC l : O CB A OCCO P GLRU COLC CSC MNCO GL GLRU COLC ,O PF RKN CKMOV K L ECO /G CPVP CKP l MOICB KMP V GL GO R GW GML UCL ISK : MO EC NOMBRA BCSC MNKCL DG C MAI LB M HCA NCL :MROAC :MD T OC l 8OCPCL V TMOIGLE P 1C B MD ., GL 2LBG l PPMAG CB TG F NCLP AI PGLAC /M PMK OC C PC ▌ KC ) Fernando López Aguilar ▌ ,MKN LV) /2 . /MRLB GML ▌ MA GML ) 0COK LV ▌ MR KC l ( VC OP CUNCOGCLAC GL GLRU NCL :MROAC PMD T OC LB :MD T OC BCSC MNKCL l ( VC OP CUNCOGCLAC GL 2M , MRB LB +GE K L ECKCL l GLLCO PCSCO GL COL GML NOGACP DOMK . ,MKKGPPGML LB MIG l ,ML OG R MO MD NCL: AI RO LM LB CP CO M FCO NCL: AI PCOSGACP 1C GP O l 8OCPCL V TMOIGLE P /2 . /MRLB GML l PPMAG CB TG F NCL: AI PGLAC , A RP OC C PC
  • 3.
    3 Background ▌OpenStack is becomingpopular choice for IaaS and is being adopted by many enterprises and Open source communities. ▌Being open cloud platform, it is ideal IaaS platform for other communities around cloud/IoT/PaaS. ▌FIWARE is a framework of open source platform components allowing the acceleration of Smart Solutions development. ▌FIWARE utilizes OpenStack as cloud backbone for IaaS and thus expanding OpenStack use cases to Smart Solutions. ▌So far FIWARE and OpenStack communities are working in silos and there is no formal collaboration between these communities. ▌This session is an attempt to bring both communities together on common agenda.
  • 4.
  • 5.
  • 6.
    6 What is FIWARE FIWAREis a … … curated … framework … of open source platform components … which can be assembled together and with other third-party platform components, ... to accelerate the development of Smart Solutions. Data/APIManagementPublicationMonetization Context Management (Core) Context Processing, Analysis, Visualization Interface to IoT, Robotics and 3rd-party systems Deploymenttools
  • 7.
    7 FIWARE: The OpenSource platform for smart solutions Smart Industry Smart Agrifood Smart Retail Smart Home Smart City Virtual Shared Data Space Smart Servicesstandard API ▌ Organizations in different domains can interchange data based on a common Context Information Management layer. ▌ Authorization and Access Control Policies govern who can access what, when (Sovereign of Data). ▌ Organizations may monetize the data they offer (Economy of Data). FIWARE NGSI and Context Broker Technology has been selected to become a CEF (Connecting Europe Facility) Building Block.
  • 8.
    8 FIWARE: The OpenSource platform for smart solutions FIWARE = OpenStack based Cloud + Generic Enablers ▌ FIWARE Generic Enablers (GE) are free open source software of "reasonable" quality which are maintained and have some connection to context data. ▌ Can be assembled together and with other 3rd-party platform components to accelerate the development of Smart Solutions. ▌ OpenStack offers the experimentation environment to assembly the different components to create a smart solution. ▌ FIWARE publishes all FIWARE GEs on FIWARE Catalogue (https://www.fiware.org/developers/catalogue/) Data = Context Information Capture Actuate Process
  • 9.
    9 FIWARE Platform Architectureoverview: FIWARE Catalogue Data/APIManagement PublicationMonetization Core Context Management (Context Broker) Context Processing, Analysis, Visualization Interface to IoT, Robotics and third party systems Deploymenttools ▌ The core component of any “Powered by FIWARE” platform/solution is the FIWARE Orion Context Broker GE. ▌ Around Orion there is a rich suite of complementary FIWARE components: l Core Context Management manipulates and stores context data. l Interfacing with the Internet of Things, Robots and third-party systems, for capturing updates on context information and translating required actuations. l Processing, analysis and visualization of context information, implementing smart behaviour of applications and/or making smart decisions. l Context Data/API management, publication and monetization, for usage control, publishing, and monetizing of context data.
  • 10.
    10 FIWARE Advantages FIWARE advantagesfor Smart City, Smart Industry and Smart agro Projects ▌ Easy to implement & Ensure interoperability l Easy development and deployment over cloud network l Provides tools & standard data models which ease application creation ▌ Easily scalable l Support ecosystem for easy scaling by utilizing existing component i.e. Generic Enablers GEs ▌ Open APIs standards l Provide cloud capability hosting with OpenStack and support extensive library of component i.e. GEs which provide open standard (NGSI) API ▌ Allows the development of powerful Apps and data fed in real-time ▌ Faster and more efficient launch l In FIWARE, API specifications are public and free, exempt from royalties l They are supported by an open source reference implementations i.e. GEri, so vendors can go to market faster. ▌ Provides context information massively l Data is compiled in context by Context broker GE which supports generate, collect, analyze in real-time and publish information
  • 11.
    FIWARE Lab :OpenStack + FIWARE Integration
  • 12.
  • 13.
    13 FIWARE Lab –Federated OpenStack Nodes FIWARE Lab is hosted FIWARE Platform which provides development environment to developers ▌Innovation and experiment based on FIWARE possible using this free sandbox environment l FIWARE Lab is distributed and arranged geographically on the network of synchronizing FIWARE Lab Nodes. l The IaaS base of FIWARE Lab is OpenStack.
  • 14.
    14 FIWARE Lab distributedarchitecture Authentication Monitoring & Tools Dashboard (GUI) FIWARE Master Node FIWARE Federated Node 1 FIWARE Federated Node n …
  • 15.
    15 FIWARE Lab MonitoringHigh Level Architecture FIWARE Infographics Master Node Infrastructure owners and subscribed usersFIHealth Tool API GET measurements for visualization POST sanity measurements NGSI Adapter API change notifications . . . Monasca API InfluxDB Metrics database BigData Analysis (FIWARE Cosmos GE) MD-VPN POST monitoring data from Ceilometer & Agent Internet Node 1 Node n Monasca Agent Ceilosca Monasca Agent Ceilosca
  • 16.
    16 FIWARE data flow + Host pollster Node pollster Noden + Ceilosca Monasca API Monasca Agent Cloud controller spread across multiple nodes Database, API server, Network controller, Scheduler, Volume controller, Object Storage or Glance server Computes nodes Servers running virtual instances + * * * Ceilometer*
  • 17.
    FIWARE Lab FutureDirections and Expectation from OpenStack Components
  • 18.
    18 The Road Ahead ▌Followthe Monasca architecture for Federated Monitoring data. ▌ELK for monitoring OpenStack log data. ▌Grafana dashboard in Monitoring system. ▌Integration of Federated identity management between different keystone identities. ▌Docker deployment support over Baremetal and/or VMs (Magnum, Ironic, or just nova-docker?). ▌HA of OpenStack Horizon.
  • 20.
  • 21.
    21 FIWARE : SimpleApplication Reference Architecture
  • 22.
    22 FIWARE Reference Architecturefor System of Systems
  • 23.
    23 FIWARE Reference Architecturefor System of Systems
  • 24.
    24 FIWARE Reference Architecturefor System of Systems