SlideShare a Scribd company logo
Cloud Forward
2015
Augusto Ciuffoletti
Cloud Forward 2015
Automated deployment of a microservice-based
monitoring infrastructure
Augusto Ciuffoletti
6 ottobre 2015
Cloud Forward
2015
Augusto Ciuffoletti
Introducing two topics
The title:
Automated deployment of a microservice-based
monitoring infrastructure
Microservices
Monitoring on demand
Let us see how the two stories merge...
Cloud Forward
2015
Augusto Ciuffoletti
Introducing two topics
The title:
Automated deployment of a microservice-based
monitoring infrastructure
Microservices
Monitoring on demand
Let us see how the two stories merge...
Cloud Forward
2015
Augusto Ciuffoletti
Introducing two topics
The title:
Automated deployment of a microservice-based
monitoring infrastructure
Microservices
Monitoring on demand
Let us see how the two stories merge...
Cloud Forward
2015
Augusto Ciuffoletti
Introducing two topics
The title:
Automated deployment of a microservice-based
monitoring infrastructure
Microservices
Monitoring on demand
Let us see how the two stories merge...
Cloud Forward
2015
Augusto Ciuffoletti
Number one: Microservices
A design paradigm for distributed system
a book in O’Reilly "animal series" by S Newman
Principles:
each component in the system is designed to provide
one small, well defined service
each component is a stand alone entity that interacts
with others across a network with a well defined
interface
Cloud Forward
2015
Augusto Ciuffoletti
Number one: Microservices
A design paradigm for distributed system
a book in O’Reilly "animal series" by S Newman
Principles:
each component in the system is designed to provide
one small, well defined service
each component is a stand alone entity that interacts
with others across a network with a well defined
interface
Cloud Forward
2015
Augusto Ciuffoletti
Number one: Microservices
A design paradigm for distributed system
a book in O’Reilly "animal series" by S Newman
Principles:
each component in the system is designed to provide
one small, well defined service
each component is a stand alone entity that interacts
with others across a network with a well defined
interface
Cloud Forward
2015
Augusto Ciuffoletti
Number one: Microservices
A design paradigm for distributed system
a book in O’Reilly "animal series" by S Newman
Principles:
each component in the system is designed to provide
one small, well defined service
each component is a stand alone entity that interacts
with others across a network with a well defined
interface
Cloud Forward
2015
Augusto Ciuffoletti
Number one: Microservices
A design paradigm for distributed system
a book in O’Reilly "animal series" by S Newman
Principles:
each component in the system is designed to provide
one small, well defined service
each component is a stand alone entity that interacts
with others across a network with a well defined
interface
Cloud Forward
2015
Augusto Ciuffoletti
Reasons to adopt the microservices
paradigm
simplifies maintenance
e.g., upgrade one single component
agility in deployment
e.g., to scale up or down
each component may use a different technology
e.g., for technical or performance reasons
simplifies development
e.g., each component developed by a distinct team
robustness
e.g., if one component fails there is a chance that the
system still works
Cloud Forward
2015
Augusto Ciuffoletti
Reasons to adopt the microservices
paradigm
simplifies maintenance
e.g., upgrade one single component
agility in deployment
e.g., to scale up or down
each component may use a different technology
e.g., for technical or performance reasons
simplifies development
e.g., each component developed by a distinct team
robustness
e.g., if one component fails there is a chance that the
system still works
Cloud Forward
2015
Augusto Ciuffoletti
Reasons to adopt the microservices
paradigm
simplifies maintenance
e.g., upgrade one single component
agility in deployment
e.g., to scale up or down
each component may use a different technology
e.g., for technical or performance reasons
simplifies development
e.g., each component developed by a distinct team
robustness
e.g., if one component fails there is a chance that the
system still works
Cloud Forward
2015
Augusto Ciuffoletti
Reasons to adopt the microservices
paradigm
simplifies maintenance
e.g., upgrade one single component
agility in deployment
e.g., to scale up or down
each component may use a different technology
e.g., for technical or performance reasons
simplifies development
e.g., each component developed by a distinct team
robustness
e.g., if one component fails there is a chance that the
system still works
Cloud Forward
2015
Augusto Ciuffoletti
Reasons to adopt the microservices
paradigm
simplifies maintenance
e.g., upgrade one single component
agility in deployment
e.g., to scale up or down
each component may use a different technology
e.g., for technical or performance reasons
simplifies development
e.g., each component developed by a distinct team
robustness
e.g., if one component fails there is a chance that the
system still works
Cloud Forward
2015
Augusto Ciuffoletti
Reasons to adopt the microservices
paradigm
simplifies maintenance
e.g., upgrade one single component
agility in deployment
e.g., to scale up or down
each component may use a different technology
e.g., for technical or performance reasons
simplifies development
e.g., each component developed by a distinct team
robustness
e.g., if one component fails there is a chance that the
system still works
Cloud Forward
2015
Augusto Ciuffoletti
Reasons to adopt the microservices
paradigm
simplifies maintenance
e.g., upgrade one single component
agility in deployment
e.g., to scale up or down
each component may use a different technology
e.g., for technical or performance reasons
simplifies development
e.g., each component developed by a distinct team
robustness
e.g., if one component fails there is a chance that the
system still works
Cloud Forward
2015
Augusto Ciuffoletti
Reasons to adopt the microservices
paradigm
simplifies maintenance
e.g., upgrade one single component
agility in deployment
e.g., to scale up or down
each component may use a different technology
e.g., for technical or performance reasons
simplifies development
e.g., each component developed by a distinct team
robustness
e.g., if one component fails there is a chance that the
system still works
Cloud Forward
2015
Augusto Ciuffoletti
Reasons to adopt the microservices
paradigm
simplifies maintenance
e.g., upgrade one single component
agility in deployment
e.g., to scale up or down
each component may use a different technology
e.g., for technical or performance reasons
simplifies development
e.g., each component developed by a distinct team
robustness
e.g., if one component fails there is a chance that the
system still works
Cloud Forward
2015
Augusto Ciuffoletti
Reasons to adopt the microservices
paradigm
simplifies maintenance
e.g., upgrade one single component
agility in deployment
e.g., to scale up or down
each component may use a different technology
e.g., for technical or performance reasons
simplifies development
e.g., each component developed by a distinct team
robustness
e.g., if one component fails there is a chance that the
system still works
Cloud Forward
2015
Augusto Ciuffoletti
Number two: Cloud monitoring
A cloud user wants to have a functional feedback from
cloud sourced resources:
not necessarily to verify service quality
control a scalable resource,
provide feedback to the users,
trigger compensating actions
NIST indicates monitoring as one of the distinctive
features of cloud computing
Cloud Forward
2015
Augusto Ciuffoletti
Number two: Cloud monitoring
A cloud user wants to have a functional feedback from
cloud sourced resources:
not necessarily to verify service quality
control a scalable resource,
provide feedback to the users,
trigger compensating actions
NIST indicates monitoring as one of the distinctive
features of cloud computing
Cloud Forward
2015
Augusto Ciuffoletti
Number two: Cloud monitoring
A cloud user wants to have a functional feedback from
cloud sourced resources:
not necessarily to verify service quality
control a scalable resource,
provide feedback to the users,
trigger compensating actions
NIST indicates monitoring as one of the distinctive
features of cloud computing
Cloud Forward
2015
Augusto Ciuffoletti
Number two: Cloud monitoring
A cloud user wants to have a functional feedback from
cloud sourced resources:
not necessarily to verify service quality
control a scalable resource,
provide feedback to the users,
trigger compensating actions
NIST indicates monitoring as one of the distinctive
features of cloud computing
Cloud Forward
2015
Augusto Ciuffoletti
Number two: Cloud monitoring
A cloud user wants to have a functional feedback from
cloud sourced resources:
not necessarily to verify service quality
control a scalable resource,
provide feedback to the users,
trigger compensating actions
NIST indicates monitoring as one of the distinctive
features of cloud computing
Cloud Forward
2015
Augusto Ciuffoletti
Number two: Cloud monitoring
A cloud user wants to have a functional feedback from
cloud sourced resources:
not necessarily to verify service quality
control a scalable resource,
provide feedback to the users,
trigger compensating actions
NIST indicates monitoring as one of the distinctive
features of cloud computing
Cloud Forward
2015
Augusto Ciuffoletti
Our option: on demand monitoring
Provide monitoring as part of the service
Give the user wide possibilities to configure a
monitoring infrastructure
Which metrics are captured and how data are
preprocessed and retrieved
Scale from simple to complex infrastructures
Do not overkill the problem in simple cases
Cope with complex infrastructures
Resource agnostic
Basic functionalities and unlimited pluggable
extensions
Cloud Forward
2015
Augusto Ciuffoletti
Our option: on demand monitoring
Provide monitoring as part of the service
Give the user wide possibilities to configure a
monitoring infrastructure
Which metrics are captured and how data are
preprocessed and retrieved
Scale from simple to complex infrastructures
Do not overkill the problem in simple cases
Cope with complex infrastructures
Resource agnostic
Basic functionalities and unlimited pluggable
extensions
Cloud Forward
2015
Augusto Ciuffoletti
Our option: on demand monitoring
Provide monitoring as part of the service
Give the user wide possibilities to configure a
monitoring infrastructure
Which metrics are captured and how data are
preprocessed and retrieved
Scale from simple to complex infrastructures
Do not overkill the problem in simple cases
Cope with complex infrastructures
Resource agnostic
Basic functionalities and unlimited pluggable
extensions
Cloud Forward
2015
Augusto Ciuffoletti
Our option: on demand monitoring
Provide monitoring as part of the service
Give the user wide possibilities to configure a
monitoring infrastructure
Which metrics are captured and how data are
preprocessed and retrieved
Scale from simple to complex infrastructures
Do not overkill the problem in simple cases
Cope with complex infrastructures
Resource agnostic
Basic functionalities and unlimited pluggable
extensions
Cloud Forward
2015
Augusto Ciuffoletti
Our option: on demand monitoring
Provide monitoring as part of the service
Give the user wide possibilities to configure a
monitoring infrastructure
Which metrics are captured and how data are
preprocessed and retrieved
Scale from simple to complex infrastructures
Do not overkill the problem in simple cases
Cope with complex infrastructures
Resource agnostic
Basic functionalities and unlimited pluggable
extensions
Cloud Forward
2015
Augusto Ciuffoletti
Our option: on demand monitoring
Provide monitoring as part of the service
Give the user wide possibilities to configure a
monitoring infrastructure
Which metrics are captured and how data are
preprocessed and retrieved
Scale from simple to complex infrastructures
Do not overkill the problem in simple cases
Cope with complex infrastructures
Resource agnostic
Basic functionalities and unlimited pluggable
extensions
Cloud Forward
2015
Augusto Ciuffoletti
Our option: on demand monitoring
Provide monitoring as part of the service
Give the user wide possibilities to configure a
monitoring infrastructure
Which metrics are captured and how data are
preprocessed and retrieved
Scale from simple to complex infrastructures
Do not overkill the problem in simple cases
Cope with complex infrastructures
Resource agnostic
Basic functionalities and unlimited pluggable
extensions
Cloud Forward
2015
Augusto Ciuffoletti
Our option: on demand monitoring
Provide monitoring as part of the service
Give the user wide possibilities to configure a
monitoring infrastructure
Which metrics are captured and how data are
preprocessed and retrieved
Scale from simple to complex infrastructures
Do not overkill the problem in simple cases
Cope with complex infrastructures
Resource agnostic
Basic functionalities and unlimited pluggable
extensions
Cloud Forward
2015
Augusto Ciuffoletti
Find a match
Monitoring is by nature split into small components
(remember Nagios)
monitoring probes are small components, possibly
embedded
monitoring data crosses a pipe of processors
(anonymization, aggregation etc)
data is finally published using an endpoint reachable
from the outside (database, web service)
Each component is supported by a specific
technology
e.g., network monitoring vs storage monitoring
The on demand nature requires agility in deployment
the cloud user that obtains a new resource may want
to monitor it
There is a match between
microservices and on demand monitoring
Cloud Forward
2015
Augusto Ciuffoletti
Find a match
Monitoring is by nature split into small components
(remember Nagios)
monitoring probes are small components, possibly
embedded
monitoring data crosses a pipe of processors
(anonymization, aggregation etc)
data is finally published using an endpoint reachable
from the outside (database, web service)
Each component is supported by a specific
technology
e.g., network monitoring vs storage monitoring
The on demand nature requires agility in deployment
the cloud user that obtains a new resource may want
to monitor it
There is a match between
microservices and on demand monitoring
Cloud Forward
2015
Augusto Ciuffoletti
Find a match
Monitoring is by nature split into small components
(remember Nagios)
monitoring probes are small components, possibly
embedded
monitoring data crosses a pipe of processors
(anonymization, aggregation etc)
data is finally published using an endpoint reachable
from the outside (database, web service)
Each component is supported by a specific
technology
e.g., network monitoring vs storage monitoring
The on demand nature requires agility in deployment
the cloud user that obtains a new resource may want
to monitor it
There is a match between
microservices and on demand monitoring
Cloud Forward
2015
Augusto Ciuffoletti
Find a match
Monitoring is by nature split into small components
(remember Nagios)
monitoring probes are small components, possibly
embedded
monitoring data crosses a pipe of processors
(anonymization, aggregation etc)
data is finally published using an endpoint reachable
from the outside (database, web service)
Each component is supported by a specific
technology
e.g., network monitoring vs storage monitoring
The on demand nature requires agility in deployment
the cloud user that obtains a new resource may want
to monitor it
There is a match between
microservices and on demand monitoring
Cloud Forward
2015
Augusto Ciuffoletti
Find a match
Monitoring is by nature split into small components
(remember Nagios)
monitoring probes are small components, possibly
embedded
monitoring data crosses a pipe of processors
(anonymization, aggregation etc)
data is finally published using an endpoint reachable
from the outside (database, web service)
Each component is supported by a specific
technology
e.g., network monitoring vs storage monitoring
The on demand nature requires agility in deployment
the cloud user that obtains a new resource may want
to monitor it
There is a match between
microservices and on demand monitoring
Cloud Forward
2015
Augusto Ciuffoletti
Find a match
Monitoring is by nature split into small components
(remember Nagios)
monitoring probes are small components, possibly
embedded
monitoring data crosses a pipe of processors
(anonymization, aggregation etc)
data is finally published using an endpoint reachable
from the outside (database, web service)
Each component is supported by a specific
technology
e.g., network monitoring vs storage monitoring
The on demand nature requires agility in deployment
the cloud user that obtains a new resource may want
to monitor it
There is a match between
microservices and on demand monitoring
Cloud Forward
2015
Augusto Ciuffoletti
Find a match
Monitoring is by nature split into small components
(remember Nagios)
monitoring probes are small components, possibly
embedded
monitoring data crosses a pipe of processors
(anonymization, aggregation etc)
data is finally published using an endpoint reachable
from the outside (database, web service)
Each component is supported by a specific
technology
e.g., network monitoring vs storage monitoring
The on demand nature requires agility in deployment
the cloud user that obtains a new resource may want
to monitor it
There is a match between
microservices and on demand monitoring
Cloud Forward
2015
Augusto Ciuffoletti
Find a match
Monitoring is by nature split into small components
(remember Nagios)
monitoring probes are small components, possibly
embedded
monitoring data crosses a pipe of processors
(anonymization, aggregation etc)
data is finally published using an endpoint reachable
from the outside (database, web service)
Each component is supported by a specific
technology
e.g., network monitoring vs storage monitoring
The on demand nature requires agility in deployment
the cloud user that obtains a new resource may want
to monitor it
There is a match between
microservices and on demand monitoring
Cloud Forward
2015
Augusto Ciuffoletti
Find a match
Monitoring is by nature split into small components
(remember Nagios)
monitoring probes are small components, possibly
embedded
monitoring data crosses a pipe of processors
(anonymization, aggregation etc)
data is finally published using an endpoint reachable
from the outside (database, web service)
Each component is supported by a specific
technology
e.g., network monitoring vs storage monitoring
The on demand nature requires agility in deployment
the cloud user that obtains a new resource may want
to monitor it
There is a match between
microservices and on demand monitoring
Cloud Forward
2015
Augusto Ciuffoletti
Summarizing: a IaaS provisioning
IaaS is just for the example: could be PaaS or
anything else
Cloud Forward
2015
Augusto Ciuffoletti
A monitoring infrastructure
Adding a monitoring infrastructure:
probes that collect monitoring data (collectors)
a device that processes monitoring data (sensor)
Cloud Forward
2015
Augusto Ciuffoletti
A monitoring infrastructure
Adding a monitoring infrastructure:
probes that collect monitoring data (collectors)
a device that processes monitoring data (sensor)
Cloud Forward
2015
Augusto Ciuffoletti
A monitoring infrastructure
Adding a monitoring infrastructure:
probes that collect monitoring data (collectors)
a device that processes monitoring data (sensor)
Cloud Forward
2015
Augusto Ciuffoletti
A cloud interface
we need to design an interface
an open standard exists: OCCI
Cloud Forward
2015
Augusto Ciuffoletti
A cloud interface
we need to design an interface
an open standard exists: OCCI
Cloud Forward
2015
Augusto Ciuffoletti
Open Cloud Computing Interface basics
The interface is REST, therefore web-oriented
The items accessed across the interface are entities
One type of entity is the resource
Another is the link, that connects two resources
A type is characterized by standard features of the
instances
attributes whose values define instances
actions that model dynamic change
The interface is extensible:
a type can be subtyped, thus adding new attributes
to the standard ones
an instance can be modified using mixins
Cloud Forward
2015
Augusto Ciuffoletti
Open Cloud Computing Interface basics
The interface is REST, therefore web-oriented
The items accessed across the interface are entities
One type of entity is the resource
Another is the link, that connects two resources
A type is characterized by standard features of the
instances
attributes whose values define instances
actions that model dynamic change
The interface is extensible:
a type can be subtyped, thus adding new attributes
to the standard ones
an instance can be modified using mixins
Cloud Forward
2015
Augusto Ciuffoletti
Open Cloud Computing Interface basics
The interface is REST, therefore web-oriented
The items accessed across the interface are entities
One type of entity is the resource
Another is the link, that connects two resources
A type is characterized by standard features of the
instances
attributes whose values define instances
actions that model dynamic change
The interface is extensible:
a type can be subtyped, thus adding new attributes
to the standard ones
an instance can be modified using mixins
Cloud Forward
2015
Augusto Ciuffoletti
Open Cloud Computing Interface basics
The interface is REST, therefore web-oriented
The items accessed across the interface are entities
One type of entity is the resource
Another is the link, that connects two resources
A type is characterized by standard features of the
instances
attributes whose values define instances
actions that model dynamic change
The interface is extensible:
a type can be subtyped, thus adding new attributes
to the standard ones
an instance can be modified using mixins
Cloud Forward
2015
Augusto Ciuffoletti
Open Cloud Computing Interface basics
The interface is REST, therefore web-oriented
The items accessed across the interface are entities
One type of entity is the resource
Another is the link, that connects two resources
A type is characterized by standard features of the
instances
attributes whose values define instances
actions that model dynamic change
The interface is extensible:
a type can be subtyped, thus adding new attributes
to the standard ones
an instance can be modified using mixins
Cloud Forward
2015
Augusto Ciuffoletti
Open Cloud Computing Interface basics
The interface is REST, therefore web-oriented
The items accessed across the interface are entities
One type of entity is the resource
Another is the link, that connects two resources
A type is characterized by standard features of the
instances
attributes whose values define instances
actions that model dynamic change
The interface is extensible:
a type can be subtyped, thus adding new attributes
to the standard ones
an instance can be modified using mixins
Cloud Forward
2015
Augusto Ciuffoletti
Open Cloud Computing Interface basics
The interface is REST, therefore web-oriented
The items accessed across the interface are entities
One type of entity is the resource
Another is the link, that connects two resources
A type is characterized by standard features of the
instances
attributes whose values define instances
actions that model dynamic change
The interface is extensible:
a type can be subtyped, thus adding new attributes
to the standard ones
an instance can be modified using mixins
Cloud Forward
2015
Augusto Ciuffoletti
Open Cloud Computing Interface basics
The interface is REST, therefore web-oriented
The items accessed across the interface are entities
One type of entity is the resource
Another is the link, that connects two resources
A type is characterized by standard features of the
instances
attributes whose values define instances
actions that model dynamic change
The interface is extensible:
a type can be subtyped, thus adding new attributes
to the standard ones
an instance can be modified using mixins
Cloud Forward
2015
Augusto Ciuffoletti
Open Cloud Computing Interface basics
The interface is REST, therefore web-oriented
The items accessed across the interface are entities
One type of entity is the resource
Another is the link, that connects two resources
A type is characterized by standard features of the
instances
attributes whose values define instances
actions that model dynamic change
The interface is extensible:
a type can be subtyped, thus adding new attributes
to the standard ones
an instance can be modified using mixins
Cloud Forward
2015
Augusto Ciuffoletti
Open Cloud Computing Interface basics
The interface is REST, therefore web-oriented
The items accessed across the interface are entities
One type of entity is the resource
Another is the link, that connects two resources
A type is characterized by standard features of the
instances
attributes whose values define instances
actions that model dynamic change
The interface is extensible:
a type can be subtyped, thus adding new attributes
to the standard ones
an instance can be modified using mixins
Cloud Forward
2015
Augusto Ciuffoletti
An OCCI model for monitoring
A Sensor is a subtype of the Resource type
A Collector is a subtype of the Link type
Add Mixins to specify the type of activity
Legenda:
the sensor (red) is an OCCI resource
the collectors (blue) are OCCI links
computing boxes and the network are OCCI
resources too
Cloud Forward
2015
Augusto Ciuffoletti
An OCCI model for monitoring
A Sensor is a subtype of the Resource type
A Collector is a subtype of the Link type
Add Mixins to specify the type of activity
Legenda:
the sensor (red) is an OCCI resource
the collectors (blue) are OCCI links
computing boxes and the network are OCCI
resources too
Cloud Forward
2015
Augusto Ciuffoletti
An OCCI model for monitoring
A Sensor is a subtype of the Resource type
A Collector is a subtype of the Link type
Add Mixins to specify the type of activity
Legenda:
the sensor (red) is an OCCI resource
the collectors (blue) are OCCI links
computing boxes and the network are OCCI
resources too
Cloud Forward
2015
Augusto Ciuffoletti
An OCCI model for monitoring
A Sensor is a subtype of the Resource type
A Collector is a subtype of the Link type
Add Mixins to specify the type of activity
Legenda:
the sensor (red) is an OCCI resource
the collectors (blue) are OCCI links
computing boxes and the network are OCCI
resources too
Cloud Forward
2015
Augusto Ciuffoletti
An OCCI model for monitoring
A Sensor is a subtype of the Resource type
A Collector is a subtype of the Link type
Add Mixins to specify the type of activity
Legenda:
the sensor (red) is an OCCI resource
the collectors (blue) are OCCI links
computing boxes and the network are OCCI
resources too
Cloud Forward
2015
Augusto Ciuffoletti
An OCCI model for monitoring
A Sensor is a subtype of the Resource type
A Collector is a subtype of the Link type
Add Mixins to specify the type of activity
Legenda:
the sensor (red) is an OCCI resource
the collectors (blue) are OCCI links
computing boxes and the network are OCCI
resources too
Cloud Forward
2015
Augusto Ciuffoletti
An OCCI model for monitoring
A Sensor is a subtype of the Resource type
A Collector is a subtype of the Link type
Add Mixins to specify the type of activity
Legenda:
the sensor (red) is an OCCI resource
the collectors (blue) are OCCI links
computing boxes and the network are OCCI
resources too
Cloud Forward
2015
Augusto Ciuffoletti
An OCCI model for monitoring
A Sensor is a subtype of the Resource type
A Collector is a subtype of the Link type
Add Mixins to specify the type of activity
Legenda:
the sensor (red) is an OCCI resource
the collectors (blue) are OCCI links
computing boxes and the network are OCCI
resources too
Cloud Forward
2015
Augusto Ciuffoletti
How do we do that?
We want to study the big arrow in the figure
How do we implement a monitoring infrastructure starting
form OCCI entities
Cloud Forward
2015
Augusto Ciuffoletti
How do we do that?
We want to study the big arrow in the figure
How do we implement a monitoring infrastructure starting
form OCCI entities
Cloud Forward
2015
Augusto Ciuffoletti
Vintage programming but...
For an early prototype we selected seasoned
technologies: Java/Unix sockets/Unix Pipes
not bound to specific programming tools
better solutions do exist
As a virtualization platform we selected Docker
demo is easely reproduceable/shareable
efficient to run on a single laptop
upgradeable to a real deployment
Cloud Forward
2015
Augusto Ciuffoletti
Vintage programming but...
For an early prototype we selected seasoned
technologies: Java/Unix sockets/Unix Pipes
not bound to specific programming tools
better solutions do exist
As a virtualization platform we selected Docker
demo is easely reproduceable/shareable
efficient to run on a single laptop
upgradeable to a real deployment
Cloud Forward
2015
Augusto Ciuffoletti
Vintage programming but...
For an early prototype we selected seasoned
technologies: Java/Unix sockets/Unix Pipes
not bound to specific programming tools
better solutions do exist
As a virtualization platform we selected Docker
demo is easely reproduceable/shareable
efficient to run on a single laptop
upgradeable to a real deployment
Cloud Forward
2015
Augusto Ciuffoletti
Vintage programming but...
For an early prototype we selected seasoned
technologies: Java/Unix sockets/Unix Pipes
not bound to specific programming tools
better solutions do exist
As a virtualization platform we selected Docker
demo is easely reproduceable/shareable
efficient to run on a single laptop
upgradeable to a real deployment
Cloud Forward
2015
Augusto Ciuffoletti
Vintage programming but...
For an early prototype we selected seasoned
technologies: Java/Unix sockets/Unix Pipes
not bound to specific programming tools
better solutions do exist
As a virtualization platform we selected Docker
demo is easely reproduceable/shareable
efficient to run on a single laptop
upgradeable to a real deployment
Cloud Forward
2015
Augusto Ciuffoletti
Vintage programming but...
For an early prototype we selected seasoned
technologies: Java/Unix sockets/Unix Pipes
not bound to specific programming tools
better solutions do exist
As a virtualization platform we selected Docker
demo is easely reproduceable/shareable
efficient to run on a single laptop
upgradeable to a real deployment
Cloud Forward
2015
Augusto Ciuffoletti
Vintage programming but...
For an early prototype we selected seasoned
technologies: Java/Unix sockets/Unix Pipes
not bound to specific programming tools
better solutions do exist
As a virtualization platform we selected Docker
demo is easely reproduceable/shareable
efficient to run on a single laptop
upgradeable to a real deployment
Cloud Forward
2015
Augusto Ciuffoletti
Deploying a demo infrastructure
The minimal architecture (4 dockers):
one HTTP server to host the OCCI entities
descriptions
one dashboard to display monitoring data
one monitored compute resource
one sensor resource
In OCCI view
One compute resource
One sensor resource
One collector link
Cloud Forward
2015
Augusto Ciuffoletti
Deploying a demo infrastructure
The minimal architecture (4 dockers):
one HTTP server to host the OCCI entities
descriptions
one dashboard to display monitoring data
one monitored compute resource
one sensor resource
In OCCI view
One compute resource
One sensor resource
One collector link
Cloud Forward
2015
Augusto Ciuffoletti
Deploying a demo infrastructure
The minimal architecture (4 dockers):
one HTTP server to host the OCCI entities
descriptions
one dashboard to display monitoring data
one monitored compute resource
one sensor resource
In OCCI view
One compute resource
One sensor resource
One collector link
Cloud Forward
2015
Augusto Ciuffoletti
Deploying a demo infrastructure
The minimal architecture (4 dockers):
one HTTP server to host the OCCI entities
descriptions
one dashboard to display monitoring data
one monitored compute resource
one sensor resource
In OCCI view
One compute resource
One sensor resource
One collector link
Cloud Forward
2015
Augusto Ciuffoletti
Deploying a demo infrastructure
The minimal architecture (4 dockers):
one HTTP server to host the OCCI entities
descriptions
one dashboard to display monitoring data
one monitored compute resource
one sensor resource
In OCCI view
One compute resource
One sensor resource
One collector link
Cloud Forward
2015
Augusto Ciuffoletti
Deploying a demo infrastructure
The minimal architecture (4 dockers):
one HTTP server to host the OCCI entities
descriptions
one dashboard to display monitoring data
one monitored compute resource
one sensor resource
In OCCI view
One compute resource
One sensor resource
One collector link
Cloud Forward
2015
Augusto Ciuffoletti
Deploying a demo infrastructure
The minimal architecture (4 dockers):
one HTTP server to host the OCCI entities
descriptions
one dashboard to display monitoring data
one monitored compute resource
one sensor resource
In OCCI view
One compute resource
One sensor resource
One collector link
Cloud Forward
2015
Augusto Ciuffoletti
Deploying a demo infrastructure
The minimal architecture (4 dockers):
one HTTP server to host the OCCI entities
descriptions
one dashboard to display monitoring data
one monitored compute resource
one sensor resource
In OCCI view
One compute resource
One sensor resource
One collector link
Cloud Forward
2015
Augusto Ciuffoletti
Deploying a demo infrastructure
The minimal architecture (4 dockers):
one HTTP server to host the OCCI entities
descriptions
one dashboard to display monitoring data
one monitored compute resource
one sensor resource
In OCCI view
One compute resource
One sensor resource
One collector link
Cloud Forward
2015
Augusto Ciuffoletti
The web server
The web server is deployed (with OCCI docs)
this is part of the cloud infrastructure
Cloud Forward
2015
Augusto Ciuffoletti
The web server
The web server is deployed (with OCCI docs)
this is part of the cloud infrastructure
Cloud Forward
2015
Augusto Ciuffoletti
The dashboard
The dashboard is deployed (UDP to receive data)
this is on user premises
Cloud Forward
2015
Augusto Ciuffoletti
The dashboard
The dashboard is deployed (UDP to receive data)
this is on user premises
Cloud Forward
2015
Augusto Ciuffoletti
The computing resource
The virtual computing resource is deployed
the RMI interface is for configuration
Cloud Forward
2015
Augusto Ciuffoletti
The computing resource
The virtual computing resource is deployed
the RMI interface is for configuration
Cloud Forward
2015
Augusto Ciuffoletti
The sensor
It is the resource that implements the monitoring
uploads the collector across the RMI interface
Cloud Forward
2015
Augusto Ciuffoletti
The sensor
It is the resource that implements the monitoring
uploads the collector across the RMI interface
Cloud Forward
2015
Augusto Ciuffoletti
GO!
The dashboard receives the probe measurements...
...filtered by the sensor
Cloud Forward
2015
Augusto Ciuffoletti
GO!
The dashboard receives the probe measurements...
...filtered by the sensor
Cloud Forward
2015
Augusto Ciuffoletti
Conclusions
Microservices are appropriate for distributed
monitoring
The OCCI API is appropriate as the interface
A prototype is available on dockerhub (look for
occimon-live)
BYOD demo on stage tonight at 17:45
Cloud Forward
2015
Augusto Ciuffoletti
Conclusions
Microservices are appropriate for distributed
monitoring
The OCCI API is appropriate as the interface
A prototype is available on dockerhub (look for
occimon-live)
BYOD demo on stage tonight at 17:45
Cloud Forward
2015
Augusto Ciuffoletti
Conclusions
Microservices are appropriate for distributed
monitoring
The OCCI API is appropriate as the interface
A prototype is available on dockerhub (look for
occimon-live)
BYOD demo on stage tonight at 17:45
Cloud Forward
2015
Augusto Ciuffoletti
Conclusions
Microservices are appropriate for distributed
monitoring
The OCCI API is appropriate as the interface
A prototype is available on dockerhub (look for
occimon-live)
BYOD demo on stage tonight at 17:45

More Related Content

Viewers also liked

Extending the OCCI API with monitoring capabilities
Extending the OCCI API with monitoring capabilitiesExtending the OCCI API with monitoring capabilities
Extending the OCCI API with monitoring capabilities
Augusto Ciuffoletti
 
IEEE1588 - Collision avoidance for Delay_Req messages in broadcast media
IEEE1588  - Collision avoidance for Delay_Req messages in broadcast mediaIEEE1588  - Collision avoidance for Delay_Req messages in broadcast media
IEEE1588 - Collision avoidance for Delay_Req messages in broadcast media
Augusto Ciuffoletti
 
ネットを信じていいですか?
ネットを信じていいですか?ネットを信じていいですか?
ネットを信じていいですか?
sirousagi1989
 
Monitoring a virtual network infrastructure - An IaaS perspective
Monitoring a virtual network infrastructure - An IaaS perspectiveMonitoring a virtual network infrastructure - An IaaS perspective
Monitoring a virtual network infrastructure - An IaaS perspective
Augusto Ciuffoletti
 
TIP: a course about IP convergence technology
TIP: a course about IP convergence technologyTIP: a course about IP convergence technology
TIP: a course about IP convergence technology
Augusto Ciuffoletti
 
Open Cloud Computing Interface
Open Cloud Computing InterfaceOpen Cloud Computing Interface
Open Cloud Computing Interface
Augusto Ciuffoletti
 

Viewers also liked (6)

Extending the OCCI API with monitoring capabilities
Extending the OCCI API with monitoring capabilitiesExtending the OCCI API with monitoring capabilities
Extending the OCCI API with monitoring capabilities
 
IEEE1588 - Collision avoidance for Delay_Req messages in broadcast media
IEEE1588  - Collision avoidance for Delay_Req messages in broadcast mediaIEEE1588  - Collision avoidance for Delay_Req messages in broadcast media
IEEE1588 - Collision avoidance for Delay_Req messages in broadcast media
 
ネットを信じていいですか?
ネットを信じていいですか?ネットを信じていいですか?
ネットを信じていいですか?
 
Monitoring a virtual network infrastructure - An IaaS perspective
Monitoring a virtual network infrastructure - An IaaS perspectiveMonitoring a virtual network infrastructure - An IaaS perspective
Monitoring a virtual network infrastructure - An IaaS perspective
 
TIP: a course about IP convergence technology
TIP: a course about IP convergence technologyTIP: a course about IP convergence technology
TIP: a course about IP convergence technology
 
Open Cloud Computing Interface
Open Cloud Computing InterfaceOpen Cloud Computing Interface
Open Cloud Computing Interface
 

Similar to Automated deployment of a microservice based monitoring architecture

Automated Provisioning, Management & Cost Control for Kubernetes Clusters
Automated Provisioning, Management & Cost Control for Kubernetes ClustersAutomated Provisioning, Management & Cost Control for Kubernetes Clusters
Automated Provisioning, Management & Cost Control for Kubernetes Clusters
Weaveworks
 
Comparative Analysis of IT Monitoring Tools
Comparative Analysis of IT Monitoring ToolsComparative Analysis of IT Monitoring Tools
Comparative Analysis of IT Monitoring Tools
apprize360
 
SFScon 2020 - Andrea Avancini Michele Santuari - An internal investigation ob...
SFScon 2020 - Andrea Avancini Michele Santuari - An internal investigation ob...SFScon 2020 - Andrea Avancini Michele Santuari - An internal investigation ob...
SFScon 2020 - Andrea Avancini Michele Santuari - An internal investigation ob...
South Tyrol Free Software Conference
 
Four considerations when monitoring microservices
Four considerations when monitoring microservicesFour considerations when monitoring microservices
Four considerations when monitoring microservices
Jason Bloomberg
 
Continuous Delivery of a Cloud Deployment at a Large Telecommunications Provider
Continuous Delivery of a Cloud Deployment at a Large Telecommunications ProviderContinuous Delivery of a Cloud Deployment at a Large Telecommunications Provider
Continuous Delivery of a Cloud Deployment at a Large Telecommunications Provider
M Kevin McHugh
 
Automating it management with Puppet + ServiceNow
Automating it management with Puppet + ServiceNowAutomating it management with Puppet + ServiceNow
Automating it management with Puppet + ServiceNow
Puppet
 
A Comparative Study of Different types of Models in Software Development Life...
A Comparative Study of Different types of Models in Software Development Life...A Comparative Study of Different types of Models in Software Development Life...
A Comparative Study of Different types of Models in Software Development Life...
IRJET Journal
 
Princeton-NJ-Meetup-Troubleshooting-with-AnyPoint-Monitoring
Princeton-NJ-Meetup-Troubleshooting-with-AnyPoint-MonitoringPrinceton-NJ-Meetup-Troubleshooting-with-AnyPoint-Monitoring
Princeton-NJ-Meetup-Troubleshooting-with-AnyPoint-Monitoring
Sravan Lingam
 
Práticas, Técnicas e Ferramentas para Continuous Delivery com ALM
Práticas, Técnicas e Ferramentas para Continuous Delivery com ALMPráticas, Técnicas e Ferramentas para Continuous Delivery com ALM
Práticas, Técnicas e Ferramentas para Continuous Delivery com ALM
Marcelo Sousa Ancelmo
 
Primendi Visiooniseminar 2014 - Simplivity Omnicube
Primendi Visiooniseminar 2014 - Simplivity OmnicubePrimendi Visiooniseminar 2014 - Simplivity Omnicube
Primendi Visiooniseminar 2014 - Simplivity Omnicube
Primend
 
2023-09-21_Seminar_Hamar_-_Starte_med_AWS
2023-09-21_Seminar_Hamar_-_Starte_med_AWS2023-09-21_Seminar_Hamar_-_Starte_med_AWS
2023-09-21_Seminar_Hamar_-_Starte_med_AWS
Håkon Eriksen Drange
 
An Architectural Deep Dive With Kubernetes And Containers Powerpoint Presenta...
An Architectural Deep Dive With Kubernetes And Containers Powerpoint Presenta...An Architectural Deep Dive With Kubernetes And Containers Powerpoint Presenta...
An Architectural Deep Dive With Kubernetes And Containers Powerpoint Presenta...
SlideTeam
 
Architecting for Continuous Delivery
Architecting for Continuous DeliveryArchitecting for Continuous Delivery
Architecting for Continuous Delivery
Mohammad Bilal Wahla
 
Kubernetes Docker Container Implementation Ppt PowerPoint Presentation Slide ...
Kubernetes Docker Container Implementation Ppt PowerPoint Presentation Slide ...Kubernetes Docker Container Implementation Ppt PowerPoint Presentation Slide ...
Kubernetes Docker Container Implementation Ppt PowerPoint Presentation Slide ...
SlideTeam
 
Par208
Par208Par208
Comment déployer et gérer dans le cloud Azure les environnements de développe...
Comment déployer et gérer dans le cloud Azure les environnements de développe...Comment déployer et gérer dans le cloud Azure les environnements de développe...
Comment déployer et gérer dans le cloud Azure les environnements de développe...
Microsoft Technet France
 
What is DevOps? What is DevOps CoE?
What is DevOps? What is DevOps CoE? What is DevOps? What is DevOps CoE?
What is DevOps? What is DevOps CoE?
7Targets AI Sales Assistants
 
Dev ops and safety critical systems
Dev ops and safety critical systemsDev ops and safety critical systems
Dev ops and safety critical systems
Len Bass
 
Automate Cloud and Application Security Deployments with Barracuda and Puppet...
Automate Cloud and Application Security Deployments with Barracuda and Puppet...Automate Cloud and Application Security Deployments with Barracuda and Puppet...
Automate Cloud and Application Security Deployments with Barracuda and Puppet...
Claire Priester Papas
 
PuppetConf 2016: Puppet and vRealize Automation: The Next Generation – Ganesh...
PuppetConf 2016: Puppet and vRealize Automation: The Next Generation – Ganesh...PuppetConf 2016: Puppet and vRealize Automation: The Next Generation – Ganesh...
PuppetConf 2016: Puppet and vRealize Automation: The Next Generation – Ganesh...
Puppet
 

Similar to Automated deployment of a microservice based monitoring architecture (20)

Automated Provisioning, Management & Cost Control for Kubernetes Clusters
Automated Provisioning, Management & Cost Control for Kubernetes ClustersAutomated Provisioning, Management & Cost Control for Kubernetes Clusters
Automated Provisioning, Management & Cost Control for Kubernetes Clusters
 
Comparative Analysis of IT Monitoring Tools
Comparative Analysis of IT Monitoring ToolsComparative Analysis of IT Monitoring Tools
Comparative Analysis of IT Monitoring Tools
 
SFScon 2020 - Andrea Avancini Michele Santuari - An internal investigation ob...
SFScon 2020 - Andrea Avancini Michele Santuari - An internal investigation ob...SFScon 2020 - Andrea Avancini Michele Santuari - An internal investigation ob...
SFScon 2020 - Andrea Avancini Michele Santuari - An internal investigation ob...
 
Four considerations when monitoring microservices
Four considerations when monitoring microservicesFour considerations when monitoring microservices
Four considerations when monitoring microservices
 
Continuous Delivery of a Cloud Deployment at a Large Telecommunications Provider
Continuous Delivery of a Cloud Deployment at a Large Telecommunications ProviderContinuous Delivery of a Cloud Deployment at a Large Telecommunications Provider
Continuous Delivery of a Cloud Deployment at a Large Telecommunications Provider
 
Automating it management with Puppet + ServiceNow
Automating it management with Puppet + ServiceNowAutomating it management with Puppet + ServiceNow
Automating it management with Puppet + ServiceNow
 
A Comparative Study of Different types of Models in Software Development Life...
A Comparative Study of Different types of Models in Software Development Life...A Comparative Study of Different types of Models in Software Development Life...
A Comparative Study of Different types of Models in Software Development Life...
 
Princeton-NJ-Meetup-Troubleshooting-with-AnyPoint-Monitoring
Princeton-NJ-Meetup-Troubleshooting-with-AnyPoint-MonitoringPrinceton-NJ-Meetup-Troubleshooting-with-AnyPoint-Monitoring
Princeton-NJ-Meetup-Troubleshooting-with-AnyPoint-Monitoring
 
Práticas, Técnicas e Ferramentas para Continuous Delivery com ALM
Práticas, Técnicas e Ferramentas para Continuous Delivery com ALMPráticas, Técnicas e Ferramentas para Continuous Delivery com ALM
Práticas, Técnicas e Ferramentas para Continuous Delivery com ALM
 
Primendi Visiooniseminar 2014 - Simplivity Omnicube
Primendi Visiooniseminar 2014 - Simplivity OmnicubePrimendi Visiooniseminar 2014 - Simplivity Omnicube
Primendi Visiooniseminar 2014 - Simplivity Omnicube
 
2023-09-21_Seminar_Hamar_-_Starte_med_AWS
2023-09-21_Seminar_Hamar_-_Starte_med_AWS2023-09-21_Seminar_Hamar_-_Starte_med_AWS
2023-09-21_Seminar_Hamar_-_Starte_med_AWS
 
An Architectural Deep Dive With Kubernetes And Containers Powerpoint Presenta...
An Architectural Deep Dive With Kubernetes And Containers Powerpoint Presenta...An Architectural Deep Dive With Kubernetes And Containers Powerpoint Presenta...
An Architectural Deep Dive With Kubernetes And Containers Powerpoint Presenta...
 
Architecting for Continuous Delivery
Architecting for Continuous DeliveryArchitecting for Continuous Delivery
Architecting for Continuous Delivery
 
Kubernetes Docker Container Implementation Ppt PowerPoint Presentation Slide ...
Kubernetes Docker Container Implementation Ppt PowerPoint Presentation Slide ...Kubernetes Docker Container Implementation Ppt PowerPoint Presentation Slide ...
Kubernetes Docker Container Implementation Ppt PowerPoint Presentation Slide ...
 
Par208
Par208Par208
Par208
 
Comment déployer et gérer dans le cloud Azure les environnements de développe...
Comment déployer et gérer dans le cloud Azure les environnements de développe...Comment déployer et gérer dans le cloud Azure les environnements de développe...
Comment déployer et gérer dans le cloud Azure les environnements de développe...
 
What is DevOps? What is DevOps CoE?
What is DevOps? What is DevOps CoE? What is DevOps? What is DevOps CoE?
What is DevOps? What is DevOps CoE?
 
Dev ops and safety critical systems
Dev ops and safety critical systemsDev ops and safety critical systems
Dev ops and safety critical systems
 
Automate Cloud and Application Security Deployments with Barracuda and Puppet...
Automate Cloud and Application Security Deployments with Barracuda and Puppet...Automate Cloud and Application Security Deployments with Barracuda and Puppet...
Automate Cloud and Application Security Deployments with Barracuda and Puppet...
 
PuppetConf 2016: Puppet and vRealize Automation: The Next Generation – Ganesh...
PuppetConf 2016: Puppet and vRealize Automation: The Next Generation – Ganesh...PuppetConf 2016: Puppet and vRealize Automation: The Next Generation – Ganesh...
PuppetConf 2016: Puppet and vRealize Automation: The Next Generation – Ganesh...
 

More from Augusto Ciuffoletti

An open-source testbed for IoT systems
An open-source testbed for IoT systemsAn open-source testbed for IoT systems
An open-source testbed for IoT systems
Augusto Ciuffoletti
 
0 basic
0 basic0 basic
Thingspeak: integrazione
Thingspeak: integrazioneThingspeak: integrazione
Thingspeak: integrazione
Augusto Ciuffoletti
 
Thingspeak: fondamenti
Thingspeak: fondamentiThingspeak: fondamenti
Thingspeak: fondamenti
Augusto Ciuffoletti
 
Design and implementation of a low-cost modular sensor
Design and implementation of a low-cost modular sensorDesign and implementation of a low-cost modular sensor
Design and implementation of a low-cost modular sensor
Augusto Ciuffoletti
 
ZHAW 2016 - OCCI for monitoring
ZHAW 2016 - OCCI for monitoringZHAW 2016 - OCCI for monitoring
ZHAW 2016 - OCCI for monitoring
Augusto Ciuffoletti
 
Laboratorio Openstack
Laboratorio OpenstackLaboratorio Openstack
Laboratorio Openstack
Augusto Ciuffoletti
 
OCCI Monitoring at OGF42 - Concepts and demo
OCCI Monitoring at OGF42 - Concepts and demoOCCI Monitoring at OGF42 - Concepts and demo
OCCI Monitoring at OGF42 - Concepts and demo
Augusto Ciuffoletti
 
2013 03 occi-monitoring
2013 03 occi-monitoring2013 03 occi-monitoring
2013 03 occi-monitoring
Augusto Ciuffoletti
 
Collision avoidance using a wandering token in the PTP protocol
Collision avoidance using a wandering token in the PTP protocolCollision avoidance using a wandering token in the PTP protocol
Collision avoidance using a wandering token in the PTP protocol
Augusto Ciuffoletti
 
Design of a secure "Token Passing" protocol
Design of a secure "Token Passing" protocolDesign of a secure "Token Passing" protocol
Design of a secure "Token Passing" protocol
Augusto Ciuffoletti
 
The wandering token
The wandering tokenThe wandering token
The wandering token
Augusto Ciuffoletti
 
Network Monitoring in the age of the Cloud
Network Monitoring in the age of the CloudNetwork Monitoring in the age of the Cloud
Network Monitoring in the age of the Cloud
Augusto Ciuffoletti
 
Grid Infrastructure Architecture A Modular Approach from CoreGRID
Grid Infrastructure Architecture A Modular Approach from CoreGRIDGrid Infrastructure Architecture A Modular Approach from CoreGRID
Grid Infrastructure Architecture A Modular Approach from CoreGRID
Augusto Ciuffoletti
 
Scalable concurrency control in a dynamic membership
Scalable concurrency control  in a dynamic membershipScalable concurrency control  in a dynamic membership
Scalable concurrency control in a dynamic membership
Augusto Ciuffoletti
 
Prototype Implementation of a Demand Driven Network Monitoring Architecture
Prototype Implementation of a Demand Driven Network Monitoring ArchitecturePrototype Implementation of a Demand Driven Network Monitoring Architecture
Prototype Implementation of a Demand Driven Network Monitoring Architecture
Augusto Ciuffoletti
 
Network Monitoring in the age of the Cloud
Network Monitoring in the age of the CloudNetwork Monitoring in the age of the Cloud
Network Monitoring in the age of the Cloud
Augusto Ciuffoletti
 

More from Augusto Ciuffoletti (17)

An open-source testbed for IoT systems
An open-source testbed for IoT systemsAn open-source testbed for IoT systems
An open-source testbed for IoT systems
 
0 basic
0 basic0 basic
0 basic
 
Thingspeak: integrazione
Thingspeak: integrazioneThingspeak: integrazione
Thingspeak: integrazione
 
Thingspeak: fondamenti
Thingspeak: fondamentiThingspeak: fondamenti
Thingspeak: fondamenti
 
Design and implementation of a low-cost modular sensor
Design and implementation of a low-cost modular sensorDesign and implementation of a low-cost modular sensor
Design and implementation of a low-cost modular sensor
 
ZHAW 2016 - OCCI for monitoring
ZHAW 2016 - OCCI for monitoringZHAW 2016 - OCCI for monitoring
ZHAW 2016 - OCCI for monitoring
 
Laboratorio Openstack
Laboratorio OpenstackLaboratorio Openstack
Laboratorio Openstack
 
OCCI Monitoring at OGF42 - Concepts and demo
OCCI Monitoring at OGF42 - Concepts and demoOCCI Monitoring at OGF42 - Concepts and demo
OCCI Monitoring at OGF42 - Concepts and demo
 
2013 03 occi-monitoring
2013 03 occi-monitoring2013 03 occi-monitoring
2013 03 occi-monitoring
 
Collision avoidance using a wandering token in the PTP protocol
Collision avoidance using a wandering token in the PTP protocolCollision avoidance using a wandering token in the PTP protocol
Collision avoidance using a wandering token in the PTP protocol
 
Design of a secure "Token Passing" protocol
Design of a secure "Token Passing" protocolDesign of a secure "Token Passing" protocol
Design of a secure "Token Passing" protocol
 
The wandering token
The wandering tokenThe wandering token
The wandering token
 
Network Monitoring in the age of the Cloud
Network Monitoring in the age of the CloudNetwork Monitoring in the age of the Cloud
Network Monitoring in the age of the Cloud
 
Grid Infrastructure Architecture A Modular Approach from CoreGRID
Grid Infrastructure Architecture A Modular Approach from CoreGRIDGrid Infrastructure Architecture A Modular Approach from CoreGRID
Grid Infrastructure Architecture A Modular Approach from CoreGRID
 
Scalable concurrency control in a dynamic membership
Scalable concurrency control  in a dynamic membershipScalable concurrency control  in a dynamic membership
Scalable concurrency control in a dynamic membership
 
Prototype Implementation of a Demand Driven Network Monitoring Architecture
Prototype Implementation of a Demand Driven Network Monitoring ArchitecturePrototype Implementation of a Demand Driven Network Monitoring Architecture
Prototype Implementation of a Demand Driven Network Monitoring Architecture
 
Network Monitoring in the age of the Cloud
Network Monitoring in the age of the CloudNetwork Monitoring in the age of the Cloud
Network Monitoring in the age of the Cloud
 

Recently uploaded

How GenAI Can Improve Supplier Performance Management.pdf
How GenAI Can Improve Supplier Performance Management.pdfHow GenAI Can Improve Supplier Performance Management.pdf
How GenAI Can Improve Supplier Performance Management.pdf
Zycus
 
Transforming Product Development using OnePlan To Boost Efficiency and Innova...
Transforming Product Development using OnePlan To Boost Efficiency and Innova...Transforming Product Development using OnePlan To Boost Efficiency and Innova...
Transforming Product Development using OnePlan To Boost Efficiency and Innova...
OnePlan Solutions
 
WMF 2024 - Unlocking the Future of Data Powering Next-Gen AI with Vector Data...
WMF 2024 - Unlocking the Future of Data Powering Next-Gen AI with Vector Data...WMF 2024 - Unlocking the Future of Data Powering Next-Gen AI with Vector Data...
WMF 2024 - Unlocking the Future of Data Powering Next-Gen AI with Vector Data...
Luigi Fugaro
 
The Power of Visual Regression Testing_ Why It Is Critical for Enterprise App...
The Power of Visual Regression Testing_ Why It Is Critical for Enterprise App...The Power of Visual Regression Testing_ Why It Is Critical for Enterprise App...
The Power of Visual Regression Testing_ Why It Is Critical for Enterprise App...
kalichargn70th171
 
The Comprehensive Guide to Validating Audio-Visual Performances.pdf
The Comprehensive Guide to Validating Audio-Visual Performances.pdfThe Comprehensive Guide to Validating Audio-Visual Performances.pdf
The Comprehensive Guide to Validating Audio-Visual Performances.pdf
kalichargn70th171
 
Superpower Your Apache Kafka Applications Development with Complementary Open...
Superpower Your Apache Kafka Applications Development with Complementary Open...Superpower Your Apache Kafka Applications Development with Complementary Open...
Superpower Your Apache Kafka Applications Development with Complementary Open...
Paul Brebner
 
Photoshop Tutorial for Beginners (2024 Edition)
Photoshop Tutorial for Beginners (2024 Edition)Photoshop Tutorial for Beginners (2024 Edition)
Photoshop Tutorial for Beginners (2024 Edition)
alowpalsadig
 
A Comprehensive Guide on Implementing Real-World Mobile Testing Strategies fo...
A Comprehensive Guide on Implementing Real-World Mobile Testing Strategies fo...A Comprehensive Guide on Implementing Real-World Mobile Testing Strategies fo...
A Comprehensive Guide on Implementing Real-World Mobile Testing Strategies fo...
kalichargn70th171
 
一比一原版(UMN毕业证)明尼苏达大学毕业证如何办理
一比一原版(UMN毕业证)明尼苏达大学毕业证如何办理一比一原版(UMN毕业证)明尼苏达大学毕业证如何办理
一比一原版(UMN毕业证)明尼苏达大学毕业证如何办理
dakas1
 
Upturn India Technologies - Web development company in Nashik
Upturn India Technologies - Web development company in NashikUpturn India Technologies - Web development company in Nashik
Upturn India Technologies - Web development company in Nashik
Upturn India Technologies
 
42 Ways to Generate Real Estate Leads - Sellxpert
42 Ways to Generate Real Estate Leads - Sellxpert42 Ways to Generate Real Estate Leads - Sellxpert
42 Ways to Generate Real Estate Leads - Sellxpert
vaishalijagtap12
 
Stork Product Overview: An AI-Powered Autonomous Delivery Fleet
Stork Product Overview: An AI-Powered Autonomous Delivery FleetStork Product Overview: An AI-Powered Autonomous Delivery Fleet
Stork Product Overview: An AI-Powered Autonomous Delivery Fleet
Vince Scalabrino
 
Enhanced Screen Flows UI/UX using SLDS with Tom Kitt
Enhanced Screen Flows UI/UX using SLDS with Tom KittEnhanced Screen Flows UI/UX using SLDS with Tom Kitt
Enhanced Screen Flows UI/UX using SLDS with Tom Kitt
Peter Caitens
 
如何办理(hull学位证书)英国赫尔大学毕业证硕士文凭原版一模一样
如何办理(hull学位证书)英国赫尔大学毕业证硕士文凭原版一模一样如何办理(hull学位证书)英国赫尔大学毕业证硕士文凭原版一模一样
如何办理(hull学位证书)英国赫尔大学毕业证硕士文凭原版一模一样
gapen1
 
Orca: Nocode Graphical Editor for Container Orchestration
Orca: Nocode Graphical Editor for Container OrchestrationOrca: Nocode Graphical Editor for Container Orchestration
Orca: Nocode Graphical Editor for Container Orchestration
Pedro J. Molina
 
ppt on the brain chip neuralink.pptx
ppt  on   the brain  chip neuralink.pptxppt  on   the brain  chip neuralink.pptx
ppt on the brain chip neuralink.pptx
Reetu63
 
🏎️Tech Transformation: DevOps Insights from the Experts 👩‍💻
🏎️Tech Transformation: DevOps Insights from the Experts 👩‍💻🏎️Tech Transformation: DevOps Insights from the Experts 👩‍💻
🏎️Tech Transformation: DevOps Insights from the Experts 👩‍💻
campbellclarkson
 
一比一原版(sdsu毕业证书)圣地亚哥州立大学毕业证如何办理
一比一原版(sdsu毕业证书)圣地亚哥州立大学毕业证如何办理一比一原版(sdsu毕业证书)圣地亚哥州立大学毕业证如何办理
一比一原版(sdsu毕业证书)圣地亚哥州立大学毕业证如何办理
kgyxske
 
Secure-by-Design Using Hardware and Software Protection for FDA Compliance
Secure-by-Design Using Hardware and Software Protection for FDA ComplianceSecure-by-Design Using Hardware and Software Protection for FDA Compliance
Secure-by-Design Using Hardware and Software Protection for FDA Compliance
ICS
 

Recently uploaded (20)

How GenAI Can Improve Supplier Performance Management.pdf
How GenAI Can Improve Supplier Performance Management.pdfHow GenAI Can Improve Supplier Performance Management.pdf
How GenAI Can Improve Supplier Performance Management.pdf
 
Transforming Product Development using OnePlan To Boost Efficiency and Innova...
Transforming Product Development using OnePlan To Boost Efficiency and Innova...Transforming Product Development using OnePlan To Boost Efficiency and Innova...
Transforming Product Development using OnePlan To Boost Efficiency and Innova...
 
WMF 2024 - Unlocking the Future of Data Powering Next-Gen AI with Vector Data...
WMF 2024 - Unlocking the Future of Data Powering Next-Gen AI with Vector Data...WMF 2024 - Unlocking the Future of Data Powering Next-Gen AI with Vector Data...
WMF 2024 - Unlocking the Future of Data Powering Next-Gen AI with Vector Data...
 
The Power of Visual Regression Testing_ Why It Is Critical for Enterprise App...
The Power of Visual Regression Testing_ Why It Is Critical for Enterprise App...The Power of Visual Regression Testing_ Why It Is Critical for Enterprise App...
The Power of Visual Regression Testing_ Why It Is Critical for Enterprise App...
 
The Comprehensive Guide to Validating Audio-Visual Performances.pdf
The Comprehensive Guide to Validating Audio-Visual Performances.pdfThe Comprehensive Guide to Validating Audio-Visual Performances.pdf
The Comprehensive Guide to Validating Audio-Visual Performances.pdf
 
Superpower Your Apache Kafka Applications Development with Complementary Open...
Superpower Your Apache Kafka Applications Development with Complementary Open...Superpower Your Apache Kafka Applications Development with Complementary Open...
Superpower Your Apache Kafka Applications Development with Complementary Open...
 
Photoshop Tutorial for Beginners (2024 Edition)
Photoshop Tutorial for Beginners (2024 Edition)Photoshop Tutorial for Beginners (2024 Edition)
Photoshop Tutorial for Beginners (2024 Edition)
 
A Comprehensive Guide on Implementing Real-World Mobile Testing Strategies fo...
A Comprehensive Guide on Implementing Real-World Mobile Testing Strategies fo...A Comprehensive Guide on Implementing Real-World Mobile Testing Strategies fo...
A Comprehensive Guide on Implementing Real-World Mobile Testing Strategies fo...
 
一比一原版(UMN毕业证)明尼苏达大学毕业证如何办理
一比一原版(UMN毕业证)明尼苏达大学毕业证如何办理一比一原版(UMN毕业证)明尼苏达大学毕业证如何办理
一比一原版(UMN毕业证)明尼苏达大学毕业证如何办理
 
bgiolcb
bgiolcbbgiolcb
bgiolcb
 
Upturn India Technologies - Web development company in Nashik
Upturn India Technologies - Web development company in NashikUpturn India Technologies - Web development company in Nashik
Upturn India Technologies - Web development company in Nashik
 
42 Ways to Generate Real Estate Leads - Sellxpert
42 Ways to Generate Real Estate Leads - Sellxpert42 Ways to Generate Real Estate Leads - Sellxpert
42 Ways to Generate Real Estate Leads - Sellxpert
 
Stork Product Overview: An AI-Powered Autonomous Delivery Fleet
Stork Product Overview: An AI-Powered Autonomous Delivery FleetStork Product Overview: An AI-Powered Autonomous Delivery Fleet
Stork Product Overview: An AI-Powered Autonomous Delivery Fleet
 
Enhanced Screen Flows UI/UX using SLDS with Tom Kitt
Enhanced Screen Flows UI/UX using SLDS with Tom KittEnhanced Screen Flows UI/UX using SLDS with Tom Kitt
Enhanced Screen Flows UI/UX using SLDS with Tom Kitt
 
如何办理(hull学位证书)英国赫尔大学毕业证硕士文凭原版一模一样
如何办理(hull学位证书)英国赫尔大学毕业证硕士文凭原版一模一样如何办理(hull学位证书)英国赫尔大学毕业证硕士文凭原版一模一样
如何办理(hull学位证书)英国赫尔大学毕业证硕士文凭原版一模一样
 
Orca: Nocode Graphical Editor for Container Orchestration
Orca: Nocode Graphical Editor for Container OrchestrationOrca: Nocode Graphical Editor for Container Orchestration
Orca: Nocode Graphical Editor for Container Orchestration
 
ppt on the brain chip neuralink.pptx
ppt  on   the brain  chip neuralink.pptxppt  on   the brain  chip neuralink.pptx
ppt on the brain chip neuralink.pptx
 
🏎️Tech Transformation: DevOps Insights from the Experts 👩‍💻
🏎️Tech Transformation: DevOps Insights from the Experts 👩‍💻🏎️Tech Transformation: DevOps Insights from the Experts 👩‍💻
🏎️Tech Transformation: DevOps Insights from the Experts 👩‍💻
 
一比一原版(sdsu毕业证书)圣地亚哥州立大学毕业证如何办理
一比一原版(sdsu毕业证书)圣地亚哥州立大学毕业证如何办理一比一原版(sdsu毕业证书)圣地亚哥州立大学毕业证如何办理
一比一原版(sdsu毕业证书)圣地亚哥州立大学毕业证如何办理
 
Secure-by-Design Using Hardware and Software Protection for FDA Compliance
Secure-by-Design Using Hardware and Software Protection for FDA ComplianceSecure-by-Design Using Hardware and Software Protection for FDA Compliance
Secure-by-Design Using Hardware and Software Protection for FDA Compliance
 

Automated deployment of a microservice based monitoring architecture

  • 1. Cloud Forward 2015 Augusto Ciuffoletti Cloud Forward 2015 Automated deployment of a microservice-based monitoring infrastructure Augusto Ciuffoletti 6 ottobre 2015
  • 2. Cloud Forward 2015 Augusto Ciuffoletti Introducing two topics The title: Automated deployment of a microservice-based monitoring infrastructure Microservices Monitoring on demand Let us see how the two stories merge...
  • 3. Cloud Forward 2015 Augusto Ciuffoletti Introducing two topics The title: Automated deployment of a microservice-based monitoring infrastructure Microservices Monitoring on demand Let us see how the two stories merge...
  • 4. Cloud Forward 2015 Augusto Ciuffoletti Introducing two topics The title: Automated deployment of a microservice-based monitoring infrastructure Microservices Monitoring on demand Let us see how the two stories merge...
  • 5. Cloud Forward 2015 Augusto Ciuffoletti Introducing two topics The title: Automated deployment of a microservice-based monitoring infrastructure Microservices Monitoring on demand Let us see how the two stories merge...
  • 6. Cloud Forward 2015 Augusto Ciuffoletti Number one: Microservices A design paradigm for distributed system a book in O’Reilly "animal series" by S Newman Principles: each component in the system is designed to provide one small, well defined service each component is a stand alone entity that interacts with others across a network with a well defined interface
  • 7. Cloud Forward 2015 Augusto Ciuffoletti Number one: Microservices A design paradigm for distributed system a book in O’Reilly "animal series" by S Newman Principles: each component in the system is designed to provide one small, well defined service each component is a stand alone entity that interacts with others across a network with a well defined interface
  • 8. Cloud Forward 2015 Augusto Ciuffoletti Number one: Microservices A design paradigm for distributed system a book in O’Reilly "animal series" by S Newman Principles: each component in the system is designed to provide one small, well defined service each component is a stand alone entity that interacts with others across a network with a well defined interface
  • 9. Cloud Forward 2015 Augusto Ciuffoletti Number one: Microservices A design paradigm for distributed system a book in O’Reilly "animal series" by S Newman Principles: each component in the system is designed to provide one small, well defined service each component is a stand alone entity that interacts with others across a network with a well defined interface
  • 10. Cloud Forward 2015 Augusto Ciuffoletti Number one: Microservices A design paradigm for distributed system a book in O’Reilly "animal series" by S Newman Principles: each component in the system is designed to provide one small, well defined service each component is a stand alone entity that interacts with others across a network with a well defined interface
  • 11. Cloud Forward 2015 Augusto Ciuffoletti Reasons to adopt the microservices paradigm simplifies maintenance e.g., upgrade one single component agility in deployment e.g., to scale up or down each component may use a different technology e.g., for technical or performance reasons simplifies development e.g., each component developed by a distinct team robustness e.g., if one component fails there is a chance that the system still works
  • 12. Cloud Forward 2015 Augusto Ciuffoletti Reasons to adopt the microservices paradigm simplifies maintenance e.g., upgrade one single component agility in deployment e.g., to scale up or down each component may use a different technology e.g., for technical or performance reasons simplifies development e.g., each component developed by a distinct team robustness e.g., if one component fails there is a chance that the system still works
  • 13. Cloud Forward 2015 Augusto Ciuffoletti Reasons to adopt the microservices paradigm simplifies maintenance e.g., upgrade one single component agility in deployment e.g., to scale up or down each component may use a different technology e.g., for technical or performance reasons simplifies development e.g., each component developed by a distinct team robustness e.g., if one component fails there is a chance that the system still works
  • 14. Cloud Forward 2015 Augusto Ciuffoletti Reasons to adopt the microservices paradigm simplifies maintenance e.g., upgrade one single component agility in deployment e.g., to scale up or down each component may use a different technology e.g., for technical or performance reasons simplifies development e.g., each component developed by a distinct team robustness e.g., if one component fails there is a chance that the system still works
  • 15. Cloud Forward 2015 Augusto Ciuffoletti Reasons to adopt the microservices paradigm simplifies maintenance e.g., upgrade one single component agility in deployment e.g., to scale up or down each component may use a different technology e.g., for technical or performance reasons simplifies development e.g., each component developed by a distinct team robustness e.g., if one component fails there is a chance that the system still works
  • 16. Cloud Forward 2015 Augusto Ciuffoletti Reasons to adopt the microservices paradigm simplifies maintenance e.g., upgrade one single component agility in deployment e.g., to scale up or down each component may use a different technology e.g., for technical or performance reasons simplifies development e.g., each component developed by a distinct team robustness e.g., if one component fails there is a chance that the system still works
  • 17. Cloud Forward 2015 Augusto Ciuffoletti Reasons to adopt the microservices paradigm simplifies maintenance e.g., upgrade one single component agility in deployment e.g., to scale up or down each component may use a different technology e.g., for technical or performance reasons simplifies development e.g., each component developed by a distinct team robustness e.g., if one component fails there is a chance that the system still works
  • 18. Cloud Forward 2015 Augusto Ciuffoletti Reasons to adopt the microservices paradigm simplifies maintenance e.g., upgrade one single component agility in deployment e.g., to scale up or down each component may use a different technology e.g., for technical or performance reasons simplifies development e.g., each component developed by a distinct team robustness e.g., if one component fails there is a chance that the system still works
  • 19. Cloud Forward 2015 Augusto Ciuffoletti Reasons to adopt the microservices paradigm simplifies maintenance e.g., upgrade one single component agility in deployment e.g., to scale up or down each component may use a different technology e.g., for technical or performance reasons simplifies development e.g., each component developed by a distinct team robustness e.g., if one component fails there is a chance that the system still works
  • 20. Cloud Forward 2015 Augusto Ciuffoletti Reasons to adopt the microservices paradigm simplifies maintenance e.g., upgrade one single component agility in deployment e.g., to scale up or down each component may use a different technology e.g., for technical or performance reasons simplifies development e.g., each component developed by a distinct team robustness e.g., if one component fails there is a chance that the system still works
  • 21. Cloud Forward 2015 Augusto Ciuffoletti Number two: Cloud monitoring A cloud user wants to have a functional feedback from cloud sourced resources: not necessarily to verify service quality control a scalable resource, provide feedback to the users, trigger compensating actions NIST indicates monitoring as one of the distinctive features of cloud computing
  • 22. Cloud Forward 2015 Augusto Ciuffoletti Number two: Cloud monitoring A cloud user wants to have a functional feedback from cloud sourced resources: not necessarily to verify service quality control a scalable resource, provide feedback to the users, trigger compensating actions NIST indicates monitoring as one of the distinctive features of cloud computing
  • 23. Cloud Forward 2015 Augusto Ciuffoletti Number two: Cloud monitoring A cloud user wants to have a functional feedback from cloud sourced resources: not necessarily to verify service quality control a scalable resource, provide feedback to the users, trigger compensating actions NIST indicates monitoring as one of the distinctive features of cloud computing
  • 24. Cloud Forward 2015 Augusto Ciuffoletti Number two: Cloud monitoring A cloud user wants to have a functional feedback from cloud sourced resources: not necessarily to verify service quality control a scalable resource, provide feedback to the users, trigger compensating actions NIST indicates monitoring as one of the distinctive features of cloud computing
  • 25. Cloud Forward 2015 Augusto Ciuffoletti Number two: Cloud monitoring A cloud user wants to have a functional feedback from cloud sourced resources: not necessarily to verify service quality control a scalable resource, provide feedback to the users, trigger compensating actions NIST indicates monitoring as one of the distinctive features of cloud computing
  • 26. Cloud Forward 2015 Augusto Ciuffoletti Number two: Cloud monitoring A cloud user wants to have a functional feedback from cloud sourced resources: not necessarily to verify service quality control a scalable resource, provide feedback to the users, trigger compensating actions NIST indicates monitoring as one of the distinctive features of cloud computing
  • 27. Cloud Forward 2015 Augusto Ciuffoletti Our option: on demand monitoring Provide monitoring as part of the service Give the user wide possibilities to configure a monitoring infrastructure Which metrics are captured and how data are preprocessed and retrieved Scale from simple to complex infrastructures Do not overkill the problem in simple cases Cope with complex infrastructures Resource agnostic Basic functionalities and unlimited pluggable extensions
  • 28. Cloud Forward 2015 Augusto Ciuffoletti Our option: on demand monitoring Provide monitoring as part of the service Give the user wide possibilities to configure a monitoring infrastructure Which metrics are captured and how data are preprocessed and retrieved Scale from simple to complex infrastructures Do not overkill the problem in simple cases Cope with complex infrastructures Resource agnostic Basic functionalities and unlimited pluggable extensions
  • 29. Cloud Forward 2015 Augusto Ciuffoletti Our option: on demand monitoring Provide monitoring as part of the service Give the user wide possibilities to configure a monitoring infrastructure Which metrics are captured and how data are preprocessed and retrieved Scale from simple to complex infrastructures Do not overkill the problem in simple cases Cope with complex infrastructures Resource agnostic Basic functionalities and unlimited pluggable extensions
  • 30. Cloud Forward 2015 Augusto Ciuffoletti Our option: on demand monitoring Provide monitoring as part of the service Give the user wide possibilities to configure a monitoring infrastructure Which metrics are captured and how data are preprocessed and retrieved Scale from simple to complex infrastructures Do not overkill the problem in simple cases Cope with complex infrastructures Resource agnostic Basic functionalities and unlimited pluggable extensions
  • 31. Cloud Forward 2015 Augusto Ciuffoletti Our option: on demand monitoring Provide monitoring as part of the service Give the user wide possibilities to configure a monitoring infrastructure Which metrics are captured and how data are preprocessed and retrieved Scale from simple to complex infrastructures Do not overkill the problem in simple cases Cope with complex infrastructures Resource agnostic Basic functionalities and unlimited pluggable extensions
  • 32. Cloud Forward 2015 Augusto Ciuffoletti Our option: on demand monitoring Provide monitoring as part of the service Give the user wide possibilities to configure a monitoring infrastructure Which metrics are captured and how data are preprocessed and retrieved Scale from simple to complex infrastructures Do not overkill the problem in simple cases Cope with complex infrastructures Resource agnostic Basic functionalities and unlimited pluggable extensions
  • 33. Cloud Forward 2015 Augusto Ciuffoletti Our option: on demand monitoring Provide monitoring as part of the service Give the user wide possibilities to configure a monitoring infrastructure Which metrics are captured and how data are preprocessed and retrieved Scale from simple to complex infrastructures Do not overkill the problem in simple cases Cope with complex infrastructures Resource agnostic Basic functionalities and unlimited pluggable extensions
  • 34. Cloud Forward 2015 Augusto Ciuffoletti Our option: on demand monitoring Provide monitoring as part of the service Give the user wide possibilities to configure a monitoring infrastructure Which metrics are captured and how data are preprocessed and retrieved Scale from simple to complex infrastructures Do not overkill the problem in simple cases Cope with complex infrastructures Resource agnostic Basic functionalities and unlimited pluggable extensions
  • 35. Cloud Forward 2015 Augusto Ciuffoletti Find a match Monitoring is by nature split into small components (remember Nagios) monitoring probes are small components, possibly embedded monitoring data crosses a pipe of processors (anonymization, aggregation etc) data is finally published using an endpoint reachable from the outside (database, web service) Each component is supported by a specific technology e.g., network monitoring vs storage monitoring The on demand nature requires agility in deployment the cloud user that obtains a new resource may want to monitor it There is a match between microservices and on demand monitoring
  • 36. Cloud Forward 2015 Augusto Ciuffoletti Find a match Monitoring is by nature split into small components (remember Nagios) monitoring probes are small components, possibly embedded monitoring data crosses a pipe of processors (anonymization, aggregation etc) data is finally published using an endpoint reachable from the outside (database, web service) Each component is supported by a specific technology e.g., network monitoring vs storage monitoring The on demand nature requires agility in deployment the cloud user that obtains a new resource may want to monitor it There is a match between microservices and on demand monitoring
  • 37. Cloud Forward 2015 Augusto Ciuffoletti Find a match Monitoring is by nature split into small components (remember Nagios) monitoring probes are small components, possibly embedded monitoring data crosses a pipe of processors (anonymization, aggregation etc) data is finally published using an endpoint reachable from the outside (database, web service) Each component is supported by a specific technology e.g., network monitoring vs storage monitoring The on demand nature requires agility in deployment the cloud user that obtains a new resource may want to monitor it There is a match between microservices and on demand monitoring
  • 38. Cloud Forward 2015 Augusto Ciuffoletti Find a match Monitoring is by nature split into small components (remember Nagios) monitoring probes are small components, possibly embedded monitoring data crosses a pipe of processors (anonymization, aggregation etc) data is finally published using an endpoint reachable from the outside (database, web service) Each component is supported by a specific technology e.g., network monitoring vs storage monitoring The on demand nature requires agility in deployment the cloud user that obtains a new resource may want to monitor it There is a match between microservices and on demand monitoring
  • 39. Cloud Forward 2015 Augusto Ciuffoletti Find a match Monitoring is by nature split into small components (remember Nagios) monitoring probes are small components, possibly embedded monitoring data crosses a pipe of processors (anonymization, aggregation etc) data is finally published using an endpoint reachable from the outside (database, web service) Each component is supported by a specific technology e.g., network monitoring vs storage monitoring The on demand nature requires agility in deployment the cloud user that obtains a new resource may want to monitor it There is a match between microservices and on demand monitoring
  • 40. Cloud Forward 2015 Augusto Ciuffoletti Find a match Monitoring is by nature split into small components (remember Nagios) monitoring probes are small components, possibly embedded monitoring data crosses a pipe of processors (anonymization, aggregation etc) data is finally published using an endpoint reachable from the outside (database, web service) Each component is supported by a specific technology e.g., network monitoring vs storage monitoring The on demand nature requires agility in deployment the cloud user that obtains a new resource may want to monitor it There is a match between microservices and on demand monitoring
  • 41. Cloud Forward 2015 Augusto Ciuffoletti Find a match Monitoring is by nature split into small components (remember Nagios) monitoring probes are small components, possibly embedded monitoring data crosses a pipe of processors (anonymization, aggregation etc) data is finally published using an endpoint reachable from the outside (database, web service) Each component is supported by a specific technology e.g., network monitoring vs storage monitoring The on demand nature requires agility in deployment the cloud user that obtains a new resource may want to monitor it There is a match between microservices and on demand monitoring
  • 42. Cloud Forward 2015 Augusto Ciuffoletti Find a match Monitoring is by nature split into small components (remember Nagios) monitoring probes are small components, possibly embedded monitoring data crosses a pipe of processors (anonymization, aggregation etc) data is finally published using an endpoint reachable from the outside (database, web service) Each component is supported by a specific technology e.g., network monitoring vs storage monitoring The on demand nature requires agility in deployment the cloud user that obtains a new resource may want to monitor it There is a match between microservices and on demand monitoring
  • 43. Cloud Forward 2015 Augusto Ciuffoletti Find a match Monitoring is by nature split into small components (remember Nagios) monitoring probes are small components, possibly embedded monitoring data crosses a pipe of processors (anonymization, aggregation etc) data is finally published using an endpoint reachable from the outside (database, web service) Each component is supported by a specific technology e.g., network monitoring vs storage monitoring The on demand nature requires agility in deployment the cloud user that obtains a new resource may want to monitor it There is a match between microservices and on demand monitoring
  • 44. Cloud Forward 2015 Augusto Ciuffoletti Summarizing: a IaaS provisioning IaaS is just for the example: could be PaaS or anything else
  • 45. Cloud Forward 2015 Augusto Ciuffoletti A monitoring infrastructure Adding a monitoring infrastructure: probes that collect monitoring data (collectors) a device that processes monitoring data (sensor)
  • 46. Cloud Forward 2015 Augusto Ciuffoletti A monitoring infrastructure Adding a monitoring infrastructure: probes that collect monitoring data (collectors) a device that processes monitoring data (sensor)
  • 47. Cloud Forward 2015 Augusto Ciuffoletti A monitoring infrastructure Adding a monitoring infrastructure: probes that collect monitoring data (collectors) a device that processes monitoring data (sensor)
  • 48. Cloud Forward 2015 Augusto Ciuffoletti A cloud interface we need to design an interface an open standard exists: OCCI
  • 49. Cloud Forward 2015 Augusto Ciuffoletti A cloud interface we need to design an interface an open standard exists: OCCI
  • 50. Cloud Forward 2015 Augusto Ciuffoletti Open Cloud Computing Interface basics The interface is REST, therefore web-oriented The items accessed across the interface are entities One type of entity is the resource Another is the link, that connects two resources A type is characterized by standard features of the instances attributes whose values define instances actions that model dynamic change The interface is extensible: a type can be subtyped, thus adding new attributes to the standard ones an instance can be modified using mixins
  • 51. Cloud Forward 2015 Augusto Ciuffoletti Open Cloud Computing Interface basics The interface is REST, therefore web-oriented The items accessed across the interface are entities One type of entity is the resource Another is the link, that connects two resources A type is characterized by standard features of the instances attributes whose values define instances actions that model dynamic change The interface is extensible: a type can be subtyped, thus adding new attributes to the standard ones an instance can be modified using mixins
  • 52. Cloud Forward 2015 Augusto Ciuffoletti Open Cloud Computing Interface basics The interface is REST, therefore web-oriented The items accessed across the interface are entities One type of entity is the resource Another is the link, that connects two resources A type is characterized by standard features of the instances attributes whose values define instances actions that model dynamic change The interface is extensible: a type can be subtyped, thus adding new attributes to the standard ones an instance can be modified using mixins
  • 53. Cloud Forward 2015 Augusto Ciuffoletti Open Cloud Computing Interface basics The interface is REST, therefore web-oriented The items accessed across the interface are entities One type of entity is the resource Another is the link, that connects two resources A type is characterized by standard features of the instances attributes whose values define instances actions that model dynamic change The interface is extensible: a type can be subtyped, thus adding new attributes to the standard ones an instance can be modified using mixins
  • 54. Cloud Forward 2015 Augusto Ciuffoletti Open Cloud Computing Interface basics The interface is REST, therefore web-oriented The items accessed across the interface are entities One type of entity is the resource Another is the link, that connects two resources A type is characterized by standard features of the instances attributes whose values define instances actions that model dynamic change The interface is extensible: a type can be subtyped, thus adding new attributes to the standard ones an instance can be modified using mixins
  • 55. Cloud Forward 2015 Augusto Ciuffoletti Open Cloud Computing Interface basics The interface is REST, therefore web-oriented The items accessed across the interface are entities One type of entity is the resource Another is the link, that connects two resources A type is characterized by standard features of the instances attributes whose values define instances actions that model dynamic change The interface is extensible: a type can be subtyped, thus adding new attributes to the standard ones an instance can be modified using mixins
  • 56. Cloud Forward 2015 Augusto Ciuffoletti Open Cloud Computing Interface basics The interface is REST, therefore web-oriented The items accessed across the interface are entities One type of entity is the resource Another is the link, that connects two resources A type is characterized by standard features of the instances attributes whose values define instances actions that model dynamic change The interface is extensible: a type can be subtyped, thus adding new attributes to the standard ones an instance can be modified using mixins
  • 57. Cloud Forward 2015 Augusto Ciuffoletti Open Cloud Computing Interface basics The interface is REST, therefore web-oriented The items accessed across the interface are entities One type of entity is the resource Another is the link, that connects two resources A type is characterized by standard features of the instances attributes whose values define instances actions that model dynamic change The interface is extensible: a type can be subtyped, thus adding new attributes to the standard ones an instance can be modified using mixins
  • 58. Cloud Forward 2015 Augusto Ciuffoletti Open Cloud Computing Interface basics The interface is REST, therefore web-oriented The items accessed across the interface are entities One type of entity is the resource Another is the link, that connects two resources A type is characterized by standard features of the instances attributes whose values define instances actions that model dynamic change The interface is extensible: a type can be subtyped, thus adding new attributes to the standard ones an instance can be modified using mixins
  • 59. Cloud Forward 2015 Augusto Ciuffoletti Open Cloud Computing Interface basics The interface is REST, therefore web-oriented The items accessed across the interface are entities One type of entity is the resource Another is the link, that connects two resources A type is characterized by standard features of the instances attributes whose values define instances actions that model dynamic change The interface is extensible: a type can be subtyped, thus adding new attributes to the standard ones an instance can be modified using mixins
  • 60. Cloud Forward 2015 Augusto Ciuffoletti An OCCI model for monitoring A Sensor is a subtype of the Resource type A Collector is a subtype of the Link type Add Mixins to specify the type of activity Legenda: the sensor (red) is an OCCI resource the collectors (blue) are OCCI links computing boxes and the network are OCCI resources too
  • 61. Cloud Forward 2015 Augusto Ciuffoletti An OCCI model for monitoring A Sensor is a subtype of the Resource type A Collector is a subtype of the Link type Add Mixins to specify the type of activity Legenda: the sensor (red) is an OCCI resource the collectors (blue) are OCCI links computing boxes and the network are OCCI resources too
  • 62. Cloud Forward 2015 Augusto Ciuffoletti An OCCI model for monitoring A Sensor is a subtype of the Resource type A Collector is a subtype of the Link type Add Mixins to specify the type of activity Legenda: the sensor (red) is an OCCI resource the collectors (blue) are OCCI links computing boxes and the network are OCCI resources too
  • 63. Cloud Forward 2015 Augusto Ciuffoletti An OCCI model for monitoring A Sensor is a subtype of the Resource type A Collector is a subtype of the Link type Add Mixins to specify the type of activity Legenda: the sensor (red) is an OCCI resource the collectors (blue) are OCCI links computing boxes and the network are OCCI resources too
  • 64. Cloud Forward 2015 Augusto Ciuffoletti An OCCI model for monitoring A Sensor is a subtype of the Resource type A Collector is a subtype of the Link type Add Mixins to specify the type of activity Legenda: the sensor (red) is an OCCI resource the collectors (blue) are OCCI links computing boxes and the network are OCCI resources too
  • 65. Cloud Forward 2015 Augusto Ciuffoletti An OCCI model for monitoring A Sensor is a subtype of the Resource type A Collector is a subtype of the Link type Add Mixins to specify the type of activity Legenda: the sensor (red) is an OCCI resource the collectors (blue) are OCCI links computing boxes and the network are OCCI resources too
  • 66. Cloud Forward 2015 Augusto Ciuffoletti An OCCI model for monitoring A Sensor is a subtype of the Resource type A Collector is a subtype of the Link type Add Mixins to specify the type of activity Legenda: the sensor (red) is an OCCI resource the collectors (blue) are OCCI links computing boxes and the network are OCCI resources too
  • 67. Cloud Forward 2015 Augusto Ciuffoletti An OCCI model for monitoring A Sensor is a subtype of the Resource type A Collector is a subtype of the Link type Add Mixins to specify the type of activity Legenda: the sensor (red) is an OCCI resource the collectors (blue) are OCCI links computing boxes and the network are OCCI resources too
  • 68. Cloud Forward 2015 Augusto Ciuffoletti How do we do that? We want to study the big arrow in the figure How do we implement a monitoring infrastructure starting form OCCI entities
  • 69. Cloud Forward 2015 Augusto Ciuffoletti How do we do that? We want to study the big arrow in the figure How do we implement a monitoring infrastructure starting form OCCI entities
  • 70. Cloud Forward 2015 Augusto Ciuffoletti Vintage programming but... For an early prototype we selected seasoned technologies: Java/Unix sockets/Unix Pipes not bound to specific programming tools better solutions do exist As a virtualization platform we selected Docker demo is easely reproduceable/shareable efficient to run on a single laptop upgradeable to a real deployment
  • 71. Cloud Forward 2015 Augusto Ciuffoletti Vintage programming but... For an early prototype we selected seasoned technologies: Java/Unix sockets/Unix Pipes not bound to specific programming tools better solutions do exist As a virtualization platform we selected Docker demo is easely reproduceable/shareable efficient to run on a single laptop upgradeable to a real deployment
  • 72. Cloud Forward 2015 Augusto Ciuffoletti Vintage programming but... For an early prototype we selected seasoned technologies: Java/Unix sockets/Unix Pipes not bound to specific programming tools better solutions do exist As a virtualization platform we selected Docker demo is easely reproduceable/shareable efficient to run on a single laptop upgradeable to a real deployment
  • 73. Cloud Forward 2015 Augusto Ciuffoletti Vintage programming but... For an early prototype we selected seasoned technologies: Java/Unix sockets/Unix Pipes not bound to specific programming tools better solutions do exist As a virtualization platform we selected Docker demo is easely reproduceable/shareable efficient to run on a single laptop upgradeable to a real deployment
  • 74. Cloud Forward 2015 Augusto Ciuffoletti Vintage programming but... For an early prototype we selected seasoned technologies: Java/Unix sockets/Unix Pipes not bound to specific programming tools better solutions do exist As a virtualization platform we selected Docker demo is easely reproduceable/shareable efficient to run on a single laptop upgradeable to a real deployment
  • 75. Cloud Forward 2015 Augusto Ciuffoletti Vintage programming but... For an early prototype we selected seasoned technologies: Java/Unix sockets/Unix Pipes not bound to specific programming tools better solutions do exist As a virtualization platform we selected Docker demo is easely reproduceable/shareable efficient to run on a single laptop upgradeable to a real deployment
  • 76. Cloud Forward 2015 Augusto Ciuffoletti Vintage programming but... For an early prototype we selected seasoned technologies: Java/Unix sockets/Unix Pipes not bound to specific programming tools better solutions do exist As a virtualization platform we selected Docker demo is easely reproduceable/shareable efficient to run on a single laptop upgradeable to a real deployment
  • 77. Cloud Forward 2015 Augusto Ciuffoletti Deploying a demo infrastructure The minimal architecture (4 dockers): one HTTP server to host the OCCI entities descriptions one dashboard to display monitoring data one monitored compute resource one sensor resource In OCCI view One compute resource One sensor resource One collector link
  • 78. Cloud Forward 2015 Augusto Ciuffoletti Deploying a demo infrastructure The minimal architecture (4 dockers): one HTTP server to host the OCCI entities descriptions one dashboard to display monitoring data one monitored compute resource one sensor resource In OCCI view One compute resource One sensor resource One collector link
  • 79. Cloud Forward 2015 Augusto Ciuffoletti Deploying a demo infrastructure The minimal architecture (4 dockers): one HTTP server to host the OCCI entities descriptions one dashboard to display monitoring data one monitored compute resource one sensor resource In OCCI view One compute resource One sensor resource One collector link
  • 80. Cloud Forward 2015 Augusto Ciuffoletti Deploying a demo infrastructure The minimal architecture (4 dockers): one HTTP server to host the OCCI entities descriptions one dashboard to display monitoring data one monitored compute resource one sensor resource In OCCI view One compute resource One sensor resource One collector link
  • 81. Cloud Forward 2015 Augusto Ciuffoletti Deploying a demo infrastructure The minimal architecture (4 dockers): one HTTP server to host the OCCI entities descriptions one dashboard to display monitoring data one monitored compute resource one sensor resource In OCCI view One compute resource One sensor resource One collector link
  • 82. Cloud Forward 2015 Augusto Ciuffoletti Deploying a demo infrastructure The minimal architecture (4 dockers): one HTTP server to host the OCCI entities descriptions one dashboard to display monitoring data one monitored compute resource one sensor resource In OCCI view One compute resource One sensor resource One collector link
  • 83. Cloud Forward 2015 Augusto Ciuffoletti Deploying a demo infrastructure The minimal architecture (4 dockers): one HTTP server to host the OCCI entities descriptions one dashboard to display monitoring data one monitored compute resource one sensor resource In OCCI view One compute resource One sensor resource One collector link
  • 84. Cloud Forward 2015 Augusto Ciuffoletti Deploying a demo infrastructure The minimal architecture (4 dockers): one HTTP server to host the OCCI entities descriptions one dashboard to display monitoring data one monitored compute resource one sensor resource In OCCI view One compute resource One sensor resource One collector link
  • 85. Cloud Forward 2015 Augusto Ciuffoletti Deploying a demo infrastructure The minimal architecture (4 dockers): one HTTP server to host the OCCI entities descriptions one dashboard to display monitoring data one monitored compute resource one sensor resource In OCCI view One compute resource One sensor resource One collector link
  • 86. Cloud Forward 2015 Augusto Ciuffoletti The web server The web server is deployed (with OCCI docs) this is part of the cloud infrastructure
  • 87. Cloud Forward 2015 Augusto Ciuffoletti The web server The web server is deployed (with OCCI docs) this is part of the cloud infrastructure
  • 88. Cloud Forward 2015 Augusto Ciuffoletti The dashboard The dashboard is deployed (UDP to receive data) this is on user premises
  • 89. Cloud Forward 2015 Augusto Ciuffoletti The dashboard The dashboard is deployed (UDP to receive data) this is on user premises
  • 90. Cloud Forward 2015 Augusto Ciuffoletti The computing resource The virtual computing resource is deployed the RMI interface is for configuration
  • 91. Cloud Forward 2015 Augusto Ciuffoletti The computing resource The virtual computing resource is deployed the RMI interface is for configuration
  • 92. Cloud Forward 2015 Augusto Ciuffoletti The sensor It is the resource that implements the monitoring uploads the collector across the RMI interface
  • 93. Cloud Forward 2015 Augusto Ciuffoletti The sensor It is the resource that implements the monitoring uploads the collector across the RMI interface
  • 94. Cloud Forward 2015 Augusto Ciuffoletti GO! The dashboard receives the probe measurements... ...filtered by the sensor
  • 95. Cloud Forward 2015 Augusto Ciuffoletti GO! The dashboard receives the probe measurements... ...filtered by the sensor
  • 96. Cloud Forward 2015 Augusto Ciuffoletti Conclusions Microservices are appropriate for distributed monitoring The OCCI API is appropriate as the interface A prototype is available on dockerhub (look for occimon-live) BYOD demo on stage tonight at 17:45
  • 97. Cloud Forward 2015 Augusto Ciuffoletti Conclusions Microservices are appropriate for distributed monitoring The OCCI API is appropriate as the interface A prototype is available on dockerhub (look for occimon-live) BYOD demo on stage tonight at 17:45
  • 98. Cloud Forward 2015 Augusto Ciuffoletti Conclusions Microservices are appropriate for distributed monitoring The OCCI API is appropriate as the interface A prototype is available on dockerhub (look for occimon-live) BYOD demo on stage tonight at 17:45
  • 99. Cloud Forward 2015 Augusto Ciuffoletti Conclusions Microservices are appropriate for distributed monitoring The OCCI API is appropriate as the interface A prototype is available on dockerhub (look for occimon-live) BYOD demo on stage tonight at 17:45