This document discusses the convergence of IoT devices, edge computing, fog computing, and cloud computing infrastructures. It notes the exponential growth in connected devices and data generated, and need for distributed computing resources closer to users to address latency, bandwidth and other constraints. Key research issues discussed include locality-aware resource management, deployment and reconfiguration of edge sites, energy monitoring and optimization, and resilience across distributed infrastructures.
Challenges and Issues of Next Cloud Computing PlatformsFrederic Desprez
Cloud computing has now crossed the frontiers of research to reach industry. It is used every day , whether to exchange emails or make
reservations on web sites. However, many research works remain to be done to improve the performance and functionality of these platforms of tomorrow. In this talk, I will do an overview of some these theoretical and appliead researches done at INRIA and particularly around Clouds distribution, energy monitoring and management, massive data processing and exchange, and resource management.
Grid'5000: Running a Large Instrument for Parallel and Distributed Computing ...Frederic Desprez
The increasing complexity of available infrastructures (hierarchical, parallel, distributed, etc.) with specific features (caches, hyper-threading, dual core, etc.) makes it extremely difficult to build analytical models that allow for a satisfying prediction. Hence, it raises the question on how to validate algorithms and software systems if a realistic analytic study is not possible. As for many other sciences, the one answer is experimental validation. However, such experimentations rely on the availability of an instrument able to validate every level of the software stack and offering different hardware and software facilities about compute, storage, and network resources.
Almost ten years after its premises, the Grid'5000 testbed has become one of the most complete testbed for designing or evaluating large-scale distributed systems. Initially dedicated to the study of large HPC facilities, Grid’5000 has evolved in order to address wider concerns related to Desktop Computing, the Internet of Services and more recently the Cloud Computing paradigm. We now target new processors features such as hyperthreading, turbo boost, and power management or large applications managing big data. In this keynote we will both address the issue of experiments in HPC and computer science and the design and usage of the Grid'5000 platform for various kind of applications.
Un cloud pour comparer nos gènes aux images du cerveau" Le pionnier des bases de données, aujourd'hui disparu, Jim Gray avait annoncé en 2007 l'emergence d'un 4eme paradigme scientifique: celui d'une recherche scientifique numérique entierement guidée par l'exploration de données massives. Cette vision est aujourd'hui la réalité de tous les jours dans les laboratoire de recherche scientifique, et elle va bien au delà de ce que l'on appelle communément "BIG DATA". Microsoft Research et Inria on démarré en 2010 un projet intitulé Azure-Brain (ou A-Brain) dont l'originalité consiste à a la fois construire au dessus de Windows Azure une nouvelle plateforme d'acces aux données massives pour les applications scientifiques, et de se confronter à la réalité de la recherche scientifique. Dans cette session nous vous proposons dans une premiere partie de resituer les enjeux recherche concernant la gestion de données massives dans le cloud, et ensuite de vous presenter la plateforme "TOMUS Blob" cloud storage optimisé sur Azure. Enfin nous vous presenterons le projet A-Brain et les résultats que nous avons obtenus: La neuro-imagerie contribue au diagnostic de certaines maladies du système nerveux. Mais nos cerveaux s'avèrent tous un peu différents les uns des autres. Cette variabilité complique l'interprétation médicale. D'où l'idée de corréler ldes images IRM du cerveaux et le patrimoine génétique de chaque patient afin de mieux délimiter les régions cérébrales qui présentent un intérêt symptomatique. Les images IRM haute définition de ce projet sont produites par la plate-forme Neurospin du CEA (Saclay). Problème pour Les chercheurs : la masse d'informations à traiter. Le CV génétique d'un individu comporte environ un million de données. À cela s'ajoutent des volumes tout aussi colossaux de pixel 3D pour décrire les images. Un data deluge: des peta octets de donnés et potentiellement des années de calcul. C'est donc ici qu'entre en jeu le cloud et une plateforme optimisée sur Azure pour traiter des applications massivement parallèles sur des données massives... Comme l'explique Gabriel Antoniu, son responsable, cette équipe de recherche rennaise a développé “des mécanismes de stockage efficaces pour améliorer l'accès à ces données massives et optimiser leur traitement. Nos développements permettent de répondre aux besoins applicatifs de nos collègues de Saclay.
Data-intensive applications on cloud computing resources: Applications in lif...Ola Spjuth
Presentation at the de.NBI 2017 symposium “The Future Development of Bioinformatics in Germany and Europe” held at the Center for Interdisciplinary Research (ZiF) of Bielefeld University, October 23-25, 2017.
https://www.denbi.de/symposium2017
Challenges and Issues of Next Cloud Computing PlatformsFrederic Desprez
Cloud computing has now crossed the frontiers of research to reach industry. It is used every day , whether to exchange emails or make
reservations on web sites. However, many research works remain to be done to improve the performance and functionality of these platforms of tomorrow. In this talk, I will do an overview of some these theoretical and appliead researches done at INRIA and particularly around Clouds distribution, energy monitoring and management, massive data processing and exchange, and resource management.
Grid'5000: Running a Large Instrument for Parallel and Distributed Computing ...Frederic Desprez
The increasing complexity of available infrastructures (hierarchical, parallel, distributed, etc.) with specific features (caches, hyper-threading, dual core, etc.) makes it extremely difficult to build analytical models that allow for a satisfying prediction. Hence, it raises the question on how to validate algorithms and software systems if a realistic analytic study is not possible. As for many other sciences, the one answer is experimental validation. However, such experimentations rely on the availability of an instrument able to validate every level of the software stack and offering different hardware and software facilities about compute, storage, and network resources.
Almost ten years after its premises, the Grid'5000 testbed has become one of the most complete testbed for designing or evaluating large-scale distributed systems. Initially dedicated to the study of large HPC facilities, Grid’5000 has evolved in order to address wider concerns related to Desktop Computing, the Internet of Services and more recently the Cloud Computing paradigm. We now target new processors features such as hyperthreading, turbo boost, and power management or large applications managing big data. In this keynote we will both address the issue of experiments in HPC and computer science and the design and usage of the Grid'5000 platform for various kind of applications.
Un cloud pour comparer nos gènes aux images du cerveau" Le pionnier des bases de données, aujourd'hui disparu, Jim Gray avait annoncé en 2007 l'emergence d'un 4eme paradigme scientifique: celui d'une recherche scientifique numérique entierement guidée par l'exploration de données massives. Cette vision est aujourd'hui la réalité de tous les jours dans les laboratoire de recherche scientifique, et elle va bien au delà de ce que l'on appelle communément "BIG DATA". Microsoft Research et Inria on démarré en 2010 un projet intitulé Azure-Brain (ou A-Brain) dont l'originalité consiste à a la fois construire au dessus de Windows Azure une nouvelle plateforme d'acces aux données massives pour les applications scientifiques, et de se confronter à la réalité de la recherche scientifique. Dans cette session nous vous proposons dans une premiere partie de resituer les enjeux recherche concernant la gestion de données massives dans le cloud, et ensuite de vous presenter la plateforme "TOMUS Blob" cloud storage optimisé sur Azure. Enfin nous vous presenterons le projet A-Brain et les résultats que nous avons obtenus: La neuro-imagerie contribue au diagnostic de certaines maladies du système nerveux. Mais nos cerveaux s'avèrent tous un peu différents les uns des autres. Cette variabilité complique l'interprétation médicale. D'où l'idée de corréler ldes images IRM du cerveaux et le patrimoine génétique de chaque patient afin de mieux délimiter les régions cérébrales qui présentent un intérêt symptomatique. Les images IRM haute définition de ce projet sont produites par la plate-forme Neurospin du CEA (Saclay). Problème pour Les chercheurs : la masse d'informations à traiter. Le CV génétique d'un individu comporte environ un million de données. À cela s'ajoutent des volumes tout aussi colossaux de pixel 3D pour décrire les images. Un data deluge: des peta octets de donnés et potentiellement des années de calcul. C'est donc ici qu'entre en jeu le cloud et une plateforme optimisée sur Azure pour traiter des applications massivement parallèles sur des données massives... Comme l'explique Gabriel Antoniu, son responsable, cette équipe de recherche rennaise a développé “des mécanismes de stockage efficaces pour améliorer l'accès à ces données massives et optimiser leur traitement. Nos développements permettent de répondre aux besoins applicatifs de nos collègues de Saclay.
Data-intensive applications on cloud computing resources: Applications in lif...Ola Spjuth
Presentation at the de.NBI 2017 symposium “The Future Development of Bioinformatics in Germany and Europe” held at the Center for Interdisciplinary Research (ZiF) of Bielefeld University, October 23-25, 2017.
https://www.denbi.de/symposium2017
From Jisc's campus network engineering for data-intensive science workshop on 19 October 2016.
https://www.jisc.ac.uk/events/campus-network-engineering-for-data-intensive-science-workshop-19-oct-2016
Cloud present, future and trajectory (Amazon Web Services) - JIsc Digifest 2016Jisc
In Jisc's future of cloud computing horizon scan report, we identified three strategic areas where Jisc could support universities and colleges in moving to the cloud – cloud as a utility, app as a service, and working to build capability in cloud technologies.
Come along to this session to hear more about this work from Jisc futurist Martin Hamilton, and find out how you can get involved.
Bridging the gap to facilitate selection and image analysis activities for la...Phidias
PHIDIAS organised it's third and final PHIDIAS Webinar of the series, this time dedicated to Use Case 2: Big Data Earth Observations (EO), took place on 18 February 2021 at 15:00 CET, showcasing how PHIDIAS is taking advantage of HPC architecture to facilitate selection and image analysis activities for land surface monitoring.
Super Infrastructure for Large-Scale Experimental Computer Science, (Almost) everything you wanted to know about SILECS/SLICES but didn't dare to ask. Presentation at "journées du GDR RSD", Nantes, Jan. 23, 2020/.
In this presentation from the Dell booth at SC13, Joseph Antony from NCI describes how they are using HPC Virtualization to meet user needs.
Watch the video presentation: http://insidehpc.com/2013/12/05/panel-discussion-thought-hpc-virtualization-never-going-happen/
SILECS: Super Infrastructure for Large-scale Experimental Computer ScienceFrederic Desprez
SILECS, based on two existing infrastructure (FIT and Grid'5000), aims to provide a large robust, trustable and scalable instrument for research in
distributed computing and networks. Experiments from the Internet of Things, data centers, cloud computing, security services, and the networks
connecting them will be possible, in a reproducible way, on various hardware and software. This instrument will offer a multi-platform experimental
infrastructure (HPC, Cloud, Big Data, Software Defined Storage, IoT, wireless, Software Defined Network / Radio) capable of exploring the
infrastructures that will be deployed tomorrow and assist researchers and industrial about how to design, build and operate a multi-scale, robust and
safe computer system. Diverse digital resources (compute, storage, link, IO devices) are be assembled to support a “playground” at scale.
IoT Challenges: Technological, Business and Social aspectsRoberto Minerva
Internet of Things is promising to be a set of technologies able to have a high impact on how people live, produce, modify and interact with the environment. Such a transformation is driven by increasing technologies capabilities of sensors/actuators, communications, general-purpose hardware, availability of software and programmability of devices. The integration of so different technologies is a problem in itself and IoT is also trying to solve cogent issues of specific problem domains, such as e-health, transportation, manufacturing, and so on. Large IoT systems (e.g., smart cities) stand on their own because the smartness requires integration of different technologies, processes and different administrative domains creating the needs to deal with a complex system. In addition to technological and problem domain specific challenges, there exist further challenges that fall in business, social and regulation realms. They can greatly impact the deployment and the success of IoT deployment. The speech aims at providing a view on some major technologies challenges of IoT and to cover a few critical business and social issues that could hamper the large deployment of IoT systems by providing some examples of implementation.
From Jisc's campus network engineering for data-intensive science workshop on 19 October 2016.
https://www.jisc.ac.uk/events/campus-network-engineering-for-data-intensive-science-workshop-19-oct-2016
Cloud present, future and trajectory (Amazon Web Services) - JIsc Digifest 2016Jisc
In Jisc's future of cloud computing horizon scan report, we identified three strategic areas where Jisc could support universities and colleges in moving to the cloud – cloud as a utility, app as a service, and working to build capability in cloud technologies.
Come along to this session to hear more about this work from Jisc futurist Martin Hamilton, and find out how you can get involved.
Bridging the gap to facilitate selection and image analysis activities for la...Phidias
PHIDIAS organised it's third and final PHIDIAS Webinar of the series, this time dedicated to Use Case 2: Big Data Earth Observations (EO), took place on 18 February 2021 at 15:00 CET, showcasing how PHIDIAS is taking advantage of HPC architecture to facilitate selection and image analysis activities for land surface monitoring.
Super Infrastructure for Large-Scale Experimental Computer Science, (Almost) everything you wanted to know about SILECS/SLICES but didn't dare to ask. Presentation at "journées du GDR RSD", Nantes, Jan. 23, 2020/.
In this presentation from the Dell booth at SC13, Joseph Antony from NCI describes how they are using HPC Virtualization to meet user needs.
Watch the video presentation: http://insidehpc.com/2013/12/05/panel-discussion-thought-hpc-virtualization-never-going-happen/
SILECS: Super Infrastructure for Large-scale Experimental Computer ScienceFrederic Desprez
SILECS, based on two existing infrastructure (FIT and Grid'5000), aims to provide a large robust, trustable and scalable instrument for research in
distributed computing and networks. Experiments from the Internet of Things, data centers, cloud computing, security services, and the networks
connecting them will be possible, in a reproducible way, on various hardware and software. This instrument will offer a multi-platform experimental
infrastructure (HPC, Cloud, Big Data, Software Defined Storage, IoT, wireless, Software Defined Network / Radio) capable of exploring the
infrastructures that will be deployed tomorrow and assist researchers and industrial about how to design, build and operate a multi-scale, robust and
safe computer system. Diverse digital resources (compute, storage, link, IO devices) are be assembled to support a “playground” at scale.
IoT Challenges: Technological, Business and Social aspectsRoberto Minerva
Internet of Things is promising to be a set of technologies able to have a high impact on how people live, produce, modify and interact with the environment. Such a transformation is driven by increasing technologies capabilities of sensors/actuators, communications, general-purpose hardware, availability of software and programmability of devices. The integration of so different technologies is a problem in itself and IoT is also trying to solve cogent issues of specific problem domains, such as e-health, transportation, manufacturing, and so on. Large IoT systems (e.g., smart cities) stand on their own because the smartness requires integration of different technologies, processes and different administrative domains creating the needs to deal with a complex system. In addition to technological and problem domain specific challenges, there exist further challenges that fall in business, social and regulation realms. They can greatly impact the deployment and the success of IoT deployment. The speech aims at providing a view on some major technologies challenges of IoT and to cover a few critical business and social issues that could hamper the large deployment of IoT systems by providing some examples of implementation.
Technology Convergence for Smart X ApplicationsBob Marcus
Cartoons showing convergence of emerging technologies into Cyber-Physical-Social grids to provide support for large-scale Smart X applications. This is a very high level overview meant to capture some of the technology interactions for non-technical viewers.
Smart city concept has a great potential improve the quality of life by use of Internet of Things paradigm.
Deployment of Wireless Sensor Networks would provide huge amount of data
It would present massive and unstructured data management and analysis challenges.
Cloud based storage and Big Data techniques show promise to generate actionable intelligence from these data streams.
IoT Semantic Interoperability: Keynote at Haystack Connect 2017Milan Milenkovic
Title: "IoT Semantic Interoperability and Project Haystack: Beginning of a Beautiful Friendship"
Definition and types of of interoperability, importance, standards, proposed cross-domain approach and feasibility POC.
The Internet of Things (IOT) is a system of interrelated computing devices, mechanical and digital machines, objects, animals or people that are provided with unique identifiers and the ability to transfer data over a network without requiring human-to-human or human-to-computer interaction.
This IOT makes a new environment for living people. Using this IOT we can manage huge amount of electricity and using this IOT we can secure our home and environment without any authorized users. I hope that this IOT is boon for all over the world.The Internet of Things also includes people – this is particularly important in areas such as home automation, where humans can control the environment via mobile applications. Through services, such as cloud services, massive volumes of data (“big data”) are being processed and turned into valuable information.
Mike McBride will provide a look at the Industrial IoT (IIoT) landscape and the OT/IT convergence. He will cover several use cases including healthcare, entertainment and smart buildings. He will cover the challenges IIoT networking faces with emerging technologies and how edge computing will provide increased performance, security and reliability. Mike will discuss the various Edge Computing standards & opensource forums along with proposed architectures. And Mike will present new solutions being proposed (ICN, slicing, Blockchain) to support the bandwidth, latency and security requirements within Industrial verticals.
About the speaker: As Sr. Director of Innovation & Strategy, within Huawei's IP Network BU, Mike leads Industrial IoT, Edge Computing and IP/SDN architecture, standardization, and strategy across product lines and industry forums. He leads architecture and standardization activities within the IIc and BBF and has served as an IETF Working Group chair for 15 years. Mike has led emerging technology projects within opensource communities and played a key role in the formation of OPEN-O (Now ONAP). He is an Ericsson alum where he developed and directed SDN/NFV network architectures. And for many years with Cisco, Mike supported customers, worked in development teams and managed mobility, wireless and video projects across BUs. Mike began his career supporting customers at Apple Computer. He resides in Orange County, CA
"Toward Cognitive-IoT Applications -- Integrating AI with Fog Computing" by Dr. Frank C. D. Tsai, Workshop of Mobile IoT with Edge Computing and Artificial Intelligence, sponsored by Ministry of Education, Taiwan
(R)evolution of the computing continuum - A few challengesFrederic Desprez
Initially proposed to interconnect computers worldwide, the Internet has significantly evolved to become in two decades a key element in almost all our activities. This (r)evolution mainly relies on the progress that has been achieved in computation and communication fields and that has led to the well-known and widely spread Cloud Computing paradigm.
With the emergence of the Internet of Things (IoT), stakeholders expect a new revolution that will push, once again, the limits of the Internet, in particular by favouring the convergence between physical and virtual worlds. This convergence is about to be made possible thanks to the development of minimalist sensors as well as complex industrial physical machines that can be connected to the Internet through edge computing infrastructures.
Among the obstacles to this new generation of Internet services is the development of a convenient and powerful framework that should allow operators, and devops, to manage the life-cycle of both the digital infrastructures and the applications deployed on top of these infrastructures, throughout the cloud to IoT continuum.
In this keynote, Frédéric Desprez and his colleague Adrien Lebre presented research issues and provide preliminary answers to identify whether the challenges brought by this new paradigm is an evolution or a revolution for our community.
SILECS/SLICES - Super Infrastructure for Large-Scale Experimental Computer Sc...Frederic Desprez
The aim of the SILECS and SLICES projects is to design and build a large infrastructure for experimental research on various aspects of distributed computing, from small connected objects to the large data centres of tomorrow. This infrastructure will allow end-to-end experimentation with software and applications at all levels of the software layers, from event capture (sensors, actuators) to data processing and storage, to radio transmission management and dynamic deployment of edge computing services, enabling reproducible research on all-point programmable networks, ... SILECS is the french node of a european infrastructure called SLICES.
# Internet Security: Safeguarding Your Digital World
In the contemporary digital age, the internet is a cornerstone of our daily lives. It connects us to vast amounts of information, provides platforms for communication, enables commerce, and offers endless entertainment. However, with these conveniences come significant security challenges. Internet security is essential to protect our digital identities, sensitive data, and overall online experience. This comprehensive guide explores the multifaceted world of internet security, providing insights into its importance, common threats, and effective strategies to safeguard your digital world.
## Understanding Internet Security
Internet security encompasses the measures and protocols used to protect information, devices, and networks from unauthorized access, attacks, and damage. It involves a wide range of practices designed to safeguard data confidentiality, integrity, and availability. Effective internet security is crucial for individuals, businesses, and governments alike, as cyber threats continue to evolve in complexity and scale.
### Key Components of Internet Security
1. **Confidentiality**: Ensuring that information is accessible only to those authorized to access it.
2. **Integrity**: Protecting information from being altered or tampered with by unauthorized parties.
3. **Availability**: Ensuring that authorized users have reliable access to information and resources when needed.
## Common Internet Security Threats
Cyber threats are numerous and constantly evolving. Understanding these threats is the first step in protecting against them. Some of the most common internet security threats include:
### Malware
Malware, or malicious software, is designed to harm, exploit, or otherwise compromise a device, network, or service. Common types of malware include:
- **Viruses**: Programs that attach themselves to legitimate software and replicate, spreading to other programs and files.
- **Worms**: Standalone malware that replicates itself to spread to other computers.
- **Trojan Horses**: Malicious software disguised as legitimate software.
- **Ransomware**: Malware that encrypts a user's files and demands a ransom for the decryption key.
- **Spyware**: Software that secretly monitors and collects user information.
### Phishing
Phishing is a social engineering attack that aims to steal sensitive information such as usernames, passwords, and credit card details. Attackers often masquerade as trusted entities in email or other communication channels, tricking victims into providing their information.
### Man-in-the-Middle (MitM) Attacks
MitM attacks occur when an attacker intercepts and potentially alters communication between two parties without their knowledge. This can lead to the unauthorized acquisition of sensitive information.
### Denial-of-Service (DoS) and Distributed Denial-of-Service (DDoS) Attacks
APNIC Foundation, presented by Ellisha Heppner at the PNG DNS Forum 2024APNIC
Ellisha Heppner, Grant Management Lead, presented an update on APNIC Foundation to the PNG DNS Forum held from 6 to 10 May, 2024 in Port Moresby, Papua New Guinea.
Multi-cluster Kubernetes Networking- Patterns, Projects and GuidelinesSanjeev Rampal
Talk presented at Kubernetes Community Day, New York, May 2024.
Technical summary of Multi-Cluster Kubernetes Networking architectures with focus on 4 key topics.
1) Key patterns for Multi-cluster architectures
2) Architectural comparison of several OSS/ CNCF projects to address these patterns
3) Evolution trends for the APIs of these projects
4) Some design recommendations & guidelines for adopting/ deploying these solutions.
Bridging the Digital Gap Brad Spiegel Macon, GA Initiative.pptxBrad Spiegel Macon GA
Brad Spiegel Macon GA’s journey exemplifies the profound impact that one individual can have on their community. Through his unwavering dedication to digital inclusion, he’s not only bridging the gap in Macon but also setting an example for others to follow.
This 7-second Brain Wave Ritual Attracts Money To You.!nirahealhty
Discover the power of a simple 7-second brain wave ritual that can attract wealth and abundance into your life. By tapping into specific brain frequencies, this technique helps you manifest financial success effortlessly. Ready to transform your financial future? Try this powerful ritual and start attracting money today!
1.Wireless Communication System_Wireless communication is a broad term that i...JeyaPerumal1
Wireless communication involves the transmission of information over a distance without the help of wires, cables or any other forms of electrical conductors.
Wireless communication is a broad term that incorporates all procedures and forms of connecting and communicating between two or more devices using a wireless signal through wireless communication technologies and devices.
Features of Wireless Communication
The evolution of wireless technology has brought many advancements with its effective features.
The transmitted distance can be anywhere between a few meters (for example, a television's remote control) and thousands of kilometers (for example, radio communication).
Wireless communication can be used for cellular telephony, wireless access to the internet, wireless home networking, and so on.
1. From IoT Devices to Cloud
Computing Infrastructures
When (bi)millions small entities should work with a few giants
F. Desprez, INRIA
Entretiens Jacques Cartier - Montréal October 2017
2. Introduction
• Exponential improvement of
– Electronics (energy consumption, size, cost)
– Capacity of networks (WAN, wireless)
• Prediction between 28 and 50 billions of connected devices by 2020
(Ericsson, CISCO)
• Exponential growth of applications near users
– Smartphones, tablets, connected devices, sensors, …
• Large number of Cloud facilities to cope with generated data
– Many platforms and infrastructures available around the world
– Several offers for IaaS, PaaS, and SaaS platforms
– Public, private, community, and hybrid clouds
– Going toward distributed Clouds (FOG, Edge)
Entretiens Jacques Cartier - Oct. 2017F. Desprez - From IoT devices to Cloud Computing Infrastructures - 2
3. Entretiens Jacques Cartier -
Oct. 2017
F. Desprez - From IoT devices to Cloud Computing Infrastructures - 3http://www.beechamresearch.com/article.aspx?id=4
4. Target Applications: Industrial Internet
• Integration of complex physical machinery with networked sensors and
software
• Application examples
– Self-driving cars, smart’* (health, cities,
transportation, power grid, retail store, …)
• Ingest data from machines, analyze it (often
in real-time), and use it to adjust operations
• Several fields need to collaborate
– Internet of Things, Big Data,
machine-to-machine communications,
machine learning, Cyber-physical systems, …
Entretiens Jacques Cartier - Oct. 2017F. Desprez - From IoT devices to Cloud Computing Infrastructures - 4
5. Industrial Internet, contd
Entretiens Jacques Cartier - Oct. 2017F. Desprez - From IoT devices to Cloud Computing Infrastructures - 5
Recent Advances in Industrial Wireless Sensor Networks Toward Efficient Management in IoT, Sheng.Z., Mahapatra, C., Zhu, C., Leung, V.C.M., A., Kansakar, P.,
U.Kahn, S., IEEE, Jun. 2015.
6. Citylabs project @ Inria
Entretiens Jacques Cartier - Oct. 2017F. Desprez - From IoT devices to Cloud Computing Infrastructures - 6
• Privacy-aware Urban-scale Physical and Social Sensing
(FUN, MiMove, SMIS, AGORA)
• Energy-efficient wireless communication, Leveraging the IoT
• Physical &/vs social sensing, Fixed &/vs mobile sensing
• Ultra large scale & heterogeneous urban systems
• Incentives & privacy for citizens
• From Sensing to Modeling Cities (CLIME, DICE, MYRIADS,
OAK, WILLOW)
• Cloud-based management of semantic urban data
• Data assimilation combining simulation models & available data to
overcome uncertainties
• Urban-scale quantitative visual analysis to leverage the visual records of
urban environment
• Next Generation City Services promoting citizen engagement
(CLIME, MiMove, SMIS, WILLOW)
• AppCivist Social App
• City planning
• Democratizing environmental data
• Smart transportation systems
• Overcoming the Smart City Challenge
• Teams involved: AGORA, CLIME, DICE, FUN, MYRIADS, MIMOVE
SMIS, WILLOW
https://citylab.inria.fr/
7. Target Applications: Tactile Internet
• Ability to deliver physical experiences remotely
• The complete loop from the physical world, to the digital and back to
the physical
Entretiens Jacques Cartier - Oct. 2017F. Desprez - From IoT devices to Cloud Computing Infrastructures - 7
http://www.zeitgeistlab.ca/doc/tactile_internet.html
8. Target Application: Disaster Resilience
• Keep computing and network services running after a natural disaster or
attack
• Geographic redundancy of the components (over “small” devices?)
• Network (re)-configuration, path restoration and protection
• Backup VM for each working VM
• Modeling the risk!
Entretiens Jacques Cartier - Oct. 2017F. Desprez - From IoT devices to Cloud Computing Infrastructures - 8
Network design requirements for disaster resilience in IaaS clouds, R. de Souza Couto, S. Secci, M. E. Mitre Campista, and L. H. Maciel Kosmalski Costa, IEEE
Communications Magazine • October 2014
9. Needs and Performance Constraints
• Performances
– Big latency issues
• Voice: 100 ms (upper latency limit
for humans)
• Video : 10 ms
• Tactile internet : 1 ms
– Bandwidth (upstream traffic mainly)
– Real-time constraints
– Scalability
Entretiens Jacques Cartier - Oct. 2017F. Desprez - From IoT devices to Cloud Computing Infrastructures - 9
• Other constraints
– Security
– Privacy
– Availability
– Durability control
10. Entretiens Jacques Cartier -
Oct. 2017
F. Desprez - From IoT devices to Cloud Computing Infrastructures - 10
John Mc Carthy,
Speaking at the MIT centennial in 1961
If computers of the kind I have advocated
become the computers of the future, then
computing may someday be organized as a
public utility just as the telephone system
is a public utility...
11. Current Situation
Entretiens Jacques Cartier - Oct. 2017F. Desprez - From IoT devices to Cloud Computing Infrastructures - 11
• Large off shore DCs to cope with the increasing UC demand while handling
energy concerns
• But
• Jurisdiction concerns (data locality), PRISM NSA scandal, Patriot Act
• Reliability (disaster recovery), single point of failure
• Network overhead
• Localization is a key element to deliver efficient as well as sustainable Utility
Computing solutions
12. Cloud Evolution
Not only mega data centres !
Entretiens Jacques Cartier - Oct. 2017F. Desprez - From IoT devices to Cloud Computing Infrastructures - 12
Courtesy to Thierry Coupaye (Orange)
14. Trends for Next Generation Clouds
• Hybrid and community clouds are by nature distributed over multiple data
centres/clouds
Entretiens Jacques Cartier - Oct. 2017F. Desprez - From IoT devices to Cloud Computing Infrastructures - 14
Courtesy to Thierry Coupaye (Orange)
16. Clouds, FOG, and Edge
• From a Cloud model (centralized mega data-centers) to a set of micro/nano
datacenters
• Locality based utility computing infrastructures
– Provide resources closer to the users
• Leverage network backbones
– Extend any point of presence of network backbones (aka PoP) with servers
• Extend to the edge by including wireless backbones
• Where should these micro-DC be deployed ?
• Energy and cost issues
• In the core network (POPs)
Entretiens Jacques Cartier - Oct. 2017F. Desprez - From IoT devices to Cloud Computing Infrastructures - 16
P
a
ul
a
B
o
b
Al
ic
e
D
u
k
e
Ch
arle
s
P
a
m
B
o
b
core backbone
17. Clouds, FOG, and Edge
• Cloud
– (Quite) centralized, big data centers, large resources, WAN
– Location depending on energy/taxes issues
• FOG
– First coined by CISCO
– OpenFog consortium in 2015 (ARM, Cisco, Dell, Intel, Microsoft, and Princetown)
– Geographically distributed computing architecture
– Resource pool of ubiquitously connected heterogeneous devices at the edge of the
network
• Edge
– Mobile Edge Computing (MEC)
– Edge of the cellular network
• Both Fog and Edge platforms push applications, data, and services away from
centralized nodes
Entretiens Jacques Cartier - Oct. 2017F. Desprez - From IoT devices to Cloud Computing Infrastructures - 17
IFCIoT: Integrated Fog Cloud IoT Architectural Paradigm for Future Internet of Things Munir, A., Kansakar, P., U.Kahn, S., arXiv, Jan. 2017.
18. Cloud-IoT Convergence
• IoT is here (and growing)
• Large Datacenters still efficient for large computations/data
management
• Micro/nano DCs to handle some computations closer to the users
• How should they be managed ?
Entretiens Jacques Cartier - Oct. 2017F. Desprez - From IoT devices to Cloud Computing Infrastructures - 18
Stability
Availability
Latency
Low latency
Heterogeneity
Low capacity
19. Research Issues
• Resource management
– Deployment, reconfiguration, location aware scheduling
• Data management
– User data, checkpoints, application images
• Network operation
– Virtualization
• Energy monitoring and consumption optimization
– Measures, resource management, multi-criteria, multiple sources, …
• Resilience
– Coping with failures (CPU, application, network, …) and attacks
• Security
• …
Entretiens Jacques Cartier - Oct. 2017F. Desprez - From IoT devices to Cloud Computing Infrastructures - 19
A Survey of Fog Computing: Concepts, Applications, and Issues? Yi, S., Li, C., Li, Q, Mobidata 2015, June. 2015.
20. Deployment and Reconfiguration
• Provisioning resources where they are needed
– Provisioning comes with a cost
– Limited capacity (≠ mega data-center)
• Zero-touch provisioning and reconfiguration
– Being able to deploy/reconfigure an edge site without human
interventions
– Data and computation
– Real-time elasticity
• Resource discovery
• Application image management
• Heterogeneous (and dynamic
platforms)
• Network issues (SDN, NFV)
Entretiens Jacques Cartier - Oct. 2017F. Desprez - From IoT devices to Cloud Computing Infrastructures - 20
21. Locality Aware Resource Management
• Mechanisms to manage the life cycle of applications (VM, containers,
bare metal) and data (users, applications) taking locality into account
• Several objective functions (multi-criteria scheduling)
– Resource consumption
– Network cost
– Energy
– $
• Classical scheduling/mapping problems revisited
– Many papers using classical ILP solvers (scaling issues there !)
• Placement of application graphs over infrastructure graphs
– Static or dynamic
• What’s about dynamicity ?
– Clients moving from one place to an other
– Failures
Entretiens Jacques Cartier - Oct. 2017F. Desprez - From IoT devices to Cloud Computing Infrastructures - 21
22. Locality Aware Resource Management
• Problem of placing application graphs, which represent application components and the
communication among these components, onto a physical graph, which represents the
computing devices and communication links in the physical system
– Tree topologies
• Baseline algorithm that provides an optimal solution to the placement of a linear
application graph (decomposable into multiple small building blocks)
• Simplification of the problem to make it tractable, NP-harness proof
• Off-line algorithm
Entretiens Jacques Cartier - Oct. 2017F. Desprez - From IoT devices to Cloud Computing Infrastructures - 22
Online Placement of Multi-Component Applications in Edge Computing Environments, Wang, S., Zafer, M., Leung, K.K., Mobidata 2015, June. 2015,
doi: 10.1109/ACCESS.2017.2665971.
23. Energy Monitoring and Consumption
Optimization
• Energy can be considered as the first metric for placement strategies
– i.e. relocate jobs/data according to the energy sources
• Preemptive jobs
– i.e. we can think about batch approaches and schedule them on the right edge DC at the right
moment
• Multi-criteria resource management
• Taking care of new energy sources (solar, wind, …)
• QoS for applications, resource consumption, energy cost
• Several issues
– Instrument realistic infrastructures,
– measure accurately consumption of resources,
– design the right models,
– isolate influential factors,
– combine energy models with performance models,
– propose models integrating inherent variability,
– perform campaign measurements,
– achieve invalidation studies
Entretiens Jacques Cartier - Oct. 2017F. Desprez - From IoT devices to Cloud Computing Infrastructures - 23
24. Renewable Energy and IoT
• Problem: How to decide to compute at the edge or offload at the edge depending on
QoS and energy-efficiency for a given IoT application?
– Performance/energy tradeoff
• Modeling application for its energy consumption and its response time
– Benchmarking (wattmeters, photovoltaic panel production traces) and simulation
– CPU and network
• Offloading the data to process video streams at edge
– Effectively reduces the response time
– Avoids unnecessary data transmission
between edge and core
– Extends for instance the battery lifetime of
end-user equipment
– On-site renewable energy production and
batteries in our scenario can save up to 50% total
consumed energy consumed at the edge
Entretiens Jacques Cartier - Oct. 2017F. Desprez - From IoT devices to Cloud Computing Infrastructures - 24
Leveraging Renewable Energy in Edge Clouds for Data Stream Analysis in IoT, Y. Li, A.-C. Orgerie, I. Rodero, M. Parashar, J.-M.
Menaud, CCGrid 2017.
Edge
Core
Edge1
data
aggregation
v-4 720p
v-5 480p
v-6 360p
Core
Edge
Core
Edge0
v-3 360p
v-2 360p
v-1 360p
r0: p=(a,b),
ac = n%
A
B
C
Data stream
analysis from
cameras
embedded on
vehicles
25. Resilience
• Several Cloud failures in the past
– Dropbox, Netflix, Amazon
– Huge costs involved
• Advantage of Edge computing platforms
– No single point of failure
• At the infrastructure level
– Replication of VMs and data on various geographic locations
– Proactive and reactive strategies taking into account network latency into
account
• At the middleware level
– Rescheduling of failed tasks
• At the application level
– Periodical checkpointing (taking into account locality)
Entretiens Jacques Cartier - Oct. 2017F. Desprez - From IoT devices to Cloud Computing Infrastructures - 25
A Survey of Fog Computing: Concepts, Applications, and Issues? Yi, S., Li, C., Li, Q, Mobidata 2015, June. 2015.
26. Virtualization/Sandboxing Technologies
• SDN/NFV requirements also requires edge DCs
• VMs/Containers/Baremetals
– How to deliver those abstractions at the edge
– Booting a VM may last minutes if the VM image is a remote attached volume
– Containers boot faster but they also require containers images
• where should we put those images?
• What's about Data?
– Where should be the data put?
– Can we envision data storage repository in every edge site?
• Extreme edge (i.e. inside Rasbperry PI, home gateways, ....)
– No sufficient resources to start VM/containers with local images
– Some system mechanisms should be deployed locally whereas other ones
should stay higher in the infrastructure
Entretiens Jacques Cartier - Oct. 2017F. Desprez - From IoT devices to Cloud Computing Infrastructures - 26
27. Other issues
• FOG networking
– Maintaining connectivity with heterogeneous (and dynamic) networks
– Use/adaptation of Software Defined Networking (SDN) and Network
Function Virtualization (NFV) features
– Quality of Service
• Interfacing and programming model
– Right now assembly code level (bunch of low level models for each kind of
platforms)
– Need of a unified model ?
• Accounting, billing and monitoring
• Privacy
• Simulation and experiments
– How to validate algorithms, protocols, and software stacks
Entretiens Jacques Cartier - Oct. 2017F. Desprez - From IoT devices to Cloud Computing Infrastructures - 27
29. The Discovery Initiative
• Leverage network backbones
– Extend any Point of Presence (PoP) of network backbones with
servers (from network hubs up to major DSLAMs that are operated by
telecom companies, network institutions…).
• Extend to the edge by including radio base stations
• Discovery
– how to operate such a massively distributed infrastructure
Entretiens Jacques Cartier - Oct. 2017F. Desprez - From IoT devices to Cloud Computing Infrastructures - 29
USA NREN
http://www.renater.fr/raccourci?lang=fr
http://beyondtheclouds.github.io/
30. Revise OpenStack to Support Fog/Edge Computing
Infrastructures
• Do not reinvent the wheel… it is too late
• Mitigate development efforts
– By favoring a bottom/up approach
– Investigate whether/how OpenStack core services can become
cooperative by default (using P2P and Self-* technics)
Entretiens Jacques Cartier - Oct. 2017F. Desprez - From IoT devices to Cloud Computing Infrastructures - 30
http://beyondtheclouds.github.io/
31. Several research issues for Discovery
• Cost of the network(s) ?
• Partial view of the system ?
• Impact on others VMs ?
• Management of VM images ?
• How to take into account locality aspects?
• Which software abstractions to make the development easier and
more reliable (distributed event programming)? …
• OpenStack distribution and deployment
Entretiens Jacques Cartier - Oct. 2017F. Desprez - From IoT devices to Cloud Computing Infrastructures - 31
Beyond The Cloud, How Should Next Generation Utility Computing Infrastructures Be Designed? Lèbre, A., J. Pastor, J., Bertier, M., Desprez, F., Rouzaud-
Cornabas, J., Tedeschi, C., Anedda, P., Zanetti, G., Nou, R., Cortes, T., Riviere, E. and Ropars, T., INRIA Research Report 8348, Aug. 2013.
http://beyondtheclouds.github.io/
32. • Pro
• Locality (jurisdiction concerns, latency-aware apps, minimize network overhead)
• Reliability/redundancy (no critical point/location/center)
• The infrastructure is naturally distributed throughout multiple areas
• Lead time to delivery
• Leverage current PoPs and extend them according to UC demands
• Energy footprint (on-going investigations with RENATER)
• Bring back part of the revenue to NRENs/Telcos
• Cons
• Security concerns (in terms of who can access to the PoPs)
• Operate a fully IaaS in a unified but distributed manner at WAN level
• Not suited for all kinds of applications : Large tightly coupled HPC workloads 50 nodes/1000 cores,
200 nodes / 4000 cores (5 racks), so 1000 nodes in one PoP does not look realistic …
• Peering agreement / economic model between network operators
http://beyondtheclouds.github.io/
32Labex UCN@Sophia – F. Desprez Feb. 18, 2016
The DISCOVERY Initiative Pros and Cons
33. “Good experiments”
A good experiment should fulfill the following properties
– Reproducibility: must give the same result with the same input
– Extensibility: must target possible comparisons with other works
and extensions (more/other processors, larger data sets,
different architectures)
– Applicability: must define realistic parameters and must allow
for an easy calibration
– “Revisability”: when an implementation does not perform as
expected, must help to identify the reasons
Entretiens Jacques Cartier - Oct. 2017F. Desprez - From IoT devices to Cloud Computing Infrastructures - 33
34. SILECS: Super Infrastructure for Large-
scale Experimental Computer Science
• Having a large scale infrastructure to experiment IoT/Edge cloud
applications and software stacks
– Scaling factor
– Exascale platforms
– Virtualized, Programmable
– FOG and Mobile Edge Computing
• Features
– Manageability
• Agility (SDN, NFV)
• Self adaptability
• Global orchestration
– Complexity
• Resources
• Energy
– Data Flow Management
• Data deluge processing
Entretiens Jacques Cartier - Oct. 2017F. Desprez - From IoT devices to Cloud Computing Infrastructures - 34
35. SILECS: based upon two infrastructures
• FIT
– Proving Internet players access to a variety of fixed and mobile technologies and
services, thus accelerating the design of advanced technologies for the Future Internet
– 4 key technologies and a single control point: IoT-Lab (connected objects & sensors,
mobility), CorteXlab (Cognitive Radio), wireless (anechoic chamber), Network Operations
Center (including a PLE access), Advanced Cloud technology including OpenStack
– 9 sites (Paris (2), Evry, Rocquencourt, Lille, Strasbourg, Lyon, Grenoble, Sophia
Antipolis)
• Grid’5000
– A scientific instrument for experimental research on large future infrastructures:
Clouds, datacenters, HPC exascale, Big Data infrastructures, networks, etc.
– 10 sites, service nodes, > 8000 cores, with a large variety of network connectivity and
storage access, dedicated interconnection network granted and managed by RENATER
gathered around a GIS (CNRS, CEA, Inria, CPU, RENATER, Institut Mines-Telecom,
CDEFI)
• Software stacks dedicated to experimentation
• Monitoring tools, resource reservation, data collection and storage
Entretiens Jacques Cartier - Oct. 2017F. Desprez - From IoT devices to Cloud Computing Infrastructures - 35
36. Grid’5000
Entretiens Jacques Cartier - Oct. 2017F. Desprez - From IoT devices to Cloud Computing Infrastructures - 36
• Testbed for research on distributed systems
• Born from the observation that we need a better and larger testbed
• HPC, Grids, P2P, and nowCloud computing and BigData systems
• A complete access to the nodes’ hardware in an exclusive mode
(from one node to the whole infrastructure)
• Dedicated network (RENATER)
• Reconfigurable: nodes with Kadeploy and network with KaVLAN
• Current status
• 10 sites, 29 clusters, 1060 nodes, 10474 cores
• Diverse technologies/resources
(Intel, AMD, Myrinet, Infiniband, two GPU clusters, energy probes)
• Some Experiments examples
• In Situ analytics
• Big Data Management
• HPC Programming approaches
• Network modeling and simulation
• Energy consumption evaluation
• Batch scheduler optimization
• Large virtual machines deployments
37. FIT Infrastructure
Entretiens Jacques Cartier - Oct. 2017F. Desprez - From IoT devices to Cloud Computing Infrastructures - 37
FIT-CorteXlab: Cognitive Radio Testbed
40 Software Defined Radio Nodes
(SOCRATE)
FIT-Wireless: WiFi mesh testbed
(DIANA)
FIT-IoT-LAB
• 2700 wireless sensor nodes spread across six different sites in France
• Nodes are either fixed or mobile and can be allocated in various topologies throughout all sites.
Sophia
Lyon
38. SILECS Design Objectives
• Deploy a large set of digital resources from sensors to data centers
– Open, remotely accessible, virtualized infrastructure
– Provide rich, diverse and advanced tools: test, measurement, benchmarking,
reproducibility, data repository, …
– Typically a « mid-scale » infrastructure
• Mobilize the scientific community in the domain of digital sciences
– Articulate the French and European efforts in this domain
– International attractivity and visibility (unique today at the international level)
• Several challenges
– Heterogeneity of the resulting infrastructures
– Different communities and different software stacks
– Keep reproducibility at its highest level
– Keep the infrastructure up-to-date
– Connect the infrastructure to other platforms in Europe and elsewhere
Entretiens Jacques Cartier - Oct. 2017F. Desprez - From IoT devices to Cloud Computing Infrastructures - 38
39. Entretiens Jacques Cartier - Oct. 2017F. Desprez - From IoT devices to Cloud Computing Infrastructures - 39
The GRAIL
40. SILECS
Entretiens Jacques Cartier - Oct. 2017F. Desprez - From IoT devices to Cloud Computing Infrastructures - 40
• New infrastructure based on two existing instruments (FIT and
Grid’5000)
• Keep the aim of previous platforms (their core scientific issues
addressed)
– IoT, wireless networks, future Internet for FIT
– HPC, Big Data, Clouds, Virtualization, … for Grid’5000
• Address new challenges
– IoT and Clouds
– New generation Cloud platforms and software stacks (Edge, FOG)
– Data streaming applications
– Locality aware resource management
– …
• Submitted to ESFRI in August
41. Conclusions
• Epic battle between centralization and distribution
– Batch processing, supercomputers, P2P, Grid, Cloud, Fog, and Edge
• Tons of new applications (with new related issues) coming
• Probably a mix of different approaches to get the best from every
infrastructure
– Regular DC, Edge, Extreme Edge
– Performance, Quality of Service, energy consumption
• Lots of research issues (both theoretical and software design issues)
• Distributed computing/network convergence
• We need new models to handle heterogeneity (CPU, networks,
storage) and dynamicity
• Scale issue
• How to perform significant experiments for these problems ?
• We live in an exciting time !
Entretiens Jacques Cartier - Oct. 2017F. Desprez - From IoT devices to Cloud Computing Infrastructures - 41