Message-Oriented Middleware for Edge Computing Applications

Thomas Rausch
Thomas RauschCo-Founder & Head of Engineering at LocalStack
Message-Oriented Middleware
for Edge Computing Applications
Thomas Rausch
Distributed Systems Group
TU Wien
http://dsg.tuwien.ac.at
2
3
Amazon AWS IoT
4
The Internet
Decoupled messaging
5
Subscribe to topic:
/robot/arm
6
Publish “move x,y,z” to
/robot/arm
7
Topic Subscriber
/robot/arm robot-client
/robot/arm ...Subscriber:
robot-client
Publisher
Subscriber:
...
Topic
/robot/arm
8
Trust?!
Availability?!
End-to-end latency: ??ms!
9
IoT Edge Cloud
Edge Computing
S. Nastic, T. Rausch, et al. 2017. A Serverless Real-Time Data Analytics Platform for Edge Computing. IEEE Internet Computing 21, 4 (2017), 64–71.
G. Lewis, et al. 2014. Tactical Cloudlets: Moving Cloud Computing to the Edge. In 2014 IEEE Military Communications Conference. IEEE, 1440–1446.
Proximity Scale
10
IoT Edge Cloud
Edge Computing
S. Nastic, T. Rausch, et al. 2017. A Serverless Real-Time Data Analytics Platform for Edge Computing. IEEE Internet Computing 21, 4 (2017), 64–71.
G. Lewis, et al. 2014. Tactical Cloudlets: Moving Cloud Computing to the Edge. In 2014 IEEE Military Communications Conference. IEEE, 1440–1446.
Proximity Scale
11
Data centers
Internet
Mobile
edge
Extreme
edge
IoT
Cloudlets
Message broker
Cloud-based MOM
Edge-enabled MOM
Edge-Enabled MOM
12
Sound familiar?
NCA’05
DEBS’05
MW’05
PODC’07
13
What’s new?
● The Cloud
– Centralized on-demand resources
● Edge resources
– Decentralized, heterogeneous, and volatile resources
(Mobile devices, IoT gateways, Cloudlets)
● Internet of Things
– Plethora of devices and protocol standards
● A new form of elasticity: Cloud to Edge
– Osmotic Computing
M. Villari, et al. 2016. Osmotic Computing: A new Paradigm for Edge/Cloud Integration. IEEE Cloud Computing
14
Data centers
Internet
Mobile
edge
Extreme
edge
IoT
Cloudlets
Challenges
15
Data centers
Mobile
edge
Extreme
edge
IoT
Proximity awareness
16
Data centers
Mobile
edge
Extreme
edge
IoT
Elasticity from the Cloud to the Edge
Runtime
provisioning
of brokers
Network
reconfiguration
17
Data centers
Mobile
edge
Extreme
edge
IoT
Privacy
& Trust
18
State of the Art – Research & Prototypes
19
Messaging Model
● MQTT: ISO standardized pub/sub protocol
– TCP/IP
– Small code footprint, low-bandwidth design
– Has become a common platform for IoT [1]
● Simple protocol
– CONNACK
– SUBSCRIBE(t), SUBACK(t)
– PUBLISH(t,msg)
– ...
[1] A. Al-Fuqaha, et al. 2015. Internet of Things: A Survey on Enabling Technologies, Protocols, and Applications
IEEE Commun. Surv. Tutorials, vol. 17, no. 4, pp. 2347–2376, 2015.
20
Messaging Model
● Message delivery guarantees (MQTT “QoS”)
– (0) At most once
– (1) At least once
– (2) Exactly once
● Maintaining guarantees despite distribution
21
State of the Art – The Real World
● Static topic bridging for proximity-based messaging
(Mosquitto & HiveMQ)
Local Broker Central Broker
Shared Topic
Internal Topics
Static
config
Static
config
Edge Cloud
Steve. 2017. Mosquitto MQTT Bridge-Usage and Configuration http://www.steves-internet-guide.com/mosquitto-bridge-configuration/
22
State of the Art – The Real World
ScalAgent. JoramMQ, a distributed MQTT broker for the Internet of Things. White paper. 2014.
23
The EMMA Project
Client
GW
c
GW
c
Broker
Broker
Device
Monitoringprotocol
Controller
Bridging
Tables
Gateway
Bridging
Table
Reconfigura-
tion Engine
REST Endpoints
Network
monitor
Buffer out
Buffer in
MQTT
Server
https://git.dsg.tuwien.ac.at/emma
Architecture Bridging & Reconfiguration
T. Rausch, S. Nastic, S. Dustdar. 2018. EMMA: Distributed QoS-Aware MQTT Middleware for Edge Computing Applications. IC2E’18.
24
Prototype Evaluation
us-east eu-west
eu-central
BrokerGateway BrokerGateway
Controller
... ...
Gateway
Broker
98 ms 27 ms
85 ms
25
Goals for short/mid-term future
● Elicit algorithmic challenges and novelties
● Message delivery guarantees (MQTT QoS)
● Elastic diffusion of brokers to the Edge
– Control heterogeneity of Edge resources
– Efficient monitoring and network reconfiguration
Cloud
Dipl.-Ing. (MSc)
Thomas Rausch
Research Assistant
TU Wien
Distributed Systems Group
Argentinierstraße 8/184-1, 1040, Vienna, Austria
T: +43 1 58801 184 838
E: rausch@dsg.tuwien.ac.at
dsg.tuwien.ac.at/staff/trausch
1 of 26

Recommended

EMMA: Distributed QoS-Aware MQTT Middleware for Edge Computing Applications by
EMMA: Distributed QoS-Aware MQTT Middleware for Edge Computing ApplicationsEMMA: Distributed QoS-Aware MQTT Middleware for Edge Computing Applications
EMMA: Distributed QoS-Aware MQTT Middleware for Edge Computing ApplicationsThomas Rausch
922 views27 slides
Cloud Origins: How OpenStack became the natural evolution of the internet and... by
Cloud Origins: How OpenStack became the natural evolution of the internet and...Cloud Origins: How OpenStack became the natural evolution of the internet and...
Cloud Origins: How OpenStack became the natural evolution of the internet and...Cloud Native Day Tel Aviv
184 views16 slides
A Generalized Label-Forwarding Architecture for the Future Internet by
A Generalized Label-Forwarding Architecture for the Future InternetA Generalized Label-Forwarding Architecture for the Future Internet
A Generalized Label-Forwarding Architecture for the Future InternetAchim Friedland
489 views11 slides
Data Center Network in a Bundle by
Data Center Network in a BundleData Center Network in a Bundle
Data Center Network in a BundleDhiman Chowdhury
484 views11 slides
Advanced Cryptography for Cloud Security by
Advanced Cryptography for Cloud SecurityAdvanced Cryptography for Cloud Security
Advanced Cryptography for Cloud SecurityNeel Chakraborty
1.6K views22 slides
OpenStack NFV Edge computing for IOT microservices by
OpenStack NFV Edge computing for IOT microservicesOpenStack NFV Edge computing for IOT microservices
OpenStack NFV Edge computing for IOT microservicesopenstackindia
5K views20 slides

More Related Content

Similar to Message-Oriented Middleware for Edge Computing Applications

IoT Networking Part 2 by
IoT Networking Part 2IoT Networking Part 2
IoT Networking Part 2Hitesh Mohapatra
867 views24 slides
The Considerations for Internet of Things @ 2017 by
The Considerations for Internet of Things @ 2017The Considerations for Internet of Things @ 2017
The Considerations for Internet of Things @ 2017Jian-Hong Pan
1.5K views54 slides
What's the Right Messaging Standard for the IoT? by
What's the Right Messaging  Standard for the IoT?What's the Right Messaging  Standard for the IoT?
What's the Right Messaging Standard for the IoT?Angelo Corsaro
13K views65 slides
ArtigofinalpublicadoASTESJ_060139.pdf by
ArtigofinalpublicadoASTESJ_060139.pdfArtigofinalpublicadoASTESJ_060139.pdf
ArtigofinalpublicadoASTESJ_060139.pdfMeftahMehdawi
5 views8 slides
Phoenix Data Conference - Big Data Analytics for IoT 11/4/17 by
Phoenix Data Conference - Big Data Analytics for IoT 11/4/17Phoenix Data Conference - Big Data Analytics for IoT 11/4/17
Phoenix Data Conference - Big Data Analytics for IoT 11/4/17Mark Goldstein
899 views84 slides
Zenoh: The Genesis by
Zenoh: The GenesisZenoh: The Genesis
Zenoh: The GenesisAngelo Corsaro
236 views26 slides

Similar to Message-Oriented Middleware for Edge Computing Applications(20)

The Considerations for Internet of Things @ 2017 by Jian-Hong Pan
The Considerations for Internet of Things @ 2017The Considerations for Internet of Things @ 2017
The Considerations for Internet of Things @ 2017
Jian-Hong Pan1.5K views
What's the Right Messaging Standard for the IoT? by Angelo Corsaro
What's the Right Messaging  Standard for the IoT?What's the Right Messaging  Standard for the IoT?
What's the Right Messaging Standard for the IoT?
Angelo Corsaro13K views
ArtigofinalpublicadoASTESJ_060139.pdf by MeftahMehdawi
ArtigofinalpublicadoASTESJ_060139.pdfArtigofinalpublicadoASTESJ_060139.pdf
ArtigofinalpublicadoASTESJ_060139.pdf
MeftahMehdawi5 views
Phoenix Data Conference - Big Data Analytics for IoT 11/4/17 by Mark Goldstein
Phoenix Data Conference - Big Data Analytics for IoT 11/4/17Phoenix Data Conference - Big Data Analytics for IoT 11/4/17
Phoenix Data Conference - Big Data Analytics for IoT 11/4/17
Mark Goldstein899 views
BKK16-500K2 CTO talk - The End to End Story by Linaro
BKK16-500K2 CTO talk - The End to End StoryBKK16-500K2 CTO talk - The End to End Story
BKK16-500K2 CTO talk - The End to End Story
Linaro397 views
Mainflux - Hyperscalable Unified IoT Platform by Sasa Klopanovic
Mainflux - Hyperscalable Unified IoT PlatformMainflux - Hyperscalable Unified IoT Platform
Mainflux - Hyperscalable Unified IoT Platform
Sasa Klopanovic323 views
Mainflux - Hyperscalable Unified IoT Platform by Sasa Klopanovic
Mainflux - Hyperscalable Unified IoT PlatformMainflux - Hyperscalable Unified IoT Platform
Mainflux - Hyperscalable Unified IoT Platform
Sasa Klopanovic190 views
NetSim Webinar on IOT by KAVITHA IYER
NetSim Webinar on IOTNetSim Webinar on IOT
NetSim Webinar on IOT
KAVITHA IYER375 views
Open Source Telecom Software Landscape by Alan Quayle by Alan Quayle
Open Source Telecom Software Landscape by Alan QuayleOpen Source Telecom Software Landscape by Alan Quayle
Open Source Telecom Software Landscape by Alan Quayle
Alan Quayle420 views
Essential Capabilities of an IoT Cloud Platform - AWS Online Tech Talks by Amazon Web Services
Essential Capabilities of an IoT Cloud Platform - AWS Online Tech TalksEssential Capabilities of an IoT Cloud Platform - AWS Online Tech Talks
Essential Capabilities of an IoT Cloud Platform - AWS Online Tech Talks
Amazon Web Services1.2K views
IETF building block in the LwM2M Ecosystem (IoT World 2017 Workshop) by Open Mobile Alliance
IETF building block in the LwM2M Ecosystem (IoT World 2017 Workshop)IETF building block in the LwM2M Ecosystem (IoT World 2017 Workshop)
IETF building block in the LwM2M Ecosystem (IoT World 2017 Workshop)
Emerging Computing Architectures by Daniel Holmberg
Emerging Computing ArchitecturesEmerging Computing Architectures
Emerging Computing Architectures
Daniel Holmberg104 views
Mmsys slideshare-intel-nokia by Rufael Mekuria
Mmsys slideshare-intel-nokiaMmsys slideshare-intel-nokia
Mmsys slideshare-intel-nokia
Rufael Mekuria126 views
DevOps for Dynamic Interoperability of IoT, Edge and Cloud Systems by Hong-Linh Truong
DevOps for Dynamic Interoperability of IoT, Edge and Cloud SystemsDevOps for Dynamic Interoperability of IoT, Edge and Cloud Systems
DevOps for Dynamic Interoperability of IoT, Edge and Cloud Systems
Hong-Linh Truong293 views
Internet of Things (IoT) and Big Data by Guido Schmutz
Internet of Things (IoT) and Big DataInternet of Things (IoT) and Big Data
Internet of Things (IoT) and Big Data
Guido Schmutz9.8K views

More from Thomas Rausch

Test cloud application deployments locally and in CI without staging environm... by
Test cloud application deployments locally and in CI without staging environm...Test cloud application deployments locally and in CI without staging environm...
Test cloud application deployments locally and in CI without staging environm...Thomas Rausch
10 views29 slides
Synthesizing Plausible Infrastructure Configurations for Evaluating Edge Comp... by
Synthesizing Plausible Infrastructure Configurations for Evaluating Edge Comp...Synthesizing Plausible Infrastructure Configurations for Evaluating Edge Comp...
Synthesizing Plausible Infrastructure Configurations for Evaluating Edge Comp...Thomas Rausch
199 views15 slides
Towards a Serverless Platform for Edge AI by
Towards a Serverless Platform for Edge AITowards a Serverless Platform for Edge AI
Towards a Serverless Platform for Edge AIThomas Rausch
470 views14 slides
Edge Intelligence: The Convergence of Humans, Things and AI by
Edge Intelligence: The Convergence of Humans, Things and AIEdge Intelligence: The Convergence of Humans, Things and AI
Edge Intelligence: The Convergence of Humans, Things and AIThomas Rausch
844 views34 slides
Portable Energy-Aware Cluster-Based Edge Computers by
Portable Energy-Aware Cluster-Based Edge ComputersPortable Energy-Aware Cluster-Based Edge Computers
Portable Energy-Aware Cluster-Based Edge ComputersThomas Rausch
847 views14 slides
An Empirical Analysis of Build Failures in the Continuous Integration Workflo... by
An Empirical Analysis of Build Failures in the Continuous Integration Workflo...An Empirical Analysis of Build Failures in the Continuous Integration Workflo...
An Empirical Analysis of Build Failures in the Continuous Integration Workflo...Thomas Rausch
912 views22 slides

More from Thomas Rausch(8)

Test cloud application deployments locally and in CI without staging environm... by Thomas Rausch
Test cloud application deployments locally and in CI without staging environm...Test cloud application deployments locally and in CI without staging environm...
Test cloud application deployments locally and in CI without staging environm...
Thomas Rausch10 views
Synthesizing Plausible Infrastructure Configurations for Evaluating Edge Comp... by Thomas Rausch
Synthesizing Plausible Infrastructure Configurations for Evaluating Edge Comp...Synthesizing Plausible Infrastructure Configurations for Evaluating Edge Comp...
Synthesizing Plausible Infrastructure Configurations for Evaluating Edge Comp...
Thomas Rausch199 views
Towards a Serverless Platform for Edge AI by Thomas Rausch
Towards a Serverless Platform for Edge AITowards a Serverless Platform for Edge AI
Towards a Serverless Platform for Edge AI
Thomas Rausch470 views
Edge Intelligence: The Convergence of Humans, Things and AI by Thomas Rausch
Edge Intelligence: The Convergence of Humans, Things and AIEdge Intelligence: The Convergence of Humans, Things and AI
Edge Intelligence: The Convergence of Humans, Things and AI
Thomas Rausch844 views
Portable Energy-Aware Cluster-Based Edge Computers by Thomas Rausch
Portable Energy-Aware Cluster-Based Edge ComputersPortable Energy-Aware Cluster-Based Edge Computers
Portable Energy-Aware Cluster-Based Edge Computers
Thomas Rausch847 views
An Empirical Analysis of Build Failures in the Continuous Integration Workflo... by Thomas Rausch
An Empirical Analysis of Build Failures in the Continuous Integration Workflo...An Empirical Analysis of Build Failures in the Continuous Integration Workflo...
An Empirical Analysis of Build Failures in the Continuous Integration Workflo...
Thomas Rausch912 views
Build Failure Prediction in Continuous Integration Workflows by Thomas Rausch
Build Failure Prediction in Continuous Integration WorkflowsBuild Failure Prediction in Continuous Integration Workflows
Build Failure Prediction in Continuous Integration Workflows
Thomas Rausch1.5K views
Git Introduction Tutorial by Thomas Rausch
Git Introduction TutorialGit Introduction Tutorial
Git Introduction Tutorial
Thomas Rausch3.9K views

Recently uploaded

Network Source of Truth and Infrastructure as Code revisited by
Network Source of Truth and Infrastructure as Code revisitedNetwork Source of Truth and Infrastructure as Code revisited
Network Source of Truth and Infrastructure as Code revisitedNetwork Automation Forum
25 views45 slides
Scaling Knowledge Graph Architectures with AI by
Scaling Knowledge Graph Architectures with AIScaling Knowledge Graph Architectures with AI
Scaling Knowledge Graph Architectures with AIEnterprise Knowledge
28 views15 slides
ESPC 2023 - Protect and Govern your Sensitive Data with Microsoft Purview in ... by
ESPC 2023 - Protect and Govern your Sensitive Data with Microsoft Purview in ...ESPC 2023 - Protect and Govern your Sensitive Data with Microsoft Purview in ...
ESPC 2023 - Protect and Govern your Sensitive Data with Microsoft Purview in ...Jasper Oosterveld
13 views49 slides
Melek BEN MAHMOUD.pdf by
Melek BEN MAHMOUD.pdfMelek BEN MAHMOUD.pdf
Melek BEN MAHMOUD.pdfMelekBenMahmoud
14 views1 slide
handbook for web 3 adoption.pdf by
handbook for web 3 adoption.pdfhandbook for web 3 adoption.pdf
handbook for web 3 adoption.pdfLiveplex
22 views16 slides
Vertical User Stories by
Vertical User StoriesVertical User Stories
Vertical User StoriesMoisés Armani Ramírez
12 views16 slides

Recently uploaded(20)

ESPC 2023 - Protect and Govern your Sensitive Data with Microsoft Purview in ... by Jasper Oosterveld
ESPC 2023 - Protect and Govern your Sensitive Data with Microsoft Purview in ...ESPC 2023 - Protect and Govern your Sensitive Data with Microsoft Purview in ...
ESPC 2023 - Protect and Govern your Sensitive Data with Microsoft Purview in ...
handbook for web 3 adoption.pdf by Liveplex
handbook for web 3 adoption.pdfhandbook for web 3 adoption.pdf
handbook for web 3 adoption.pdf
Liveplex22 views
Empathic Computing: Delivering the Potential of the Metaverse by Mark Billinghurst
Empathic Computing: Delivering  the Potential of the MetaverseEmpathic Computing: Delivering  the Potential of the Metaverse
Empathic Computing: Delivering the Potential of the Metaverse
Mark Billinghurst476 views
Transcript: The Details of Description Techniques tips and tangents on altern... by BookNet Canada
Transcript: The Details of Description Techniques tips and tangents on altern...Transcript: The Details of Description Techniques tips and tangents on altern...
Transcript: The Details of Description Techniques tips and tangents on altern...
BookNet Canada135 views
HTTP headers that make your website go faster - devs.gent November 2023 by Thijs Feryn
HTTP headers that make your website go faster - devs.gent November 2023HTTP headers that make your website go faster - devs.gent November 2023
HTTP headers that make your website go faster - devs.gent November 2023
Thijs Feryn21 views
Voice Logger - Telephony Integration Solution at Aegis by Nirmal Sharma
Voice Logger - Telephony Integration Solution at AegisVoice Logger - Telephony Integration Solution at Aegis
Voice Logger - Telephony Integration Solution at Aegis
Nirmal Sharma31 views
【USB韌體設計課程】精選講義節錄-USB的列舉過程_艾鍗學院 by IttrainingIttraining
【USB韌體設計課程】精選講義節錄-USB的列舉過程_艾鍗學院【USB韌體設計課程】精選講義節錄-USB的列舉過程_艾鍗學院
【USB韌體設計課程】精選講義節錄-USB的列舉過程_艾鍗學院
GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N... by James Anderson
GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N...GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N...
GDG Cloud Southlake 28 Brad Taylor and Shawn Augenstein Old Problems in the N...
James Anderson66 views

Message-Oriented Middleware for Edge Computing Applications