SlideShare a Scribd company logo
1 of 16
Download to read offline
1
From leading edge IoT
Protocols to Python
Dashboarding an
End2End Journey
Lukas Ott - ApacheCon North America 2022
2
●
Part of the community
●
By Day: Domain (Enterprise) Architect
●
By Night: Open Source Enthusiast
●
Pythonista
●
Copenhagen & Frankfurt
●
I connect People, Processes, Data and Machines
Who am I
@ot_luk
otluk
3
Orchestrators
Data Visualization
Message Broker IIoT connector
Operating
System
Database
Data
Processing
Apache Projects in context of IoT (extract)
4
IoT Protocols
Connecting IoT devices – OSI Model
1. Physical (Bluetooth, Ethernet, LTE, NFC, RFID, Wi-Fi, Z-Wave, Zigbee)
2. Data link (IEEE 802.15.5, LPWAN)
3. Network (IP, 6LoWPAN)
4. Transport (Transmission Control Protocol (TCP), User Datagram Protocol (UDP))
5. Session
6. Presentation
7. Application
https://en.wikipedia.org/wiki/OSI_model
5
IoT Protocols – Application Layer
●
Advanced Message Queuing Protocol (AMQP)
●
Constrained Application Protocol (CoAP)
●
Data Distribution Service (DDS)
●
Message Queue Telemetry Transport (MQTT)
●
Lightweight Machine to Machine (LwM2M)
6
Advanced Message Queuing Protocol (AMQP)
●
Popular Apache Frameworks:
– https://activemq.apache.org/
– https://pulsar.apache.org/
– https://qpid.apache.org/index.html
●
Properties
– Brokered
– Publish / Subscribe
– Direct Exchange
7
Message Queue Telemetry Transport (MQTT)
●
Popular Apache Frameworks:
– https://streampipes.apache.org/
– https://activemq.apache.org/
●
Properties
– Tied to TCP
– Publish / Subscribe
– Brokered
8
Data Distribution Service (DDS)
●
Popular Apache Frameworks:
– https://mynewt.apache.org/
– https://nuttx.apache.org/
●
Properties
– Publish / Subscribe
–
Peer-to-Peer
9
And many more...
●
Checkout 8-)
– https://plc4x.apache.org/
The universal protocol adapter for Industrial IoT
10
11
Zenoh
●
Zenoh unifies data in motion, data at rest and computations.
It elegantly blends traditional pub/sub with geo distributed storage,
queries and computations, while retaining a level of time and space
efficiency that is well beyond any of the mainstream stacks.
– Zero Overhead Pub/sub, Store/Query and Compute.
12
●
A high-level app and dashboarding solution for Python
– Use the PyData tools and plotting libraries that you know and love
– Develop in your favorite editor or notebook environment and
seamlessly deploy the resulting application
– Stream data large and small to the front end
●
Integrates for instance Apache Echarts
13
Apache IoTDB
●
IoT native database with high performance for data
management and analysis
●
Checkout Apache Con Asia for more details
14
Data Visualization
ZIP / PIP Stack
Database
IoT Protocol
15
Github Repo: https://github.com/ottlukas/ApacheCon_2022_IoT
16

More Related Content

Similar to From leading IoT Protocols to Python Dashboarding_final

Mainflux - Hyperscalable Unified IoT Platform
Mainflux - Hyperscalable Unified IoT PlatformMainflux - Hyperscalable Unified IoT Platform
Mainflux - Hyperscalable Unified IoT Platform
Sasa Klopanovic
 
Building a Next-gen Data Platform and Leveraging the OSS Ecosystem for Easy W...
Building a Next-gen Data Platform and Leveraging the OSS Ecosystem for Easy W...Building a Next-gen Data Platform and Leveraging the OSS Ecosystem for Easy W...
Building a Next-gen Data Platform and Leveraging the OSS Ecosystem for Easy W...
StampedeCon
 

Similar to From leading IoT Protocols to Python Dashboarding_final (20)

Mainflux - Hyperscalable Unified IoT Platform
Mainflux - Hyperscalable Unified IoT PlatformMainflux - Hyperscalable Unified IoT Platform
Mainflux - Hyperscalable Unified IoT Platform
 
Building a Next-gen Data Platform and Leveraging the OSS Ecosystem for Easy W...
Building a Next-gen Data Platform and Leveraging the OSS Ecosystem for Easy W...Building a Next-gen Data Platform and Leveraging the OSS Ecosystem for Easy W...
Building a Next-gen Data Platform and Leveraging the OSS Ecosystem for Easy W...
 
DDDP 2019 - Brown to Green
DDDP 2019  - Brown to GreenDDDP 2019  - Brown to Green
DDDP 2019 - Brown to Green
 
NETWORK TRAFFIC ANALYSIS: HADOOP PIG VS TYPICAL MAPREDUCE
NETWORK TRAFFIC ANALYSIS: HADOOP PIG VS TYPICAL MAPREDUCENETWORK TRAFFIC ANALYSIS: HADOOP PIG VS TYPICAL MAPREDUCE
NETWORK TRAFFIC ANALYSIS: HADOOP PIG VS TYPICAL MAPREDUCE
 
SDN and metrics from the SDOs
SDN and metrics from the SDOsSDN and metrics from the SDOs
SDN and metrics from the SDOs
 
Red Hat® Ceph Storage and Network Solutions for Software Defined Infrastructure
Red Hat® Ceph Storage and Network Solutions for Software Defined InfrastructureRed Hat® Ceph Storage and Network Solutions for Software Defined Infrastructure
Red Hat® Ceph Storage and Network Solutions for Software Defined Infrastructure
 
Data streaming
Data streamingData streaming
Data streaming
 
BKK16-500K2 CTO talk - The End to End Story
BKK16-500K2 CTO talk - The End to End StoryBKK16-500K2 CTO talk - The End to End Story
BKK16-500K2 CTO talk - The End to End Story
 
Phoenix Data Conference - Big Data Analytics for IoT 11/4/17
Phoenix Data Conference - Big Data Analytics for IoT 11/4/17Phoenix Data Conference - Big Data Analytics for IoT 11/4/17
Phoenix Data Conference - Big Data Analytics for IoT 11/4/17
 
Open Networking
Open NetworkingOpen Networking
Open Networking
 
[OpenStack Day in Korea 2015] Keynote 2 - Leveraging OpenStack to Realize the...
[OpenStack Day in Korea 2015] Keynote 2 - Leveraging OpenStack to Realize the...[OpenStack Day in Korea 2015] Keynote 2 - Leveraging OpenStack to Realize the...
[OpenStack Day in Korea 2015] Keynote 2 - Leveraging OpenStack to Realize the...
 
Drone data sync
Drone data syncDrone data sync
Drone data sync
 
Accelerating Apache Hadoop through High-Performance Networking and I/O Techno...
Accelerating Apache Hadoop through High-Performance Networking and I/O Techno...Accelerating Apache Hadoop through High-Performance Networking and I/O Techno...
Accelerating Apache Hadoop through High-Performance Networking and I/O Techno...
 
Internet of Things - protocols review (MeetUp Wireless & Networks, Poznań 21....
Internet of Things - protocols review (MeetUp Wireless & Networks, Poznań 21....Internet of Things - protocols review (MeetUp Wireless & Networks, Poznań 21....
Internet of Things - protocols review (MeetUp Wireless & Networks, Poznań 21....
 
Accelerate Big Data Processing with High-Performance Computing Technologies
Accelerate Big Data Processing with High-Performance Computing TechnologiesAccelerate Big Data Processing with High-Performance Computing Technologies
Accelerate Big Data Processing with High-Performance Computing Technologies
 
IPMI is dead, Long live Redfish
IPMI is dead, Long live RedfishIPMI is dead, Long live Redfish
IPMI is dead, Long live Redfish
 
Wearables and IoT Strategy
Wearables and IoT StrategyWearables and IoT Strategy
Wearables and IoT Strategy
 
SDN, OpenFlow, NFV, and Virtual Network
SDN, OpenFlow, NFV, and Virtual NetworkSDN, OpenFlow, NFV, and Virtual Network
SDN, OpenFlow, NFV, and Virtual Network
 
OPEN NETWORK OPERATING SYSTEM.PPTX
OPEN NETWORK OPERATING SYSTEM.PPTXOPEN NETWORK OPERATING SYSTEM.PPTX
OPEN NETWORK OPERATING SYSTEM.PPTX
 
Understanding Hadoop
Understanding HadoopUnderstanding Hadoop
Understanding Hadoop
 

More from Lukas Ott (8)

Platform Strategy and Data-driven development in Pharmaceutical Industry
Platform Strategy and Data-driven development in Pharmaceutical IndustryPlatform Strategy and Data-driven development in Pharmaceutical Industry
Platform Strategy and Data-driven development in Pharmaceutical Industry
 
DXC Industrialized A.I. – Von der Data Story zum industrialisierten A.I. Service
DXC Industrialized A.I. – Von der Data Story zum industrialisierten A.I. ServiceDXC Industrialized A.I. – Von der Data Story zum industrialisierten A.I. Service
DXC Industrialized A.I. – Von der Data Story zum industrialisierten A.I. Service
 
Smart Manufacturing
Smart ManufacturingSmart Manufacturing
Smart Manufacturing
 
Cognitive Systems
Cognitive SystemsCognitive Systems
Cognitive Systems
 
Hadoop und IoT
Hadoop und IoTHadoop und IoT
Hadoop und IoT
 
Cax systeme final
Cax   systeme finalCax   systeme final
Cax systeme final
 
Big Data und Social Media
Big Data und Social MediaBig Data und Social Media
Big Data und Social Media
 
Semantisches Web und Wissensmanagement
Semantisches Web und WissensmanagementSemantisches Web und Wissensmanagement
Semantisches Web und Wissensmanagement
 

Recently uploaded

+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...
+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...
+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...
Health
 
In Riyadh ((+919101817206)) Cytotec kit @ Abortion Pills Saudi Arabia
In Riyadh ((+919101817206)) Cytotec kit @ Abortion Pills Saudi ArabiaIn Riyadh ((+919101817206)) Cytotec kit @ Abortion Pills Saudi Arabia
In Riyadh ((+919101817206)) Cytotec kit @ Abortion Pills Saudi Arabia
ahmedjiabur940
 
如何办理英国诺森比亚大学毕业证(NU毕业证书)成绩单原件一模一样
如何办理英国诺森比亚大学毕业证(NU毕业证书)成绩单原件一模一样如何办理英国诺森比亚大学毕业证(NU毕业证书)成绩单原件一模一样
如何办理英国诺森比亚大学毕业证(NU毕业证书)成绩单原件一模一样
wsppdmt
 
怎样办理旧金山城市学院毕业证(CCSF毕业证书)成绩单学校原版复制
怎样办理旧金山城市学院毕业证(CCSF毕业证书)成绩单学校原版复制怎样办理旧金山城市学院毕业证(CCSF毕业证书)成绩单学校原版复制
怎样办理旧金山城市学院毕业证(CCSF毕业证书)成绩单学校原版复制
vexqp
 
怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制
怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制
怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制
vexqp
 
一比一原版(曼大毕业证书)曼尼托巴大学毕业证成绩单留信学历认证一手价格
一比一原版(曼大毕业证书)曼尼托巴大学毕业证成绩单留信学历认证一手价格一比一原版(曼大毕业证书)曼尼托巴大学毕业证成绩单留信学历认证一手价格
一比一原版(曼大毕业证书)曼尼托巴大学毕业证成绩单留信学历认证一手价格
q6pzkpark
 
Jual Cytotec Asli Obat Aborsi No. 1 Paling Manjur
Jual Cytotec Asli Obat Aborsi No. 1 Paling ManjurJual Cytotec Asli Obat Aborsi No. 1 Paling Manjur
Jual Cytotec Asli Obat Aborsi No. 1 Paling Manjur
ptikerjasaptiker
 
Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...
nirzagarg
 
Top profile Call Girls In Begusarai [ 7014168258 ] Call Me For Genuine Models...
Top profile Call Girls In Begusarai [ 7014168258 ] Call Me For Genuine Models...Top profile Call Girls In Begusarai [ 7014168258 ] Call Me For Genuine Models...
Top profile Call Girls In Begusarai [ 7014168258 ] Call Me For Genuine Models...
nirzagarg
 
Jual obat aborsi Bandung ( 085657271886 ) Cytote pil telat bulan penggugur ka...
Jual obat aborsi Bandung ( 085657271886 ) Cytote pil telat bulan penggugur ka...Jual obat aborsi Bandung ( 085657271886 ) Cytote pil telat bulan penggugur ka...
Jual obat aborsi Bandung ( 085657271886 ) Cytote pil telat bulan penggugur ka...
Klinik kandungan
 

Recently uploaded (20)

Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...
 
+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...
+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...
+97470301568>>weed for sale in qatar ,weed for sale in dubai,weed for sale in...
 
In Riyadh ((+919101817206)) Cytotec kit @ Abortion Pills Saudi Arabia
In Riyadh ((+919101817206)) Cytotec kit @ Abortion Pills Saudi ArabiaIn Riyadh ((+919101817206)) Cytotec kit @ Abortion Pills Saudi Arabia
In Riyadh ((+919101817206)) Cytotec kit @ Abortion Pills Saudi Arabia
 
Sequential and reinforcement learning for demand side management by Margaux B...
Sequential and reinforcement learning for demand side management by Margaux B...Sequential and reinforcement learning for demand side management by Margaux B...
Sequential and reinforcement learning for demand side management by Margaux B...
 
DATA SUMMIT 24 Building Real-Time Pipelines With FLaNK
DATA SUMMIT 24  Building Real-Time Pipelines With FLaNKDATA SUMMIT 24  Building Real-Time Pipelines With FLaNK
DATA SUMMIT 24 Building Real-Time Pipelines With FLaNK
 
Predicting HDB Resale Prices - Conducting Linear Regression Analysis With Orange
Predicting HDB Resale Prices - Conducting Linear Regression Analysis With OrangePredicting HDB Resale Prices - Conducting Linear Regression Analysis With Orange
Predicting HDB Resale Prices - Conducting Linear Regression Analysis With Orange
 
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed
5CL-ADBA,5cladba, Chinese supplier, safety is guaranteed
 
如何办理英国诺森比亚大学毕业证(NU毕业证书)成绩单原件一模一样
如何办理英国诺森比亚大学毕业证(NU毕业证书)成绩单原件一模一样如何办理英国诺森比亚大学毕业证(NU毕业证书)成绩单原件一模一样
如何办理英国诺森比亚大学毕业证(NU毕业证书)成绩单原件一模一样
 
7. Epi of Chronic respiratory diseases.ppt
7. Epi of Chronic respiratory diseases.ppt7. Epi of Chronic respiratory diseases.ppt
7. Epi of Chronic respiratory diseases.ppt
 
怎样办理旧金山城市学院毕业证(CCSF毕业证书)成绩单学校原版复制
怎样办理旧金山城市学院毕业证(CCSF毕业证书)成绩单学校原版复制怎样办理旧金山城市学院毕业证(CCSF毕业证书)成绩单学校原版复制
怎样办理旧金山城市学院毕业证(CCSF毕业证书)成绩单学校原版复制
 
SR-101-01012024-EN.docx Federal Constitution of the Swiss Confederation
SR-101-01012024-EN.docx  Federal Constitution  of the Swiss ConfederationSR-101-01012024-EN.docx  Federal Constitution  of the Swiss Confederation
SR-101-01012024-EN.docx Federal Constitution of the Swiss Confederation
 
Capstone in Interprofessional Informatic // IMPACT OF COVID 19 ON EDUCATION
Capstone in Interprofessional Informatic  // IMPACT OF COVID 19 ON EDUCATIONCapstone in Interprofessional Informatic  // IMPACT OF COVID 19 ON EDUCATION
Capstone in Interprofessional Informatic // IMPACT OF COVID 19 ON EDUCATION
 
怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制
怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制
怎样办理伦敦大学毕业证(UoL毕业证书)成绩单学校原版复制
 
Aspirational Block Program Block Syaldey District - Almora
Aspirational Block Program Block Syaldey District - AlmoraAspirational Block Program Block Syaldey District - Almora
Aspirational Block Program Block Syaldey District - Almora
 
一比一原版(曼大毕业证书)曼尼托巴大学毕业证成绩单留信学历认证一手价格
一比一原版(曼大毕业证书)曼尼托巴大学毕业证成绩单留信学历认证一手价格一比一原版(曼大毕业证书)曼尼托巴大学毕业证成绩单留信学历认证一手价格
一比一原版(曼大毕业证书)曼尼托巴大学毕业证成绩单留信学历认证一手价格
 
Jual Cytotec Asli Obat Aborsi No. 1 Paling Manjur
Jual Cytotec Asli Obat Aborsi No. 1 Paling ManjurJual Cytotec Asli Obat Aborsi No. 1 Paling Manjur
Jual Cytotec Asli Obat Aborsi No. 1 Paling Manjur
 
Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...
Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...
 
Top profile Call Girls In Begusarai [ 7014168258 ] Call Me For Genuine Models...
Top profile Call Girls In Begusarai [ 7014168258 ] Call Me For Genuine Models...Top profile Call Girls In Begusarai [ 7014168258 ] Call Me For Genuine Models...
Top profile Call Girls In Begusarai [ 7014168258 ] Call Me For Genuine Models...
 
Jual obat aborsi Bandung ( 085657271886 ) Cytote pil telat bulan penggugur ka...
Jual obat aborsi Bandung ( 085657271886 ) Cytote pil telat bulan penggugur ka...Jual obat aborsi Bandung ( 085657271886 ) Cytote pil telat bulan penggugur ka...
Jual obat aborsi Bandung ( 085657271886 ) Cytote pil telat bulan penggugur ka...
 
Harnessing the Power of GenAI for BI and Reporting.pptx
Harnessing the Power of GenAI for BI and Reporting.pptxHarnessing the Power of GenAI for BI and Reporting.pptx
Harnessing the Power of GenAI for BI and Reporting.pptx
 

From leading IoT Protocols to Python Dashboarding_final

  • 1. 1 From leading edge IoT Protocols to Python Dashboarding an End2End Journey Lukas Ott - ApacheCon North America 2022
  • 2. 2 ● Part of the community ● By Day: Domain (Enterprise) Architect ● By Night: Open Source Enthusiast ● Pythonista ● Copenhagen & Frankfurt ● I connect People, Processes, Data and Machines Who am I @ot_luk otluk
  • 3. 3 Orchestrators Data Visualization Message Broker IIoT connector Operating System Database Data Processing Apache Projects in context of IoT (extract)
  • 4. 4 IoT Protocols Connecting IoT devices – OSI Model 1. Physical (Bluetooth, Ethernet, LTE, NFC, RFID, Wi-Fi, Z-Wave, Zigbee) 2. Data link (IEEE 802.15.5, LPWAN) 3. Network (IP, 6LoWPAN) 4. Transport (Transmission Control Protocol (TCP), User Datagram Protocol (UDP)) 5. Session 6. Presentation 7. Application https://en.wikipedia.org/wiki/OSI_model
  • 5. 5 IoT Protocols – Application Layer ● Advanced Message Queuing Protocol (AMQP) ● Constrained Application Protocol (CoAP) ● Data Distribution Service (DDS) ● Message Queue Telemetry Transport (MQTT) ● Lightweight Machine to Machine (LwM2M)
  • 6. 6 Advanced Message Queuing Protocol (AMQP) ● Popular Apache Frameworks: – https://activemq.apache.org/ – https://pulsar.apache.org/ – https://qpid.apache.org/index.html ● Properties – Brokered – Publish / Subscribe – Direct Exchange
  • 7. 7 Message Queue Telemetry Transport (MQTT) ● Popular Apache Frameworks: – https://streampipes.apache.org/ – https://activemq.apache.org/ ● Properties – Tied to TCP – Publish / Subscribe – Brokered
  • 8. 8 Data Distribution Service (DDS) ● Popular Apache Frameworks: – https://mynewt.apache.org/ – https://nuttx.apache.org/ ● Properties – Publish / Subscribe – Peer-to-Peer
  • 9. 9 And many more... ● Checkout 8-) – https://plc4x.apache.org/ The universal protocol adapter for Industrial IoT
  • 10. 10
  • 11. 11 Zenoh ● Zenoh unifies data in motion, data at rest and computations. It elegantly blends traditional pub/sub with geo distributed storage, queries and computations, while retaining a level of time and space efficiency that is well beyond any of the mainstream stacks. – Zero Overhead Pub/sub, Store/Query and Compute.
  • 12. 12 ● A high-level app and dashboarding solution for Python – Use the PyData tools and plotting libraries that you know and love – Develop in your favorite editor or notebook environment and seamlessly deploy the resulting application – Stream data large and small to the front end ● Integrates for instance Apache Echarts
  • 13. 13 Apache IoTDB ● IoT native database with high performance for data management and analysis ● Checkout Apache Con Asia for more details
  • 14. 14 Data Visualization ZIP / PIP Stack Database IoT Protocol
  • 16. 16