SlideShare a Scribd company logo
DREAM:LabDREAM:Lab
Sensing & Edge
Analytics
Client Device
Message
Broker
Apache Apollo
Android
Streaming Data
Processing
Apache Storm
Interactive
Analytics
Apache Spark
Desktop
Raspberry
Pi
Dashboard &
Viz. Logic
Node.js Server
GLRQlty
Processed Data
HBase
Flow
CloudEdge
Raw Data
HDFS
Reverse Proxy
Nginx
M - MQTT, T - TCP
W - WebSocket
Pub - Publisher
Sub - Subscriber
RT - Real Time Data
QR - Query Result
SJ - Spark Job
JS - Spark Job Status
A - Async, S - Sync
BT - Broker & Topic
Pub/M/T Pub/M/T(A)
Sub/M/W
Sub/M/W
QueryREST
Write
Write
Read
RT|QR(A) SJ JS(A)|QR(S)
Sub/M/T
BT(A)|QR(S)
Sensors
/Motes

More Related Content

What's hot

Big Data on EC2: Mashing Technology in the Cloud
Big Data on EC2: Mashing Technology in the CloudBig Data on EC2: Mashing Technology in the Cloud
Big Data on EC2: Mashing Technology in the CloudGeorge Ang
 
Spark at Airbnb
Spark at AirbnbSpark at Airbnb
Spark at Airbnb
Hao Wang
 
Watching Pigs Fly with the Netflix Hadoop Toolkit (Hadoop Summit 2013)
Watching Pigs Fly with the Netflix Hadoop Toolkit (Hadoop Summit 2013)Watching Pigs Fly with the Netflix Hadoop Toolkit (Hadoop Summit 2013)
Watching Pigs Fly with the Netflix Hadoop Toolkit (Hadoop Summit 2013)
Jeff Magnusson
 
Presto @ Uber Hadoop summit2017
Presto @ Uber Hadoop summit2017Presto @ Uber Hadoop summit2017
Presto @ Uber Hadoop summit2017
Zhenxiao Luo
 
Distilling Insights @ Appsflyer (Data Architecture)
Distilling Insights @ Appsflyer (Data Architecture)Distilling Insights @ Appsflyer (Data Architecture)
Distilling Insights @ Appsflyer (Data Architecture)
Arnon Rotem-Gal-Oz
 
RDF by Structured Reference to Semantics, the RS2 framework
RDF by Structured Reference to Semantics, the RS2 frameworkRDF by Structured Reference to Semantics, the RS2 framework
RDF by Structured Reference to Semantics, the RS2 framework
Khan Mostafa
 
Curse of Cardinality: A History and Evolution of Monitoring at Scale
Curse of Cardinality: A History and Evolution of Monitoring at ScaleCurse of Cardinality: A History and Evolution of Monitoring at Scale
Curse of Cardinality: A History and Evolution of Monitoring at Scale
Michael Goodness
 
The IoT and big data
The IoT and big dataThe IoT and big data
The IoT and big data
Gal Ben-Haim
 
Hasura 2.0 Webinar
Hasura 2.0   WebinarHasura 2.0   Webinar
Hasura 2.0 Webinar
Hasura
 
Netflix Big Data Paris 2017
Netflix Big Data Paris 2017Netflix Big Data Paris 2017
Netflix Big Data Paris 2017
Jason Flittner
 
Presto@Netflix Presto Meetup 03-19-15
Presto@Netflix Presto Meetup 03-19-15Presto@Netflix Presto Meetup 03-19-15
Presto@Netflix Presto Meetup 03-19-15
Zhenxiao Luo
 
Lighthouse - an open-source library to build data lakes - Kris Peeters
Lighthouse - an open-source library to build data lakes - Kris PeetersLighthouse - an open-source library to build data lakes - Kris Peeters
Lighthouse - an open-source library to build data lakes - Kris Peeters
Data Science Leuven
 
Ronan Corkery, kdb+ developer at Kx Systems: “Kdb+: How Wall Street Tech can ...
Ronan Corkery, kdb+ developer at Kx Systems: “Kdb+: How Wall Street Tech can ...Ronan Corkery, kdb+ developer at Kx Systems: “Kdb+: How Wall Street Tech can ...
Ronan Corkery, kdb+ developer at Kx Systems: “Kdb+: How Wall Street Tech can ...
Maya Lumbroso
 
Distilling insights @ AppsFlyer
Distilling insights @ AppsFlyerDistilling insights @ AppsFlyer
Distilling insights @ AppsFlyer
Arnon Rotem-Gal-Oz
 
Real-time analytics as a service at King
Real-time analytics as a service at King Real-time analytics as a service at King
Real-time analytics as a service at King
Gyula Fóra
 
Collecting Endpoint Security Logs Through Big Data Technology - Dedi Dwianto
Collecting Endpoint Security Logs Through Big Data Technology - Dedi DwiantoCollecting Endpoint Security Logs Through Big Data Technology - Dedi Dwianto
Collecting Endpoint Security Logs Through Big Data Technology - Dedi Dwianto
idsecconf
 
PhD Projects in Cloudsim Research Assistance
PhD Projects in Cloudsim Research AssistancePhD Projects in Cloudsim Research Assistance
PhD Projects in Cloudsim Research Assistance
PhD Services
 
Stefano Pampaloni - Big data streaming analysis without code
Stefano Pampaloni  - Big data streaming analysis without codeStefano Pampaloni  - Big data streaming analysis without code
Stefano Pampaloni - Big data streaming analysis without code
Codemotion
 
Building a real-time, scalable and intelligent programmatic ad buying platform
Building a real-time, scalable and intelligent programmatic ad buying platformBuilding a real-time, scalable and intelligent programmatic ad buying platform
Building a real-time, scalable and intelligent programmatic ad buying platform
Jampp
 

What's hot (20)

Big Data on EC2: Mashing Technology in the Cloud
Big Data on EC2: Mashing Technology in the CloudBig Data on EC2: Mashing Technology in the Cloud
Big Data on EC2: Mashing Technology in the Cloud
 
Spark at Airbnb
Spark at AirbnbSpark at Airbnb
Spark at Airbnb
 
Watching Pigs Fly with the Netflix Hadoop Toolkit (Hadoop Summit 2013)
Watching Pigs Fly with the Netflix Hadoop Toolkit (Hadoop Summit 2013)Watching Pigs Fly with the Netflix Hadoop Toolkit (Hadoop Summit 2013)
Watching Pigs Fly with the Netflix Hadoop Toolkit (Hadoop Summit 2013)
 
Presto @ Uber Hadoop summit2017
Presto @ Uber Hadoop summit2017Presto @ Uber Hadoop summit2017
Presto @ Uber Hadoop summit2017
 
Distilling Insights @ Appsflyer (Data Architecture)
Distilling Insights @ Appsflyer (Data Architecture)Distilling Insights @ Appsflyer (Data Architecture)
Distilling Insights @ Appsflyer (Data Architecture)
 
RDF by Structured Reference to Semantics, the RS2 framework
RDF by Structured Reference to Semantics, the RS2 frameworkRDF by Structured Reference to Semantics, the RS2 framework
RDF by Structured Reference to Semantics, the RS2 framework
 
Curse of Cardinality: A History and Evolution of Monitoring at Scale
Curse of Cardinality: A History and Evolution of Monitoring at ScaleCurse of Cardinality: A History and Evolution of Monitoring at Scale
Curse of Cardinality: A History and Evolution of Monitoring at Scale
 
The IoT and big data
The IoT and big dataThe IoT and big data
The IoT and big data
 
Hasura 2.0 Webinar
Hasura 2.0   WebinarHasura 2.0   Webinar
Hasura 2.0 Webinar
 
Netflix Big Data Paris 2017
Netflix Big Data Paris 2017Netflix Big Data Paris 2017
Netflix Big Data Paris 2017
 
Presto@Netflix Presto Meetup 03-19-15
Presto@Netflix Presto Meetup 03-19-15Presto@Netflix Presto Meetup 03-19-15
Presto@Netflix Presto Meetup 03-19-15
 
Lighthouse - an open-source library to build data lakes - Kris Peeters
Lighthouse - an open-source library to build data lakes - Kris PeetersLighthouse - an open-source library to build data lakes - Kris Peeters
Lighthouse - an open-source library to build data lakes - Kris Peeters
 
Ronan Corkery, kdb+ developer at Kx Systems: “Kdb+: How Wall Street Tech can ...
Ronan Corkery, kdb+ developer at Kx Systems: “Kdb+: How Wall Street Tech can ...Ronan Corkery, kdb+ developer at Kx Systems: “Kdb+: How Wall Street Tech can ...
Ronan Corkery, kdb+ developer at Kx Systems: “Kdb+: How Wall Street Tech can ...
 
Apache Spark Streaming
Apache Spark StreamingApache Spark Streaming
Apache Spark Streaming
 
Distilling insights @ AppsFlyer
Distilling insights @ AppsFlyerDistilling insights @ AppsFlyer
Distilling insights @ AppsFlyer
 
Real-time analytics as a service at King
Real-time analytics as a service at King Real-time analytics as a service at King
Real-time analytics as a service at King
 
Collecting Endpoint Security Logs Through Big Data Technology - Dedi Dwianto
Collecting Endpoint Security Logs Through Big Data Technology - Dedi DwiantoCollecting Endpoint Security Logs Through Big Data Technology - Dedi Dwianto
Collecting Endpoint Security Logs Through Big Data Technology - Dedi Dwianto
 
PhD Projects in Cloudsim Research Assistance
PhD Projects in Cloudsim Research AssistancePhD Projects in Cloudsim Research Assistance
PhD Projects in Cloudsim Research Assistance
 
Stefano Pampaloni - Big data streaming analysis without code
Stefano Pampaloni  - Big data streaming analysis without codeStefano Pampaloni  - Big data streaming analysis without code
Stefano Pampaloni - Big data streaming analysis without code
 
Building a real-time, scalable and intelligent programmatic ad buying platform
Building a real-time, scalable and intelligent programmatic ad buying platformBuilding a real-time, scalable and intelligent programmatic ad buying platform
Building a real-time, scalable and intelligent programmatic ad buying platform
 

Viewers also liked

Question one
Question one Question one
Question one
abbeycoleman12
 
GEB3213 final project report
GEB3213 final project reportGEB3213 final project report
GEB3213 final project report
Eric Sawdon
 
Past simple
Past simplePast simple
Past simple
KimberlyKoolman
 
Selected_Case_Studies_Julian_Reiner
Selected_Case_Studies_Julian_ReinerSelected_Case_Studies_Julian_Reiner
Selected_Case_Studies_Julian_ReinerJULIAN A. REINER
 
Systech insights edition-Mark Woodward Smith
Systech insights edition-Mark Woodward Smith Systech insights edition-Mark Woodward Smith
Systech insights edition-Mark Woodward Smith
mark woodward-smith
 
COMFORT APPAREL - COMPANY PROFILE
COMFORT APPAREL  - COMPANY PROFILECOMFORT APPAREL  - COMPANY PROFILE
COMFORT APPAREL - COMPANY PROFILESaad Jamil
 
Day 1 examples u1f13
Day 1 examples u1f13Day 1 examples u1f13
Day 1 examples u1f13jchartiersjsd
 
Dirty Oceans by Paige
Dirty Oceans by PaigeDirty Oceans by Paige
Dirty Oceans by Paige
vscottdmp
 
Trabajo de tifany y tatis dde blogggg
Trabajo de tifany y tatis dde bloggggTrabajo de tifany y tatis dde blogggg
Trabajo de tifany y tatis dde blogggg
julio cesar henao arenas
 

Viewers also liked (11)

Question one
Question one Question one
Question one
 
GEB3213 final project report
GEB3213 final project reportGEB3213 final project report
GEB3213 final project report
 
Past simple
Past simplePast simple
Past simple
 
Selected_Case_Studies_Julian_Reiner
Selected_Case_Studies_Julian_ReinerSelected_Case_Studies_Julian_Reiner
Selected_Case_Studies_Julian_Reiner
 
A-Level Certificates
A-Level CertificatesA-Level Certificates
A-Level Certificates
 
ReportCaster
ReportCasterReportCaster
ReportCaster
 
Systech insights edition-Mark Woodward Smith
Systech insights edition-Mark Woodward Smith Systech insights edition-Mark Woodward Smith
Systech insights edition-Mark Woodward Smith
 
COMFORT APPAREL - COMPANY PROFILE
COMFORT APPAREL  - COMPANY PROFILECOMFORT APPAREL  - COMPANY PROFILE
COMFORT APPAREL - COMPANY PROFILE
 
Day 1 examples u1f13
Day 1 examples u1f13Day 1 examples u1f13
Day 1 examples u1f13
 
Dirty Oceans by Paige
Dirty Oceans by PaigeDirty Oceans by Paige
Dirty Oceans by Paige
 
Trabajo de tifany y tatis dde blogggg
Trabajo de tifany y tatis dde bloggggTrabajo de tifany y tatis dde blogggg
Trabajo de tifany y tatis dde blogggg
 

Water S-w Stack

  • 1. DREAM:LabDREAM:Lab Sensing & Edge Analytics Client Device Message Broker Apache Apollo Android Streaming Data Processing Apache Storm Interactive Analytics Apache Spark Desktop Raspberry Pi Dashboard & Viz. Logic Node.js Server GLRQlty Processed Data HBase Flow CloudEdge Raw Data HDFS Reverse Proxy Nginx M - MQTT, T - TCP W - WebSocket Pub - Publisher Sub - Subscriber RT - Real Time Data QR - Query Result SJ - Spark Job JS - Spark Job Status A - Async, S - Sync BT - Broker & Topic Pub/M/T Pub/M/T(A) Sub/M/W Sub/M/W QueryREST Write Write Read RT|QR(A) SJ JS(A)|QR(S) Sub/M/T BT(A)|QR(S) Sensors /Motes