SlideShare a Scribd company logo
Hasibur Rahman
Enabling Scalable Publish/Subscribe
for Logical-Clustering in
Crowdsourcing via MediaSense
Science and Information Conference 2014
August 27-29, 2014 | London UK
Department of Computer and Systems Sciences (DSV)
Stockholm University
Overview
• Introduction
• Background
• Motivation
• Research Problem
• Our Solution
• Advantages and Analysis
• Conclusions and Future Work
Introduction
• Crowdsourcing
• Increase of Information
• Vast IoT sources
• Logical-Clustering
• Efficient Management of Context Information (CI)
• Filters out similar context from distributed sources
• MediaSense
• A scalable distributed IoT platform for CI sharing
Background
• Spontaneous human participation i.e. crowdsourcing is pivotal for future pervasive computing (Franco-
2011)
• The surge of social networks, mobile devices, Internet or Web-enabled services have enabled
unprecedented level of human participation in crowdsourcing which has been branded as “human-in-the-
loop-sensing” or citizen sensor networks (Boulos et al. -2011), Sheth -2009)
• Ericsson predicts that 50-500 billion mobile devices will be in use by 2020 (Ericsson - 2013)
• Ericsson envisions 5G as enabler for Networked Society (Ericsson - 2013)
• This necessitates proper management of CI so that resources can be shared from remote places
• Logical-clustering has been proposed as opposed to physical clustering to efficiently manage CI (Rahman et
al. - 2013)
Crowdsourcing
• People
• Pervasive devices
• Internet or Web-enabled services
• Surrounding things
• Context Information
Motivation
• Sharing heterogenous CI obtained from distributed sources
• Publish/Subscribe (PubSub) has emerged as an efficient means of
sharing ubiquitous CI
• By leveraging the PubSub in the crowdsourcing model can unravel the
challenge of sharing CI in real-time
What is the problem?
Can the distributed MediaSense platform (Kanter et al., 2009) be used as scalable PubSub model in real-time?
If it does then how does this approach differ from other approaches?"
We have proposed MediaSense as a potential solution to the above research questions
How can the context-IDs in logical-clustering be shared efficiently in real-time?
How can we synchronize logical-sink?
Our Solution
An entity registers as UCI in MediaSense
Each logical-sink registers itself as
a UCI and associated context-IDs
as its data
Logical-sinks are synchronized by
registering physical sinks as UCIs
Our Approach
Our advantages
Real-time,
Distributed- no central point of
failure issue
Fast, Efficient, Scalable
Memory efficient
Our advantages
74%
74%
74% improvement
compared to existing
MediaSense
# of published
context-IDs
Current
MediaSense
Modified
MediaSense
% improvement
1000 7.34 ms 4.17 ms 76
10000 8.93 ms 5.37 ms 66
100000 10.74 ms 6.23 ms 72
200000 11.65 ms 6.69 ms 74
Analysis
For both Published and Subscribed
items
3537 messages/sec if it is run only
for one second and over 9000 if
just published for logical-sink
PubSub messages/sec lowers by
one-third while magnitude is
increased by ten-fold
Analysis
86%
Subscription matching only
For a hundred-fold increase 86%
increase in matching duration
Analysis
Subscription matching only for a
single context-ID
The one-millionth context-ID took
8.76 ms to match with the
published context-IDs
Analysis
99%
99%
99% improvement compared
to PARDES for 2 million
context-IDs
PARDES increasing; MediaSense
increase is minimal
Analysis (Scalability)
# of
context-
IDs
Le Subscribe
(Counting)
MediaSense
%
improvement
500 K 85 ms 14.76 ms 476
1 million 350 ms 16.22 ms 2058
# of
context-
IDs
Le Subscribe
(Counting)
MediaSense
%
improvement
15 K 621 3151 407
1 million 7 91 1200
2058%
2058% improvement
compared to Le Subscribe in
terms of subscription
matching
1200%
1200% improvement in
PubSub messages/sec
Analysis
451%
163%
163%
&
451%
MediaSense betters Le
Subscribe and ToPSS
respectively by 163% and
minimum by 451%
Conclusions
MediaSense is feasible as PubSub model in
crowdsourcing especially in logical-clustering
It is fast- requires only 9.59 ms to match
two-millionth published context-ID
Scales well compared to other PubSub
model
Efficient and no centralization
Occupies only 185.97 MB memory to
store 5 million context-IDs
Future Work
UCI discovery
Performance evaluation on
devices with limited
computational capabilities
Adaptability and awareness
Security might be a concern; we
will look into this
+ 46 (0) 70 7463968
Contact Hasibur Rahman
hasibur.rahman021
hasibur@dsv.su.se
twitter.com/hasiburrahman29
facebook.com/SuZon.Hasibur.Rahman
ACKNOWLEDGMENT
The work is partially supported by funding
from the European Union FP7 MobiS project.
The outcome of this research will be used later
in the project.
Q & A!
Thank You!
Credits
mobiS logo
www.mobis-euproject.eu/
IMAGE CREDITS
Q & A image
http://www.openlounge.org/lunargame/one-question-infinite-
answers/

More Related Content

Viewers also liked

Risk assessment (1)
Risk assessment (1)Risk assessment (1)
Risk assessment (1)
Methembedarikwa5
 
Internship presentation
Internship presentationInternship presentation
Internship presentation
Benoît Browaeys
 
Career path power point
Career path power pointCareer path power point
Career path power point
Eric Warren II
 
Statistical Dissemination Control in Large Machine-to-Machine Communication N...
Statistical Dissemination Control in Large Machine-to-Machine Communication N...Statistical Dissemination Control in Large Machine-to-Machine Communication N...
Statistical Dissemination Control in Large Machine-to-Machine Communication N...
kitechsolutions
 
Revisi karakteristik transistor
Revisi karakteristik transistorRevisi karakteristik transistor
Revisi karakteristik transistor
Malik Abdul
 
лоцкинська зош
лоцкинська зошлоцкинська зош
лоцкинська зош
servisosvita
 
Las Herramientas Web
Las Herramientas WebLas Herramientas Web
Las Herramientas Web
Pamela Castellanos
 
ЗЕЙНЕТАҚЬI ЗАҢНАМАСЬIНДАҒЬI ЖАҢАЛЬIҚТАР
ЗЕЙНЕТАҚЬI ЗАҢНАМАСЬIНДАҒЬI ЖАҢАЛЬIҚТАРЗЕЙНЕТАҚЬI ЗАҢНАМАСЬIНДАҒЬI ЖАҢАЛЬIҚТАР
ЗЕЙНЕТАҚЬI ЗАҢНАМАСЬIНДАҒЬI ЖАҢАЛЬIҚТАР
Yelnur Shalkibayev
 
Development+of+South+Korea+-+Final+Paper-+Wynn (2)
Development+of+South+Korea+-+Final+Paper-+Wynn (2)Development+of+South+Korea+-+Final+Paper-+Wynn (2)
Development+of+South+Korea+-+Final+Paper-+Wynn (2)Wynn Wang, MA
 

Viewers also liked (11)

Risk assessment (1)
Risk assessment (1)Risk assessment (1)
Risk assessment (1)
 
Internship presentation
Internship presentationInternship presentation
Internship presentation
 
Career path power point
Career path power pointCareer path power point
Career path power point
 
Statistical Dissemination Control in Large Machine-to-Machine Communication N...
Statistical Dissemination Control in Large Machine-to-Machine Communication N...Statistical Dissemination Control in Large Machine-to-Machine Communication N...
Statistical Dissemination Control in Large Machine-to-Machine Communication N...
 
Pitch 2016
Pitch 2016Pitch 2016
Pitch 2016
 
Revisi karakteristik transistor
Revisi karakteristik transistorRevisi karakteristik transistor
Revisi karakteristik transistor
 
лоцкинська зош
лоцкинська зошлоцкинська зош
лоцкинська зош
 
Las Herramientas Web
Las Herramientas WebLas Herramientas Web
Las Herramientas Web
 
ЗЕЙНЕТАҚЬI ЗАҢНАМАСЬIНДАҒЬI ЖАҢАЛЬIҚТАР
ЗЕЙНЕТАҚЬI ЗАҢНАМАСЬIНДАҒЬI ЖАҢАЛЬIҚТАРЗЕЙНЕТАҚЬI ЗАҢНАМАСЬIНДАҒЬI ЖАҢАЛЬIҚТАР
ЗЕЙНЕТАҚЬI ЗАҢНАМАСЬIНДАҒЬI ЖАҢАЛЬIҚТАР
 
Development+of+South+Korea+-+Final+Paper-+Wynn (2)
Development+of+South+Korea+-+Final+Paper-+Wynn (2)Development+of+South+Korea+-+Final+Paper-+Wynn (2)
Development+of+South+Korea+-+Final+Paper-+Wynn (2)
 
Sanjib Resume
Sanjib ResumeSanjib Resume
Sanjib Resume
 

Similar to Enabling Scalable Publish/Subscribe for Logical-Clustering in Crowdsourcing via MediaSense

Safe Drinking Water In Bangladesh Essay
Safe Drinking Water In Bangladesh EssaySafe Drinking Water In Bangladesh Essay
Safe Drinking Water In Bangladesh Essay
Susan Cox
 
Bonazzi commons bd2 k ahm 2016 v2
Bonazzi commons bd2 k ahm 2016 v2Bonazzi commons bd2 k ahm 2016 v2
Bonazzi commons bd2 k ahm 2016 v2
Vivien Bonazzi
 
The Commons: Leveraging the Power of the Cloud for Big Data
The Commons: Leveraging the Power of the Cloud for Big DataThe Commons: Leveraging the Power of the Cloud for Big Data
The Commons: Leveraging the Power of the Cloud for Big Data
Philip Bourne
 
A Framework for Geospatial Web Services for Public Health by Dr. Leslie Lenert
A Framework for Geospatial Web Services for Public Health by Dr. Leslie LenertA Framework for Geospatial Web Services for Public Health by Dr. Leslie Lenert
A Framework for Geospatial Web Services for Public Health by Dr. Leslie Lenert
Wansoo Im
 
Internet of Things - Benefits for the Ummah
Internet of Things - Benefits for the UmmahInternet of Things - Benefits for the Ummah
Internet of Things - Benefits for the Ummah
Dr. Mazlan Abbas
 
Comparative Analysis and Secure ALM P2P Overlay Multicasting of Various Multi...
Comparative Analysis and Secure ALM P2P Overlay Multicasting of Various Multi...Comparative Analysis and Secure ALM P2P Overlay Multicasting of Various Multi...
Comparative Analysis and Secure ALM P2P Overlay Multicasting of Various Multi...
IJERD Editor
 
MULTIPATH BROADCAST AND GOSSIP BASED APPROACH FOR VIDEO CIRCULATION
MULTIPATH BROADCAST AND GOSSIP BASED APPROACH FOR VIDEO CIRCULATIONMULTIPATH BROADCAST AND GOSSIP BASED APPROACH FOR VIDEO CIRCULATION
MULTIPATH BROADCAST AND GOSSIP BASED APPROACH FOR VIDEO CIRCULATION
Association of Scientists, Developers and Faculties
 
Dr H K Kaul
Dr H K KaulDr H K Kaul
Dr H K Kaul
lrc.jiit
 
Why Digization Increases the Value of Print Collections"
Why Digization Increases the Value of Print Collections"Why Digization Increases the Value of Print Collections"
Why Digization Increases the Value of Print Collections"guest6ce11f
 
The Future Started Yesterday: The Top Ten Computer and IT Trends
The Future Started Yesterday: The Top Ten Computer and IT TrendsThe Future Started Yesterday: The Top Ten Computer and IT Trends
The Future Started Yesterday: The Top Ten Computer and IT Trends
Career Communications Group
 
ACIS Annual Report 2014
ACIS Annual Report 2014ACIS Annual Report 2014
ACIS Annual Report 2014Ralf Klamma
 
CD-GAIN: Content Delivery Through the Analysis of Users' Access Patterns, ta...
CD-GAIN: Content Delivery  Through the Analysis of Users' Access Patterns, ta...CD-GAIN: Content Delivery  Through the Analysis of Users' Access Patterns, ta...
CD-GAIN: Content Delivery Through the Analysis of Users' Access Patterns, ta...
Dima Karamshuk
 
FIWARE Global Summit - The Digital Single Market - Benefits and Solutions for...
FIWARE Global Summit - The Digital Single Market - Benefits and Solutions for...FIWARE Global Summit - The Digital Single Market - Benefits and Solutions for...
FIWARE Global Summit - The Digital Single Market - Benefits and Solutions for...
FIWARE
 
Cultivating Sustainable Software For Research
Cultivating Sustainable Software For ResearchCultivating Sustainable Software For Research
Cultivating Sustainable Software For Research
Neil Chue Hong
 
Channel model data2012
Channel model data2012Channel model data2012
Channel model data2012
STIinnsbruck
 
Science Gateway Canvas
Science Gateway CanvasScience Gateway Canvas
Science Gateway Canvas
Shayan Shahand
 
InterSystems presentatie: Making Sense of Unstructured Data
InterSystems presentatie: Making Sense of Unstructured DataInterSystems presentatie: Making Sense of Unstructured Data
InterSystems presentatie: Making Sense of Unstructured Data
InterSystems Benelux
 
The NIH Data Commons - BD2K All Hands Meeting 2015
The NIH Data Commons -  BD2K All Hands Meeting 2015The NIH Data Commons -  BD2K All Hands Meeting 2015
The NIH Data Commons - BD2K All Hands Meeting 2015
Vivien Bonazzi
 
The NEEDS vs. the WANTS in IoT
The NEEDS vs. the WANTS in IoTThe NEEDS vs. the WANTS in IoT
The NEEDS vs. the WANTS in IoT
Prasant Misra
 
Big Data and User Segmentation in Mobile Context
Big Data and User Segmentation in Mobile ContextBig Data and User Segmentation in Mobile Context
Big Data and User Segmentation in Mobile Context
InMobi Technology
 

Similar to Enabling Scalable Publish/Subscribe for Logical-Clustering in Crowdsourcing via MediaSense (20)

Safe Drinking Water In Bangladesh Essay
Safe Drinking Water In Bangladesh EssaySafe Drinking Water In Bangladesh Essay
Safe Drinking Water In Bangladesh Essay
 
Bonazzi commons bd2 k ahm 2016 v2
Bonazzi commons bd2 k ahm 2016 v2Bonazzi commons bd2 k ahm 2016 v2
Bonazzi commons bd2 k ahm 2016 v2
 
The Commons: Leveraging the Power of the Cloud for Big Data
The Commons: Leveraging the Power of the Cloud for Big DataThe Commons: Leveraging the Power of the Cloud for Big Data
The Commons: Leveraging the Power of the Cloud for Big Data
 
A Framework for Geospatial Web Services for Public Health by Dr. Leslie Lenert
A Framework for Geospatial Web Services for Public Health by Dr. Leslie LenertA Framework for Geospatial Web Services for Public Health by Dr. Leslie Lenert
A Framework for Geospatial Web Services for Public Health by Dr. Leslie Lenert
 
Internet of Things - Benefits for the Ummah
Internet of Things - Benefits for the UmmahInternet of Things - Benefits for the Ummah
Internet of Things - Benefits for the Ummah
 
Comparative Analysis and Secure ALM P2P Overlay Multicasting of Various Multi...
Comparative Analysis and Secure ALM P2P Overlay Multicasting of Various Multi...Comparative Analysis and Secure ALM P2P Overlay Multicasting of Various Multi...
Comparative Analysis and Secure ALM P2P Overlay Multicasting of Various Multi...
 
MULTIPATH BROADCAST AND GOSSIP BASED APPROACH FOR VIDEO CIRCULATION
MULTIPATH BROADCAST AND GOSSIP BASED APPROACH FOR VIDEO CIRCULATIONMULTIPATH BROADCAST AND GOSSIP BASED APPROACH FOR VIDEO CIRCULATION
MULTIPATH BROADCAST AND GOSSIP BASED APPROACH FOR VIDEO CIRCULATION
 
Dr H K Kaul
Dr H K KaulDr H K Kaul
Dr H K Kaul
 
Why Digization Increases the Value of Print Collections"
Why Digization Increases the Value of Print Collections"Why Digization Increases the Value of Print Collections"
Why Digization Increases the Value of Print Collections"
 
The Future Started Yesterday: The Top Ten Computer and IT Trends
The Future Started Yesterday: The Top Ten Computer and IT TrendsThe Future Started Yesterday: The Top Ten Computer and IT Trends
The Future Started Yesterday: The Top Ten Computer and IT Trends
 
ACIS Annual Report 2014
ACIS Annual Report 2014ACIS Annual Report 2014
ACIS Annual Report 2014
 
CD-GAIN: Content Delivery Through the Analysis of Users' Access Patterns, ta...
CD-GAIN: Content Delivery  Through the Analysis of Users' Access Patterns, ta...CD-GAIN: Content Delivery  Through the Analysis of Users' Access Patterns, ta...
CD-GAIN: Content Delivery Through the Analysis of Users' Access Patterns, ta...
 
FIWARE Global Summit - The Digital Single Market - Benefits and Solutions for...
FIWARE Global Summit - The Digital Single Market - Benefits and Solutions for...FIWARE Global Summit - The Digital Single Market - Benefits and Solutions for...
FIWARE Global Summit - The Digital Single Market - Benefits and Solutions for...
 
Cultivating Sustainable Software For Research
Cultivating Sustainable Software For ResearchCultivating Sustainable Software For Research
Cultivating Sustainable Software For Research
 
Channel model data2012
Channel model data2012Channel model data2012
Channel model data2012
 
Science Gateway Canvas
Science Gateway CanvasScience Gateway Canvas
Science Gateway Canvas
 
InterSystems presentatie: Making Sense of Unstructured Data
InterSystems presentatie: Making Sense of Unstructured DataInterSystems presentatie: Making Sense of Unstructured Data
InterSystems presentatie: Making Sense of Unstructured Data
 
The NIH Data Commons - BD2K All Hands Meeting 2015
The NIH Data Commons -  BD2K All Hands Meeting 2015The NIH Data Commons -  BD2K All Hands Meeting 2015
The NIH Data Commons - BD2K All Hands Meeting 2015
 
The NEEDS vs. the WANTS in IoT
The NEEDS vs. the WANTS in IoTThe NEEDS vs. the WANTS in IoT
The NEEDS vs. the WANTS in IoT
 
Big Data and User Segmentation in Mobile Context
Big Data and User Segmentation in Mobile ContextBig Data and User Segmentation in Mobile Context
Big Data and User Segmentation in Mobile Context
 

Recently uploaded

Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
Alan Dix
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
BookNet Canada
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
DianaGray10
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
UiPathCommunity
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
RTTS
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
Sri Ambati
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Product School
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
ControlCase
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
Product School
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
Elena Simperl
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
Frank van Harmelen
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
James Anderson
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
Safe Software
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
Guy Korland
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Product School
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
Product School
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Inflectra
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
Jemma Hussein Allen
 

Recently uploaded (20)

Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
 
Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...Mission to Decommission: Importance of Decommissioning Products to Increase E...
Mission to Decommission: Importance of Decommissioning Products to Increase E...
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
 
Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*Neuro-symbolic is not enough, we need neuro-*semantic*
Neuro-symbolic is not enough, we need neuro-*semantic*
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
 

Enabling Scalable Publish/Subscribe for Logical-Clustering in Crowdsourcing via MediaSense

  • 1. Hasibur Rahman Enabling Scalable Publish/Subscribe for Logical-Clustering in Crowdsourcing via MediaSense Science and Information Conference 2014 August 27-29, 2014 | London UK Department of Computer and Systems Sciences (DSV) Stockholm University
  • 2. Overview • Introduction • Background • Motivation • Research Problem • Our Solution • Advantages and Analysis • Conclusions and Future Work
  • 3. Introduction • Crowdsourcing • Increase of Information • Vast IoT sources • Logical-Clustering • Efficient Management of Context Information (CI) • Filters out similar context from distributed sources • MediaSense • A scalable distributed IoT platform for CI sharing
  • 4. Background • Spontaneous human participation i.e. crowdsourcing is pivotal for future pervasive computing (Franco- 2011) • The surge of social networks, mobile devices, Internet or Web-enabled services have enabled unprecedented level of human participation in crowdsourcing which has been branded as “human-in-the- loop-sensing” or citizen sensor networks (Boulos et al. -2011), Sheth -2009) • Ericsson predicts that 50-500 billion mobile devices will be in use by 2020 (Ericsson - 2013) • Ericsson envisions 5G as enabler for Networked Society (Ericsson - 2013) • This necessitates proper management of CI so that resources can be shared from remote places • Logical-clustering has been proposed as opposed to physical clustering to efficiently manage CI (Rahman et al. - 2013)
  • 5. Crowdsourcing • People • Pervasive devices • Internet or Web-enabled services • Surrounding things • Context Information
  • 6. Motivation • Sharing heterogenous CI obtained from distributed sources • Publish/Subscribe (PubSub) has emerged as an efficient means of sharing ubiquitous CI • By leveraging the PubSub in the crowdsourcing model can unravel the challenge of sharing CI in real-time
  • 7. What is the problem? Can the distributed MediaSense platform (Kanter et al., 2009) be used as scalable PubSub model in real-time? If it does then how does this approach differ from other approaches?" We have proposed MediaSense as a potential solution to the above research questions How can the context-IDs in logical-clustering be shared efficiently in real-time? How can we synchronize logical-sink?
  • 8. Our Solution An entity registers as UCI in MediaSense Each logical-sink registers itself as a UCI and associated context-IDs as its data Logical-sinks are synchronized by registering physical sinks as UCIs
  • 10. Our advantages Real-time, Distributed- no central point of failure issue Fast, Efficient, Scalable Memory efficient
  • 11. Our advantages 74% 74% 74% improvement compared to existing MediaSense # of published context-IDs Current MediaSense Modified MediaSense % improvement 1000 7.34 ms 4.17 ms 76 10000 8.93 ms 5.37 ms 66 100000 10.74 ms 6.23 ms 72 200000 11.65 ms 6.69 ms 74
  • 12. Analysis For both Published and Subscribed items 3537 messages/sec if it is run only for one second and over 9000 if just published for logical-sink PubSub messages/sec lowers by one-third while magnitude is increased by ten-fold
  • 13. Analysis 86% Subscription matching only For a hundred-fold increase 86% increase in matching duration
  • 14. Analysis Subscription matching only for a single context-ID The one-millionth context-ID took 8.76 ms to match with the published context-IDs
  • 15. Analysis 99% 99% 99% improvement compared to PARDES for 2 million context-IDs PARDES increasing; MediaSense increase is minimal
  • 16. Analysis (Scalability) # of context- IDs Le Subscribe (Counting) MediaSense % improvement 500 K 85 ms 14.76 ms 476 1 million 350 ms 16.22 ms 2058 # of context- IDs Le Subscribe (Counting) MediaSense % improvement 15 K 621 3151 407 1 million 7 91 1200 2058% 2058% improvement compared to Le Subscribe in terms of subscription matching 1200% 1200% improvement in PubSub messages/sec
  • 17. Analysis 451% 163% 163% & 451% MediaSense betters Le Subscribe and ToPSS respectively by 163% and minimum by 451%
  • 18. Conclusions MediaSense is feasible as PubSub model in crowdsourcing especially in logical-clustering It is fast- requires only 9.59 ms to match two-millionth published context-ID Scales well compared to other PubSub model Efficient and no centralization Occupies only 185.97 MB memory to store 5 million context-IDs
  • 19. Future Work UCI discovery Performance evaluation on devices with limited computational capabilities Adaptability and awareness Security might be a concern; we will look into this
  • 20. + 46 (0) 70 7463968 Contact Hasibur Rahman hasibur.rahman021 hasibur@dsv.su.se twitter.com/hasiburrahman29 facebook.com/SuZon.Hasibur.Rahman
  • 21. ACKNOWLEDGMENT The work is partially supported by funding from the European Union FP7 MobiS project. The outcome of this research will be used later in the project.
  • 22. Q & A! Thank You!
  • 23. Credits mobiS logo www.mobis-euproject.eu/ IMAGE CREDITS Q & A image http://www.openlounge.org/lunargame/one-question-infinite- answers/