SlideShare a Scribd company logo
1 of 57
Download to read offline
2/16/21 1
Demetris Trihinas
trihinas.d@unic.ac.cy
1
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
Low-Cost Approximate and Adaptive
Monitoring Techniques
Demetris Trihinas
trihinas.d@unic.ac.cy
Department of Computer Science
University of Nicosia
2/16/21 2
Demetris Trihinas
trihinas.d@unic.ac.cy
2
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
Full-Time Faculty Member
University of Nicosia
“Designing and developing scalable and self-adaptive tools for data
management, exploration and visualization”
@dtrihinas
http://dtrihinas.info
https://ailab.unic.ac.cy/
https://www.slideshare.net/DemetrisTrihinas
@AilabUnic
2/16/21 4
Demetris Trihinas
trihinas.d@unic.ac.cy
4
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
The Internet of Things
The physical world is now an information system
Exchanging continuous data streams with other network-
enabled devices, systems and humans…
Internet-enabled (battery-powered) physical devices
with smart processing capabilities…
Intelligent Transportation Services
Health and Activity Tracking Precision Farming Smart Metering and Power Grids
2/16/21 5
Demetris Trihinas
trihinas.d@unic.ac.cy
5
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
The Big Data in IoT
[HP, Oct 2016]
IoT monitoring data accounted for 2% of digital universe in 2012,
with projections that by 2020 it will rise above 12%
[Cisco VNI, 2016]
3+ million car telemetry updates per second
Data explosion outpacing the technology
[2016]
500+ million active monitoring streams at all times
A single self-driving vehicle will produce 4GB per day
…equal to 2666 internet users
[Uber Engineering, 2017]
[IDC, 2016]
2/16/21 6
Demetris Trihinas
trihinas.d@unic.ac.cy
6
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
The Harsh Reality
Network latencies, bandwidth limitations,
pricing (in/out cloud traffic is billed),
constant location awareness
Augmenting IoT and the Cloud
The Developer Perspective
Monitoring-as-a-Service eases monitoring infrastructure management by enabling scalable
and multi-tenant monitoring over the internet via a pay-as-you-use business model
2/16/21 7
Demetris Trihinas
trihinas.d@unic.ac.cy
7
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
Edge Computing
A term coined to reflect computation and decision-making at the
logical extremes of the network, ideally “in place” on the data source
Shorter response times
Simple
Sensing
Edge
Computing
Less network pressure
2/16/21 8
Demetris Trihinas
trihinas.d@unic.ac.cy
8
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
Challenge 1 – Taming data volume and data velocity with limited
processing and network capabilities
Challenge 2 - IoT devices are usually battery-powered which means
intense processing leads to less battery-life
Data processing and dissemination
are the main energy drains in
embedded and mobile devices
Edge Computing Challenges
2/16/21 9
Demetris Trihinas
trihinas.d@unic.ac.cy
9
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
Motivation
“if a degree of inaccuracy can be tolerated, low-cost
approximate and adaptive monitoring techniques that
are capable of dynamically adjusting the data collection
and dissemination rate, can effectively tackle real-time
data processing and energy-efficiency on the edge of
monitored networks”
2/16/21 10
Demetris Trihinas
trihinas.d@unic.ac.cy
10
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
Presentation Outline
• Background and Motivation
• Problem Statement
• Related Work
• AdaM: the Adaptive Monitoring Framework
• ADMin: a Plugin for Model-Based Adaptive Dissemination
• Talk Conclusion
2/16/21 11
Demetris Trihinas
trihinas.d@unic.ac.cy
11
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
Problem Statement
Low-Cost Approximate and Adaptive Monitoring
2/16/21 12
Demetris Trihinas
trihinas.d@unic.ac.cy
12
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
Preliminaries
• A monitoring stream ! = {$%}%'(
)
published by a data source is a large
stochastic sequence of i.i.d datapoints, denoted as $% , where * = 0, 1, … , /
and / → ∞.
• A datapoint $% is a tuple 2%3, 4%, 5% described by a unique identifier for the
monitoring source 2%3, a timestamp 4% and a value 5%
• A datapoint may have a set of other attributes (e.g., location) although for
brevity we will omit other attributes without loss of generality
$%
$%67
Monitoring Stream M
2/16/21 13
Demetris Trihinas
trihinas.d@unic.ac.cy
13
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
Preliminaries
• Approximate Techniques?
• Decision mechanisms based on estimation models capturing and predicting
monitoring stream runtime evolution within certain accuracy guarantees.
• Adaptive?
• Adapt monitoring source properties based on the predicaments of the
estimation models.
• Low-Cost?
• The costs (time, resources) of applying adaptive monitoring techniques are
(much) less than leaving the monitoring process as is.
2/16/21 14
Demetris Trihinas
trihinas.d@unic.ac.cy
14
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
Periodic Sampling
The process of triggering the collection mechanism of a monitored source every !
time units such that the "#$ datapoint is collected at time %& = " ( !
)&
)&*+
Metric Stream M sampled every T = 1s
Compute resources and energy are wasted while generating large data volumes at a high velocity
Sudden events and significant insights are missed
Metric Stream M sampled every T = 10s
2/16/21 15
Demetris Trihinas
trihinas.d@unic.ac.cy
15
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
Adaptive Sampling
• Dynamically adjust the periodicity !" based on some estimation model #(%),
capturing runtime information of the monitoring stream evolution.
• How large of an adjustment is required, “ideally”, depends on some evaluation
(distance) metric denoting the ability of the model to (correctly) estimate and
follow metric stream evolution.
'"
'"()
!"()
Metric Stream %′ dynamically sampled
Metric Stream % with ! = 1-
Find max ! ∈ [!0"1, !034] to collect '"() based on estimation of metric stream evolution
#(%), such that %′ differs from % less than user-defined imprecision value 6 ('7-8 < 6)
2/16/21 16
Demetris Trihinas
trihinas.d@unic.ac.cy
16
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
Periodic Dissemination
Monitoring
Source
Receiving
Entity
The process of triggering the network controller of a data source every ! time
units such that the "#$ datapoint is disseminated at time %& = " ( ! to interested
receiving entities.
No data loss
Energy consumption for data dissemination:
)#*# = +, + ., ( χ + ε1
per message cost
+, >> .,
per byte cost
., ≅ 0.01 ( +,
energy
for state transitions
2/16/21 17
Demetris Trihinas
trihinas.d@unic.ac.cy
17
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
Adaptive Dissemination
• Dynamically adapt dissemination rate by applying approximation
techniques to sensed datapoints to reduce comm. Overhead.
• Achieve by suppressing consecutive datapoints from dissemination
with “little” change in their metric values.
• How much is change is considered as “little” depends on:
• The approximation technique
• Accuracy guarantees given by the user and denoting the probability
(confidence δ) with which sensed datapoints are approximated.
2/16/21 18
Demetris Trihinas
trihinas.d@unic.ac.cy
18
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
Model-Based Adaptive Dissemination
• Monitoring source maintains runtime estimation model !(#) capturing monitoring
stream evolution and variability.
• At the %&' time interval instead of metric values, the model is disseminated.
• Receiving entities predict source state from the given model assuming subsequent k-
datapoints can be approximated d)*+|) = f(! # , 01) within given accuracy guarantees.
Metric Stream # Approximated Metric Stream #′
2/16/21 19
Demetris Trihinas
trihinas.d@unic.ac.cy
19
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
Model-Based Adaptive Dissemination
• Monitoring source withholds further dissemination interacting with receiver
only when shifts in monitoring stream value distribution render model as
inconsistent with the actual source state.
• If model parameterization is inconsistent, at this point, it must be updated.
decision criteria?
decision
function?
Metric Stream ! Approximated Metric Stream !′
2/16/21 20
Demetris Trihinas
trihinas.d@unic.ac.cy
20
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
Metric Filtering
• A form of adaptive dissemination: suppress latest datapoint(s)
dissemination if their values have not “changed” since last reported
• Metric stream suppression but… no model -> no forecasting
• Fixed filter ranges assume monitoring stream value distribution will not
change in in the future (no guarantees any values will be filtered at all)
if (curValue ∈ [prevValue – R, prevValue + R ])
filter(curValue)
2/16/21 21
Demetris Trihinas
trihinas.d@unic.ac.cy
21
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
Adaptive Filtering
• Dynamically adjust the filter range ! based on the current variability of the
monitoring stream, denoted as "($)
Metric Stream $′ with adaptive Range
Metric Stream $
'(
'()*
!()*
!(
• Find the max filter range !()* ∈ [!-(., !-01] for '()* such that $3 differs
from $ less than a user-defined imprecision value 4 based on the variability
of the metric stream "($)
2/16/21 22
Demetris Trihinas
trihinas.d@unic.ac.cy
22
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
Related Work
2/16/21 23
Demetris Trihinas
trihinas.d@unic.ac.cy
23
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
Approximate and Adaptive Monitoring
• Wide applicability in various domains such as:
• Data stream processing
• Distributed system and network monitoring
• Signal processing
• WSNs
• Biosignal and Biomedical
reporting (wearables!!!)
• Differential privacy preserving
2/16/21 24
Demetris Trihinas
trihinas.d@unic.ac.cy
24
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
Limitations of the State-of-the-Art
• Require excessive profiling to configure optimal framework parameters
[Deligiannakis, ACM SIGMOD 2011], [Roy, ACM SIGCOMM, 2015], [Jorg, Middleware 2017]
• Present large runtime footprints reducing benefits of adaptiveness in the
end [Silberstein, ACM SIGMOD 2006], [Kim, IEEE IoT, 2017], [Meng, IEEE Trans. Computers 2013]
• Fail to acknowledge abrupt and transient shifts in metric stream evolution
[Werner, ACM SenSys 2011], [Gaura, IEEE Trans. Sensors 2013], [Fan, ACM CIKM 2013], [Du, IEEE
BigData 2015]
• Offline approaches or require coordination from server-side components
[Rastogi, ACM SIGMOD 2009], [Olston, ACM SIGMOD 2010], [Bailis, ACM SIGMOD 2017]
2/16/21 25
Demetris Trihinas
trihinas.d@unic.ac.cy
25
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
AdaM: the Adaptive Monitoring
Framework
“AdaM: Adaptive Monitoring Framework for Sampling and Filtering on IoT Devices”.
D. Trihinas, G. Pallis and M.D. Dikaiakos, 2015 IEEE International Conference on Big
Data (IEEE BigData 2015), May 201Santa Clara, CA, USA
“Low-Cost Adaptive Monitoring Techniques for the Internet of Things”. D. Trihinas, G.
Pallis and M.D. Dikaiakos, IEEE Transactions on Services Computing, 2018.
2/16/21 26
Demetris Trihinas
trihinas.d@unic.ac.cy
26
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
The Adaptive Monitoring Framework
μProcessor
μOS
Memory
Adaptive
Filtering
metric
updates
A
P
I
updated
periodicity
compressed
metric stream
updated
filter range
filtered
metric stream
AdaM
S
E
N
S
I
N
G
U
N
I
T
estimation
confidence
Low-Cost Approximate
Stream Estimation
Adaptive
Sampling
stream
variability
stream
evolution online
stats
Model
Base
N
E
T
W
O
R
K
U
N
I
T
metric
stream
Developed as a software library offering low-cost approximate and
adaptive monitoring for software agents and IoT devices
2/16/21 27
Demetris Trihinas
trihinas.d@unic.ac.cy
27
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
Step 1: Update runtime monitoring stream evolution ! Μ
• Probabilistic Exponential Weighted Moving Average (PEWMA) to estimate
distance between consecutive datapoints #
$%&' with $% = )% − )%+'
#
$%&' = ,% = -
. / ,%+' + 1 − -
. $%
• Datapoints labelled as “expected” if estimation lands in prediction intervals
determined from user confidence guarantees or “unexpected” otherwise
• “Unexpected” datapoints are stored in local buffer for dissemination
Looks like an exponential moving average, right?
But weighting -
. = 2 1 − 3P% is probabilistically applied!
AdaM Estimation Process
2/16/21 28
Demetris Trihinas
trihinas.d@unic.ac.cy
28
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
• Timely boost PEWMA to appropriate value base
• Metric stream evolution and variability updated with
only previous value knowledge
Step 2: Detect over time monotonic phases of growth or decay to reduce
time “lagging” effects in monitoring stream evolution estimation
Upward
trend
Downward
trend
!" = $
% & (!"()+ +"()) + 1 − $
% /"
AdaM Estimation Process
2/16/21 29
Demetris Trihinas
trihinas.d@unic.ac.cy
29
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
EWMA after spikes overestimates
subsequent values EWMA slow to acknowledge spikes
AdaM estimation process
• Probabilistic reasoning -> No overestimation after “bursty” intervals
• Detecting gradual trends -> No “lagging” effects
AdaM Estimation Process
2/16/21 30
Demetris Trihinas
trihinas.d@unic.ac.cy
30
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
AdaM Adaptive Sampling
• After updating estimation model, we compute the current estimation
confidence ("# ≤ 1) based on actual and estimated standard deviation
• Next, we update sampling period '#() based on the current confidence
and the user-defined imprecision γ (e.g. 10% tolerance to errors)
"# = 1 −
| -
.# − .#|
.#
… the more “confident” the algorithm is, the larger the
outputted periodicity '#() can be…
λ is an
aggressiveness
multiplier
(default λ=1)
2/16/21 31
Demetris Trihinas
trihinas.d@unic.ac.cy
31
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
AdaM Adaptive Filtering
• Update variability of the metric stream using moving Fano Factor !"
which is an indicator of the stream value dispersion
• We then compare #$%% to the user-provided maximum tolerable
imprecision guarantees & in attempt to widen filter range
!" =
#"
(
)"
…a low !" (due to #") indicates a currently in-dispersed data
stream which means low variability in the metric stream…
2/16/21 32
Demetris Trihinas
trihinas.d@unic.ac.cy
32
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
AdaM Evaluation
• Compare accuracy and on-device overheads
• Real-world and publically available datasets
• Testbeds: cloud apps, internet security services, wearables, cloud
monitoring, intelligent transportation service
• Under-evaluation frameworks
• L-SIP [Gaura et al., IEEE Trans. on Sensors 2013]
• i-EWMA [Trihinas et al., IEEE/ACM CCGrid 2014]
• FAST [Fan et al., ACM CIKM 2013, IEEE TKDE 2014]
2/16/21 33
Demetris Trihinas
trihinas.d@unic.ac.cy
33
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
Memory Trace
Java Sorting Benchmark
CPU Trace
Carnegie Mellon RainMon Project
Disk I/O Trace
Carnegie Mellon RainMon Project
TCP Port Trace
Cyber Defence SANS Tech Institute
Step Trace
Fitbit Charge Wearable
Heartrate Trace
Fitbit Charge Wearable
Real-World and Publically Available Datasets
2/16/21 34
Demetris Trihinas
trihinas.d@unic.ac.cy
34
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
Energy Consumption
Network Traffic
Error (MAPE)
Accuracy and On-Device Performance Evaluation
AdaM achieves a balance between efficiency and accuracy, reducing data volume by at least 74%,
energy consumption by 71% while always maintaining accuracy above 89%
CPU Cycles
2/16/21 35
Demetris Trihinas
trihinas.d@unic.ac.cy
35
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
in Action!
Steps Heartrate Calories
94%
accuracy!
96%
accuracy!
91%
accuracy!
6x less processing! 4x less network traffic!
4x less energy usage!
+
3 - 5 days 7 - 8 days
2/16/21 36
Demetris Trihinas
trihinas.d@unic.ac.cy
36
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
Intelligent Transportation Service
Dublin Smart
City ITS
1000 Buses with GPS
tracking sending
updates to ITS
Alerts when >10 buses in city area, per
5min window, are reporting delays
over 1 SD from their weekly average
With the ITS achieves 8x data volume reduction while still detecting 92% of
all reported incidents
Apache Spark cluster with 5 workers
on large VMs (8VCPU, 8GB RAM)
2/16/21 37
Demetris Trihinas
trihinas.d@unic.ac.cy
37
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
ADMin: a Plugin for Model-Based
Adaptive Dissemination
“ADMin: Adaptive Monitoring Dissemination for the Internet of Things”.
D. Trihinas, G. Pallis and M.D. Dikaiakos, 2017 IEEE Conference on Computer
Communications (IEEE INFOCOM 2017), Atlanta, GA, USA
2/16/21 38
Demetris Trihinas
trihinas.d@unic.ac.cy
38
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
The Adaptive Monitoring Framework
μProcessor
μOS
Memory
Adaptive
Filtering
metric
updates
A
P
I
updated
periodicity compressed
metric stream
updated
filter range
filtered
metric stream
AdaM
S
E
N
S
I
N
G
U
N
I
T
estimation
confidence
Low-Cost Approximate
Stream Estimation
Adaptive
Sampling
stream
variability
stream
evolution
online
stats
Model
Base
change
detected
N
E
T
W
O
R
K
U
N
I
T
Model-Based
Dissemination
Datapoint
Buffer
ADMin
metric
stream
2/16/21 39
Demetris Trihinas
trihinas.d@unic.ac.cy
39
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
The ADMin plugin for Model-Based Dissemination
“Instead of sending datapoints, we model the metric stream so that values are inferred
from the model and only trigger an update when changes in the stream render the
model as inconsistent”
2/16/21 40
Demetris Trihinas
trihinas.d@unic.ac.cy
40
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
Test if seasonality enrichment is beneficial to estimation process and
update estimation model accordingly
seasonal
Seasonal with
exponential trend
Seasonal with
damped trend
• Tendency of the metric stream to exhibit behavior that
repeats itself every L periods (e.g., hourly)
• Seasonal effects highly evident in IoT data (e.g., human
biosignals, environmental data)
PV Panel Production Air Temperature
ADMin Seasonality Enrichment
2/16/21 41
Demetris Trihinas
trihinas.d@unic.ac.cy
41
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
• Holt Winter’s Method used to estimate seasonal contribution
• However… perfect seasonal behavior is rarely observed in real-life
ADMin Seasonality Enrichment
PV Panel
Production
Considering the day before
hourly average (Si-L) will lead
to overestimation
• Online testing to determine if seasonal contribution beneficial
• Forecasting k-subsequent datapoints with trend and seasonality
!
"#$%|# ← (# + * +# + ,#
2/16/21 42
Demetris Trihinas
trihinas.d@unic.ac.cy
42
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
ADMin Runtime Shift Detection
• Cumulative Sum (CUSUM) test to detect shifts in metric stream value
probability distribution which render estimation model as inconsistent
ts
prior shift
after shift
!" = ln
&((", *++)
& (", *+
*"
++
= *"
+
+ .
where ε magnitude
of change
Log-Likelihood Ratio
However, . not known beforehand
but… estimation model provides us with an approximate /
0
12 3",{567,8"98} > ℎ → >ℎ12? @A?A!?A@
h is measured in
standard
deviation units
& (", *+
& (", *++
Decision Function
Trend and seasonality provide model greater
accuracy ( ̂
. → .) and to adapt to unexpected,
abrupt and and volatile changes is metric stream
2/16/21 43
Demetris Trihinas
trihinas.d@unic.ac.cy
43
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
ADMin Evaluation
• ADMin in 3 configurations
• No seasonality enrichment (ADMin)
• Static seasonality enrichment - previous day hourly average (ADMin_S1)
• Dynamic seasonality enrichment – ComCube* integration (ADMin_S2)
• Under comparison frameworks
• LANCE [Werner et al., ACM SenSys 2011]
• G-SIP [Gaura et al., IEEE Trans. on Sensors 2013]
• ADWIN [Bifet et al., SIAM 2010]
All three under-comparison framework parameters configured to output best results
* “Non-linear mining of competing local activities ”, Y. Matsubara, Y. Sakurai and C. Faloutsos, WWW 2016
2/16/21 44
Demetris Trihinas
trihinas.d@unic.ac.cy
44
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
Photovoltaic Panel Current (IDC) Production
2 Weeks of data collected every 1 second
Data reduction: 87% -- Accuracy: 93%
Weather Station Air Temperature (oC)
2 Weeks of data collected every 1 second
Data reduction: 85% -- Accuracy: 92%
Wearable Human Heartrate (bpm)
2 Weeks of data collected every 1 minute
Data reduction: 80% -- Accuracy: 90%
ADMin in Action!
2/16/21 45
Demetris Trihinas
trihinas.d@unic.ac.cy
45
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
• Comparison of number of monitoring stream disseminations triggered for shifts that
actually occurred (true positives) and number of false alarms (false positives)
• Ground truth pre-determined offline by PELT algorithm [Killick, 2012]
Shift Detection Accuracy Evaluation
ground truth
false
alarms
correctly
detected
shifts
Air Temperature Dataset Wearable Dataset
ADMin features high accuracy (>90%) and low false alarm ratio (<10%) which is drastically reduced
when incorporating seasonality knowledge by at least 47% compared to the other approaches
2/16/21 46
Demetris Trihinas
trihinas.d@unic.ac.cy
46
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
Shift Detection Delay Evaluation
• Shift detection delay is the difference in time to when a shift is detected by a
technique compared to the actual time of occurrence
ADMin outperforms other
techniques by at least 29%
When incorporating trend and seasonality knowledge even for datasets with irregular seasonal
behavior ADMin reduces shift detection time by at least 67% compared to the other techniques
2/16/21 48
Demetris Trihinas
trihinas.d@unic.ac.cy
48
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
Conclusion
• Monitoring at the “edge” implies significant costs
• AdaM: the Adaptive Monitoring Framework
• Low-cost estimation process featuring probabilistic learning to capture metric stream
runtime evolution, trend and variability
• Dynamically adjusts metric periodicity and filtering based on estimation model
“confidence” which rewards correct estimations
• ADMin: model-based dissemination lowers communication overhead in IoT networks
when monitoring data featuring seasonal patterns and trends
• Results show AdaM and ADMin achieve a balance between efficiency and
accuracy, reducing data volume by 74%, energy consumption by 71%, shift
detection delays by 61%, while maintaining accuracy above 89%
2/16/21 49
Demetris Trihinas
trihinas.d@unic.ac.cy
49
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
AdaM Applicability
• Raspberry Pi micro-controllers
• Linux-based environments
• Android Wear devices
• Cloud monitoring tools with adaptive interfaces (e.g.,
JCatascopia, pyCatascopia, Netdata plugin)
• Ported to R for offloading temporal graph processing
• Python for efficient data stream processing with Apache Flink
2/16/21 50
Demetris Trihinas
trihinas.d@unic.ac.cy
50
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
http://linc.ucy.ac.cy/AdaM
2/16/21 51
Demetris Trihinas
trihinas.d@unic.ac.cy
51
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
ailab.unic.ac.cy
• Virtual/F2F Summer and Fall Internships
• Interesting Projects
• Fogify: Scalable Emulator for Geo-Distributed Data-Intensive Apps Deployed in Fog Realms
2/16/21 52
Demetris Trihinas
trihinas.d@unic.ac.cy
52
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
Backup Slides
2/16/21 53
Demetris Trihinas
trihinas.d@unic.ac.cy
53
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
More processing
(e.g., peak detection
for hr monitoring) Driving Peripherals
(e.g., accelerometer,
leds)
Interesting Articles
“Energy-harvesting wearables for activity-aware services”, S. Khalifa et al., IEEE Internet Computing, 2015
“Taking the internet to the next physical level”, V. Cerf and M. Senges, IEEE Computer, 2016
Emulated behavior of wearable device on Raspberry Pi with ARM processor
(1 core 32MHz, 128MB RAM)
Periodic Sampling with Physical
Sensing
OS Monitoring
2/16/21 54
Demetris Trihinas
trihinas.d@unic.ac.cy
54
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
AdaM γ-Parameter Evaluation
For a wide range of γ-parameter values we compute AdaM’s
MAPE per trace
Even for extreme imprecision values (>0.3) AdaM can still take correct
decisions signifying the importance of the confidence metric
2/16/21 55
Demetris Trihinas
trihinas.d@unic.ac.cy
55
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
AdaM Trend ξ-Parameter Evaluation
Trend estimation can shed 2-5% error when computing the metric stream
evolution for a wide range of configuration values
2/16/21 56
Demetris Trihinas
trihinas.d@unic.ac.cy
56
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
• Online testing (T-Test) to determine if seasonal contribution beneficial
to estimation or not
• Detecting optimal seasonality cycle (L) is an open research challenge
especially when different cycles exist in monitoring stream
• Approximate runtime seasonal periodicity detection
• ComCube Framework (Matsubara et al., WWW, 2016): lightweight tensor-based
and parameter-free framework for near-optimal seasonal periodicity detection
!
"#$%|# ← (# + * +# + ,#
“Non-linear mining of competing local activities ”, Y. Matsubara, Y. Sakurai and C. Faloutsos, WWW 2016
ADMin Seasonality Enrichment
2/16/21 57
Demetris Trihinas
trihinas.d@unic.ac.cy
57
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
ADMin Runtime Shift Detection
ts ti
Trend and seasonality provide model with greater accuracy
( ̂
" → ") and to adapt to unexpected, abrupt and and volatile
changes is monitoring stream
Challenge 2: CUSUM threshold h static and
sensitive when stream variability is low
($ → 0 ) thus triggering… false alarms
Adapt CUSUM sensitivity by adapting
h after dissemination triggered and
restrict h with hmin
Challenge 1: Getting '( requires linear time…
Can )* be used instead of )+?
2/16/21 58
Demetris Trihinas
trihinas.d@unic.ac.cy
58
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
Data Volume Reduction
ADMin reduces data volume by at least 60% while maintaining accuracy always above 86%
With seasonality knowledge data volume is reduced by at least 71% while accuracy is
always above 91%
Overhead Evaluation
What do users see!
Mean Absolute Percentage Error
2/16/21 59
Demetris Trihinas
trihinas.d@unic.ac.cy
59
Seminar Talk @ UPitt | Feb 2021
Department of
Computer Science
Facebook DB Cluster Adaptive Monitoring
“Inside the Social Network’s (Datacenter) Network”, A. Roy et al., ACM SIGCOMM, 2015

More Related Content

What's hot

The Incorporation of Machine Learning into Scientific Simulations at Lawrence...
The Incorporation of Machine Learning into Scientific Simulations at Lawrence...The Incorporation of Machine Learning into Scientific Simulations at Lawrence...
The Incorporation of Machine Learning into Scientific Simulations at Lawrence...inside-BigData.com
 
Design of area and power efficient half adder using transmission gate
Design of area and power efficient half adder using transmission gateDesign of area and power efficient half adder using transmission gate
Design of area and power efficient half adder using transmission gateeSAT Journals
 
IRJET - Wavelet based Image Fusion using FPGA for Biomedical Application
 IRJET - Wavelet based Image Fusion using FPGA for Biomedical Application IRJET - Wavelet based Image Fusion using FPGA for Biomedical Application
IRJET - Wavelet based Image Fusion using FPGA for Biomedical ApplicationIRJET Journal
 
Image Registration Based on CCRE for Remote Sensing Images
Image Registration Based on CCRE for Remote Sensing ImagesImage Registration Based on CCRE for Remote Sensing Images
Image Registration Based on CCRE for Remote Sensing ImagesSujoy Sarathi
 
Ensemble Methods for Collective Intelligence: Combining Ubiquitous ML Models ...
Ensemble Methods for Collective Intelligence: Combining Ubiquitous ML Models ...Ensemble Methods for Collective Intelligence: Combining Ubiquitous ML Models ...
Ensemble Methods for Collective Intelligence: Combining Ubiquitous ML Models ...Bharath Sudharsan
 
Energy and latency aware application
Energy and latency aware applicationEnergy and latency aware application
Energy and latency aware applicationcsandit
 
IRJET - Realization of Power Optimised Carry Skip Adder using AOI Logic
IRJET -  	  Realization of Power Optimised Carry Skip Adder using AOI LogicIRJET -  	  Realization of Power Optimised Carry Skip Adder using AOI Logic
IRJET - Realization of Power Optimised Carry Skip Adder using AOI LogicIRJET Journal
 
Integrated Model Discovery and Self-Adaptation of Robots
Integrated Model Discovery and Self-Adaptation of RobotsIntegrated Model Discovery and Self-Adaptation of Robots
Integrated Model Discovery and Self-Adaptation of RobotsPooyan Jamshidi
 
Clustbigfim frequent itemset mining of
Clustbigfim frequent itemset mining ofClustbigfim frequent itemset mining of
Clustbigfim frequent itemset mining ofijfcstjournal
 
Globe2Train: A Framework for Distributed ML Model Training using IoT Devices ...
Globe2Train: A Framework for Distributed ML Model Training using IoT Devices ...Globe2Train: A Framework for Distributed ML Model Training using IoT Devices ...
Globe2Train: A Framework for Distributed ML Model Training using IoT Devices ...Bharath Sudharsan
 
Spine net learning scale permuted backbone for recognition and localization
Spine net learning scale permuted backbone for recognition and localizationSpine net learning scale permuted backbone for recognition and localization
Spine net learning scale permuted backbone for recognition and localizationDevansh16
 
“An Introduction to Single-Photon Avalanche Diodes—A New Type of Imager for C...
“An Introduction to Single-Photon Avalanche Diodes—A New Type of Imager for C...“An Introduction to Single-Photon Avalanche Diodes—A New Type of Imager for C...
“An Introduction to Single-Photon Avalanche Diodes—A New Type of Imager for C...Edge AI and Vision Alliance
 
Generating higher accuracy digital data products by model parameter
Generating higher accuracy digital data products by model parameterGenerating higher accuracy digital data products by model parameter
Generating higher accuracy digital data products by model parameterIAEME Publication
 
Toward Distributed, Global, Deep Learning Using IoT Devices
Toward Distributed, Global, Deep Learning Using IoT DevicesToward Distributed, Global, Deep Learning Using IoT Devices
Toward Distributed, Global, Deep Learning Using IoT DevicesBharath Sudharsan
 
Artificial Neural Network Based Graphical User Interface for Estimation of Fa...
Artificial Neural Network Based Graphical User Interface for Estimation of Fa...Artificial Neural Network Based Graphical User Interface for Estimation of Fa...
Artificial Neural Network Based Graphical User Interface for Estimation of Fa...ijsrd.com
 
IRJET- Design the Surveillance Algorithm and Motion Detection of Objects for ...
IRJET- Design the Surveillance Algorithm and Motion Detection of Objects for ...IRJET- Design the Surveillance Algorithm and Motion Detection of Objects for ...
IRJET- Design the Surveillance Algorithm and Motion Detection of Objects for ...IRJET Journal
 
Real-Time Pedestrian Detection Using Apache Storm in a Distributed Environment
Real-Time Pedestrian Detection Using Apache Storm in a Distributed Environment Real-Time Pedestrian Detection Using Apache Storm in a Distributed Environment
Real-Time Pedestrian Detection Using Apache Storm in a Distributed Environment csandit
 

What's hot (18)

The Incorporation of Machine Learning into Scientific Simulations at Lawrence...
The Incorporation of Machine Learning into Scientific Simulations at Lawrence...The Incorporation of Machine Learning into Scientific Simulations at Lawrence...
The Incorporation of Machine Learning into Scientific Simulations at Lawrence...
 
Design of area and power efficient half adder using transmission gate
Design of area and power efficient half adder using transmission gateDesign of area and power efficient half adder using transmission gate
Design of area and power efficient half adder using transmission gate
 
IRJET - Wavelet based Image Fusion using FPGA for Biomedical Application
 IRJET - Wavelet based Image Fusion using FPGA for Biomedical Application IRJET - Wavelet based Image Fusion using FPGA for Biomedical Application
IRJET - Wavelet based Image Fusion using FPGA for Biomedical Application
 
Image Registration Based on CCRE for Remote Sensing Images
Image Registration Based on CCRE for Remote Sensing ImagesImage Registration Based on CCRE for Remote Sensing Images
Image Registration Based on CCRE for Remote Sensing Images
 
Ensemble Methods for Collective Intelligence: Combining Ubiquitous ML Models ...
Ensemble Methods for Collective Intelligence: Combining Ubiquitous ML Models ...Ensemble Methods for Collective Intelligence: Combining Ubiquitous ML Models ...
Ensemble Methods for Collective Intelligence: Combining Ubiquitous ML Models ...
 
Energy and latency aware application
Energy and latency aware applicationEnergy and latency aware application
Energy and latency aware application
 
IRJET - Realization of Power Optimised Carry Skip Adder using AOI Logic
IRJET -  	  Realization of Power Optimised Carry Skip Adder using AOI LogicIRJET -  	  Realization of Power Optimised Carry Skip Adder using AOI Logic
IRJET - Realization of Power Optimised Carry Skip Adder using AOI Logic
 
Control of computing systems
Control of computing systemsControl of computing systems
Control of computing systems
 
Integrated Model Discovery and Self-Adaptation of Robots
Integrated Model Discovery and Self-Adaptation of RobotsIntegrated Model Discovery and Self-Adaptation of Robots
Integrated Model Discovery and Self-Adaptation of Robots
 
Clustbigfim frequent itemset mining of
Clustbigfim frequent itemset mining ofClustbigfim frequent itemset mining of
Clustbigfim frequent itemset mining of
 
Globe2Train: A Framework for Distributed ML Model Training using IoT Devices ...
Globe2Train: A Framework for Distributed ML Model Training using IoT Devices ...Globe2Train: A Framework for Distributed ML Model Training using IoT Devices ...
Globe2Train: A Framework for Distributed ML Model Training using IoT Devices ...
 
Spine net learning scale permuted backbone for recognition and localization
Spine net learning scale permuted backbone for recognition and localizationSpine net learning scale permuted backbone for recognition and localization
Spine net learning scale permuted backbone for recognition and localization
 
“An Introduction to Single-Photon Avalanche Diodes—A New Type of Imager for C...
“An Introduction to Single-Photon Avalanche Diodes—A New Type of Imager for C...“An Introduction to Single-Photon Avalanche Diodes—A New Type of Imager for C...
“An Introduction to Single-Photon Avalanche Diodes—A New Type of Imager for C...
 
Generating higher accuracy digital data products by model parameter
Generating higher accuracy digital data products by model parameterGenerating higher accuracy digital data products by model parameter
Generating higher accuracy digital data products by model parameter
 
Toward Distributed, Global, Deep Learning Using IoT Devices
Toward Distributed, Global, Deep Learning Using IoT DevicesToward Distributed, Global, Deep Learning Using IoT Devices
Toward Distributed, Global, Deep Learning Using IoT Devices
 
Artificial Neural Network Based Graphical User Interface for Estimation of Fa...
Artificial Neural Network Based Graphical User Interface for Estimation of Fa...Artificial Neural Network Based Graphical User Interface for Estimation of Fa...
Artificial Neural Network Based Graphical User Interface for Estimation of Fa...
 
IRJET- Design the Surveillance Algorithm and Motion Detection of Objects for ...
IRJET- Design the Surveillance Algorithm and Motion Detection of Objects for ...IRJET- Design the Surveillance Algorithm and Motion Detection of Objects for ...
IRJET- Design the Surveillance Algorithm and Motion Detection of Objects for ...
 
Real-Time Pedestrian Detection Using Apache Storm in a Distributed Environment
Real-Time Pedestrian Detection Using Apache Storm in a Distributed Environment Real-Time Pedestrian Detection Using Apache Storm in a Distributed Environment
Real-Time Pedestrian Detection Using Apache Storm in a Distributed Environment
 

Similar to Low-Cost Approximate and Adaptive Techniques for the Internet of Things

Low-Cost Approximate and Adaptive Monitoring Techniques for the Internet of T...
Low-Cost Approximate and Adaptive Monitoring Techniques for the Internet of T...Low-Cost Approximate and Adaptive Monitoring Techniques for the Internet of T...
Low-Cost Approximate and Adaptive Monitoring Techniques for the Internet of T...Demetris Trihinas
 
Rapidly Testing ML-Driven Drone Applications - The FlockAI Framework
Rapidly Testing ML-Driven Drone Applications - The FlockAI FrameworkRapidly Testing ML-Driven Drone Applications - The FlockAI Framework
Rapidly Testing ML-Driven Drone Applications - The FlockAI FrameworkDemetris Trihinas
 
StreamSight: A Query-Driven Framework Extending Streaming IoT Analytics to th...
StreamSight: A Query-Driven Framework Extending Streaming IoT Analytics to th...StreamSight: A Query-Driven Framework Extending Streaming IoT Analytics to th...
StreamSight: A Query-Driven Framework Extending Streaming IoT Analytics to th...Demetris Trihinas
 
Towards Energy and Carbon Footprint and Testing for AI-driven IoT Services
Towards Energy and Carbon Footprint and Testing for AI-driven IoT ServicesTowards Energy and Carbon Footprint and Testing for AI-driven IoT Services
Towards Energy and Carbon Footprint and Testing for AI-driven IoT ServicesDemetris Trihinas
 
Semantics in Sensor Networks
Semantics in Sensor NetworksSemantics in Sensor Networks
Semantics in Sensor NetworksOscar Corcho
 
Session 3-Distributed System Principals
Session 3-Distributed System PrincipalsSession 3-Distributed System Principals
Session 3-Distributed System PrincipalsISSGC Summer School
 
CROM Digital Twins and IoT
CROM Digital Twins and IoTCROM Digital Twins and IoT
CROM Digital Twins and IoTJuan C. Vasquez
 
Making Actionable Decisions at the Network's Edge
Making Actionable Decisions at the Network's EdgeMaking Actionable Decisions at the Network's Edge
Making Actionable Decisions at the Network's EdgeCognizant
 
Dynamic Semantics for Semantics for Dynamic IoT Environments
Dynamic Semantics for Semantics for Dynamic IoT EnvironmentsDynamic Semantics for Semantics for Dynamic IoT Environments
Dynamic Semantics for Semantics for Dynamic IoT EnvironmentsPayamBarnaghi
 
Ncct Ieee Software Abstract Collection Volume 1 50+ Abst
Ncct   Ieee Software Abstract Collection Volume 1   50+ AbstNcct   Ieee Software Abstract Collection Volume 1   50+ Abst
Ncct Ieee Software Abstract Collection Volume 1 50+ Abstncct
 
Privacy Preserving Aggregate Statistics for Mobile Crowdsensing
Privacy Preserving Aggregate Statistics for Mobile CrowdsensingPrivacy Preserving Aggregate Statistics for Mobile Crowdsensing
Privacy Preserving Aggregate Statistics for Mobile CrowdsensingIJSRED
 
Show and Tell - Data and Digitalisation, Digital Twins.pdf
Show and Tell - Data and Digitalisation, Digital Twins.pdfShow and Tell - Data and Digitalisation, Digital Twins.pdf
Show and Tell - Data and Digitalisation, Digital Twins.pdfSIFOfgem
 
Urban Environment Monitor
Urban Environment MonitorUrban Environment Monitor
Urban Environment MonitorBeta2k
 
Paper id 25201431
Paper id 25201431Paper id 25201431
Paper id 25201431IJRAT
 
Data processing in Cyber-Physical Systems
Data processing in Cyber-Physical SystemsData processing in Cyber-Physical Systems
Data processing in Cyber-Physical SystemsBob Marcus
 
PERICLES Ecosystem Modelling (NCDD use case) - Acting on Change 2016
PERICLES Ecosystem Modelling (NCDD use case) - Acting on Change 2016PERICLES Ecosystem Modelling (NCDD use case) - Acting on Change 2016
PERICLES Ecosystem Modelling (NCDD use case) - Acting on Change 2016PERICLES_FP7
 
How to make data more usable on the Internet of Things
How to make data more usable on the Internet of ThingsHow to make data more usable on the Internet of Things
How to make data more usable on the Internet of ThingsPayamBarnaghi
 

Similar to Low-Cost Approximate and Adaptive Techniques for the Internet of Things (20)

Low-Cost Approximate and Adaptive Monitoring Techniques for the Internet of T...
Low-Cost Approximate and Adaptive Monitoring Techniques for the Internet of T...Low-Cost Approximate and Adaptive Monitoring Techniques for the Internet of T...
Low-Cost Approximate and Adaptive Monitoring Techniques for the Internet of T...
 
Rapidly Testing ML-Driven Drone Applications - The FlockAI Framework
Rapidly Testing ML-Driven Drone Applications - The FlockAI FrameworkRapidly Testing ML-Driven Drone Applications - The FlockAI Framework
Rapidly Testing ML-Driven Drone Applications - The FlockAI Framework
 
StreamSight: A Query-Driven Framework Extending Streaming IoT Analytics to th...
StreamSight: A Query-Driven Framework Extending Streaming IoT Analytics to th...StreamSight: A Query-Driven Framework Extending Streaming IoT Analytics to th...
StreamSight: A Query-Driven Framework Extending Streaming IoT Analytics to th...
 
Towards Energy and Carbon Footprint and Testing for AI-driven IoT Services
Towards Energy and Carbon Footprint and Testing for AI-driven IoT ServicesTowards Energy and Carbon Footprint and Testing for AI-driven IoT Services
Towards Energy and Carbon Footprint and Testing for AI-driven IoT Services
 
Chapter 1.pdf
Chapter 1.pdfChapter 1.pdf
Chapter 1.pdf
 
Semantics in Sensor Networks
Semantics in Sensor NetworksSemantics in Sensor Networks
Semantics in Sensor Networks
 
Session 3-Distributed System Principals
Session 3-Distributed System PrincipalsSession 3-Distributed System Principals
Session 3-Distributed System Principals
 
CROM Digital Twins and IoT
CROM Digital Twins and IoTCROM Digital Twins and IoT
CROM Digital Twins and IoT
 
Making Actionable Decisions at the Network's Edge
Making Actionable Decisions at the Network's EdgeMaking Actionable Decisions at the Network's Edge
Making Actionable Decisions at the Network's Edge
 
Dynamic Semantics for Semantics for Dynamic IoT Environments
Dynamic Semantics for Semantics for Dynamic IoT EnvironmentsDynamic Semantics for Semantics for Dynamic IoT Environments
Dynamic Semantics for Semantics for Dynamic IoT Environments
 
Ncct Ieee Software Abstract Collection Volume 1 50+ Abst
Ncct   Ieee Software Abstract Collection Volume 1   50+ AbstNcct   Ieee Software Abstract Collection Volume 1   50+ Abst
Ncct Ieee Software Abstract Collection Volume 1 50+ Abst
 
Chapter 02
Chapter 02Chapter 02
Chapter 02
 
Privacy Preserving Aggregate Statistics for Mobile Crowdsensing
Privacy Preserving Aggregate Statistics for Mobile CrowdsensingPrivacy Preserving Aggregate Statistics for Mobile Crowdsensing
Privacy Preserving Aggregate Statistics for Mobile Crowdsensing
 
Show and Tell - Data and Digitalisation, Digital Twins.pdf
Show and Tell - Data and Digitalisation, Digital Twins.pdfShow and Tell - Data and Digitalisation, Digital Twins.pdf
Show and Tell - Data and Digitalisation, Digital Twins.pdf
 
Urban Environment Monitor
Urban Environment MonitorUrban Environment Monitor
Urban Environment Monitor
 
Paper id 25201431
Paper id 25201431Paper id 25201431
Paper id 25201431
 
Ci days notre_dame_april2010
Ci days notre_dame_april2010Ci days notre_dame_april2010
Ci days notre_dame_april2010
 
Data processing in Cyber-Physical Systems
Data processing in Cyber-Physical SystemsData processing in Cyber-Physical Systems
Data processing in Cyber-Physical Systems
 
PERICLES Ecosystem Modelling (NCDD use case) - Acting on Change 2016
PERICLES Ecosystem Modelling (NCDD use case) - Acting on Change 2016PERICLES Ecosystem Modelling (NCDD use case) - Acting on Change 2016
PERICLES Ecosystem Modelling (NCDD use case) - Acting on Change 2016
 
How to make data more usable on the Internet of Things
How to make data more usable on the Internet of ThingsHow to make data more usable on the Internet of Things
How to make data more usable on the Internet of Things
 

More from Demetris Trihinas

Telling a Story – or Even Propaganda – Through Data Visualization
Telling a Story – or Even Propaganda – Through Data VisualizationTelling a Story – or Even Propaganda – Through Data Visualization
Telling a Story – or Even Propaganda – Through Data VisualizationDemetris Trihinas
 
Machine Learning Introduction
Machine Learning IntroductionMachine Learning Introduction
Machine Learning IntroductionDemetris Trihinas
 
Απεικόνιση και Αλληλεπίδραση Δεδομένων Μεγάλου Όγκου με Διαδραστικούς Χάρτες
Απεικόνιση και Αλληλεπίδραση Δεδομένων Μεγάλου Όγκου με Διαδραστικούς ΧάρτεςΑπεικόνιση και Αλληλεπίδραση Δεδομένων Μεγάλου Όγκου με Διαδραστικούς Χάρτες
Απεικόνιση και Αλληλεπίδραση Δεδομένων Μεγάλου Όγκου με Διαδραστικούς ΧάρτεςDemetris Trihinas
 
The Data Science Process: From Mining Raw Data to Story Visualization
The Data Science Process: From Mining Raw Data to Story VisualizationThe Data Science Process: From Mining Raw Data to Story Visualization
The Data Science Process: From Mining Raw Data to Story VisualizationDemetris Trihinas
 
From Mining Raw Data to Story Visualization
From Mining Raw Data to Story VisualizationFrom Mining Raw Data to Story Visualization
From Mining Raw Data to Story VisualizationDemetris Trihinas
 
Designing Scalable and Secure Microservices by Embracing DevOps-as-a-Service ...
Designing Scalable and Secure Microservices by Embracing DevOps-as-a-Service ...Designing Scalable and Secure Microservices by Embracing DevOps-as-a-Service ...
Designing Scalable and Secure Microservices by Embracing DevOps-as-a-Service ...Demetris Trihinas
 
Adam - Adaptive Monitoring in 5min
Adam - Adaptive Monitoring in 5minAdam - Adaptive Monitoring in 5min
Adam - Adaptive Monitoring in 5minDemetris Trihinas
 
Low-Cost Adaptive Monitoring Techniques for the Internet of Things
Low-Cost Adaptive Monitoring Techniques for the Internet of ThingsLow-Cost Adaptive Monitoring Techniques for the Internet of Things
Low-Cost Adaptive Monitoring Techniques for the Internet of ThingsDemetris Trihinas
 
AdaM: an Adaptive Monitoring Framework for Sampling and Filtering on IoT Devices
AdaM: an Adaptive Monitoring Framework for Sampling and Filtering on IoT DevicesAdaM: an Adaptive Monitoring Framework for Sampling and Filtering on IoT Devices
AdaM: an Adaptive Monitoring Framework for Sampling and Filtering on IoT DevicesDemetris Trihinas
 
Cloud Elasticity and the CELAR Project
Cloud Elasticity and the CELAR ProjectCloud Elasticity and the CELAR Project
Cloud Elasticity and the CELAR ProjectDemetris Trihinas
 
[ccgrid2014] JCatascopia: Monitoring Elastically Adaptive Applications in the...
[ccgrid2014] JCatascopia: Monitoring Elastically Adaptive Applications in the...[ccgrid2014] JCatascopia: Monitoring Elastically Adaptive Applications in the...
[ccgrid2014] JCatascopia: Monitoring Elastically Adaptive Applications in the...Demetris Trihinas
 
[SummerSoc 2014] Monitoring Elastic Cloud Services
[SummerSoc 2014] Monitoring Elastic Cloud Services[SummerSoc 2014] Monitoring Elastic Cloud Services
[SummerSoc 2014] Monitoring Elastic Cloud ServicesDemetris Trihinas
 

More from Demetris Trihinas (13)

Telling a Story – or Even Propaganda – Through Data Visualization
Telling a Story – or Even Propaganda – Through Data VisualizationTelling a Story – or Even Propaganda – Through Data Visualization
Telling a Story – or Even Propaganda – Through Data Visualization
 
Machine Learning Introduction
Machine Learning IntroductionMachine Learning Introduction
Machine Learning Introduction
 
Απεικόνιση και Αλληλεπίδραση Δεδομένων Μεγάλου Όγκου με Διαδραστικούς Χάρτες
Απεικόνιση και Αλληλεπίδραση Δεδομένων Μεγάλου Όγκου με Διαδραστικούς ΧάρτεςΑπεικόνιση και Αλληλεπίδραση Δεδομένων Μεγάλου Όγκου με Διαδραστικούς Χάρτες
Απεικόνιση και Αλληλεπίδραση Δεδομένων Μεγάλου Όγκου με Διαδραστικούς Χάρτες
 
The Data Science Process: From Mining Raw Data to Story Visualization
The Data Science Process: From Mining Raw Data to Story VisualizationThe Data Science Process: From Mining Raw Data to Story Visualization
The Data Science Process: From Mining Raw Data to Story Visualization
 
From Mining Raw Data to Story Visualization
From Mining Raw Data to Story VisualizationFrom Mining Raw Data to Story Visualization
From Mining Raw Data to Story Visualization
 
Designing Scalable and Secure Microservices by Embracing DevOps-as-a-Service ...
Designing Scalable and Secure Microservices by Embracing DevOps-as-a-Service ...Designing Scalable and Secure Microservices by Embracing DevOps-as-a-Service ...
Designing Scalable and Secure Microservices by Embracing DevOps-as-a-Service ...
 
Adam - Adaptive Monitoring in 5min
Adam - Adaptive Monitoring in 5minAdam - Adaptive Monitoring in 5min
Adam - Adaptive Monitoring in 5min
 
Low-Cost Adaptive Monitoring Techniques for the Internet of Things
Low-Cost Adaptive Monitoring Techniques for the Internet of ThingsLow-Cost Adaptive Monitoring Techniques for the Internet of Things
Low-Cost Adaptive Monitoring Techniques for the Internet of Things
 
AdaM: an Adaptive Monitoring Framework for Sampling and Filtering on IoT Devices
AdaM: an Adaptive Monitoring Framework for Sampling and Filtering on IoT DevicesAdaM: an Adaptive Monitoring Framework for Sampling and Filtering on IoT Devices
AdaM: an Adaptive Monitoring Framework for Sampling and Filtering on IoT Devices
 
Find A Project
Find A ProjectFind A Project
Find A Project
 
Cloud Elasticity and the CELAR Project
Cloud Elasticity and the CELAR ProjectCloud Elasticity and the CELAR Project
Cloud Elasticity and the CELAR Project
 
[ccgrid2014] JCatascopia: Monitoring Elastically Adaptive Applications in the...
[ccgrid2014] JCatascopia: Monitoring Elastically Adaptive Applications in the...[ccgrid2014] JCatascopia: Monitoring Elastically Adaptive Applications in the...
[ccgrid2014] JCatascopia: Monitoring Elastically Adaptive Applications in the...
 
[SummerSoc 2014] Monitoring Elastic Cloud Services
[SummerSoc 2014] Monitoring Elastic Cloud Services[SummerSoc 2014] Monitoring Elastic Cloud Services
[SummerSoc 2014] Monitoring Elastic Cloud Services
 

Recently uploaded

Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Paola De la Torre
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhisoniya singh
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersThousandEyes
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptxLBM Solutions
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Patryk Bandurski
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphNeo4j
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 

Recently uploaded (20)

Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping Elbows
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food Manufacturing
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptx
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 

Low-Cost Approximate and Adaptive Techniques for the Internet of Things

  • 1. 2/16/21 1 Demetris Trihinas trihinas.d@unic.ac.cy 1 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science Low-Cost Approximate and Adaptive Monitoring Techniques Demetris Trihinas trihinas.d@unic.ac.cy Department of Computer Science University of Nicosia
  • 2. 2/16/21 2 Demetris Trihinas trihinas.d@unic.ac.cy 2 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science Full-Time Faculty Member University of Nicosia “Designing and developing scalable and self-adaptive tools for data management, exploration and visualization” @dtrihinas http://dtrihinas.info https://ailab.unic.ac.cy/ https://www.slideshare.net/DemetrisTrihinas @AilabUnic
  • 3. 2/16/21 4 Demetris Trihinas trihinas.d@unic.ac.cy 4 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science The Internet of Things The physical world is now an information system Exchanging continuous data streams with other network- enabled devices, systems and humans… Internet-enabled (battery-powered) physical devices with smart processing capabilities… Intelligent Transportation Services Health and Activity Tracking Precision Farming Smart Metering and Power Grids
  • 4. 2/16/21 5 Demetris Trihinas trihinas.d@unic.ac.cy 5 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science The Big Data in IoT [HP, Oct 2016] IoT monitoring data accounted for 2% of digital universe in 2012, with projections that by 2020 it will rise above 12% [Cisco VNI, 2016] 3+ million car telemetry updates per second Data explosion outpacing the technology [2016] 500+ million active monitoring streams at all times A single self-driving vehicle will produce 4GB per day …equal to 2666 internet users [Uber Engineering, 2017] [IDC, 2016]
  • 5. 2/16/21 6 Demetris Trihinas trihinas.d@unic.ac.cy 6 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science The Harsh Reality Network latencies, bandwidth limitations, pricing (in/out cloud traffic is billed), constant location awareness Augmenting IoT and the Cloud The Developer Perspective Monitoring-as-a-Service eases monitoring infrastructure management by enabling scalable and multi-tenant monitoring over the internet via a pay-as-you-use business model
  • 6. 2/16/21 7 Demetris Trihinas trihinas.d@unic.ac.cy 7 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science Edge Computing A term coined to reflect computation and decision-making at the logical extremes of the network, ideally “in place” on the data source Shorter response times Simple Sensing Edge Computing Less network pressure
  • 7. 2/16/21 8 Demetris Trihinas trihinas.d@unic.ac.cy 8 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science Challenge 1 – Taming data volume and data velocity with limited processing and network capabilities Challenge 2 - IoT devices are usually battery-powered which means intense processing leads to less battery-life Data processing and dissemination are the main energy drains in embedded and mobile devices Edge Computing Challenges
  • 8. 2/16/21 9 Demetris Trihinas trihinas.d@unic.ac.cy 9 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science Motivation “if a degree of inaccuracy can be tolerated, low-cost approximate and adaptive monitoring techniques that are capable of dynamically adjusting the data collection and dissemination rate, can effectively tackle real-time data processing and energy-efficiency on the edge of monitored networks”
  • 9. 2/16/21 10 Demetris Trihinas trihinas.d@unic.ac.cy 10 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science Presentation Outline • Background and Motivation • Problem Statement • Related Work • AdaM: the Adaptive Monitoring Framework • ADMin: a Plugin for Model-Based Adaptive Dissemination • Talk Conclusion
  • 10. 2/16/21 11 Demetris Trihinas trihinas.d@unic.ac.cy 11 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science Problem Statement Low-Cost Approximate and Adaptive Monitoring
  • 11. 2/16/21 12 Demetris Trihinas trihinas.d@unic.ac.cy 12 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science Preliminaries • A monitoring stream ! = {$%}%'( ) published by a data source is a large stochastic sequence of i.i.d datapoints, denoted as $% , where * = 0, 1, … , / and / → ∞. • A datapoint $% is a tuple 2%3, 4%, 5% described by a unique identifier for the monitoring source 2%3, a timestamp 4% and a value 5% • A datapoint may have a set of other attributes (e.g., location) although for brevity we will omit other attributes without loss of generality $% $%67 Monitoring Stream M
  • 12. 2/16/21 13 Demetris Trihinas trihinas.d@unic.ac.cy 13 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science Preliminaries • Approximate Techniques? • Decision mechanisms based on estimation models capturing and predicting monitoring stream runtime evolution within certain accuracy guarantees. • Adaptive? • Adapt monitoring source properties based on the predicaments of the estimation models. • Low-Cost? • The costs (time, resources) of applying adaptive monitoring techniques are (much) less than leaving the monitoring process as is.
  • 13. 2/16/21 14 Demetris Trihinas trihinas.d@unic.ac.cy 14 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science Periodic Sampling The process of triggering the collection mechanism of a monitored source every ! time units such that the "#$ datapoint is collected at time %& = " ( ! )& )&*+ Metric Stream M sampled every T = 1s Compute resources and energy are wasted while generating large data volumes at a high velocity Sudden events and significant insights are missed Metric Stream M sampled every T = 10s
  • 14. 2/16/21 15 Demetris Trihinas trihinas.d@unic.ac.cy 15 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science Adaptive Sampling • Dynamically adjust the periodicity !" based on some estimation model #(%), capturing runtime information of the monitoring stream evolution. • How large of an adjustment is required, “ideally”, depends on some evaluation (distance) metric denoting the ability of the model to (correctly) estimate and follow metric stream evolution. '" '"() !"() Metric Stream %′ dynamically sampled Metric Stream % with ! = 1- Find max ! ∈ [!0"1, !034] to collect '"() based on estimation of metric stream evolution #(%), such that %′ differs from % less than user-defined imprecision value 6 ('7-8 < 6)
  • 15. 2/16/21 16 Demetris Trihinas trihinas.d@unic.ac.cy 16 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science Periodic Dissemination Monitoring Source Receiving Entity The process of triggering the network controller of a data source every ! time units such that the "#$ datapoint is disseminated at time %& = " ( ! to interested receiving entities. No data loss Energy consumption for data dissemination: )#*# = +, + ., ( χ + ε1 per message cost +, >> ., per byte cost ., ≅ 0.01 ( +, energy for state transitions
  • 16. 2/16/21 17 Demetris Trihinas trihinas.d@unic.ac.cy 17 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science Adaptive Dissemination • Dynamically adapt dissemination rate by applying approximation techniques to sensed datapoints to reduce comm. Overhead. • Achieve by suppressing consecutive datapoints from dissemination with “little” change in their metric values. • How much is change is considered as “little” depends on: • The approximation technique • Accuracy guarantees given by the user and denoting the probability (confidence δ) with which sensed datapoints are approximated.
  • 17. 2/16/21 18 Demetris Trihinas trihinas.d@unic.ac.cy 18 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science Model-Based Adaptive Dissemination • Monitoring source maintains runtime estimation model !(#) capturing monitoring stream evolution and variability. • At the %&' time interval instead of metric values, the model is disseminated. • Receiving entities predict source state from the given model assuming subsequent k- datapoints can be approximated d)*+|) = f(! # , 01) within given accuracy guarantees. Metric Stream # Approximated Metric Stream #′
  • 18. 2/16/21 19 Demetris Trihinas trihinas.d@unic.ac.cy 19 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science Model-Based Adaptive Dissemination • Monitoring source withholds further dissemination interacting with receiver only when shifts in monitoring stream value distribution render model as inconsistent with the actual source state. • If model parameterization is inconsistent, at this point, it must be updated. decision criteria? decision function? Metric Stream ! Approximated Metric Stream !′
  • 19. 2/16/21 20 Demetris Trihinas trihinas.d@unic.ac.cy 20 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science Metric Filtering • A form of adaptive dissemination: suppress latest datapoint(s) dissemination if their values have not “changed” since last reported • Metric stream suppression but… no model -> no forecasting • Fixed filter ranges assume monitoring stream value distribution will not change in in the future (no guarantees any values will be filtered at all) if (curValue ∈ [prevValue – R, prevValue + R ]) filter(curValue)
  • 20. 2/16/21 21 Demetris Trihinas trihinas.d@unic.ac.cy 21 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science Adaptive Filtering • Dynamically adjust the filter range ! based on the current variability of the monitoring stream, denoted as "($) Metric Stream $′ with adaptive Range Metric Stream $ '( '()* !()* !( • Find the max filter range !()* ∈ [!-(., !-01] for '()* such that $3 differs from $ less than a user-defined imprecision value 4 based on the variability of the metric stream "($)
  • 21. 2/16/21 22 Demetris Trihinas trihinas.d@unic.ac.cy 22 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science Related Work
  • 22. 2/16/21 23 Demetris Trihinas trihinas.d@unic.ac.cy 23 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science Approximate and Adaptive Monitoring • Wide applicability in various domains such as: • Data stream processing • Distributed system and network monitoring • Signal processing • WSNs • Biosignal and Biomedical reporting (wearables!!!) • Differential privacy preserving
  • 23. 2/16/21 24 Demetris Trihinas trihinas.d@unic.ac.cy 24 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science Limitations of the State-of-the-Art • Require excessive profiling to configure optimal framework parameters [Deligiannakis, ACM SIGMOD 2011], [Roy, ACM SIGCOMM, 2015], [Jorg, Middleware 2017] • Present large runtime footprints reducing benefits of adaptiveness in the end [Silberstein, ACM SIGMOD 2006], [Kim, IEEE IoT, 2017], [Meng, IEEE Trans. Computers 2013] • Fail to acknowledge abrupt and transient shifts in metric stream evolution [Werner, ACM SenSys 2011], [Gaura, IEEE Trans. Sensors 2013], [Fan, ACM CIKM 2013], [Du, IEEE BigData 2015] • Offline approaches or require coordination from server-side components [Rastogi, ACM SIGMOD 2009], [Olston, ACM SIGMOD 2010], [Bailis, ACM SIGMOD 2017]
  • 24. 2/16/21 25 Demetris Trihinas trihinas.d@unic.ac.cy 25 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science AdaM: the Adaptive Monitoring Framework “AdaM: Adaptive Monitoring Framework for Sampling and Filtering on IoT Devices”. D. Trihinas, G. Pallis and M.D. Dikaiakos, 2015 IEEE International Conference on Big Data (IEEE BigData 2015), May 201Santa Clara, CA, USA “Low-Cost Adaptive Monitoring Techniques for the Internet of Things”. D. Trihinas, G. Pallis and M.D. Dikaiakos, IEEE Transactions on Services Computing, 2018.
  • 25. 2/16/21 26 Demetris Trihinas trihinas.d@unic.ac.cy 26 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science The Adaptive Monitoring Framework μProcessor μOS Memory Adaptive Filtering metric updates A P I updated periodicity compressed metric stream updated filter range filtered metric stream AdaM S E N S I N G U N I T estimation confidence Low-Cost Approximate Stream Estimation Adaptive Sampling stream variability stream evolution online stats Model Base N E T W O R K U N I T metric stream Developed as a software library offering low-cost approximate and adaptive monitoring for software agents and IoT devices
  • 26. 2/16/21 27 Demetris Trihinas trihinas.d@unic.ac.cy 27 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science Step 1: Update runtime monitoring stream evolution ! Μ • Probabilistic Exponential Weighted Moving Average (PEWMA) to estimate distance between consecutive datapoints # $%&' with $% = )% − )%+' # $%&' = ,% = - . / ,%+' + 1 − - . $% • Datapoints labelled as “expected” if estimation lands in prediction intervals determined from user confidence guarantees or “unexpected” otherwise • “Unexpected” datapoints are stored in local buffer for dissemination Looks like an exponential moving average, right? But weighting - . = 2 1 − 3P% is probabilistically applied! AdaM Estimation Process
  • 27. 2/16/21 28 Demetris Trihinas trihinas.d@unic.ac.cy 28 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science • Timely boost PEWMA to appropriate value base • Metric stream evolution and variability updated with only previous value knowledge Step 2: Detect over time monotonic phases of growth or decay to reduce time “lagging” effects in monitoring stream evolution estimation Upward trend Downward trend !" = $ % & (!"()+ +"()) + 1 − $ % /" AdaM Estimation Process
  • 28. 2/16/21 29 Demetris Trihinas trihinas.d@unic.ac.cy 29 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science EWMA after spikes overestimates subsequent values EWMA slow to acknowledge spikes AdaM estimation process • Probabilistic reasoning -> No overestimation after “bursty” intervals • Detecting gradual trends -> No “lagging” effects AdaM Estimation Process
  • 29. 2/16/21 30 Demetris Trihinas trihinas.d@unic.ac.cy 30 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science AdaM Adaptive Sampling • After updating estimation model, we compute the current estimation confidence ("# ≤ 1) based on actual and estimated standard deviation • Next, we update sampling period '#() based on the current confidence and the user-defined imprecision γ (e.g. 10% tolerance to errors) "# = 1 − | - .# − .#| .# … the more “confident” the algorithm is, the larger the outputted periodicity '#() can be… λ is an aggressiveness multiplier (default λ=1)
  • 30. 2/16/21 31 Demetris Trihinas trihinas.d@unic.ac.cy 31 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science AdaM Adaptive Filtering • Update variability of the metric stream using moving Fano Factor !" which is an indicator of the stream value dispersion • We then compare #$%% to the user-provided maximum tolerable imprecision guarantees & in attempt to widen filter range !" = #" ( )" …a low !" (due to #") indicates a currently in-dispersed data stream which means low variability in the metric stream…
  • 31. 2/16/21 32 Demetris Trihinas trihinas.d@unic.ac.cy 32 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science AdaM Evaluation • Compare accuracy and on-device overheads • Real-world and publically available datasets • Testbeds: cloud apps, internet security services, wearables, cloud monitoring, intelligent transportation service • Under-evaluation frameworks • L-SIP [Gaura et al., IEEE Trans. on Sensors 2013] • i-EWMA [Trihinas et al., IEEE/ACM CCGrid 2014] • FAST [Fan et al., ACM CIKM 2013, IEEE TKDE 2014]
  • 32. 2/16/21 33 Demetris Trihinas trihinas.d@unic.ac.cy 33 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science Memory Trace Java Sorting Benchmark CPU Trace Carnegie Mellon RainMon Project Disk I/O Trace Carnegie Mellon RainMon Project TCP Port Trace Cyber Defence SANS Tech Institute Step Trace Fitbit Charge Wearable Heartrate Trace Fitbit Charge Wearable Real-World and Publically Available Datasets
  • 33. 2/16/21 34 Demetris Trihinas trihinas.d@unic.ac.cy 34 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science Energy Consumption Network Traffic Error (MAPE) Accuracy and On-Device Performance Evaluation AdaM achieves a balance between efficiency and accuracy, reducing data volume by at least 74%, energy consumption by 71% while always maintaining accuracy above 89% CPU Cycles
  • 34. 2/16/21 35 Demetris Trihinas trihinas.d@unic.ac.cy 35 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science in Action! Steps Heartrate Calories 94% accuracy! 96% accuracy! 91% accuracy! 6x less processing! 4x less network traffic! 4x less energy usage! + 3 - 5 days 7 - 8 days
  • 35. 2/16/21 36 Demetris Trihinas trihinas.d@unic.ac.cy 36 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science Intelligent Transportation Service Dublin Smart City ITS 1000 Buses with GPS tracking sending updates to ITS Alerts when >10 buses in city area, per 5min window, are reporting delays over 1 SD from their weekly average With the ITS achieves 8x data volume reduction while still detecting 92% of all reported incidents Apache Spark cluster with 5 workers on large VMs (8VCPU, 8GB RAM)
  • 36. 2/16/21 37 Demetris Trihinas trihinas.d@unic.ac.cy 37 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science ADMin: a Plugin for Model-Based Adaptive Dissemination “ADMin: Adaptive Monitoring Dissemination for the Internet of Things”. D. Trihinas, G. Pallis and M.D. Dikaiakos, 2017 IEEE Conference on Computer Communications (IEEE INFOCOM 2017), Atlanta, GA, USA
  • 37. 2/16/21 38 Demetris Trihinas trihinas.d@unic.ac.cy 38 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science The Adaptive Monitoring Framework μProcessor μOS Memory Adaptive Filtering metric updates A P I updated periodicity compressed metric stream updated filter range filtered metric stream AdaM S E N S I N G U N I T estimation confidence Low-Cost Approximate Stream Estimation Adaptive Sampling stream variability stream evolution online stats Model Base change detected N E T W O R K U N I T Model-Based Dissemination Datapoint Buffer ADMin metric stream
  • 38. 2/16/21 39 Demetris Trihinas trihinas.d@unic.ac.cy 39 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science The ADMin plugin for Model-Based Dissemination “Instead of sending datapoints, we model the metric stream so that values are inferred from the model and only trigger an update when changes in the stream render the model as inconsistent”
  • 39. 2/16/21 40 Demetris Trihinas trihinas.d@unic.ac.cy 40 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science Test if seasonality enrichment is beneficial to estimation process and update estimation model accordingly seasonal Seasonal with exponential trend Seasonal with damped trend • Tendency of the metric stream to exhibit behavior that repeats itself every L periods (e.g., hourly) • Seasonal effects highly evident in IoT data (e.g., human biosignals, environmental data) PV Panel Production Air Temperature ADMin Seasonality Enrichment
  • 40. 2/16/21 41 Demetris Trihinas trihinas.d@unic.ac.cy 41 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science • Holt Winter’s Method used to estimate seasonal contribution • However… perfect seasonal behavior is rarely observed in real-life ADMin Seasonality Enrichment PV Panel Production Considering the day before hourly average (Si-L) will lead to overestimation • Online testing to determine if seasonal contribution beneficial • Forecasting k-subsequent datapoints with trend and seasonality ! "#$%|# ← (# + * +# + ,#
  • 41. 2/16/21 42 Demetris Trihinas trihinas.d@unic.ac.cy 42 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science ADMin Runtime Shift Detection • Cumulative Sum (CUSUM) test to detect shifts in metric stream value probability distribution which render estimation model as inconsistent ts prior shift after shift !" = ln &((", *++) & (", *+ *" ++ = *" + + . where ε magnitude of change Log-Likelihood Ratio However, . not known beforehand but… estimation model provides us with an approximate / 0 12 3",{567,8"98} > ℎ → >ℎ12? @A?A!?A@ h is measured in standard deviation units & (", *+ & (", *++ Decision Function Trend and seasonality provide model greater accuracy ( ̂ . → .) and to adapt to unexpected, abrupt and and volatile changes is metric stream
  • 42. 2/16/21 43 Demetris Trihinas trihinas.d@unic.ac.cy 43 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science ADMin Evaluation • ADMin in 3 configurations • No seasonality enrichment (ADMin) • Static seasonality enrichment - previous day hourly average (ADMin_S1) • Dynamic seasonality enrichment – ComCube* integration (ADMin_S2) • Under comparison frameworks • LANCE [Werner et al., ACM SenSys 2011] • G-SIP [Gaura et al., IEEE Trans. on Sensors 2013] • ADWIN [Bifet et al., SIAM 2010] All three under-comparison framework parameters configured to output best results * “Non-linear mining of competing local activities ”, Y. Matsubara, Y. Sakurai and C. Faloutsos, WWW 2016
  • 43. 2/16/21 44 Demetris Trihinas trihinas.d@unic.ac.cy 44 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science Photovoltaic Panel Current (IDC) Production 2 Weeks of data collected every 1 second Data reduction: 87% -- Accuracy: 93% Weather Station Air Temperature (oC) 2 Weeks of data collected every 1 second Data reduction: 85% -- Accuracy: 92% Wearable Human Heartrate (bpm) 2 Weeks of data collected every 1 minute Data reduction: 80% -- Accuracy: 90% ADMin in Action!
  • 44. 2/16/21 45 Demetris Trihinas trihinas.d@unic.ac.cy 45 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science • Comparison of number of monitoring stream disseminations triggered for shifts that actually occurred (true positives) and number of false alarms (false positives) • Ground truth pre-determined offline by PELT algorithm [Killick, 2012] Shift Detection Accuracy Evaluation ground truth false alarms correctly detected shifts Air Temperature Dataset Wearable Dataset ADMin features high accuracy (>90%) and low false alarm ratio (<10%) which is drastically reduced when incorporating seasonality knowledge by at least 47% compared to the other approaches
  • 45. 2/16/21 46 Demetris Trihinas trihinas.d@unic.ac.cy 46 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science Shift Detection Delay Evaluation • Shift detection delay is the difference in time to when a shift is detected by a technique compared to the actual time of occurrence ADMin outperforms other techniques by at least 29% When incorporating trend and seasonality knowledge even for datasets with irregular seasonal behavior ADMin reduces shift detection time by at least 67% compared to the other techniques
  • 46. 2/16/21 48 Demetris Trihinas trihinas.d@unic.ac.cy 48 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science Conclusion • Monitoring at the “edge” implies significant costs • AdaM: the Adaptive Monitoring Framework • Low-cost estimation process featuring probabilistic learning to capture metric stream runtime evolution, trend and variability • Dynamically adjusts metric periodicity and filtering based on estimation model “confidence” which rewards correct estimations • ADMin: model-based dissemination lowers communication overhead in IoT networks when monitoring data featuring seasonal patterns and trends • Results show AdaM and ADMin achieve a balance between efficiency and accuracy, reducing data volume by 74%, energy consumption by 71%, shift detection delays by 61%, while maintaining accuracy above 89%
  • 47. 2/16/21 49 Demetris Trihinas trihinas.d@unic.ac.cy 49 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science AdaM Applicability • Raspberry Pi micro-controllers • Linux-based environments • Android Wear devices • Cloud monitoring tools with adaptive interfaces (e.g., JCatascopia, pyCatascopia, Netdata plugin) • Ported to R for offloading temporal graph processing • Python for efficient data stream processing with Apache Flink
  • 48. 2/16/21 50 Demetris Trihinas trihinas.d@unic.ac.cy 50 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science http://linc.ucy.ac.cy/AdaM
  • 49. 2/16/21 51 Demetris Trihinas trihinas.d@unic.ac.cy 51 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science ailab.unic.ac.cy • Virtual/F2F Summer and Fall Internships • Interesting Projects • Fogify: Scalable Emulator for Geo-Distributed Data-Intensive Apps Deployed in Fog Realms
  • 50. 2/16/21 52 Demetris Trihinas trihinas.d@unic.ac.cy 52 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science Backup Slides
  • 51. 2/16/21 53 Demetris Trihinas trihinas.d@unic.ac.cy 53 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science More processing (e.g., peak detection for hr monitoring) Driving Peripherals (e.g., accelerometer, leds) Interesting Articles “Energy-harvesting wearables for activity-aware services”, S. Khalifa et al., IEEE Internet Computing, 2015 “Taking the internet to the next physical level”, V. Cerf and M. Senges, IEEE Computer, 2016 Emulated behavior of wearable device on Raspberry Pi with ARM processor (1 core 32MHz, 128MB RAM) Periodic Sampling with Physical Sensing OS Monitoring
  • 52. 2/16/21 54 Demetris Trihinas trihinas.d@unic.ac.cy 54 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science AdaM γ-Parameter Evaluation For a wide range of γ-parameter values we compute AdaM’s MAPE per trace Even for extreme imprecision values (>0.3) AdaM can still take correct decisions signifying the importance of the confidence metric
  • 53. 2/16/21 55 Demetris Trihinas trihinas.d@unic.ac.cy 55 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science AdaM Trend ξ-Parameter Evaluation Trend estimation can shed 2-5% error when computing the metric stream evolution for a wide range of configuration values
  • 54. 2/16/21 56 Demetris Trihinas trihinas.d@unic.ac.cy 56 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science • Online testing (T-Test) to determine if seasonal contribution beneficial to estimation or not • Detecting optimal seasonality cycle (L) is an open research challenge especially when different cycles exist in monitoring stream • Approximate runtime seasonal periodicity detection • ComCube Framework (Matsubara et al., WWW, 2016): lightweight tensor-based and parameter-free framework for near-optimal seasonal periodicity detection ! "#$%|# ← (# + * +# + ,# “Non-linear mining of competing local activities ”, Y. Matsubara, Y. Sakurai and C. Faloutsos, WWW 2016 ADMin Seasonality Enrichment
  • 55. 2/16/21 57 Demetris Trihinas trihinas.d@unic.ac.cy 57 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science ADMin Runtime Shift Detection ts ti Trend and seasonality provide model with greater accuracy ( ̂ " → ") and to adapt to unexpected, abrupt and and volatile changes is monitoring stream Challenge 2: CUSUM threshold h static and sensitive when stream variability is low ($ → 0 ) thus triggering… false alarms Adapt CUSUM sensitivity by adapting h after dissemination triggered and restrict h with hmin Challenge 1: Getting '( requires linear time… Can )* be used instead of )+?
  • 56. 2/16/21 58 Demetris Trihinas trihinas.d@unic.ac.cy 58 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science Data Volume Reduction ADMin reduces data volume by at least 60% while maintaining accuracy always above 86% With seasonality knowledge data volume is reduced by at least 71% while accuracy is always above 91% Overhead Evaluation What do users see! Mean Absolute Percentage Error
  • 57. 2/16/21 59 Demetris Trihinas trihinas.d@unic.ac.cy 59 Seminar Talk @ UPitt | Feb 2021 Department of Computer Science Facebook DB Cluster Adaptive Monitoring “Inside the Social Network’s (Datacenter) Network”, A. Roy et al., ACM SIGCOMM, 2015