SlideShare a Scribd company logo
Detection of faulty rain gauges using
telecommunication microwave links

Blandine Bianchi, EPFL
Alexis Berne, EPFL
Jörg Rieckermann, SWW
Take-home message!

We need to ensure good data quality!
• Create redundant information
• Use advanced data analysis techniques
Motivation
The Hochrhein-bridge
Motivation
The Hochrhein-bridge
Motivation
The Hochrhein-bridge

27 cm
Motivation
The Hochrhein-bridge

54 cm
Motivation
The Hochrhein-bridge

54 cm
Urban Hydrology
Data quality control?

• At least every two years
• Dynamic calibration recommended
Stransky, D. et al. (2007) The effect of rainfall measurement uncertainties on rainfall-runoff process
modelling Water Science and Technology Vol 55 No 4
Urban Water Management

Concentrations

Control charts for online sensors
40
30
20
10

Sensor value
Reference measurement = grab sample

0
11.Jun.01

11. june 01
35

09.Jul.01

06.Aug.01

9. july 01

6. aug 01

63

91

4

Differences

In-control

0

-4

Change of
membrane

Thomann, M. et al. (2002) An efficient monitoring concept with control charts for on-line sensors
Water Science and Technology Vol 46 No 4–5 pp 107–116
Urban Hydrology

Concentrations

Quality control for rain gauges

40
30
20
10

Sensor value
Reference measurement = grab sample

0
11.Jun.01

11. june 01
35

09.Jul.01

06.Aug.01

9. july 01

6. aug 01

63

91

4

Differences

In-control

0

-4

Change of
membrane

Thomann et al. (2002)

We need
• Redundant information on precipitation
• Statistical quality control methods
• Automated procedures
Microwave links from telecommunication networks
MWL signals are attenuated by rainfall
Microwave links from telecommunication networks
MWL signals are attenuated by rainfall
Rain gauge

MWL
Microwave links from telecommunication networks
MWL signals are attenuated by rainfall
Microwave links from telecommunication networks
MWL signals are attenuated by rainfall
Microwave links from telecommunication networks
MWL signals are attenuated by rainfall
Idea
Using MWL signals for quality control

!
.

Friedhof Affoltern

!
.

!
.
!
.

ARA Glatt

!
.

Friedhof Nordheim

!
.

!
.

ARA Werdhölzli

!
.

Glattzentrum
ARA Neugut

Friedhof Schwamendingen

Josefstrasse

!
.

Friedhof Fluntern

Text

!
.

!
.

Völkerkundemuseum

Friedhof Friesenberg

!
.

Legende

!
.
0

Regenmesser ERZ und Eawag
ORANGE Richtfunkantennen

0.5

1

2
Kilometer

3

4

5

!
.

Wasserwerk Moos

Friedhof Enzenbühl

#
*
Case study Zurich
Quality control of rain gauges

Material
• 14 operational links (Orange CH),
frequencies 23-58 GHz, 0.3 – 8.4 Km,
• 14 rain gauges
(13 tipping-buckets and 1 weighing).
Case study Zurich
Quality control of rain gauges

Material
• 14 operational links (Orange CH),
frequencies 23-58 GHz, 0.3 – 8.4 Km,
• 14 rain gauges
(13 tipping-buckets and 1 weighing).

Goal and Methods
1. Detect occurrence of dry/rainy periods
=> Ratio test
2. Detect quantitative errors
=> CUSUM control charts
Results (1)
Detection of dry and rainy periods

Ratio test
1. Compute contingency
table for reference
periods (both sensors are
in agreement)

Rain Gauge No. 8

[%]
Results (1)
Detection of dry and rainy periods

Ratio test
1. Compute contingency
table for reference
periods (both sensors are
in agreement)
2. Define thresholds
faulty: 1%
suspicious: 5%

Rain Gauge No. 8

[%]
Results (1)
Detection of dry and rainy periods

Ratio test
1. Compute contingency
table for reference
periods (both sensors are
in agreement)
2. Define thresholds
faulty: 1%
suspicious: 5%
3. Apply classification rule
during monitoring period
Results (1)
Detection of dry and rainy periods

Ratio test
1. Compute contingency
table for reference
periods (both sensors are
in agreement)
2. Define thresholds
faulty: 1%
suspicious: 5%
3. Apply classification rule
during monitoring period

Rain Gauge No.13
Results (2)
Detection of quantitative errors

CUSUM* control chart
Suited to identify small
biases/ shifts in process
1. Compute MWL rain rates
and target value
(reference period)

*Montgomery, D.C. (2000) Introduction to Statistical Quality Control, 4th ed. New York: John Wiley & Sons.
Results (2)
Detection of quantitative errors

Rain Gauge No.13 vs. Link No.7

CUSUM

CUSUM* control chart
Suited to identify small
biases/ shifts in process
1. Compute MWL rain rates
and target value
(reference period)
2. Plotting CUSUM statistic
of differences of sensors
to check out-of-control

*Montgomery, D.C. (2000) Introduction to Statistical Quality Control, 4th ed. New York: John Wiley & Sons.
Results (2)
Detection of quantitative errors

Rain Gauge No.13 vs. Link No.7

CUSUM

CUSUM* control chart
Suited to identify small
biases/ shifts in process
1. Compute MWL rain rates
and target value
(reference period)
2. Plotting CUSUM statistic
of differences of sensors
to check out-of-control
3. Apply classification rule
during monitoring period

*Montgomery, D.C. (2000) Introduction to Statistical Quality Control, 4th ed. New York: John Wiley & Sons.
Scenario analysis
Testing the sensitivity of the methodology

Introducing virtual errors
Scenario analyis
Testing the sensitivity of the methodology

Introducing virtual errors
1. Blockage at 1 [mm/h]
Scenario analyis
Testing the sensitivity of the methodology

Introducing virtual errors
1. Blockage at 1 [mm/h]
2. Relative error of 170%
Scenario analyis
Testing the sensitivity of the methodology

Introducing virtual errors
1. Blockage at 1 [mm/h]
2. Relative error of 170%
3. Random error of 1-10 [mm/h]
Conclusions
We need to ensure good data quality!
• Create redundant information
• Use advanced data analysis techniques
Conclusions
We need to ensure good data quality!
• Create redundant information
• Use advanced data analysis techniques

• We demonstrated the possibility to identify faulty
rain gauges using operational telecommunication
microwave links (MWL)
• The algorithms for process control are straight
forward to apply, also in real-time
• MWL data are not (yet) generally available
Bianchi, B. et al., Detection of faulty rain gauges using telecommunication microwave
links (submitted to Journal of Hydrology)

More Related Content

What's hot

Statistical downscaling sdsm
Statistical downscaling sdsmStatistical downscaling sdsm
Statistical downscaling sdsm
Putu Santikayasa
 
Sampling-SDM2012_Jun
Sampling-SDM2012_JunSampling-SDM2012_Jun
Sampling-SDM2012_Jun
MDO_Lab
 
Integration of Atmospheric Stability in CFD Modeling for Wind Energy Assessme...
Integration of Atmospheric Stability in CFD Modeling for Wind Energy Assessme...Integration of Atmospheric Stability in CFD Modeling for Wind Energy Assessme...
Integration of Atmospheric Stability in CFD Modeling for Wind Energy Assessme...
Jean-Claude Meteodyn
 
CALPUFF in Odor Modeling: State of the Practice, Recent Developments and Futu...
CALPUFF in Odor Modeling: State of the Practice, Recent Developments and Futu...CALPUFF in Odor Modeling: State of the Practice, Recent Developments and Futu...
CALPUFF in Odor Modeling: State of the Practice, Recent Developments and Futu...
BREEZE Software
 
Operational efficiency using cloud software NEWWA AWWA
Operational efficiency using cloud software NEWWA AWWAOperational efficiency using cloud software NEWWA AWWA
Operational efficiency using cloud software NEWWA AWWA
Mark Moreau
 
Ambient Air Quality Monitoring in Southern Alberta
Ambient Air Quality Monitoring in Southern AlbertaAmbient Air Quality Monitoring in Southern Alberta
Ambient Air Quality Monitoring in Southern Alberta
Kepa2014
 
Estimating Ammonia Emissions from Livestock Operations Using Low-Cost, Time-A...
Estimating Ammonia Emissions from Livestock Operations Using Low-Cost, Time-A...Estimating Ammonia Emissions from Livestock Operations Using Low-Cost, Time-A...
Estimating Ammonia Emissions from Livestock Operations Using Low-Cost, Time-A...
LPE Learning Center
 
ICOS ATC Labeling Process
ICOS ATC Labeling ProcessICOS ATC Labeling Process
Dragana densitometry 2nd-behydroday_v2
Dragana densitometry 2nd-behydroday_v2Dragana densitometry 2nd-behydroday_v2
Dragana densitometry 2nd-behydroday_v2
Waterbouwkundig Laboratorium
 
Downscaling climate information (BC3 Summer School _July 2015)
Downscaling climate information (BC3 Summer School _July 2015)Downscaling climate information (BC3 Summer School _July 2015)
Downscaling climate information (BC3 Summer School _July 2015)
BC3 - Basque Center for Climate Change
 
Liquid Level Estimation in Dynamic Condition using Kalman Filter
Liquid Level Estimation in Dynamic Condition using Kalman FilterLiquid Level Estimation in Dynamic Condition using Kalman Filter
Liquid Level Estimation in Dynamic Condition using Kalman Filter
IJERA Editor
 
Julian R - Spatial downscaling of future climate predictions for agriculture ...
Julian R - Spatial downscaling of future climate predictions for agriculture ...Julian R - Spatial downscaling of future climate predictions for agriculture ...
Julian R - Spatial downscaling of future climate predictions for agriculture ...
Decision and Policy Analysis Program
 
LandGEM
LandGEMLandGEM
DMUG 2016 - Prof. Alan Robins, University of Surrey
DMUG 2016 - Prof. Alan Robins, University of SurreyDMUG 2016 - Prof. Alan Robins, University of Surrey
DMUG 2016 - Prof. Alan Robins, University of Surrey
IES / IAQM
 
Wqtc2013 dist syswq-modeling-20131107
Wqtc2013 dist syswq-modeling-20131107Wqtc2013 dist syswq-modeling-20131107
Wqtc2013 dist syswq-modeling-20131107
John B. Cook, PE, CEO
 
WCOS GasTrak
WCOS GasTrakWCOS GasTrak
WCOS GasTrak
Gary Godberson
 
Land gem v 3
Land gem v 3Land gem v 3
Land gem v 3
Umangi Mehta
 
Flood frequency analysis of river kosi, uttarakhand, india using statistical ...
Flood frequency analysis of river kosi, uttarakhand, india using statistical ...Flood frequency analysis of river kosi, uttarakhand, india using statistical ...
Flood frequency analysis of river kosi, uttarakhand, india using statistical ...
eSAT Journals
 
DSD-INT 2019 Lake Eutrophication Modelling with Delft3D Suite, Wuhan City, Ch...
DSD-INT 2019 Lake Eutrophication Modelling with Delft3D Suite, Wuhan City, Ch...DSD-INT 2019 Lake Eutrophication Modelling with Delft3D Suite, Wuhan City, Ch...
DSD-INT 2019 Lake Eutrophication Modelling with Delft3D Suite, Wuhan City, Ch...
Deltares
 
1997-07-30 Use of Airmass History Models & Techniques for Source Attribution
1997-07-30 Use of Airmass History Models & Techniques for Source Attribution1997-07-30 Use of Airmass History Models & Techniques for Source Attribution
1997-07-30 Use of Airmass History Models & Techniques for Source Attribution
Rudolf Husar
 

What's hot (20)

Statistical downscaling sdsm
Statistical downscaling sdsmStatistical downscaling sdsm
Statistical downscaling sdsm
 
Sampling-SDM2012_Jun
Sampling-SDM2012_JunSampling-SDM2012_Jun
Sampling-SDM2012_Jun
 
Integration of Atmospheric Stability in CFD Modeling for Wind Energy Assessme...
Integration of Atmospheric Stability in CFD Modeling for Wind Energy Assessme...Integration of Atmospheric Stability in CFD Modeling for Wind Energy Assessme...
Integration of Atmospheric Stability in CFD Modeling for Wind Energy Assessme...
 
CALPUFF in Odor Modeling: State of the Practice, Recent Developments and Futu...
CALPUFF in Odor Modeling: State of the Practice, Recent Developments and Futu...CALPUFF in Odor Modeling: State of the Practice, Recent Developments and Futu...
CALPUFF in Odor Modeling: State of the Practice, Recent Developments and Futu...
 
Operational efficiency using cloud software NEWWA AWWA
Operational efficiency using cloud software NEWWA AWWAOperational efficiency using cloud software NEWWA AWWA
Operational efficiency using cloud software NEWWA AWWA
 
Ambient Air Quality Monitoring in Southern Alberta
Ambient Air Quality Monitoring in Southern AlbertaAmbient Air Quality Monitoring in Southern Alberta
Ambient Air Quality Monitoring in Southern Alberta
 
Estimating Ammonia Emissions from Livestock Operations Using Low-Cost, Time-A...
Estimating Ammonia Emissions from Livestock Operations Using Low-Cost, Time-A...Estimating Ammonia Emissions from Livestock Operations Using Low-Cost, Time-A...
Estimating Ammonia Emissions from Livestock Operations Using Low-Cost, Time-A...
 
ICOS ATC Labeling Process
ICOS ATC Labeling ProcessICOS ATC Labeling Process
ICOS ATC Labeling Process
 
Dragana densitometry 2nd-behydroday_v2
Dragana densitometry 2nd-behydroday_v2Dragana densitometry 2nd-behydroday_v2
Dragana densitometry 2nd-behydroday_v2
 
Downscaling climate information (BC3 Summer School _July 2015)
Downscaling climate information (BC3 Summer School _July 2015)Downscaling climate information (BC3 Summer School _July 2015)
Downscaling climate information (BC3 Summer School _July 2015)
 
Liquid Level Estimation in Dynamic Condition using Kalman Filter
Liquid Level Estimation in Dynamic Condition using Kalman FilterLiquid Level Estimation in Dynamic Condition using Kalman Filter
Liquid Level Estimation in Dynamic Condition using Kalman Filter
 
Julian R - Spatial downscaling of future climate predictions for agriculture ...
Julian R - Spatial downscaling of future climate predictions for agriculture ...Julian R - Spatial downscaling of future climate predictions for agriculture ...
Julian R - Spatial downscaling of future climate predictions for agriculture ...
 
LandGEM
LandGEMLandGEM
LandGEM
 
DMUG 2016 - Prof. Alan Robins, University of Surrey
DMUG 2016 - Prof. Alan Robins, University of SurreyDMUG 2016 - Prof. Alan Robins, University of Surrey
DMUG 2016 - Prof. Alan Robins, University of Surrey
 
Wqtc2013 dist syswq-modeling-20131107
Wqtc2013 dist syswq-modeling-20131107Wqtc2013 dist syswq-modeling-20131107
Wqtc2013 dist syswq-modeling-20131107
 
WCOS GasTrak
WCOS GasTrakWCOS GasTrak
WCOS GasTrak
 
Land gem v 3
Land gem v 3Land gem v 3
Land gem v 3
 
Flood frequency analysis of river kosi, uttarakhand, india using statistical ...
Flood frequency analysis of river kosi, uttarakhand, india using statistical ...Flood frequency analysis of river kosi, uttarakhand, india using statistical ...
Flood frequency analysis of river kosi, uttarakhand, india using statistical ...
 
DSD-INT 2019 Lake Eutrophication Modelling with Delft3D Suite, Wuhan City, Ch...
DSD-INT 2019 Lake Eutrophication Modelling with Delft3D Suite, Wuhan City, Ch...DSD-INT 2019 Lake Eutrophication Modelling with Delft3D Suite, Wuhan City, Ch...
DSD-INT 2019 Lake Eutrophication Modelling with Delft3D Suite, Wuhan City, Ch...
 
1997-07-30 Use of Airmass History Models & Techniques for Source Attribution
1997-07-30 Use of Airmass History Models & Techniques for Source Attribution1997-07-30 Use of Airmass History Models & Techniques for Source Attribution
1997-07-30 Use of Airmass History Models & Techniques for Source Attribution
 

Similar to Quality control of rain gauge measurements using telecommunication microwave links

Pipeline leak detection system
Pipeline leak detection systemPipeline leak detection system
Pipeline leak detection system
Abhijeet Malhotra
 
WMO Field Intercomparison of Rainfall Intensity Gauges WMO/TD-No.1504 2009
WMO Field Intercomparison of Rainfall Intensity Gauges WMO/TD-No.1504 2009WMO Field Intercomparison of Rainfall Intensity Gauges WMO/TD-No.1504 2009
WMO Field Intercomparison of Rainfall Intensity Gauges WMO/TD-No.1504 2009
indiawrm
 
SENSOR NETWORK FOR REAL‐TIME MONITORING AND DETECTION CONTAMINATION IN DRINKI...
SENSOR NETWORK FOR REAL‐TIME MONITORING AND DETECTION CONTAMINATION IN DRINKI...SENSOR NETWORK FOR REAL‐TIME MONITORING AND DETECTION CONTAMINATION IN DRINKI...
SENSOR NETWORK FOR REAL‐TIME MONITORING AND DETECTION CONTAMINATION IN DRINKI...
ijiert bestjournal
 
Quality Control and Measurement Uncertainty
Quality Control and Measurement UncertaintyQuality Control and Measurement Uncertainty
Quality Control and Measurement Uncertainty
CLEEN_Ltd
 
portable_flow_measurement-pr-en PES Scotland NIVUS
portable_flow_measurement-pr-en PES Scotland NIVUSportable_flow_measurement-pr-en PES Scotland NIVUS
portable_flow_measurement-pr-en PES Scotland NIVUS
David White
 
New information sources for rain fields
New information sources for rain fieldsNew information sources for rain fields
New information sources for rain fields
Andreas Scheidegger
 
IRJET- Smart Water Monitoring System for Real-Time Water Quality and Usage Mo...
IRJET- Smart Water Monitoring System for Real-Time Water Quality and Usage Mo...IRJET- Smart Water Monitoring System for Real-Time Water Quality and Usage Mo...
IRJET- Smart Water Monitoring System for Real-Time Water Quality and Usage Mo...
IRJET Journal
 
Cnfms 18-06-14 sai bhaskar
Cnfms  18-06-14 sai bhaskarCnfms  18-06-14 sai bhaskar
Cnfms 18-06-14 sai bhaskar
Sai Bhaskar Reddy Nakka
 
THE PRESSURE SIGNAL CALIBRATION TECHNOLOGY OF THE COMPREHENSIVE TEST SYSTEM
THE PRESSURE SIGNAL CALIBRATION TECHNOLOGY OF THE COMPREHENSIVE TEST SYSTEMTHE PRESSURE SIGNAL CALIBRATION TECHNOLOGY OF THE COMPREHENSIVE TEST SYSTEM
THE PRESSURE SIGNAL CALIBRATION TECHNOLOGY OF THE COMPREHENSIVE TEST SYSTEM
ieijjournal1
 
THE PRESSURE SIGNAL CALIBRATION TECHNOLOGY OF THE COMPREHENSIVE TEST SYSTEM
THE PRESSURE SIGNAL CALIBRATION TECHNOLOGY OF THE COMPREHENSIVE TEST SYSTEMTHE PRESSURE SIGNAL CALIBRATION TECHNOLOGY OF THE COMPREHENSIVE TEST SYSTEM
THE PRESSURE SIGNAL CALIBRATION TECHNOLOGY OF THE COMPREHENSIVE TEST SYSTEM
ieijjournal
 
Advanced gas leakage detection using acoustic sensors new
Advanced gas leakage detection using acoustic sensors newAdvanced gas leakage detection using acoustic sensors new
Advanced gas leakage detection using acoustic sensors new
Yatheesh Kaggere
 
THE PRESSURE SIGNAL CALIBRATION TECHNOLOGY OF THE COMPREHENSIVE TEST SYSTEM
THE PRESSURE SIGNAL CALIBRATION TECHNOLOGY OF THE COMPREHENSIVE TEST SYSTEMTHE PRESSURE SIGNAL CALIBRATION TECHNOLOGY OF THE COMPREHENSIVE TEST SYSTEM
THE PRESSURE SIGNAL CALIBRATION TECHNOLOGY OF THE COMPREHENSIVE TEST SYSTEM
ieijjournal
 
EMI unit -1 introduction to measurements
EMI unit -1 introduction to measurementsEMI unit -1 introduction to measurements
EMI unit -1 introduction to measurements
GopalakrishnaU
 
TESTING OF COST-EFFECTIVE LEAK LOCALIZATION METHOD
TESTING OF COST-EFFECTIVE LEAK LOCALIZATION METHODTESTING OF COST-EFFECTIVE LEAK LOCALIZATION METHOD
TESTING OF COST-EFFECTIVE LEAK LOCALIZATION METHOD
iQHub
 
Wqtc2013 invest ofperformanceprobswitheds-20130910
Wqtc2013 invest ofperformanceprobswitheds-20130910Wqtc2013 invest ofperformanceprobswitheds-20130910
Wqtc2013 invest ofperformanceprobswitheds-20130910
John B. Cook, PE, CEO
 
Basic concepts of instrumentation
Basic concepts of instrumentationBasic concepts of instrumentation
Basic concepts of instrumentation
G. Udhaya Sankar
 
4 emergenze meteo_-_uni_ge_-_caviglia
4 emergenze meteo_-_uni_ge_-_caviglia4 emergenze meteo_-_uni_ge_-_caviglia
4 emergenze meteo_-_uni_ge_-_caviglia
Gter srl Innovazione in Geomatica Gnss e Gis
 
Pipeline Monitoring Using Vibroacoustic Sensing – A Review
Pipeline Monitoring Using Vibroacoustic Sensing – A ReviewPipeline Monitoring Using Vibroacoustic Sensing – A Review
Pipeline Monitoring Using Vibroacoustic Sensing – A Review
IRJET Journal
 
Venturi and orificemeter - Ed Ryan Ruales
Venturi and orificemeter - Ed Ryan RualesVenturi and orificemeter - Ed Ryan Ruales
Venturi and orificemeter - Ed Ryan Ruales
Ed Ryan Ruales
 
Water pipes
Water pipesWater pipes
Water pipes
sudheerchekka1
 

Similar to Quality control of rain gauge measurements using telecommunication microwave links (20)

Pipeline leak detection system
Pipeline leak detection systemPipeline leak detection system
Pipeline leak detection system
 
WMO Field Intercomparison of Rainfall Intensity Gauges WMO/TD-No.1504 2009
WMO Field Intercomparison of Rainfall Intensity Gauges WMO/TD-No.1504 2009WMO Field Intercomparison of Rainfall Intensity Gauges WMO/TD-No.1504 2009
WMO Field Intercomparison of Rainfall Intensity Gauges WMO/TD-No.1504 2009
 
SENSOR NETWORK FOR REAL‐TIME MONITORING AND DETECTION CONTAMINATION IN DRINKI...
SENSOR NETWORK FOR REAL‐TIME MONITORING AND DETECTION CONTAMINATION IN DRINKI...SENSOR NETWORK FOR REAL‐TIME MONITORING AND DETECTION CONTAMINATION IN DRINKI...
SENSOR NETWORK FOR REAL‐TIME MONITORING AND DETECTION CONTAMINATION IN DRINKI...
 
Quality Control and Measurement Uncertainty
Quality Control and Measurement UncertaintyQuality Control and Measurement Uncertainty
Quality Control and Measurement Uncertainty
 
portable_flow_measurement-pr-en PES Scotland NIVUS
portable_flow_measurement-pr-en PES Scotland NIVUSportable_flow_measurement-pr-en PES Scotland NIVUS
portable_flow_measurement-pr-en PES Scotland NIVUS
 
New information sources for rain fields
New information sources for rain fieldsNew information sources for rain fields
New information sources for rain fields
 
IRJET- Smart Water Monitoring System for Real-Time Water Quality and Usage Mo...
IRJET- Smart Water Monitoring System for Real-Time Water Quality and Usage Mo...IRJET- Smart Water Monitoring System for Real-Time Water Quality and Usage Mo...
IRJET- Smart Water Monitoring System for Real-Time Water Quality and Usage Mo...
 
Cnfms 18-06-14 sai bhaskar
Cnfms  18-06-14 sai bhaskarCnfms  18-06-14 sai bhaskar
Cnfms 18-06-14 sai bhaskar
 
THE PRESSURE SIGNAL CALIBRATION TECHNOLOGY OF THE COMPREHENSIVE TEST SYSTEM
THE PRESSURE SIGNAL CALIBRATION TECHNOLOGY OF THE COMPREHENSIVE TEST SYSTEMTHE PRESSURE SIGNAL CALIBRATION TECHNOLOGY OF THE COMPREHENSIVE TEST SYSTEM
THE PRESSURE SIGNAL CALIBRATION TECHNOLOGY OF THE COMPREHENSIVE TEST SYSTEM
 
THE PRESSURE SIGNAL CALIBRATION TECHNOLOGY OF THE COMPREHENSIVE TEST SYSTEM
THE PRESSURE SIGNAL CALIBRATION TECHNOLOGY OF THE COMPREHENSIVE TEST SYSTEMTHE PRESSURE SIGNAL CALIBRATION TECHNOLOGY OF THE COMPREHENSIVE TEST SYSTEM
THE PRESSURE SIGNAL CALIBRATION TECHNOLOGY OF THE COMPREHENSIVE TEST SYSTEM
 
Advanced gas leakage detection using acoustic sensors new
Advanced gas leakage detection using acoustic sensors newAdvanced gas leakage detection using acoustic sensors new
Advanced gas leakage detection using acoustic sensors new
 
THE PRESSURE SIGNAL CALIBRATION TECHNOLOGY OF THE COMPREHENSIVE TEST SYSTEM
THE PRESSURE SIGNAL CALIBRATION TECHNOLOGY OF THE COMPREHENSIVE TEST SYSTEMTHE PRESSURE SIGNAL CALIBRATION TECHNOLOGY OF THE COMPREHENSIVE TEST SYSTEM
THE PRESSURE SIGNAL CALIBRATION TECHNOLOGY OF THE COMPREHENSIVE TEST SYSTEM
 
EMI unit -1 introduction to measurements
EMI unit -1 introduction to measurementsEMI unit -1 introduction to measurements
EMI unit -1 introduction to measurements
 
TESTING OF COST-EFFECTIVE LEAK LOCALIZATION METHOD
TESTING OF COST-EFFECTIVE LEAK LOCALIZATION METHODTESTING OF COST-EFFECTIVE LEAK LOCALIZATION METHOD
TESTING OF COST-EFFECTIVE LEAK LOCALIZATION METHOD
 
Wqtc2013 invest ofperformanceprobswitheds-20130910
Wqtc2013 invest ofperformanceprobswitheds-20130910Wqtc2013 invest ofperformanceprobswitheds-20130910
Wqtc2013 invest ofperformanceprobswitheds-20130910
 
Basic concepts of instrumentation
Basic concepts of instrumentationBasic concepts of instrumentation
Basic concepts of instrumentation
 
4 emergenze meteo_-_uni_ge_-_caviglia
4 emergenze meteo_-_uni_ge_-_caviglia4 emergenze meteo_-_uni_ge_-_caviglia
4 emergenze meteo_-_uni_ge_-_caviglia
 
Pipeline Monitoring Using Vibroacoustic Sensing – A Review
Pipeline Monitoring Using Vibroacoustic Sensing – A ReviewPipeline Monitoring Using Vibroacoustic Sensing – A Review
Pipeline Monitoring Using Vibroacoustic Sensing – A Review
 
Venturi and orificemeter - Ed Ryan Ruales
Venturi and orificemeter - Ed Ryan RualesVenturi and orificemeter - Ed Ryan Ruales
Venturi and orificemeter - Ed Ryan Ruales
 
Water pipes
Water pipesWater pipes
Water pipes
 

Recently uploaded

Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
MichaelKnudsen27
 
inQuba Webinar Mastering Customer Journey Management with Dr Graham Hill
inQuba Webinar Mastering Customer Journey Management with Dr Graham HillinQuba Webinar Mastering Customer Journey Management with Dr Graham Hill
inQuba Webinar Mastering Customer Journey Management with Dr Graham Hill
LizaNolte
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
Jason Packer
 
Northern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
Northern Engraving | Modern Metal Trim, Nameplates and Appliance PanelsNorthern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
Northern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
Northern Engraving
 
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectorsConnector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
DianaGray10
 
Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)
Jakub Marek
 
A Deep Dive into ScyllaDB's Architecture
A Deep Dive into ScyllaDB's ArchitectureA Deep Dive into ScyllaDB's Architecture
A Deep Dive into ScyllaDB's Architecture
ScyllaDB
 
Mutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented ChatbotsMutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented Chatbots
Pablo Gómez Abajo
 
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
Edge AI and Vision Alliance
 
GNSS spoofing via SDR (Criptored Talks 2024)
GNSS spoofing via SDR (Criptored Talks 2024)GNSS spoofing via SDR (Criptored Talks 2024)
GNSS spoofing via SDR (Criptored Talks 2024)
Javier Junquera
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
Chart Kalyan
 
JavaLand 2024: Application Development Green Masterplan
JavaLand 2024: Application Development Green MasterplanJavaLand 2024: Application Development Green Masterplan
JavaLand 2024: Application Development Green Masterplan
Miro Wengner
 
"$10 thousand per minute of downtime: architecture, queues, streaming and fin...
"$10 thousand per minute of downtime: architecture, queues, streaming and fin..."$10 thousand per minute of downtime: architecture, queues, streaming and fin...
"$10 thousand per minute of downtime: architecture, queues, streaming and fin...
Fwdays
 
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
saastr
 
Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
AstuteBusiness
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
ssuserfac0301
 
High performance Serverless Java on AWS- GoTo Amsterdam 2024
High performance Serverless Java on AWS- GoTo Amsterdam 2024High performance Serverless Java on AWS- GoTo Amsterdam 2024
High performance Serverless Java on AWS- GoTo Amsterdam 2024
Vadym Kazulkin
 
Dandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity serverDandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity server
Antonios Katsarakis
 
Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...
Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...
Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...
Pitangent Analytics & Technology Solutions Pvt. Ltd
 
Christine's Supplier Sourcing Presentaion.pptx
Christine's Supplier Sourcing Presentaion.pptxChristine's Supplier Sourcing Presentaion.pptx
Christine's Supplier Sourcing Presentaion.pptx
christinelarrosa
 

Recently uploaded (20)

Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
 
inQuba Webinar Mastering Customer Journey Management with Dr Graham Hill
inQuba Webinar Mastering Customer Journey Management with Dr Graham HillinQuba Webinar Mastering Customer Journey Management with Dr Graham Hill
inQuba Webinar Mastering Customer Journey Management with Dr Graham Hill
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
 
Northern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
Northern Engraving | Modern Metal Trim, Nameplates and Appliance PanelsNorthern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
Northern Engraving | Modern Metal Trim, Nameplates and Appliance Panels
 
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectorsConnector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
 
Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)
 
A Deep Dive into ScyllaDB's Architecture
A Deep Dive into ScyllaDB's ArchitectureA Deep Dive into ScyllaDB's Architecture
A Deep Dive into ScyllaDB's Architecture
 
Mutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented ChatbotsMutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented Chatbots
 
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
 
GNSS spoofing via SDR (Criptored Talks 2024)
GNSS spoofing via SDR (Criptored Talks 2024)GNSS spoofing via SDR (Criptored Talks 2024)
GNSS spoofing via SDR (Criptored Talks 2024)
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
 
JavaLand 2024: Application Development Green Masterplan
JavaLand 2024: Application Development Green MasterplanJavaLand 2024: Application Development Green Masterplan
JavaLand 2024: Application Development Green Masterplan
 
"$10 thousand per minute of downtime: architecture, queues, streaming and fin...
"$10 thousand per minute of downtime: architecture, queues, streaming and fin..."$10 thousand per minute of downtime: architecture, queues, streaming and fin...
"$10 thousand per minute of downtime: architecture, queues, streaming and fin...
 
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
 
Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
 
High performance Serverless Java on AWS- GoTo Amsterdam 2024
High performance Serverless Java on AWS- GoTo Amsterdam 2024High performance Serverless Java on AWS- GoTo Amsterdam 2024
High performance Serverless Java on AWS- GoTo Amsterdam 2024
 
Dandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity serverDandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity server
 
Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...
Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...
Crafting Excellence: A Comprehensive Guide to iOS Mobile App Development Serv...
 
Christine's Supplier Sourcing Presentaion.pptx
Christine's Supplier Sourcing Presentaion.pptxChristine's Supplier Sourcing Presentaion.pptx
Christine's Supplier Sourcing Presentaion.pptx
 

Quality control of rain gauge measurements using telecommunication microwave links

  • 1. Detection of faulty rain gauges using telecommunication microwave links Blandine Bianchi, EPFL Alexis Berne, EPFL Jörg Rieckermann, SWW
  • 2. Take-home message! We need to ensure good data quality! • Create redundant information • Use advanced data analysis techniques
  • 8. Urban Hydrology Data quality control? • At least every two years • Dynamic calibration recommended Stransky, D. et al. (2007) The effect of rainfall measurement uncertainties on rainfall-runoff process modelling Water Science and Technology Vol 55 No 4
  • 9. Urban Water Management Concentrations Control charts for online sensors 40 30 20 10 Sensor value Reference measurement = grab sample 0 11.Jun.01 11. june 01 35 09.Jul.01 06.Aug.01 9. july 01 6. aug 01 63 91 4 Differences In-control 0 -4 Change of membrane Thomann, M. et al. (2002) An efficient monitoring concept with control charts for on-line sensors Water Science and Technology Vol 46 No 4–5 pp 107–116
  • 10. Urban Hydrology Concentrations Quality control for rain gauges 40 30 20 10 Sensor value Reference measurement = grab sample 0 11.Jun.01 11. june 01 35 09.Jul.01 06.Aug.01 9. july 01 6. aug 01 63 91 4 Differences In-control 0 -4 Change of membrane Thomann et al. (2002) We need • Redundant information on precipitation • Statistical quality control methods • Automated procedures
  • 11. Microwave links from telecommunication networks MWL signals are attenuated by rainfall
  • 12. Microwave links from telecommunication networks MWL signals are attenuated by rainfall Rain gauge MWL
  • 13. Microwave links from telecommunication networks MWL signals are attenuated by rainfall
  • 14. Microwave links from telecommunication networks MWL signals are attenuated by rainfall
  • 15. Microwave links from telecommunication networks MWL signals are attenuated by rainfall
  • 16. Idea Using MWL signals for quality control ! . Friedhof Affoltern ! . ! . ! . ARA Glatt ! . Friedhof Nordheim ! . ! . ARA Werdhölzli ! . Glattzentrum ARA Neugut Friedhof Schwamendingen Josefstrasse ! . Friedhof Fluntern Text ! . ! . Völkerkundemuseum Friedhof Friesenberg ! . Legende ! . 0 Regenmesser ERZ und Eawag ORANGE Richtfunkantennen 0.5 1 2 Kilometer 3 4 5 ! . Wasserwerk Moos Friedhof Enzenbühl # *
  • 17. Case study Zurich Quality control of rain gauges Material • 14 operational links (Orange CH), frequencies 23-58 GHz, 0.3 – 8.4 Km, • 14 rain gauges (13 tipping-buckets and 1 weighing).
  • 18. Case study Zurich Quality control of rain gauges Material • 14 operational links (Orange CH), frequencies 23-58 GHz, 0.3 – 8.4 Km, • 14 rain gauges (13 tipping-buckets and 1 weighing). Goal and Methods 1. Detect occurrence of dry/rainy periods => Ratio test 2. Detect quantitative errors => CUSUM control charts
  • 19. Results (1) Detection of dry and rainy periods Ratio test 1. Compute contingency table for reference periods (both sensors are in agreement) Rain Gauge No. 8 [%]
  • 20. Results (1) Detection of dry and rainy periods Ratio test 1. Compute contingency table for reference periods (both sensors are in agreement) 2. Define thresholds faulty: 1% suspicious: 5% Rain Gauge No. 8 [%]
  • 21. Results (1) Detection of dry and rainy periods Ratio test 1. Compute contingency table for reference periods (both sensors are in agreement) 2. Define thresholds faulty: 1% suspicious: 5% 3. Apply classification rule during monitoring period
  • 22. Results (1) Detection of dry and rainy periods Ratio test 1. Compute contingency table for reference periods (both sensors are in agreement) 2. Define thresholds faulty: 1% suspicious: 5% 3. Apply classification rule during monitoring period Rain Gauge No.13
  • 23. Results (2) Detection of quantitative errors CUSUM* control chart Suited to identify small biases/ shifts in process 1. Compute MWL rain rates and target value (reference period) *Montgomery, D.C. (2000) Introduction to Statistical Quality Control, 4th ed. New York: John Wiley & Sons.
  • 24. Results (2) Detection of quantitative errors Rain Gauge No.13 vs. Link No.7 CUSUM CUSUM* control chart Suited to identify small biases/ shifts in process 1. Compute MWL rain rates and target value (reference period) 2. Plotting CUSUM statistic of differences of sensors to check out-of-control *Montgomery, D.C. (2000) Introduction to Statistical Quality Control, 4th ed. New York: John Wiley & Sons.
  • 25. Results (2) Detection of quantitative errors Rain Gauge No.13 vs. Link No.7 CUSUM CUSUM* control chart Suited to identify small biases/ shifts in process 1. Compute MWL rain rates and target value (reference period) 2. Plotting CUSUM statistic of differences of sensors to check out-of-control 3. Apply classification rule during monitoring period *Montgomery, D.C. (2000) Introduction to Statistical Quality Control, 4th ed. New York: John Wiley & Sons.
  • 26. Scenario analysis Testing the sensitivity of the methodology Introducing virtual errors
  • 27. Scenario analyis Testing the sensitivity of the methodology Introducing virtual errors 1. Blockage at 1 [mm/h]
  • 28. Scenario analyis Testing the sensitivity of the methodology Introducing virtual errors 1. Blockage at 1 [mm/h] 2. Relative error of 170%
  • 29. Scenario analyis Testing the sensitivity of the methodology Introducing virtual errors 1. Blockage at 1 [mm/h] 2. Relative error of 170% 3. Random error of 1-10 [mm/h]
  • 30. Conclusions We need to ensure good data quality! • Create redundant information • Use advanced data analysis techniques
  • 31. Conclusions We need to ensure good data quality! • Create redundant information • Use advanced data analysis techniques • We demonstrated the possibility to identify faulty rain gauges using operational telecommunication microwave links (MWL) • The algorithms for process control are straight forward to apply, also in real-time • MWL data are not (yet) generally available Bianchi, B. et al., Detection of faulty rain gauges using telecommunication microwave links (submitted to Journal of Hydrology)

Editor's Notes

  1. One of the most recent has been done by our colleagues from Prague University.Recommendations: OurQuestion: whodoesthisroutinebasis, everytwoyears?Who evenhas a devicefordynamiccalibration?LINK: methodsarethere, availableIdeally, thiswouldbedoneduringoperation, e.g. install a secondgaugerightnextto it. Way somemonths/yearsLetmeshowyouanotherexample
  2. Examplefrom WWTPs,wheretheyusedShewhardcontrolcharts, fromstatisticalprocesscontroltodetermine out ofcontrolsituationof an online Ammonium sensor.Requirement: dailyreferencemeasurements (ormore)
  3. Ideally, thisshouldbepossiblefor rain gaugedata also!Ifpossibleautomated, avoid a lotof personal costtogotothesiteeach time.LINK: so whatcanwe do?