SlideShare a Scribd company logo
Hélène Boisgontier
Deltares Software Days – Kampala 2023
Modelling in a data scarce
environment: the story of
HydroMT
Contents
• Why HydroMT ?
• About HydroMT
• Demo: Building a model with HydroMT
2
Why HydroMT ?
Why do we need models?
We (approximately) know what happened…
• In the past
• At a certain location
4
Why do we need models?
But what will happen in the future?
• Tomorrow
• Next week
• Next year(s): E.g. climate change
And what happens at other locations?
What are the causes of current issues
(water scarcity, poor quality…)?
Or are the land-use management
plans or mitigation measures efficient
and sustainable?
• Reforestation
• Increase of agricultural land…
5
?
Climate Change Population growth
Why do we need models?
Model can help with:
• Better understanding of a complex system
• Assess effects of scenarios or measures and strategies
• Predict into the future
Model can have different forms:
• Simple / lumped
• Complex / gridded
6
Models need data…
• Model construction data
− Base model data (often static or do not vary much in time)
− E.g.: elevation, land-use, river cross-sections…
• Model execution data
− Data to execute the model, like boundary or initial conditions
(often dynamic)
− E.g.: meteorological data (precipitation, wind…), hydrological
data (discharge, groundwater recharge…)
• Model validation data:
− Data to estimate the efficiency of the model, to calibrate and
validate it.
− E.g.: discharge, water level, flood maps…
7
Classical approach
1) Collect local data
2) Collect more local data
3) Collect even more local data
4) Analyse data
5) Build a model
6) Throw away 80% of the collected data
1) Month 1-3
2) Month 3-6
3) Month 6
4) Month 7
5) Month 8-12
6) Month 12
8
Models need data…
Time
Rationale
Examples of (new) datasets
2015 2017
• (Good) data becomes more widely available
• At higher temporal and spatial resolution
• As the data improves, we want to improve our models
Rationale
• (Good) data becomes more widely available
• At higher temporal and spatial resolution
• As the data improves, we want to improve our models
• Need for tools that:
− Operate on these datasets
− Are easy to use (for modelling experts (!))
− Support the modellers by doing the “hard” & “boring” work
− Support developments in enhancing these datasets
− Support re-using methods and workflows for different models
• Hence, HydroMT was born!
10
GIS
processing
Classical approach
1) Collect local data
2) Collect more local data
3) Collect even more local data
4) Analyse data
5) Build a model
6) Throw away 80% of the collected data
New approach
1) Build an initial model base on available
(global) data
2) Discuss where improvements are required and
which data is missing
3) Collect local data
4) Analyse data
5) Improve the model with the new data
11
Model approach with hydroMT
About HydroMT
12 October 2022
About HydroMT
HydroMT (Hydro Model Tools) is an open-source Python package at the interface between
data, users, and water system models.
It includes GIS, hydrological, statistical and plotting methods needed for rapidly building inter-connected
environmental models for hydrology, water quality, groundwater, water resources and environmental
impacts applications.
13
Build Update Plot Stat
Cloud-ready
Scalable
Reproducible
Flexible
Fast
About HydroMT
• Open Source
• Available on Github
• MIT license
• Releases on pypi and conda for easier installation
• Online documentation and interactive examples
with Binder
• Works via command line
14
> hydromt build wflow “my_model” “{‘basin’: [x,y]}”
-i wflow_build.ini -d data_catalog.yml -vv
About HydroMT
• Data-centred model building with HydroMT
− Rapid model building/updating globally
15
Useful in quick scan analysis
Ventiane Laos example: flood hazard and impact mapping
wflow + SFINCS + Delft-FIAT
Useful in data-scarce regions
Coumpound flood modelling Mozambique
About HydroMT
• Data-centred model building with HydroMT
− Rapid model building /updating globally
− Small to large applications
16
AXA Western Europe
World Water Quality Assessment
About HydroMT
• Data-centred model building with HydroMT
− Rapid model building /updating globally
− Small to large applications
− Operate on global and local datasets (data harmonization)
17
Global population grid
Mines locations
Regional statistics
Water Quality Diagnostic in Peru
Mix of 40+ emission data from global and local sources
About HydroMT
• Data-centred model building with HydroMT
− Rapid model building /updating globally
− Small to large applications
− Operate on global and local datasets (data harmonization)
− Support developments in enhancing these local datasets
18
BMA Bangkok
Improving local data to build Delft3DFM models
About HydroMT
• Data-centred model building with HydroMT
− Rapid model building /updating globally
− Small to large applications
− Operate on global and local datasets (data harmonization)
− Support developments in enhancing these local datasets
− Modular tool: methods and workflows can be reused for different
models (plugins)
19
Steps to run HydroMT
Building a model
• Steps to build a model
1. Select the data you want to use, download if needed,
and prepare a data catalog or use a pre-defined one.
2. Select your region of interest.
3. Select the model components you want to build
and the options (data source, resampling method
etc.) by preparing a model configuration file or
use a pre-defined one.
4. Build your model using the Command Line Interface (CLI) or Python.
21
HydroMT documentation:
https://deltares.github.io/hydromt/latest/user_guide/model_build.html
> hydromt build wflow “my_model” “{‘basin’: [x,y]}” -i wflow_build.ini -d data_catalog.yml -vv
Demo video
Building a first wflow model for the Mara river
Building another one for Mbalangeti river
Updating the climate data
Building a Delft3D FM model
Take away
Using HydroMT
• Approach data at the center of model building
− First get a model from (global) available data
− Improve with local data
• Usage
− Many types of projects and a lot of applications use HydroMT directly
− Tools powered by HydroMT: Climate Stress Test Toolbox, FloodAdapt
• Available plugins
− wflow
− D-Flow FM (Delft3D FM Suite)
− SFINCS
− Delft-FIAT
− DELWAQ (kernel of the D-Water Quality and D-Emissions modules of the Delft3D FM Suite)
28
Upcoming features
• Data: reduce effort to download data and write data catalogs
− Use data from public clouds like Google GCS or Amazon AWS
− Use data available via API like OpenStreetMap or Copernicus
− Use directly download-able data through https like wind atlas or many more
• Models: make it easier to prepare data without a plugin
− ‘Generic’ models like GridModel (regular grid), MeshModel (unstructured grid), VectorModel (lumped and
semi-distributed), NetworkModel (networks)
− Generic models helps prepare all data required but in common GIS formats rather than model formats
• Others:
− Commands and tools to help analyze or export and share data
− Commands and tools to help quickly visualize and analyze model results
− Conversion commands to convert model data to common GIS formats (new data or connect models)
29
Links HydroMT and HydroMT-wflow
• HydroMT docs: https://deltares.github.io/hydromt/latest/
• Github HydroMT: https://github.com/Deltares/hydromt
• Plugins:
− HydroMT wflow: https://deltares.github.io/hydromt_wflow/
− HydroMT SFINCS: https://deltares.github.io/hydromt_sfincs/
− HydroMT FIAT: https://deltares.github.io/hydromt_fiat/
− HydroMT DELWAQ: https://deltares.github.io/hydromt_delwaq/
− HydroMT D-Flow FM: https://deltares.github.io/hydromt_delft3dfm/
Thank you for your attention!
www.deltares.nl
info@deltares.nl
@deltares
@deltares
linkedin.com/company/deltares
facebook.com/deltaresNL

More Related Content

Similar to DSD-Kampala 2023 Modelling in a data scarce environment - the story of HydroMT - Boisgontier

DGterzo
DGterzoDGterzo
DSD-INT 2019 Modelling in DANUBIUS-RI-Bellafiore
DSD-INT 2019 Modelling in DANUBIUS-RI-BellafioreDSD-INT 2019 Modelling in DANUBIUS-RI-Bellafiore
DSD-INT 2019 Modelling in DANUBIUS-RI-Bellafiore
Deltares
 
First online hangout SC5 - Big Data Europe first pilot-presentation-hangout
First online hangout SC5 - Big Data Europe  first pilot-presentation-hangoutFirst online hangout SC5 - Big Data Europe  first pilot-presentation-hangout
First online hangout SC5 - Big Data Europe first pilot-presentation-hangout
BigData_Europe
 
22 - CSIRO - Water Data Management-Sep-17
22 - CSIRO - Water Data Management-Sep-1722 - CSIRO - Water Data Management-Sep-17
22 - CSIRO - Water Data Management-Sep-17
indiawrm
 
Presentation
PresentationPresentation
Presentation
bolu804
 
DSD-INT 2019 Global Data Services and Analysis Frameworks-Luijendijk
DSD-INT 2019 Global Data Services and Analysis Frameworks-LuijendijkDSD-INT 2019 Global Data Services and Analysis Frameworks-Luijendijk
DSD-INT 2019 Global Data Services and Analysis Frameworks-Luijendijk
Deltares
 
COINS CV
COINS CVCOINS CV
COINS CV
Mohamed Gibrel
 
Accès ouvert aux données météorologiques d’Environnement Canada
Accès ouvert aux données météorologiques d’Environnement CanadaAccès ouvert aux données météorologiques d’Environnement Canada
Accès ouvert aux données météorologiques d’Environnement Canada
VisionGEOMATIQUE2014
 
Wastewater networks modeling using info works cs
Wastewater networks modeling using info works csWastewater networks modeling using info works cs
Wastewater networks modeling using info works cs
AHMED NADIM JILANI
 
Models Done Better... - UDG2018 - Intertek and DHI
Models Done Better... - UDG2018 - Intertek and DHIModels Done Better... - UDG2018 - Intertek and DHI
Models Done Better... - UDG2018 - Intertek and DHI
Stephen Flood
 
big_data_casestudies_2.ppt
big_data_casestudies_2.pptbig_data_casestudies_2.ppt
big_data_casestudies_2.ppt
vishal choudhary
 
A Framework for Data Collection, Transformation and Processing in industrial...
A Framework for Data Collection,  Transformation and Processing in industrial...A Framework for Data Collection,  Transformation and Processing in industrial...
A Framework for Data Collection, Transformation and Processing in industrial...
FAST-Lab. Factory Automation Systems and Technologies Laboratory, Tampere University of Technology
 
Experimental transformation of ABS data into Data Cube Vocabulary (DCV) form...
Experimental transformation of  ABS data into Data Cube Vocabulary (DCV) form...Experimental transformation of  ABS data into Data Cube Vocabulary (DCV) form...
Experimental transformation of ABS data into Data Cube Vocabulary (DCV) form...
Alistair Hamilton
 
Khatibi lecture cov.uni
Khatibi lecture cov.uniKhatibi lecture cov.uni
Khatibi lecture cov.uni
Rahman Khatibi
 
Big Data HPC Convergence and a bunch of other things
Big Data HPC Convergence and a bunch of other thingsBig Data HPC Convergence and a bunch of other things
Big Data HPC Convergence and a bunch of other things
Geoffrey Fox
 
PERICLES Workflow for the automated updating of Digital Ecosystem Models with...
PERICLES Workflow for the automated updating of Digital Ecosystem Models with...PERICLES Workflow for the automated updating of Digital Ecosystem Models with...
PERICLES Workflow for the automated updating of Digital Ecosystem Models with...
PERICLES_FP7
 
Big Data in Action : Operations, Analytics and more
Big Data in Action : Operations, Analytics and moreBig Data in Action : Operations, Analytics and more
Big Data in Action : Operations, Analytics and more
Softweb Solutions
 
FIWARE Wednesday Webinars - Cities as Enablers of the Data Economy: Smart Dat...
FIWARE Wednesday Webinars - Cities as Enablers of the Data Economy: Smart Dat...FIWARE Wednesday Webinars - Cities as Enablers of the Data Economy: Smart Dat...
FIWARE Wednesday Webinars - Cities as Enablers of the Data Economy: Smart Dat...
FIWARE
 
Data‐intensive hydrologic modeling: A Cloud strategy for integrating PIHM, GI...
Data‐intensive hydrologic modeling: A Cloud strategy for integrating PIHM, GI...Data‐intensive hydrologic modeling: A Cloud strategy for integrating PIHM, GI...
Data‐intensive hydrologic modeling: A Cloud strategy for integrating PIHM, GI...
lleonardSlideShare
 
High Performance Data Analytics and a Java Grande Run Time
High Performance Data Analytics and a Java Grande Run TimeHigh Performance Data Analytics and a Java Grande Run Time
High Performance Data Analytics and a Java Grande Run Time
Geoffrey Fox
 

Similar to DSD-Kampala 2023 Modelling in a data scarce environment - the story of HydroMT - Boisgontier (20)

DGterzo
DGterzoDGterzo
DGterzo
 
DSD-INT 2019 Modelling in DANUBIUS-RI-Bellafiore
DSD-INT 2019 Modelling in DANUBIUS-RI-BellafioreDSD-INT 2019 Modelling in DANUBIUS-RI-Bellafiore
DSD-INT 2019 Modelling in DANUBIUS-RI-Bellafiore
 
First online hangout SC5 - Big Data Europe first pilot-presentation-hangout
First online hangout SC5 - Big Data Europe  first pilot-presentation-hangoutFirst online hangout SC5 - Big Data Europe  first pilot-presentation-hangout
First online hangout SC5 - Big Data Europe first pilot-presentation-hangout
 
22 - CSIRO - Water Data Management-Sep-17
22 - CSIRO - Water Data Management-Sep-1722 - CSIRO - Water Data Management-Sep-17
22 - CSIRO - Water Data Management-Sep-17
 
Presentation
PresentationPresentation
Presentation
 
DSD-INT 2019 Global Data Services and Analysis Frameworks-Luijendijk
DSD-INT 2019 Global Data Services and Analysis Frameworks-LuijendijkDSD-INT 2019 Global Data Services and Analysis Frameworks-Luijendijk
DSD-INT 2019 Global Data Services and Analysis Frameworks-Luijendijk
 
COINS CV
COINS CVCOINS CV
COINS CV
 
Accès ouvert aux données météorologiques d’Environnement Canada
Accès ouvert aux données météorologiques d’Environnement CanadaAccès ouvert aux données météorologiques d’Environnement Canada
Accès ouvert aux données météorologiques d’Environnement Canada
 
Wastewater networks modeling using info works cs
Wastewater networks modeling using info works csWastewater networks modeling using info works cs
Wastewater networks modeling using info works cs
 
Models Done Better... - UDG2018 - Intertek and DHI
Models Done Better... - UDG2018 - Intertek and DHIModels Done Better... - UDG2018 - Intertek and DHI
Models Done Better... - UDG2018 - Intertek and DHI
 
big_data_casestudies_2.ppt
big_data_casestudies_2.pptbig_data_casestudies_2.ppt
big_data_casestudies_2.ppt
 
A Framework for Data Collection, Transformation and Processing in industrial...
A Framework for Data Collection,  Transformation and Processing in industrial...A Framework for Data Collection,  Transformation and Processing in industrial...
A Framework for Data Collection, Transformation and Processing in industrial...
 
Experimental transformation of ABS data into Data Cube Vocabulary (DCV) form...
Experimental transformation of  ABS data into Data Cube Vocabulary (DCV) form...Experimental transformation of  ABS data into Data Cube Vocabulary (DCV) form...
Experimental transformation of ABS data into Data Cube Vocabulary (DCV) form...
 
Khatibi lecture cov.uni
Khatibi lecture cov.uniKhatibi lecture cov.uni
Khatibi lecture cov.uni
 
Big Data HPC Convergence and a bunch of other things
Big Data HPC Convergence and a bunch of other thingsBig Data HPC Convergence and a bunch of other things
Big Data HPC Convergence and a bunch of other things
 
PERICLES Workflow for the automated updating of Digital Ecosystem Models with...
PERICLES Workflow for the automated updating of Digital Ecosystem Models with...PERICLES Workflow for the automated updating of Digital Ecosystem Models with...
PERICLES Workflow for the automated updating of Digital Ecosystem Models with...
 
Big Data in Action : Operations, Analytics and more
Big Data in Action : Operations, Analytics and moreBig Data in Action : Operations, Analytics and more
Big Data in Action : Operations, Analytics and more
 
FIWARE Wednesday Webinars - Cities as Enablers of the Data Economy: Smart Dat...
FIWARE Wednesday Webinars - Cities as Enablers of the Data Economy: Smart Dat...FIWARE Wednesday Webinars - Cities as Enablers of the Data Economy: Smart Dat...
FIWARE Wednesday Webinars - Cities as Enablers of the Data Economy: Smart Dat...
 
Data‐intensive hydrologic modeling: A Cloud strategy for integrating PIHM, GI...
Data‐intensive hydrologic modeling: A Cloud strategy for integrating PIHM, GI...Data‐intensive hydrologic modeling: A Cloud strategy for integrating PIHM, GI...
Data‐intensive hydrologic modeling: A Cloud strategy for integrating PIHM, GI...
 
High Performance Data Analytics and a Java Grande Run Time
High Performance Data Analytics and a Java Grande Run TimeHigh Performance Data Analytics and a Java Grande Run Time
High Performance Data Analytics and a Java Grande Run Time
 

More from Deltares

DSD-INT 2023 Hydrology User Days - Intro - Day 3 - Kroon
DSD-INT 2023 Hydrology User Days - Intro - Day 3 - KroonDSD-INT 2023 Hydrology User Days - Intro - Day 3 - Kroon
DSD-INT 2023 Hydrology User Days - Intro - Day 3 - Kroon
Deltares
 
DSD-INT 2023 Demo EPIC Response Assessment Methodology (ERAM) - Couvin Rodriguez
DSD-INT 2023 Demo EPIC Response Assessment Methodology (ERAM) - Couvin RodriguezDSD-INT 2023 Demo EPIC Response Assessment Methodology (ERAM) - Couvin Rodriguez
DSD-INT 2023 Demo EPIC Response Assessment Methodology (ERAM) - Couvin Rodriguez
Deltares
 
DSD-INT 2023 Demo Climate Stress Testing Tool (CST Tool) - Taner
DSD-INT 2023 Demo Climate Stress Testing Tool (CST Tool) - TanerDSD-INT 2023 Demo Climate Stress Testing Tool (CST Tool) - Taner
DSD-INT 2023 Demo Climate Stress Testing Tool (CST Tool) - Taner
Deltares
 
DSD-INT 2023 Demo Climate Resilient Cities Tool (CRC Tool) - Rooze
DSD-INT 2023 Demo Climate Resilient Cities Tool (CRC Tool) - RoozeDSD-INT 2023 Demo Climate Resilient Cities Tool (CRC Tool) - Rooze
DSD-INT 2023 Demo Climate Resilient Cities Tool (CRC Tool) - Rooze
Deltares
 
DSD-INT 2023 Approaches for assessing multi-hazard risk - Ward
DSD-INT 2023 Approaches for assessing multi-hazard risk - WardDSD-INT 2023 Approaches for assessing multi-hazard risk - Ward
DSD-INT 2023 Approaches for assessing multi-hazard risk - Ward
Deltares
 
DSD-INT 2023 Dynamic Adaptive Policy Pathways (DAPP) - Theory & Showcase - Wa...
DSD-INT 2023 Dynamic Adaptive Policy Pathways (DAPP) - Theory & Showcase - Wa...DSD-INT 2023 Dynamic Adaptive Policy Pathways (DAPP) - Theory & Showcase - Wa...
DSD-INT 2023 Dynamic Adaptive Policy Pathways (DAPP) - Theory & Showcase - Wa...
Deltares
 
DSD-INT 2023 Global hydrological modelling to support worldwide water assessm...
DSD-INT 2023 Global hydrological modelling to support worldwide water assessm...DSD-INT 2023 Global hydrological modelling to support worldwide water assessm...
DSD-INT 2023 Global hydrological modelling to support worldwide water assessm...
Deltares
 
DSD-INT 2023 Modelling implications - IPCC Working Group II - From AR6 to AR7...
DSD-INT 2023 Modelling implications - IPCC Working Group II - From AR6 to AR7...DSD-INT 2023 Modelling implications - IPCC Working Group II - From AR6 to AR7...
DSD-INT 2023 Modelling implications - IPCC Working Group II - From AR6 to AR7...
Deltares
 
DSD-INT 2023 Knowledge and tools for Climate Adaptation - Jeuken
DSD-INT 2023 Knowledge and tools for Climate Adaptation - JeukenDSD-INT 2023 Knowledge and tools for Climate Adaptation - Jeuken
DSD-INT 2023 Knowledge and tools for Climate Adaptation - Jeuken
Deltares
 
DSD-INT 2023 Coupling RIBASIM to a MODFLOW groundwater model - Bootsma
DSD-INT 2023 Coupling RIBASIM to a MODFLOW groundwater model - BootsmaDSD-INT 2023 Coupling RIBASIM to a MODFLOW groundwater model - Bootsma
DSD-INT 2023 Coupling RIBASIM to a MODFLOW groundwater model - Bootsma
Deltares
 
DSD-INT 2023 Create your own MODFLOW 6 sub-variant - Muller
DSD-INT 2023 Create your own MODFLOW 6 sub-variant - MullerDSD-INT 2023 Create your own MODFLOW 6 sub-variant - Muller
DSD-INT 2023 Create your own MODFLOW 6 sub-variant - Muller
Deltares
 
DSD-INT 2023 Example of unstructured MODFLOW 6 modelling in California - Romero
DSD-INT 2023 Example of unstructured MODFLOW 6 modelling in California - RomeroDSD-INT 2023 Example of unstructured MODFLOW 6 modelling in California - Romero
DSD-INT 2023 Example of unstructured MODFLOW 6 modelling in California - Romero
Deltares
 
DSD-INT 2023 Challenges and developments in groundwater modeling - Bakker
DSD-INT 2023 Challenges and developments in groundwater modeling - BakkerDSD-INT 2023 Challenges and developments in groundwater modeling - Bakker
DSD-INT 2023 Challenges and developments in groundwater modeling - Bakker
Deltares
 
DSD-INT 2023 Demo new features iMOD Suite - van Engelen
DSD-INT 2023 Demo new features iMOD Suite - van EngelenDSD-INT 2023 Demo new features iMOD Suite - van Engelen
DSD-INT 2023 Demo new features iMOD Suite - van Engelen
Deltares
 
DSD-INT 2023 iMOD and new developments - Davids
DSD-INT 2023 iMOD and new developments - DavidsDSD-INT 2023 iMOD and new developments - Davids
DSD-INT 2023 iMOD and new developments - Davids
Deltares
 
DSD-INT 2023 Recent MODFLOW Developments - Langevin
DSD-INT 2023 Recent MODFLOW Developments - LangevinDSD-INT 2023 Recent MODFLOW Developments - Langevin
DSD-INT 2023 Recent MODFLOW Developments - Langevin
Deltares
 
DSD-INT 2023 Needs related to user interfaces - Snippen
DSD-INT 2023 Needs related to user interfaces - SnippenDSD-INT 2023 Needs related to user interfaces - Snippen
DSD-INT 2023 Needs related to user interfaces - Snippen
Deltares
 
DSD-INT 2023 Coupling RIBASIM to a MODFLOW groundwater model - Bootsma
DSD-INT 2023 Coupling RIBASIM to a MODFLOW groundwater model - BootsmaDSD-INT 2023 Coupling RIBASIM to a MODFLOW groundwater model - Bootsma
DSD-INT 2023 Coupling RIBASIM to a MODFLOW groundwater model - Bootsma
Deltares
 
DSD-INT 2023 Parameterization of a RIBASIM model and the network lumping appr...
DSD-INT 2023 Parameterization of a RIBASIM model and the network lumping appr...DSD-INT 2023 Parameterization of a RIBASIM model and the network lumping appr...
DSD-INT 2023 Parameterization of a RIBASIM model and the network lumping appr...
Deltares
 
DSD-INT 2023 Parameterization of RIBASIM and flexibility in the lumped approa...
DSD-INT 2023 Parameterization of RIBASIM and flexibility in the lumped approa...DSD-INT 2023 Parameterization of RIBASIM and flexibility in the lumped approa...
DSD-INT 2023 Parameterization of RIBASIM and flexibility in the lumped approa...
Deltares
 

More from Deltares (20)

DSD-INT 2023 Hydrology User Days - Intro - Day 3 - Kroon
DSD-INT 2023 Hydrology User Days - Intro - Day 3 - KroonDSD-INT 2023 Hydrology User Days - Intro - Day 3 - Kroon
DSD-INT 2023 Hydrology User Days - Intro - Day 3 - Kroon
 
DSD-INT 2023 Demo EPIC Response Assessment Methodology (ERAM) - Couvin Rodriguez
DSD-INT 2023 Demo EPIC Response Assessment Methodology (ERAM) - Couvin RodriguezDSD-INT 2023 Demo EPIC Response Assessment Methodology (ERAM) - Couvin Rodriguez
DSD-INT 2023 Demo EPIC Response Assessment Methodology (ERAM) - Couvin Rodriguez
 
DSD-INT 2023 Demo Climate Stress Testing Tool (CST Tool) - Taner
DSD-INT 2023 Demo Climate Stress Testing Tool (CST Tool) - TanerDSD-INT 2023 Demo Climate Stress Testing Tool (CST Tool) - Taner
DSD-INT 2023 Demo Climate Stress Testing Tool (CST Tool) - Taner
 
DSD-INT 2023 Demo Climate Resilient Cities Tool (CRC Tool) - Rooze
DSD-INT 2023 Demo Climate Resilient Cities Tool (CRC Tool) - RoozeDSD-INT 2023 Demo Climate Resilient Cities Tool (CRC Tool) - Rooze
DSD-INT 2023 Demo Climate Resilient Cities Tool (CRC Tool) - Rooze
 
DSD-INT 2023 Approaches for assessing multi-hazard risk - Ward
DSD-INT 2023 Approaches for assessing multi-hazard risk - WardDSD-INT 2023 Approaches for assessing multi-hazard risk - Ward
DSD-INT 2023 Approaches for assessing multi-hazard risk - Ward
 
DSD-INT 2023 Dynamic Adaptive Policy Pathways (DAPP) - Theory & Showcase - Wa...
DSD-INT 2023 Dynamic Adaptive Policy Pathways (DAPP) - Theory & Showcase - Wa...DSD-INT 2023 Dynamic Adaptive Policy Pathways (DAPP) - Theory & Showcase - Wa...
DSD-INT 2023 Dynamic Adaptive Policy Pathways (DAPP) - Theory & Showcase - Wa...
 
DSD-INT 2023 Global hydrological modelling to support worldwide water assessm...
DSD-INT 2023 Global hydrological modelling to support worldwide water assessm...DSD-INT 2023 Global hydrological modelling to support worldwide water assessm...
DSD-INT 2023 Global hydrological modelling to support worldwide water assessm...
 
DSD-INT 2023 Modelling implications - IPCC Working Group II - From AR6 to AR7...
DSD-INT 2023 Modelling implications - IPCC Working Group II - From AR6 to AR7...DSD-INT 2023 Modelling implications - IPCC Working Group II - From AR6 to AR7...
DSD-INT 2023 Modelling implications - IPCC Working Group II - From AR6 to AR7...
 
DSD-INT 2023 Knowledge and tools for Climate Adaptation - Jeuken
DSD-INT 2023 Knowledge and tools for Climate Adaptation - JeukenDSD-INT 2023 Knowledge and tools for Climate Adaptation - Jeuken
DSD-INT 2023 Knowledge and tools for Climate Adaptation - Jeuken
 
DSD-INT 2023 Coupling RIBASIM to a MODFLOW groundwater model - Bootsma
DSD-INT 2023 Coupling RIBASIM to a MODFLOW groundwater model - BootsmaDSD-INT 2023 Coupling RIBASIM to a MODFLOW groundwater model - Bootsma
DSD-INT 2023 Coupling RIBASIM to a MODFLOW groundwater model - Bootsma
 
DSD-INT 2023 Create your own MODFLOW 6 sub-variant - Muller
DSD-INT 2023 Create your own MODFLOW 6 sub-variant - MullerDSD-INT 2023 Create your own MODFLOW 6 sub-variant - Muller
DSD-INT 2023 Create your own MODFLOW 6 sub-variant - Muller
 
DSD-INT 2023 Example of unstructured MODFLOW 6 modelling in California - Romero
DSD-INT 2023 Example of unstructured MODFLOW 6 modelling in California - RomeroDSD-INT 2023 Example of unstructured MODFLOW 6 modelling in California - Romero
DSD-INT 2023 Example of unstructured MODFLOW 6 modelling in California - Romero
 
DSD-INT 2023 Challenges and developments in groundwater modeling - Bakker
DSD-INT 2023 Challenges and developments in groundwater modeling - BakkerDSD-INT 2023 Challenges and developments in groundwater modeling - Bakker
DSD-INT 2023 Challenges and developments in groundwater modeling - Bakker
 
DSD-INT 2023 Demo new features iMOD Suite - van Engelen
DSD-INT 2023 Demo new features iMOD Suite - van EngelenDSD-INT 2023 Demo new features iMOD Suite - van Engelen
DSD-INT 2023 Demo new features iMOD Suite - van Engelen
 
DSD-INT 2023 iMOD and new developments - Davids
DSD-INT 2023 iMOD and new developments - DavidsDSD-INT 2023 iMOD and new developments - Davids
DSD-INT 2023 iMOD and new developments - Davids
 
DSD-INT 2023 Recent MODFLOW Developments - Langevin
DSD-INT 2023 Recent MODFLOW Developments - LangevinDSD-INT 2023 Recent MODFLOW Developments - Langevin
DSD-INT 2023 Recent MODFLOW Developments - Langevin
 
DSD-INT 2023 Needs related to user interfaces - Snippen
DSD-INT 2023 Needs related to user interfaces - SnippenDSD-INT 2023 Needs related to user interfaces - Snippen
DSD-INT 2023 Needs related to user interfaces - Snippen
 
DSD-INT 2023 Coupling RIBASIM to a MODFLOW groundwater model - Bootsma
DSD-INT 2023 Coupling RIBASIM to a MODFLOW groundwater model - BootsmaDSD-INT 2023 Coupling RIBASIM to a MODFLOW groundwater model - Bootsma
DSD-INT 2023 Coupling RIBASIM to a MODFLOW groundwater model - Bootsma
 
DSD-INT 2023 Parameterization of a RIBASIM model and the network lumping appr...
DSD-INT 2023 Parameterization of a RIBASIM model and the network lumping appr...DSD-INT 2023 Parameterization of a RIBASIM model and the network lumping appr...
DSD-INT 2023 Parameterization of a RIBASIM model and the network lumping appr...
 
DSD-INT 2023 Parameterization of RIBASIM and flexibility in the lumped approa...
DSD-INT 2023 Parameterization of RIBASIM and flexibility in the lumped approa...DSD-INT 2023 Parameterization of RIBASIM and flexibility in the lumped approa...
DSD-INT 2023 Parameterization of RIBASIM and flexibility in the lumped approa...
 

Recently uploaded

UI5con 2024 - Keynote: Latest News about UI5 and it’s Ecosystem
UI5con 2024 - Keynote: Latest News about UI5 and it’s EcosystemUI5con 2024 - Keynote: Latest News about UI5 and it’s Ecosystem
UI5con 2024 - Keynote: Latest News about UI5 and it’s Ecosystem
Peter Muessig
 
Lecture 2 - software testing SE 412.pptx
Lecture 2 - software testing SE 412.pptxLecture 2 - software testing SE 412.pptx
Lecture 2 - software testing SE 412.pptx
TaghreedAltamimi
 
ALGIT - Assembly Line for Green IT - Numbers, Data, Facts
ALGIT - Assembly Line for Green IT - Numbers, Data, FactsALGIT - Assembly Line for Green IT - Numbers, Data, Facts
ALGIT - Assembly Line for Green IT - Numbers, Data, Facts
Green Software Development
 
E-Invoicing Implementation: A Step-by-Step Guide for Saudi Arabian Companies
E-Invoicing Implementation: A Step-by-Step Guide for Saudi Arabian CompaniesE-Invoicing Implementation: A Step-by-Step Guide for Saudi Arabian Companies
E-Invoicing Implementation: A Step-by-Step Guide for Saudi Arabian Companies
Quickdice ERP
 
Requirement Traceability in Xen Functional Safety
Requirement Traceability in Xen Functional SafetyRequirement Traceability in Xen Functional Safety
Requirement Traceability in Xen Functional Safety
Ayan Halder
 
Need for Speed: Removing speed bumps from your Symfony projects ⚡️
Need for Speed: Removing speed bumps from your Symfony projects ⚡️Need for Speed: Removing speed bumps from your Symfony projects ⚡️
Need for Speed: Removing speed bumps from your Symfony projects ⚡️
Łukasz Chruściel
 
Transform Your Communication with Cloud-Based IVR Solutions
Transform Your Communication with Cloud-Based IVR SolutionsTransform Your Communication with Cloud-Based IVR Solutions
Transform Your Communication with Cloud-Based IVR Solutions
TheSMSPoint
 
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Neo4j - Product Vision and Knowledge Graphs - GraphSummit ParisNeo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Neo4j
 
Webinar On-Demand: Using Flutter for Embedded
Webinar On-Demand: Using Flutter for EmbeddedWebinar On-Demand: Using Flutter for Embedded
Webinar On-Demand: Using Flutter for Embedded
ICS
 
E-commerce Development Services- Hornet Dynamics
E-commerce Development Services- Hornet DynamicsE-commerce Development Services- Hornet Dynamics
E-commerce Development Services- Hornet Dynamics
Hornet Dynamics
 
OpenMetadata Community Meeting - 5th June 2024
OpenMetadata Community Meeting - 5th June 2024OpenMetadata Community Meeting - 5th June 2024
OpenMetadata Community Meeting - 5th June 2024
OpenMetadata
 
Empowering Growth with Best Software Development Company in Noida - Deuglo
Empowering Growth with Best Software  Development Company in Noida - DeugloEmpowering Growth with Best Software  Development Company in Noida - Deuglo
Empowering Growth with Best Software Development Company in Noida - Deuglo
Deuglo Infosystem Pvt Ltd
 
Microservice Teams - How the cloud changes the way we work
Microservice Teams - How the cloud changes the way we workMicroservice Teams - How the cloud changes the way we work
Microservice Teams - How the cloud changes the way we work
Sven Peters
 
Mobile App Development Company In Noida | Drona Infotech
Mobile App Development Company In Noida | Drona InfotechMobile App Development Company In Noida | Drona Infotech
Mobile App Development Company In Noida | Drona Infotech
Drona Infotech
 
openEuler Case Study - The Journey to Supply Chain Security
openEuler Case Study - The Journey to Supply Chain SecurityopenEuler Case Study - The Journey to Supply Chain Security
openEuler Case Study - The Journey to Supply Chain Security
Shane Coughlan
 
GreenCode-A-VSCode-Plugin--Dario-Jurisic
GreenCode-A-VSCode-Plugin--Dario-JurisicGreenCode-A-VSCode-Plugin--Dario-Jurisic
GreenCode-A-VSCode-Plugin--Dario-Jurisic
Green Software Development
 
UI5con 2024 - Bring Your Own Design System
UI5con 2024 - Bring Your Own Design SystemUI5con 2024 - Bring Your Own Design System
UI5con 2024 - Bring Your Own Design System
Peter Muessig
 
Graspan: A Big Data System for Big Code Analysis
Graspan: A Big Data System for Big Code AnalysisGraspan: A Big Data System for Big Code Analysis
Graspan: A Big Data System for Big Code Analysis
Aftab Hussain
 
socradar-q1-2024-aviation-industry-report.pdf
socradar-q1-2024-aviation-industry-report.pdfsocradar-q1-2024-aviation-industry-report.pdf
socradar-q1-2024-aviation-industry-report.pdf
SOCRadar
 
SMS API Integration in Saudi Arabia| Best SMS API Service
SMS API Integration in Saudi Arabia| Best SMS API ServiceSMS API Integration in Saudi Arabia| Best SMS API Service
SMS API Integration in Saudi Arabia| Best SMS API Service
Yara Milbes
 

Recently uploaded (20)

UI5con 2024 - Keynote: Latest News about UI5 and it’s Ecosystem
UI5con 2024 - Keynote: Latest News about UI5 and it’s EcosystemUI5con 2024 - Keynote: Latest News about UI5 and it’s Ecosystem
UI5con 2024 - Keynote: Latest News about UI5 and it’s Ecosystem
 
Lecture 2 - software testing SE 412.pptx
Lecture 2 - software testing SE 412.pptxLecture 2 - software testing SE 412.pptx
Lecture 2 - software testing SE 412.pptx
 
ALGIT - Assembly Line for Green IT - Numbers, Data, Facts
ALGIT - Assembly Line for Green IT - Numbers, Data, FactsALGIT - Assembly Line for Green IT - Numbers, Data, Facts
ALGIT - Assembly Line for Green IT - Numbers, Data, Facts
 
E-Invoicing Implementation: A Step-by-Step Guide for Saudi Arabian Companies
E-Invoicing Implementation: A Step-by-Step Guide for Saudi Arabian CompaniesE-Invoicing Implementation: A Step-by-Step Guide for Saudi Arabian Companies
E-Invoicing Implementation: A Step-by-Step Guide for Saudi Arabian Companies
 
Requirement Traceability in Xen Functional Safety
Requirement Traceability in Xen Functional SafetyRequirement Traceability in Xen Functional Safety
Requirement Traceability in Xen Functional Safety
 
Need for Speed: Removing speed bumps from your Symfony projects ⚡️
Need for Speed: Removing speed bumps from your Symfony projects ⚡️Need for Speed: Removing speed bumps from your Symfony projects ⚡️
Need for Speed: Removing speed bumps from your Symfony projects ⚡️
 
Transform Your Communication with Cloud-Based IVR Solutions
Transform Your Communication with Cloud-Based IVR SolutionsTransform Your Communication with Cloud-Based IVR Solutions
Transform Your Communication with Cloud-Based IVR Solutions
 
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Neo4j - Product Vision and Knowledge Graphs - GraphSummit ParisNeo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
Neo4j - Product Vision and Knowledge Graphs - GraphSummit Paris
 
Webinar On-Demand: Using Flutter for Embedded
Webinar On-Demand: Using Flutter for EmbeddedWebinar On-Demand: Using Flutter for Embedded
Webinar On-Demand: Using Flutter for Embedded
 
E-commerce Development Services- Hornet Dynamics
E-commerce Development Services- Hornet DynamicsE-commerce Development Services- Hornet Dynamics
E-commerce Development Services- Hornet Dynamics
 
OpenMetadata Community Meeting - 5th June 2024
OpenMetadata Community Meeting - 5th June 2024OpenMetadata Community Meeting - 5th June 2024
OpenMetadata Community Meeting - 5th June 2024
 
Empowering Growth with Best Software Development Company in Noida - Deuglo
Empowering Growth with Best Software  Development Company in Noida - DeugloEmpowering Growth with Best Software  Development Company in Noida - Deuglo
Empowering Growth with Best Software Development Company in Noida - Deuglo
 
Microservice Teams - How the cloud changes the way we work
Microservice Teams - How the cloud changes the way we workMicroservice Teams - How the cloud changes the way we work
Microservice Teams - How the cloud changes the way we work
 
Mobile App Development Company In Noida | Drona Infotech
Mobile App Development Company In Noida | Drona InfotechMobile App Development Company In Noida | Drona Infotech
Mobile App Development Company In Noida | Drona Infotech
 
openEuler Case Study - The Journey to Supply Chain Security
openEuler Case Study - The Journey to Supply Chain SecurityopenEuler Case Study - The Journey to Supply Chain Security
openEuler Case Study - The Journey to Supply Chain Security
 
GreenCode-A-VSCode-Plugin--Dario-Jurisic
GreenCode-A-VSCode-Plugin--Dario-JurisicGreenCode-A-VSCode-Plugin--Dario-Jurisic
GreenCode-A-VSCode-Plugin--Dario-Jurisic
 
UI5con 2024 - Bring Your Own Design System
UI5con 2024 - Bring Your Own Design SystemUI5con 2024 - Bring Your Own Design System
UI5con 2024 - Bring Your Own Design System
 
Graspan: A Big Data System for Big Code Analysis
Graspan: A Big Data System for Big Code AnalysisGraspan: A Big Data System for Big Code Analysis
Graspan: A Big Data System for Big Code Analysis
 
socradar-q1-2024-aviation-industry-report.pdf
socradar-q1-2024-aviation-industry-report.pdfsocradar-q1-2024-aviation-industry-report.pdf
socradar-q1-2024-aviation-industry-report.pdf
 
SMS API Integration in Saudi Arabia| Best SMS API Service
SMS API Integration in Saudi Arabia| Best SMS API ServiceSMS API Integration in Saudi Arabia| Best SMS API Service
SMS API Integration in Saudi Arabia| Best SMS API Service
 

DSD-Kampala 2023 Modelling in a data scarce environment - the story of HydroMT - Boisgontier

  • 1. Hélène Boisgontier Deltares Software Days – Kampala 2023 Modelling in a data scarce environment: the story of HydroMT
  • 2. Contents • Why HydroMT ? • About HydroMT • Demo: Building a model with HydroMT 2
  • 4. Why do we need models? We (approximately) know what happened… • In the past • At a certain location 4
  • 5. Why do we need models? But what will happen in the future? • Tomorrow • Next week • Next year(s): E.g. climate change And what happens at other locations? What are the causes of current issues (water scarcity, poor quality…)? Or are the land-use management plans or mitigation measures efficient and sustainable? • Reforestation • Increase of agricultural land… 5 ? Climate Change Population growth
  • 6. Why do we need models? Model can help with: • Better understanding of a complex system • Assess effects of scenarios or measures and strategies • Predict into the future Model can have different forms: • Simple / lumped • Complex / gridded 6
  • 7. Models need data… • Model construction data − Base model data (often static or do not vary much in time) − E.g.: elevation, land-use, river cross-sections… • Model execution data − Data to execute the model, like boundary or initial conditions (often dynamic) − E.g.: meteorological data (precipitation, wind…), hydrological data (discharge, groundwater recharge…) • Model validation data: − Data to estimate the efficiency of the model, to calibrate and validate it. − E.g.: discharge, water level, flood maps… 7
  • 8. Classical approach 1) Collect local data 2) Collect more local data 3) Collect even more local data 4) Analyse data 5) Build a model 6) Throw away 80% of the collected data 1) Month 1-3 2) Month 3-6 3) Month 6 4) Month 7 5) Month 8-12 6) Month 12 8 Models need data… Time
  • 9. Rationale Examples of (new) datasets 2015 2017 • (Good) data becomes more widely available • At higher temporal and spatial resolution • As the data improves, we want to improve our models
  • 10. Rationale • (Good) data becomes more widely available • At higher temporal and spatial resolution • As the data improves, we want to improve our models • Need for tools that: − Operate on these datasets − Are easy to use (for modelling experts (!)) − Support the modellers by doing the “hard” & “boring” work − Support developments in enhancing these datasets − Support re-using methods and workflows for different models • Hence, HydroMT was born! 10 GIS processing
  • 11. Classical approach 1) Collect local data 2) Collect more local data 3) Collect even more local data 4) Analyse data 5) Build a model 6) Throw away 80% of the collected data New approach 1) Build an initial model base on available (global) data 2) Discuss where improvements are required and which data is missing 3) Collect local data 4) Analyse data 5) Improve the model with the new data 11 Model approach with hydroMT
  • 13. About HydroMT HydroMT (Hydro Model Tools) is an open-source Python package at the interface between data, users, and water system models. It includes GIS, hydrological, statistical and plotting methods needed for rapidly building inter-connected environmental models for hydrology, water quality, groundwater, water resources and environmental impacts applications. 13 Build Update Plot Stat Cloud-ready Scalable Reproducible Flexible Fast
  • 14. About HydroMT • Open Source • Available on Github • MIT license • Releases on pypi and conda for easier installation • Online documentation and interactive examples with Binder • Works via command line 14 > hydromt build wflow “my_model” “{‘basin’: [x,y]}” -i wflow_build.ini -d data_catalog.yml -vv
  • 15. About HydroMT • Data-centred model building with HydroMT − Rapid model building/updating globally 15 Useful in quick scan analysis Ventiane Laos example: flood hazard and impact mapping wflow + SFINCS + Delft-FIAT Useful in data-scarce regions Coumpound flood modelling Mozambique
  • 16. About HydroMT • Data-centred model building with HydroMT − Rapid model building /updating globally − Small to large applications 16 AXA Western Europe World Water Quality Assessment
  • 17. About HydroMT • Data-centred model building with HydroMT − Rapid model building /updating globally − Small to large applications − Operate on global and local datasets (data harmonization) 17 Global population grid Mines locations Regional statistics Water Quality Diagnostic in Peru Mix of 40+ emission data from global and local sources
  • 18. About HydroMT • Data-centred model building with HydroMT − Rapid model building /updating globally − Small to large applications − Operate on global and local datasets (data harmonization) − Support developments in enhancing these local datasets 18 BMA Bangkok Improving local data to build Delft3DFM models
  • 19. About HydroMT • Data-centred model building with HydroMT − Rapid model building /updating globally − Small to large applications − Operate on global and local datasets (data harmonization) − Support developments in enhancing these local datasets − Modular tool: methods and workflows can be reused for different models (plugins) 19
  • 20. Steps to run HydroMT
  • 21. Building a model • Steps to build a model 1. Select the data you want to use, download if needed, and prepare a data catalog or use a pre-defined one. 2. Select your region of interest. 3. Select the model components you want to build and the options (data source, resampling method etc.) by preparing a model configuration file or use a pre-defined one. 4. Build your model using the Command Line Interface (CLI) or Python. 21 HydroMT documentation: https://deltares.github.io/hydromt/latest/user_guide/model_build.html > hydromt build wflow “my_model” “{‘basin’: [x,y]}” -i wflow_build.ini -d data_catalog.yml -vv
  • 23. Building a first wflow model for the Mara river
  • 24. Building another one for Mbalangeti river
  • 26. Building a Delft3D FM model
  • 28. Using HydroMT • Approach data at the center of model building − First get a model from (global) available data − Improve with local data • Usage − Many types of projects and a lot of applications use HydroMT directly − Tools powered by HydroMT: Climate Stress Test Toolbox, FloodAdapt • Available plugins − wflow − D-Flow FM (Delft3D FM Suite) − SFINCS − Delft-FIAT − DELWAQ (kernel of the D-Water Quality and D-Emissions modules of the Delft3D FM Suite) 28
  • 29. Upcoming features • Data: reduce effort to download data and write data catalogs − Use data from public clouds like Google GCS or Amazon AWS − Use data available via API like OpenStreetMap or Copernicus − Use directly download-able data through https like wind atlas or many more • Models: make it easier to prepare data without a plugin − ‘Generic’ models like GridModel (regular grid), MeshModel (unstructured grid), VectorModel (lumped and semi-distributed), NetworkModel (networks) − Generic models helps prepare all data required but in common GIS formats rather than model formats • Others: − Commands and tools to help analyze or export and share data − Commands and tools to help quickly visualize and analyze model results − Conversion commands to convert model data to common GIS formats (new data or connect models) 29
  • 30. Links HydroMT and HydroMT-wflow • HydroMT docs: https://deltares.github.io/hydromt/latest/ • Github HydroMT: https://github.com/Deltares/hydromt • Plugins: − HydroMT wflow: https://deltares.github.io/hydromt_wflow/ − HydroMT SFINCS: https://deltares.github.io/hydromt_sfincs/ − HydroMT FIAT: https://deltares.github.io/hydromt_fiat/ − HydroMT DELWAQ: https://deltares.github.io/hydromt_delwaq/ − HydroMT D-Flow FM: https://deltares.github.io/hydromt_delft3dfm/
  • 31. Thank you for your attention! www.deltares.nl info@deltares.nl @deltares @deltares linkedin.com/company/deltares facebook.com/deltaresNL