SlideShare a Scribd company logo
1 of 31
Download to read offline
Hélène Boisgontier
Deltares Software Days – Kampala 2023
Modelling in a data scarce
environment: the story of
HydroMT
Contents
• Why HydroMT ?
• About HydroMT
• Demo: Building a model with HydroMT
2
Why HydroMT ?
Why do we need models?
We (approximately) know what happened…
• In the past
• At a certain location
4
Why do we need models?
But what will happen in the future?
• Tomorrow
• Next week
• Next year(s): E.g. climate change
And what happens at other locations?
What are the causes of current issues
(water scarcity, poor quality…)?
Or are the land-use management
plans or mitigation measures efficient
and sustainable?
• Reforestation
• Increase of agricultural land…
5
?
Climate Change Population growth
Why do we need models?
Model can help with:
• Better understanding of a complex system
• Assess effects of scenarios or measures and strategies
• Predict into the future
Model can have different forms:
• Simple / lumped
• Complex / gridded
6
Models need data…
• Model construction data
− Base model data (often static or do not vary much in time)
− E.g.: elevation, land-use, river cross-sections…
• Model execution data
− Data to execute the model, like boundary or initial conditions
(often dynamic)
− E.g.: meteorological data (precipitation, wind…), hydrological
data (discharge, groundwater recharge…)
• Model validation data:
− Data to estimate the efficiency of the model, to calibrate and
validate it.
− E.g.: discharge, water level, flood maps…
7
Classical approach
1) Collect local data
2) Collect more local data
3) Collect even more local data
4) Analyse data
5) Build a model
6) Throw away 80% of the collected data
1) Month 1-3
2) Month 3-6
3) Month 6
4) Month 7
5) Month 8-12
6) Month 12
8
Models need data…
Time
Rationale
Examples of (new) datasets
2015 2017
• (Good) data becomes more widely available
• At higher temporal and spatial resolution
• As the data improves, we want to improve our models
Rationale
• (Good) data becomes more widely available
• At higher temporal and spatial resolution
• As the data improves, we want to improve our models
• Need for tools that:
− Operate on these datasets
− Are easy to use (for modelling experts (!))
− Support the modellers by doing the “hard” & “boring” work
− Support developments in enhancing these datasets
− Support re-using methods and workflows for different models
• Hence, HydroMT was born!
10
GIS
processing
Classical approach
1) Collect local data
2) Collect more local data
3) Collect even more local data
4) Analyse data
5) Build a model
6) Throw away 80% of the collected data
New approach
1) Build an initial model base on available
(global) data
2) Discuss where improvements are required and
which data is missing
3) Collect local data
4) Analyse data
5) Improve the model with the new data
11
Model approach with hydroMT
About HydroMT
12 October 2022
About HydroMT
HydroMT (Hydro Model Tools) is an open-source Python package at the interface between
data, users, and water system models.
It includes GIS, hydrological, statistical and plotting methods needed for rapidly building inter-connected
environmental models for hydrology, water quality, groundwater, water resources and environmental
impacts applications.
13
Build Update Plot Stat
Cloud-ready
Scalable
Reproducible
Flexible
Fast
About HydroMT
• Open Source
• Available on Github
• MIT license
• Releases on pypi and conda for easier installation
• Online documentation and interactive examples
with Binder
• Works via command line
14
> hydromt build wflow “my_model” “{‘basin’: [x,y]}”
-i wflow_build.ini -d data_catalog.yml -vv
About HydroMT
• Data-centred model building with HydroMT
− Rapid model building/updating globally
15
Useful in quick scan analysis
Ventiane Laos example: flood hazard and impact mapping
wflow + SFINCS + Delft-FIAT
Useful in data-scarce regions
Coumpound flood modelling Mozambique
About HydroMT
• Data-centred model building with HydroMT
− Rapid model building /updating globally
− Small to large applications
16
AXA Western Europe
World Water Quality Assessment
About HydroMT
• Data-centred model building with HydroMT
− Rapid model building /updating globally
− Small to large applications
− Operate on global and local datasets (data harmonization)
17
Global population grid
Mines locations
Regional statistics
Water Quality Diagnostic in Peru
Mix of 40+ emission data from global and local sources
About HydroMT
• Data-centred model building with HydroMT
− Rapid model building /updating globally
− Small to large applications
− Operate on global and local datasets (data harmonization)
− Support developments in enhancing these local datasets
18
BMA Bangkok
Improving local data to build Delft3DFM models
About HydroMT
• Data-centred model building with HydroMT
− Rapid model building /updating globally
− Small to large applications
− Operate on global and local datasets (data harmonization)
− Support developments in enhancing these local datasets
− Modular tool: methods and workflows can be reused for different
models (plugins)
19
Steps to run HydroMT
Building a model
• Steps to build a model
1. Select the data you want to use, download if needed,
and prepare a data catalog or use a pre-defined one.
2. Select your region of interest.
3. Select the model components you want to build
and the options (data source, resampling method
etc.) by preparing a model configuration file or
use a pre-defined one.
4. Build your model using the Command Line Interface (CLI) or Python.
21
HydroMT documentation:
https://deltares.github.io/hydromt/latest/user_guide/model_build.html
> hydromt build wflow “my_model” “{‘basin’: [x,y]}” -i wflow_build.ini -d data_catalog.yml -vv
Demo video
Building a first wflow model for the Mara river
Building another one for Mbalangeti river
Updating the climate data
Building a Delft3D FM model
Take away
Using HydroMT
• Approach data at the center of model building
− First get a model from (global) available data
− Improve with local data
• Usage
− Many types of projects and a lot of applications use HydroMT directly
− Tools powered by HydroMT: Climate Stress Test Toolbox, FloodAdapt
• Available plugins
− wflow
− D-Flow FM (Delft3D FM Suite)
− SFINCS
− Delft-FIAT
− DELWAQ (kernel of the D-Water Quality and D-Emissions modules of the Delft3D FM Suite)
28
Upcoming features
• Data: reduce effort to download data and write data catalogs
− Use data from public clouds like Google GCS or Amazon AWS
− Use data available via API like OpenStreetMap or Copernicus
− Use directly download-able data through https like wind atlas or many more
• Models: make it easier to prepare data without a plugin
− ‘Generic’ models like GridModel (regular grid), MeshModel (unstructured grid), VectorModel (lumped and
semi-distributed), NetworkModel (networks)
− Generic models helps prepare all data required but in common GIS formats rather than model formats
• Others:
− Commands and tools to help analyze or export and share data
− Commands and tools to help quickly visualize and analyze model results
− Conversion commands to convert model data to common GIS formats (new data or connect models)
29
Links HydroMT and HydroMT-wflow
• HydroMT docs: https://deltares.github.io/hydromt/latest/
• Github HydroMT: https://github.com/Deltares/hydromt
• Plugins:
− HydroMT wflow: https://deltares.github.io/hydromt_wflow/
− HydroMT SFINCS: https://deltares.github.io/hydromt_sfincs/
− HydroMT FIAT: https://deltares.github.io/hydromt_fiat/
− HydroMT DELWAQ: https://deltares.github.io/hydromt_delwaq/
− HydroMT D-Flow FM: https://deltares.github.io/hydromt_delft3dfm/
Thank you for your attention!
www.deltares.nl
info@deltares.nl
@deltares
@deltares
linkedin.com/company/deltares
facebook.com/deltaresNL

More Related Content

Similar to DSD-Kampala 2023 Modelling in a data scarce environment - the story of HydroMT - Boisgontier

DSD-INT 2019 Modelling in DANUBIUS-RI-Bellafiore
DSD-INT 2019 Modelling in DANUBIUS-RI-BellafioreDSD-INT 2019 Modelling in DANUBIUS-RI-Bellafiore
DSD-INT 2019 Modelling in DANUBIUS-RI-BellafioreDeltares
 
First online hangout SC5 - Big Data Europe first pilot-presentation-hangout
First online hangout SC5 - Big Data Europe  first pilot-presentation-hangoutFirst online hangout SC5 - Big Data Europe  first pilot-presentation-hangout
First online hangout SC5 - Big Data Europe first pilot-presentation-hangoutBigData_Europe
 
22 - CSIRO - Water Data Management-Sep-17
22 - CSIRO - Water Data Management-Sep-1722 - CSIRO - Water Data Management-Sep-17
22 - CSIRO - Water Data Management-Sep-17indiawrm
 
Presentation
PresentationPresentation
Presentationbolu804
 
DSD-INT 2019 Global Data Services and Analysis Frameworks-Luijendijk
DSD-INT 2019 Global Data Services and Analysis Frameworks-LuijendijkDSD-INT 2019 Global Data Services and Analysis Frameworks-Luijendijk
DSD-INT 2019 Global Data Services and Analysis Frameworks-LuijendijkDeltares
 
Accès ouvert aux données météorologiques d’Environnement Canada
Accès ouvert aux données météorologiques d’Environnement CanadaAccès ouvert aux données météorologiques d’Environnement Canada
Accès ouvert aux données météorologiques d’Environnement CanadaVisionGEOMATIQUE2014
 
Wastewater networks modeling using info works cs
Wastewater networks modeling using info works csWastewater networks modeling using info works cs
Wastewater networks modeling using info works csAHMED NADIM JILANI
 
Models Done Better... - UDG2018 - Intertek and DHI
Models Done Better... - UDG2018 - Intertek and DHIModels Done Better... - UDG2018 - Intertek and DHI
Models Done Better... - UDG2018 - Intertek and DHIStephen Flood
 
big_data_casestudies_2.ppt
big_data_casestudies_2.pptbig_data_casestudies_2.ppt
big_data_casestudies_2.pptvishal choudhary
 
Experimental transformation of ABS data into Data Cube Vocabulary (DCV) form...
Experimental transformation of  ABS data into Data Cube Vocabulary (DCV) form...Experimental transformation of  ABS data into Data Cube Vocabulary (DCV) form...
Experimental transformation of ABS data into Data Cube Vocabulary (DCV) form...Alistair Hamilton
 
Khatibi lecture cov.uni
Khatibi lecture cov.uniKhatibi lecture cov.uni
Khatibi lecture cov.uniRahman Khatibi
 
Big Data HPC Convergence and a bunch of other things
Big Data HPC Convergence and a bunch of other thingsBig Data HPC Convergence and a bunch of other things
Big Data HPC Convergence and a bunch of other thingsGeoffrey Fox
 
PERICLES Workflow for the automated updating of Digital Ecosystem Models with...
PERICLES Workflow for the automated updating of Digital Ecosystem Models with...PERICLES Workflow for the automated updating of Digital Ecosystem Models with...
PERICLES Workflow for the automated updating of Digital Ecosystem Models with...PERICLES_FP7
 
Big Data in Action : Operations, Analytics and more
Big Data in Action : Operations, Analytics and moreBig Data in Action : Operations, Analytics and more
Big Data in Action : Operations, Analytics and moreSoftweb Solutions
 
FIWARE Wednesday Webinars - Cities as Enablers of the Data Economy: Smart Dat...
FIWARE Wednesday Webinars - Cities as Enablers of the Data Economy: Smart Dat...FIWARE Wednesday Webinars - Cities as Enablers of the Data Economy: Smart Dat...
FIWARE Wednesday Webinars - Cities as Enablers of the Data Economy: Smart Dat...FIWARE
 
Data‐intensive hydrologic modeling: A Cloud strategy for integrating PIHM, GI...
Data‐intensive hydrologic modeling: A Cloud strategy for integrating PIHM, GI...Data‐intensive hydrologic modeling: A Cloud strategy for integrating PIHM, GI...
Data‐intensive hydrologic modeling: A Cloud strategy for integrating PIHM, GI...lleonardSlideShare
 
High Performance Data Analytics and a Java Grande Run Time
High Performance Data Analytics and a Java Grande Run TimeHigh Performance Data Analytics and a Java Grande Run Time
High Performance Data Analytics and a Java Grande Run TimeGeoffrey Fox
 

Similar to DSD-Kampala 2023 Modelling in a data scarce environment - the story of HydroMT - Boisgontier (20)

DGterzo
DGterzoDGterzo
DGterzo
 
DSD-INT 2019 Modelling in DANUBIUS-RI-Bellafiore
DSD-INT 2019 Modelling in DANUBIUS-RI-BellafioreDSD-INT 2019 Modelling in DANUBIUS-RI-Bellafiore
DSD-INT 2019 Modelling in DANUBIUS-RI-Bellafiore
 
First online hangout SC5 - Big Data Europe first pilot-presentation-hangout
First online hangout SC5 - Big Data Europe  first pilot-presentation-hangoutFirst online hangout SC5 - Big Data Europe  first pilot-presentation-hangout
First online hangout SC5 - Big Data Europe first pilot-presentation-hangout
 
22 - CSIRO - Water Data Management-Sep-17
22 - CSIRO - Water Data Management-Sep-1722 - CSIRO - Water Data Management-Sep-17
22 - CSIRO - Water Data Management-Sep-17
 
Presentation
PresentationPresentation
Presentation
 
DSD-INT 2019 Global Data Services and Analysis Frameworks-Luijendijk
DSD-INT 2019 Global Data Services and Analysis Frameworks-LuijendijkDSD-INT 2019 Global Data Services and Analysis Frameworks-Luijendijk
DSD-INT 2019 Global Data Services and Analysis Frameworks-Luijendijk
 
COINS CV
COINS CVCOINS CV
COINS CV
 
Accès ouvert aux données météorologiques d’Environnement Canada
Accès ouvert aux données météorologiques d’Environnement CanadaAccès ouvert aux données météorologiques d’Environnement Canada
Accès ouvert aux données météorologiques d’Environnement Canada
 
Wastewater networks modeling using info works cs
Wastewater networks modeling using info works csWastewater networks modeling using info works cs
Wastewater networks modeling using info works cs
 
Models Done Better... - UDG2018 - Intertek and DHI
Models Done Better... - UDG2018 - Intertek and DHIModels Done Better... - UDG2018 - Intertek and DHI
Models Done Better... - UDG2018 - Intertek and DHI
 
big_data_casestudies_2.ppt
big_data_casestudies_2.pptbig_data_casestudies_2.ppt
big_data_casestudies_2.ppt
 
A Framework for Data Collection, Transformation and Processing in industrial...
A Framework for Data Collection,  Transformation and Processing in industrial...A Framework for Data Collection,  Transformation and Processing in industrial...
A Framework for Data Collection, Transformation and Processing in industrial...
 
Experimental transformation of ABS data into Data Cube Vocabulary (DCV) form...
Experimental transformation of  ABS data into Data Cube Vocabulary (DCV) form...Experimental transformation of  ABS data into Data Cube Vocabulary (DCV) form...
Experimental transformation of ABS data into Data Cube Vocabulary (DCV) form...
 
Khatibi lecture cov.uni
Khatibi lecture cov.uniKhatibi lecture cov.uni
Khatibi lecture cov.uni
 
Big Data HPC Convergence and a bunch of other things
Big Data HPC Convergence and a bunch of other thingsBig Data HPC Convergence and a bunch of other things
Big Data HPC Convergence and a bunch of other things
 
PERICLES Workflow for the automated updating of Digital Ecosystem Models with...
PERICLES Workflow for the automated updating of Digital Ecosystem Models with...PERICLES Workflow for the automated updating of Digital Ecosystem Models with...
PERICLES Workflow for the automated updating of Digital Ecosystem Models with...
 
Big Data in Action : Operations, Analytics and more
Big Data in Action : Operations, Analytics and moreBig Data in Action : Operations, Analytics and more
Big Data in Action : Operations, Analytics and more
 
FIWARE Wednesday Webinars - Cities as Enablers of the Data Economy: Smart Dat...
FIWARE Wednesday Webinars - Cities as Enablers of the Data Economy: Smart Dat...FIWARE Wednesday Webinars - Cities as Enablers of the Data Economy: Smart Dat...
FIWARE Wednesday Webinars - Cities as Enablers of the Data Economy: Smart Dat...
 
Data‐intensive hydrologic modeling: A Cloud strategy for integrating PIHM, GI...
Data‐intensive hydrologic modeling: A Cloud strategy for integrating PIHM, GI...Data‐intensive hydrologic modeling: A Cloud strategy for integrating PIHM, GI...
Data‐intensive hydrologic modeling: A Cloud strategy for integrating PIHM, GI...
 
High Performance Data Analytics and a Java Grande Run Time
High Performance Data Analytics and a Java Grande Run TimeHigh Performance Data Analytics and a Java Grande Run Time
High Performance Data Analytics and a Java Grande Run Time
 

More from Deltares

DSD-INT 2023 Hydrology User Days - Intro - Day 3 - Kroon
DSD-INT 2023 Hydrology User Days - Intro - Day 3 - KroonDSD-INT 2023 Hydrology User Days - Intro - Day 3 - Kroon
DSD-INT 2023 Hydrology User Days - Intro - Day 3 - KroonDeltares
 
DSD-INT 2023 Demo EPIC Response Assessment Methodology (ERAM) - Couvin Rodriguez
DSD-INT 2023 Demo EPIC Response Assessment Methodology (ERAM) - Couvin RodriguezDSD-INT 2023 Demo EPIC Response Assessment Methodology (ERAM) - Couvin Rodriguez
DSD-INT 2023 Demo EPIC Response Assessment Methodology (ERAM) - Couvin RodriguezDeltares
 
DSD-INT 2023 Demo Climate Stress Testing Tool (CST Tool) - Taner
DSD-INT 2023 Demo Climate Stress Testing Tool (CST Tool) - TanerDSD-INT 2023 Demo Climate Stress Testing Tool (CST Tool) - Taner
DSD-INT 2023 Demo Climate Stress Testing Tool (CST Tool) - TanerDeltares
 
DSD-INT 2023 Demo Climate Resilient Cities Tool (CRC Tool) - Rooze
DSD-INT 2023 Demo Climate Resilient Cities Tool (CRC Tool) - RoozeDSD-INT 2023 Demo Climate Resilient Cities Tool (CRC Tool) - Rooze
DSD-INT 2023 Demo Climate Resilient Cities Tool (CRC Tool) - RoozeDeltares
 
DSD-INT 2023 Approaches for assessing multi-hazard risk - Ward
DSD-INT 2023 Approaches for assessing multi-hazard risk - WardDSD-INT 2023 Approaches for assessing multi-hazard risk - Ward
DSD-INT 2023 Approaches for assessing multi-hazard risk - WardDeltares
 
DSD-INT 2023 Dynamic Adaptive Policy Pathways (DAPP) - Theory & Showcase - Wa...
DSD-INT 2023 Dynamic Adaptive Policy Pathways (DAPP) - Theory & Showcase - Wa...DSD-INT 2023 Dynamic Adaptive Policy Pathways (DAPP) - Theory & Showcase - Wa...
DSD-INT 2023 Dynamic Adaptive Policy Pathways (DAPP) - Theory & Showcase - Wa...Deltares
 
DSD-INT 2023 Global hydrological modelling to support worldwide water assessm...
DSD-INT 2023 Global hydrological modelling to support worldwide water assessm...DSD-INT 2023 Global hydrological modelling to support worldwide water assessm...
DSD-INT 2023 Global hydrological modelling to support worldwide water assessm...Deltares
 
DSD-INT 2023 Modelling implications - IPCC Working Group II - From AR6 to AR7...
DSD-INT 2023 Modelling implications - IPCC Working Group II - From AR6 to AR7...DSD-INT 2023 Modelling implications - IPCC Working Group II - From AR6 to AR7...
DSD-INT 2023 Modelling implications - IPCC Working Group II - From AR6 to AR7...Deltares
 
DSD-INT 2023 Knowledge and tools for Climate Adaptation - Jeuken
DSD-INT 2023 Knowledge and tools for Climate Adaptation - JeukenDSD-INT 2023 Knowledge and tools for Climate Adaptation - Jeuken
DSD-INT 2023 Knowledge and tools for Climate Adaptation - JeukenDeltares
 
DSD-INT 2023 Coupling RIBASIM to a MODFLOW groundwater model - Bootsma
DSD-INT 2023 Coupling RIBASIM to a MODFLOW groundwater model - BootsmaDSD-INT 2023 Coupling RIBASIM to a MODFLOW groundwater model - Bootsma
DSD-INT 2023 Coupling RIBASIM to a MODFLOW groundwater model - BootsmaDeltares
 
DSD-INT 2023 Create your own MODFLOW 6 sub-variant - Muller
DSD-INT 2023 Create your own MODFLOW 6 sub-variant - MullerDSD-INT 2023 Create your own MODFLOW 6 sub-variant - Muller
DSD-INT 2023 Create your own MODFLOW 6 sub-variant - MullerDeltares
 
DSD-INT 2023 Example of unstructured MODFLOW 6 modelling in California - Romero
DSD-INT 2023 Example of unstructured MODFLOW 6 modelling in California - RomeroDSD-INT 2023 Example of unstructured MODFLOW 6 modelling in California - Romero
DSD-INT 2023 Example of unstructured MODFLOW 6 modelling in California - RomeroDeltares
 
DSD-INT 2023 Challenges and developments in groundwater modeling - Bakker
DSD-INT 2023 Challenges and developments in groundwater modeling - BakkerDSD-INT 2023 Challenges and developments in groundwater modeling - Bakker
DSD-INT 2023 Challenges and developments in groundwater modeling - BakkerDeltares
 
DSD-INT 2023 Demo new features iMOD Suite - van Engelen
DSD-INT 2023 Demo new features iMOD Suite - van EngelenDSD-INT 2023 Demo new features iMOD Suite - van Engelen
DSD-INT 2023 Demo new features iMOD Suite - van EngelenDeltares
 
DSD-INT 2023 iMOD and new developments - Davids
DSD-INT 2023 iMOD and new developments - DavidsDSD-INT 2023 iMOD and new developments - Davids
DSD-INT 2023 iMOD and new developments - DavidsDeltares
 
DSD-INT 2023 Recent MODFLOW Developments - Langevin
DSD-INT 2023 Recent MODFLOW Developments - LangevinDSD-INT 2023 Recent MODFLOW Developments - Langevin
DSD-INT 2023 Recent MODFLOW Developments - LangevinDeltares
 
DSD-INT 2023 Needs related to user interfaces - Snippen
DSD-INT 2023 Needs related to user interfaces - SnippenDSD-INT 2023 Needs related to user interfaces - Snippen
DSD-INT 2023 Needs related to user interfaces - SnippenDeltares
 
DSD-INT 2023 Coupling RIBASIM to a MODFLOW groundwater model - Bootsma
DSD-INT 2023 Coupling RIBASIM to a MODFLOW groundwater model - BootsmaDSD-INT 2023 Coupling RIBASIM to a MODFLOW groundwater model - Bootsma
DSD-INT 2023 Coupling RIBASIM to a MODFLOW groundwater model - BootsmaDeltares
 
DSD-INT 2023 Parameterization of a RIBASIM model and the network lumping appr...
DSD-INT 2023 Parameterization of a RIBASIM model and the network lumping appr...DSD-INT 2023 Parameterization of a RIBASIM model and the network lumping appr...
DSD-INT 2023 Parameterization of a RIBASIM model and the network lumping appr...Deltares
 
DSD-INT 2023 Parameterization of RIBASIM and flexibility in the lumped approa...
DSD-INT 2023 Parameterization of RIBASIM and flexibility in the lumped approa...DSD-INT 2023 Parameterization of RIBASIM and flexibility in the lumped approa...
DSD-INT 2023 Parameterization of RIBASIM and flexibility in the lumped approa...Deltares
 

More from Deltares (20)

DSD-INT 2023 Hydrology User Days - Intro - Day 3 - Kroon
DSD-INT 2023 Hydrology User Days - Intro - Day 3 - KroonDSD-INT 2023 Hydrology User Days - Intro - Day 3 - Kroon
DSD-INT 2023 Hydrology User Days - Intro - Day 3 - Kroon
 
DSD-INT 2023 Demo EPIC Response Assessment Methodology (ERAM) - Couvin Rodriguez
DSD-INT 2023 Demo EPIC Response Assessment Methodology (ERAM) - Couvin RodriguezDSD-INT 2023 Demo EPIC Response Assessment Methodology (ERAM) - Couvin Rodriguez
DSD-INT 2023 Demo EPIC Response Assessment Methodology (ERAM) - Couvin Rodriguez
 
DSD-INT 2023 Demo Climate Stress Testing Tool (CST Tool) - Taner
DSD-INT 2023 Demo Climate Stress Testing Tool (CST Tool) - TanerDSD-INT 2023 Demo Climate Stress Testing Tool (CST Tool) - Taner
DSD-INT 2023 Demo Climate Stress Testing Tool (CST Tool) - Taner
 
DSD-INT 2023 Demo Climate Resilient Cities Tool (CRC Tool) - Rooze
DSD-INT 2023 Demo Climate Resilient Cities Tool (CRC Tool) - RoozeDSD-INT 2023 Demo Climate Resilient Cities Tool (CRC Tool) - Rooze
DSD-INT 2023 Demo Climate Resilient Cities Tool (CRC Tool) - Rooze
 
DSD-INT 2023 Approaches for assessing multi-hazard risk - Ward
DSD-INT 2023 Approaches for assessing multi-hazard risk - WardDSD-INT 2023 Approaches for assessing multi-hazard risk - Ward
DSD-INT 2023 Approaches for assessing multi-hazard risk - Ward
 
DSD-INT 2023 Dynamic Adaptive Policy Pathways (DAPP) - Theory & Showcase - Wa...
DSD-INT 2023 Dynamic Adaptive Policy Pathways (DAPP) - Theory & Showcase - Wa...DSD-INT 2023 Dynamic Adaptive Policy Pathways (DAPP) - Theory & Showcase - Wa...
DSD-INT 2023 Dynamic Adaptive Policy Pathways (DAPP) - Theory & Showcase - Wa...
 
DSD-INT 2023 Global hydrological modelling to support worldwide water assessm...
DSD-INT 2023 Global hydrological modelling to support worldwide water assessm...DSD-INT 2023 Global hydrological modelling to support worldwide water assessm...
DSD-INT 2023 Global hydrological modelling to support worldwide water assessm...
 
DSD-INT 2023 Modelling implications - IPCC Working Group II - From AR6 to AR7...
DSD-INT 2023 Modelling implications - IPCC Working Group II - From AR6 to AR7...DSD-INT 2023 Modelling implications - IPCC Working Group II - From AR6 to AR7...
DSD-INT 2023 Modelling implications - IPCC Working Group II - From AR6 to AR7...
 
DSD-INT 2023 Knowledge and tools for Climate Adaptation - Jeuken
DSD-INT 2023 Knowledge and tools for Climate Adaptation - JeukenDSD-INT 2023 Knowledge and tools for Climate Adaptation - Jeuken
DSD-INT 2023 Knowledge and tools for Climate Adaptation - Jeuken
 
DSD-INT 2023 Coupling RIBASIM to a MODFLOW groundwater model - Bootsma
DSD-INT 2023 Coupling RIBASIM to a MODFLOW groundwater model - BootsmaDSD-INT 2023 Coupling RIBASIM to a MODFLOW groundwater model - Bootsma
DSD-INT 2023 Coupling RIBASIM to a MODFLOW groundwater model - Bootsma
 
DSD-INT 2023 Create your own MODFLOW 6 sub-variant - Muller
DSD-INT 2023 Create your own MODFLOW 6 sub-variant - MullerDSD-INT 2023 Create your own MODFLOW 6 sub-variant - Muller
DSD-INT 2023 Create your own MODFLOW 6 sub-variant - Muller
 
DSD-INT 2023 Example of unstructured MODFLOW 6 modelling in California - Romero
DSD-INT 2023 Example of unstructured MODFLOW 6 modelling in California - RomeroDSD-INT 2023 Example of unstructured MODFLOW 6 modelling in California - Romero
DSD-INT 2023 Example of unstructured MODFLOW 6 modelling in California - Romero
 
DSD-INT 2023 Challenges and developments in groundwater modeling - Bakker
DSD-INT 2023 Challenges and developments in groundwater modeling - BakkerDSD-INT 2023 Challenges and developments in groundwater modeling - Bakker
DSD-INT 2023 Challenges and developments in groundwater modeling - Bakker
 
DSD-INT 2023 Demo new features iMOD Suite - van Engelen
DSD-INT 2023 Demo new features iMOD Suite - van EngelenDSD-INT 2023 Demo new features iMOD Suite - van Engelen
DSD-INT 2023 Demo new features iMOD Suite - van Engelen
 
DSD-INT 2023 iMOD and new developments - Davids
DSD-INT 2023 iMOD and new developments - DavidsDSD-INT 2023 iMOD and new developments - Davids
DSD-INT 2023 iMOD and new developments - Davids
 
DSD-INT 2023 Recent MODFLOW Developments - Langevin
DSD-INT 2023 Recent MODFLOW Developments - LangevinDSD-INT 2023 Recent MODFLOW Developments - Langevin
DSD-INT 2023 Recent MODFLOW Developments - Langevin
 
DSD-INT 2023 Needs related to user interfaces - Snippen
DSD-INT 2023 Needs related to user interfaces - SnippenDSD-INT 2023 Needs related to user interfaces - Snippen
DSD-INT 2023 Needs related to user interfaces - Snippen
 
DSD-INT 2023 Coupling RIBASIM to a MODFLOW groundwater model - Bootsma
DSD-INT 2023 Coupling RIBASIM to a MODFLOW groundwater model - BootsmaDSD-INT 2023 Coupling RIBASIM to a MODFLOW groundwater model - Bootsma
DSD-INT 2023 Coupling RIBASIM to a MODFLOW groundwater model - Bootsma
 
DSD-INT 2023 Parameterization of a RIBASIM model and the network lumping appr...
DSD-INT 2023 Parameterization of a RIBASIM model and the network lumping appr...DSD-INT 2023 Parameterization of a RIBASIM model and the network lumping appr...
DSD-INT 2023 Parameterization of a RIBASIM model and the network lumping appr...
 
DSD-INT 2023 Parameterization of RIBASIM and flexibility in the lumped approa...
DSD-INT 2023 Parameterization of RIBASIM and flexibility in the lumped approa...DSD-INT 2023 Parameterization of RIBASIM and flexibility in the lumped approa...
DSD-INT 2023 Parameterization of RIBASIM and flexibility in the lumped approa...
 

Recently uploaded

MYjobs Presentation Django-based project
MYjobs Presentation Django-based projectMYjobs Presentation Django-based project
MYjobs Presentation Django-based projectAnoyGreter
 
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样umasea
 
英国UN学位证,北安普顿大学毕业证书1:1制作
英国UN学位证,北安普顿大学毕业证书1:1制作英国UN学位证,北安普顿大学毕业证书1:1制作
英国UN学位证,北安普顿大学毕业证书1:1制作qr0udbr0
 
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...stazi3110
 
What is Fashion PLM and Why Do You Need It
What is Fashion PLM and Why Do You Need ItWhat is Fashion PLM and Why Do You Need It
What is Fashion PLM and Why Do You Need ItWave PLM
 
Cloud Management Software Platforms: OpenStack
Cloud Management Software Platforms: OpenStackCloud Management Software Platforms: OpenStack
Cloud Management Software Platforms: OpenStackVICTOR MAESTRE RAMIREZ
 
chapter--4-software-project-planning.ppt
chapter--4-software-project-planning.pptchapter--4-software-project-planning.ppt
chapter--4-software-project-planning.pptkotipi9215
 
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...Christina Lin
 
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdfGOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdfAlina Yurenko
 
Intelligent Home Wi-Fi Solutions | ThinkPalm
Intelligent Home Wi-Fi Solutions | ThinkPalmIntelligent Home Wi-Fi Solutions | ThinkPalm
Intelligent Home Wi-Fi Solutions | ThinkPalmSujith Sukumaran
 
Cloud Data Center Network Construction - IEEE
Cloud Data Center Network Construction - IEEECloud Data Center Network Construction - IEEE
Cloud Data Center Network Construction - IEEEVICTOR MAESTRE RAMIREZ
 
Folding Cheat Sheet #4 - fourth in a series
Folding Cheat Sheet #4 - fourth in a seriesFolding Cheat Sheet #4 - fourth in a series
Folding Cheat Sheet #4 - fourth in a seriesPhilip Schwarz
 
Asset Management Software - Infographic
Asset Management Software - InfographicAsset Management Software - Infographic
Asset Management Software - InfographicHr365.us smith
 
Der Spagat zwischen BIAS und FAIRNESS (2024)
Der Spagat zwischen BIAS und FAIRNESS (2024)Der Spagat zwischen BIAS und FAIRNESS (2024)
Der Spagat zwischen BIAS und FAIRNESS (2024)OPEN KNOWLEDGE GmbH
 
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideBuilding Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideChristina Lin
 
EY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityEY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityNeo4j
 
Implementing Zero Trust strategy with Azure
Implementing Zero Trust strategy with AzureImplementing Zero Trust strategy with Azure
Implementing Zero Trust strategy with AzureDinusha Kumarasiri
 
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptxKnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptxTier1 app
 
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024StefanoLambiase
 

Recently uploaded (20)

MYjobs Presentation Django-based project
MYjobs Presentation Django-based projectMYjobs Presentation Django-based project
MYjobs Presentation Django-based project
 
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
 
英国UN学位证,北安普顿大学毕业证书1:1制作
英国UN学位证,北安普顿大学毕业证书1:1制作英国UN学位证,北安普顿大学毕业证书1:1制作
英国UN学位证,北安普顿大学毕业证书1:1制作
 
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
 
What is Fashion PLM and Why Do You Need It
What is Fashion PLM and Why Do You Need ItWhat is Fashion PLM and Why Do You Need It
What is Fashion PLM and Why Do You Need It
 
Cloud Management Software Platforms: OpenStack
Cloud Management Software Platforms: OpenStackCloud Management Software Platforms: OpenStack
Cloud Management Software Platforms: OpenStack
 
chapter--4-software-project-planning.ppt
chapter--4-software-project-planning.pptchapter--4-software-project-planning.ppt
chapter--4-software-project-planning.ppt
 
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
 
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdfGOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
 
Hot Sexy call girls in Patel Nagar🔝 9953056974 🔝 escort Service
Hot Sexy call girls in Patel Nagar🔝 9953056974 🔝 escort ServiceHot Sexy call girls in Patel Nagar🔝 9953056974 🔝 escort Service
Hot Sexy call girls in Patel Nagar🔝 9953056974 🔝 escort Service
 
Intelligent Home Wi-Fi Solutions | ThinkPalm
Intelligent Home Wi-Fi Solutions | ThinkPalmIntelligent Home Wi-Fi Solutions | ThinkPalm
Intelligent Home Wi-Fi Solutions | ThinkPalm
 
Cloud Data Center Network Construction - IEEE
Cloud Data Center Network Construction - IEEECloud Data Center Network Construction - IEEE
Cloud Data Center Network Construction - IEEE
 
Folding Cheat Sheet #4 - fourth in a series
Folding Cheat Sheet #4 - fourth in a seriesFolding Cheat Sheet #4 - fourth in a series
Folding Cheat Sheet #4 - fourth in a series
 
Asset Management Software - Infographic
Asset Management Software - InfographicAsset Management Software - Infographic
Asset Management Software - Infographic
 
Der Spagat zwischen BIAS und FAIRNESS (2024)
Der Spagat zwischen BIAS und FAIRNESS (2024)Der Spagat zwischen BIAS und FAIRNESS (2024)
Der Spagat zwischen BIAS und FAIRNESS (2024)
 
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideBuilding Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
 
EY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityEY_Graph Database Powered Sustainability
EY_Graph Database Powered Sustainability
 
Implementing Zero Trust strategy with Azure
Implementing Zero Trust strategy with AzureImplementing Zero Trust strategy with Azure
Implementing Zero Trust strategy with Azure
 
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptxKnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
KnowAPIs-UnknownPerf-jaxMainz-2024 (1).pptx
 
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024
 

DSD-Kampala 2023 Modelling in a data scarce environment - the story of HydroMT - Boisgontier

  • 1. Hélène Boisgontier Deltares Software Days – Kampala 2023 Modelling in a data scarce environment: the story of HydroMT
  • 2. Contents • Why HydroMT ? • About HydroMT • Demo: Building a model with HydroMT 2
  • 4. Why do we need models? We (approximately) know what happened… • In the past • At a certain location 4
  • 5. Why do we need models? But what will happen in the future? • Tomorrow • Next week • Next year(s): E.g. climate change And what happens at other locations? What are the causes of current issues (water scarcity, poor quality…)? Or are the land-use management plans or mitigation measures efficient and sustainable? • Reforestation • Increase of agricultural land… 5 ? Climate Change Population growth
  • 6. Why do we need models? Model can help with: • Better understanding of a complex system • Assess effects of scenarios or measures and strategies • Predict into the future Model can have different forms: • Simple / lumped • Complex / gridded 6
  • 7. Models need data… • Model construction data − Base model data (often static or do not vary much in time) − E.g.: elevation, land-use, river cross-sections… • Model execution data − Data to execute the model, like boundary or initial conditions (often dynamic) − E.g.: meteorological data (precipitation, wind…), hydrological data (discharge, groundwater recharge…) • Model validation data: − Data to estimate the efficiency of the model, to calibrate and validate it. − E.g.: discharge, water level, flood maps… 7
  • 8. Classical approach 1) Collect local data 2) Collect more local data 3) Collect even more local data 4) Analyse data 5) Build a model 6) Throw away 80% of the collected data 1) Month 1-3 2) Month 3-6 3) Month 6 4) Month 7 5) Month 8-12 6) Month 12 8 Models need data… Time
  • 9. Rationale Examples of (new) datasets 2015 2017 • (Good) data becomes more widely available • At higher temporal and spatial resolution • As the data improves, we want to improve our models
  • 10. Rationale • (Good) data becomes more widely available • At higher temporal and spatial resolution • As the data improves, we want to improve our models • Need for tools that: − Operate on these datasets − Are easy to use (for modelling experts (!)) − Support the modellers by doing the “hard” & “boring” work − Support developments in enhancing these datasets − Support re-using methods and workflows for different models • Hence, HydroMT was born! 10 GIS processing
  • 11. Classical approach 1) Collect local data 2) Collect more local data 3) Collect even more local data 4) Analyse data 5) Build a model 6) Throw away 80% of the collected data New approach 1) Build an initial model base on available (global) data 2) Discuss where improvements are required and which data is missing 3) Collect local data 4) Analyse data 5) Improve the model with the new data 11 Model approach with hydroMT
  • 13. About HydroMT HydroMT (Hydro Model Tools) is an open-source Python package at the interface between data, users, and water system models. It includes GIS, hydrological, statistical and plotting methods needed for rapidly building inter-connected environmental models for hydrology, water quality, groundwater, water resources and environmental impacts applications. 13 Build Update Plot Stat Cloud-ready Scalable Reproducible Flexible Fast
  • 14. About HydroMT • Open Source • Available on Github • MIT license • Releases on pypi and conda for easier installation • Online documentation and interactive examples with Binder • Works via command line 14 > hydromt build wflow “my_model” “{‘basin’: [x,y]}” -i wflow_build.ini -d data_catalog.yml -vv
  • 15. About HydroMT • Data-centred model building with HydroMT − Rapid model building/updating globally 15 Useful in quick scan analysis Ventiane Laos example: flood hazard and impact mapping wflow + SFINCS + Delft-FIAT Useful in data-scarce regions Coumpound flood modelling Mozambique
  • 16. About HydroMT • Data-centred model building with HydroMT − Rapid model building /updating globally − Small to large applications 16 AXA Western Europe World Water Quality Assessment
  • 17. About HydroMT • Data-centred model building with HydroMT − Rapid model building /updating globally − Small to large applications − Operate on global and local datasets (data harmonization) 17 Global population grid Mines locations Regional statistics Water Quality Diagnostic in Peru Mix of 40+ emission data from global and local sources
  • 18. About HydroMT • Data-centred model building with HydroMT − Rapid model building /updating globally − Small to large applications − Operate on global and local datasets (data harmonization) − Support developments in enhancing these local datasets 18 BMA Bangkok Improving local data to build Delft3DFM models
  • 19. About HydroMT • Data-centred model building with HydroMT − Rapid model building /updating globally − Small to large applications − Operate on global and local datasets (data harmonization) − Support developments in enhancing these local datasets − Modular tool: methods and workflows can be reused for different models (plugins) 19
  • 20. Steps to run HydroMT
  • 21. Building a model • Steps to build a model 1. Select the data you want to use, download if needed, and prepare a data catalog or use a pre-defined one. 2. Select your region of interest. 3. Select the model components you want to build and the options (data source, resampling method etc.) by preparing a model configuration file or use a pre-defined one. 4. Build your model using the Command Line Interface (CLI) or Python. 21 HydroMT documentation: https://deltares.github.io/hydromt/latest/user_guide/model_build.html > hydromt build wflow “my_model” “{‘basin’: [x,y]}” -i wflow_build.ini -d data_catalog.yml -vv
  • 23. Building a first wflow model for the Mara river
  • 24. Building another one for Mbalangeti river
  • 26. Building a Delft3D FM model
  • 28. Using HydroMT • Approach data at the center of model building − First get a model from (global) available data − Improve with local data • Usage − Many types of projects and a lot of applications use HydroMT directly − Tools powered by HydroMT: Climate Stress Test Toolbox, FloodAdapt • Available plugins − wflow − D-Flow FM (Delft3D FM Suite) − SFINCS − Delft-FIAT − DELWAQ (kernel of the D-Water Quality and D-Emissions modules of the Delft3D FM Suite) 28
  • 29. Upcoming features • Data: reduce effort to download data and write data catalogs − Use data from public clouds like Google GCS or Amazon AWS − Use data available via API like OpenStreetMap or Copernicus − Use directly download-able data through https like wind atlas or many more • Models: make it easier to prepare data without a plugin − ‘Generic’ models like GridModel (regular grid), MeshModel (unstructured grid), VectorModel (lumped and semi-distributed), NetworkModel (networks) − Generic models helps prepare all data required but in common GIS formats rather than model formats • Others: − Commands and tools to help analyze or export and share data − Commands and tools to help quickly visualize and analyze model results − Conversion commands to convert model data to common GIS formats (new data or connect models) 29
  • 30. Links HydroMT and HydroMT-wflow • HydroMT docs: https://deltares.github.io/hydromt/latest/ • Github HydroMT: https://github.com/Deltares/hydromt • Plugins: − HydroMT wflow: https://deltares.github.io/hydromt_wflow/ − HydroMT SFINCS: https://deltares.github.io/hydromt_sfincs/ − HydroMT FIAT: https://deltares.github.io/hydromt_fiat/ − HydroMT DELWAQ: https://deltares.github.io/hydromt_delwaq/ − HydroMT D-Flow FM: https://deltares.github.io/hydromt_delft3dfm/
  • 31. Thank you for your attention! www.deltares.nl info@deltares.nl @deltares @deltares linkedin.com/company/deltares facebook.com/deltaresNL