SlideShare a Scribd company logo
1 of 21
Download to read offline
1Challenge the future
Autolocalization techniques for ocean
modelling using OpenDA
Nils van Velzen, Umer Altaf, Martin Verlaan, Arnold Heemink
Workshop on Meteorological Sensitivity Analysis and Data Assimilation
1-5 June 2015 Roanoke, West Virginia
2Challenge the future
Outline
• OpenDA
•  Ensemble methods and localization
•  Automatic localization techniques
•  Experiments with NEMO model
3Challenge the future
OpenDA: framework for Data Assimiation
•  Content:
–  Set of interfaces that define interactions between components
–  Library of data-assimilation algorithms
–  DA philosophy
–  Building blocks only need to
be implemented once
4Challenge the future
OpenDA: framework for Data Assimiation
• Black box coupling
•  Model needs proper restart functionality
•  + Easy to implemented
•  + No change to model code
•  - Restart/file overhead
•  - localization might be difficult to implement
5Challenge the future
Localization
•  Ensemble Kalman methods:
•  Analyzed ensemble is given by:
6Challenge the future
Localization
•  Covariance: low rank approximation compared to model
state:
•  Structural underestimation of errors
•  Spurious correlations
7Challenge the future
Localization
•  Ensemble is set of “basis” vectors for representing errors
and update
8Challenge the future
Localization
•  Localization of gain matrix
•  Increases “dimension” of the update
•  How to determine ?
•  Is distance a good measure?
•  What is the location of state variables
9Challenge the future
Localization
Source:wikipedia
10Challenge the future
Localization
Source:deltares
11Challenge the future
Auto Localization
•  Anderson 2004:
•  Define Ng groups of Ne ensembles
•  Each group has its own gain matrix
•  Assume elements from gain matrices are drawn from
distribution containing the “true” gain matrix.
•  Minimize:
•  Too much computational work for real time application
•  Good for investigating good selections of weights
12Challenge the future
Auto Localization
•  Zhang and Oliver 2011:
•  Create ensemble (NB) of gain matrices based on the initial
ensemble using bootstrapping
•  Estimation of variance of each element of the gain matrix
•  Ratio between mean and variance
•  Localization weights
•  Balance parameter (Zhang and Oliver 2010)
13Challenge the future
Experiment Setup
Medium Case Benchmark
• Free run 40 years.
• State vector includes:
(ub,vb,tb,sshb,un,vn,tn,sshn)
Ensemble Kalman filter
• 30/100 Ensemble members
• SSH observations. ENVISAT, Jason-1
•  Analysis: 2 days
14Challenge the future
Experiment Setup
15Challenge the future
Results
16Challenge the future
Results
Medium Case Benchmark
• Assimilating SSH every 2 days
• Assimilation period: 1 year
17Challenge the future
18Challenge the future
19Challenge the future
20Challenge the future
Medium Case Benchmark Results
•  Localization improves results
•  Limitation: No. of observation
21Challenge the future
•  NEMO-OpenDA framework is established.
•  Localization is not trivial to implement
•  Auto localization seems promising
•  Next steps:
•  More experimenting
•  Combine auto localization with normal localization
Acknowledgements:
This work is supported by SANGOMA a European FP7-SPACE-2011 project, Grant 283580.
This work was carried out with the support of the Danish Council for Strategic Research as part of the project
”HydroCast e Hydrological Forecasting and Data Assimilation”, Contract No. 11- 116880 (http://
hydrocast.dhigroup.com/).
Summary

More Related Content

Viewers also liked

Kims Resume revised
Kims Resume revisedKims Resume revised
Kims Resume revisedKim Pike
 
Hogar san José del municipio de Convención.
Hogar san José del municipio de Convención.Hogar san José del municipio de Convención.
Hogar san José del municipio de Convención.anitamosu
 
CFMA May 2015 - Recruitment & Retention
CFMA May 2015 - Recruitment & RetentionCFMA May 2015 - Recruitment & Retention
CFMA May 2015 - Recruitment & RetentionChristine Rahlf
 
Bat kid
Bat kidBat kid
Bat kid119604
 
마말레이드 GUI PPT입니다.
마말레이드 GUI PPT입니다.마말레이드 GUI PPT입니다.
마말레이드 GUI PPT입니다.ChoiHyoRim
 
Introduction_to_dataassimilation
Introduction_to_dataassimilationIntroduction_to_dataassimilation
Introduction_to_dataassimilationNils van Velzen
 
Sci 13 - Students Understanding of Science
Sci 13 - Students Understanding of ScienceSci 13 - Students Understanding of Science
Sci 13 - Students Understanding of SciencePaul John Barrientos
 
Introduction_modern_fortran_short
Introduction_modern_fortran_shortIntroduction_modern_fortran_short
Introduction_modern_fortran_shortNils van Velzen
 
오순도순 병아리 GUI
오순도순 병아리 GUI오순도순 병아리 GUI
오순도순 병아리 GUIChoiHyoRim
 
Marie-Ève Auger CV Design Graphique 2016
Marie-Ève Auger CV Design Graphique 2016Marie-Ève Auger CV Design Graphique 2016
Marie-Ève Auger CV Design Graphique 2016Marie-Ève Auger
 
Nota lengkap budaya dan masyarakat(ansos)
Nota lengkap budaya dan masyarakat(ansos)Nota lengkap budaya dan masyarakat(ansos)
Nota lengkap budaya dan masyarakat(ansos)Muhd Hasrul
 

Viewers also liked (19)

Kims Resume revised
Kims Resume revisedKims Resume revised
Kims Resume revised
 
CV JCLefebvre eng
CV JCLefebvre engCV JCLefebvre eng
CV JCLefebvre eng
 
Memoire Fossi_corrige
Memoire Fossi_corrigeMemoire Fossi_corrige
Memoire Fossi_corrige
 
Hogar san José del municipio de Convención.
Hogar san José del municipio de Convención.Hogar san José del municipio de Convención.
Hogar san José del municipio de Convención.
 
Heat in volume changes
Heat in volume changesHeat in volume changes
Heat in volume changes
 
звіт директора 2015
звіт директора 2015звіт директора 2015
звіт директора 2015
 
CFMA May 2015 - Recruitment & Retention
CFMA May 2015 - Recruitment & RetentionCFMA May 2015 - Recruitment & Retention
CFMA May 2015 - Recruitment & Retention
 
EGU2015
EGU2015EGU2015
EGU2015
 
Bat kid
Bat kidBat kid
Bat kid
 
마말레이드 GUI PPT입니다.
마말레이드 GUI PPT입니다.마말레이드 GUI PPT입니다.
마말레이드 GUI PPT입니다.
 
Introduction_to_dataassimilation
Introduction_to_dataassimilationIntroduction_to_dataassimilation
Introduction_to_dataassimilation
 
CV JCLefebvre fr
CV JCLefebvre frCV JCLefebvre fr
CV JCLefebvre fr
 
Julian Felipe
Julian FelipeJulian Felipe
Julian Felipe
 
Sci 13 - Students Understanding of Science
Sci 13 - Students Understanding of ScienceSci 13 - Students Understanding of Science
Sci 13 - Students Understanding of Science
 
Introduction_modern_fortran_short
Introduction_modern_fortran_shortIntroduction_modern_fortran_short
Introduction_modern_fortran_short
 
오순도순 병아리 GUI
오순도순 병아리 GUI오순도순 병아리 GUI
오순도순 병아리 GUI
 
Marie-Ève Auger CV Design Graphique 2016
Marie-Ève Auger CV Design Graphique 2016Marie-Ève Auger CV Design Graphique 2016
Marie-Ève Auger CV Design Graphique 2016
 
Nota lengkap budaya dan masyarakat(ansos)
Nota lengkap budaya dan masyarakat(ansos)Nota lengkap budaya dan masyarakat(ansos)
Nota lengkap budaya dan masyarakat(ansos)
 
openda_local_analysis
openda_local_analysisopenda_local_analysis
openda_local_analysis
 

Similar to adjoint10_nilsvanvelzen

The Status of ML Algorithms for Structure-property Relationships Using Matb...
The Status of ML Algorithms for Structure-property Relationships Using Matb...The Status of ML Algorithms for Structure-property Relationships Using Matb...
The Status of ML Algorithms for Structure-property Relationships Using Matb...Anubhav Jain
 
ResNeSt: Split-Attention Networks
ResNeSt: Split-Attention NetworksResNeSt: Split-Attention Networks
ResNeSt: Split-Attention NetworksSeunghyun Hwang
 
Handling Missing Attributes using Matrix Factorization 
Handling Missing Attributes using Matrix Factorization Handling Missing Attributes using Matrix Factorization 
Handling Missing Attributes using Matrix Factorization CS, NcState
 
JOB SCHEDULING USING ANT COLONY OPTIMIZATION ALGORITHM
JOB SCHEDULING USING ANT COLONY OPTIMIZATION ALGORITHMJOB SCHEDULING USING ANT COLONY OPTIMIZATION ALGORITHM
JOB SCHEDULING USING ANT COLONY OPTIMIZATION ALGORITHMmailjkb
 
End-to-End Object Detection with Transformers
End-to-End Object Detection with TransformersEnd-to-End Object Detection with Transformers
End-to-End Object Detection with TransformersSeunghyun Hwang
 
Nimrita deep learning
Nimrita deep learningNimrita deep learning
Nimrita deep learningNimrita Koul
 
Automating Speed: A Proven Approach to Preventing Performance Regressions in ...
Automating Speed: A Proven Approach to Preventing Performance Regressions in ...Automating Speed: A Proven Approach to Preventing Performance Regressions in ...
Automating Speed: A Proven Approach to Preventing Performance Regressions in ...HostedbyConfluent
 
Presentation - Predicting Online Purchases Using Conversion Prediction Modeli...
Presentation - Predicting Online Purchases Using Conversion Prediction Modeli...Presentation - Predicting Online Purchases Using Conversion Prediction Modeli...
Presentation - Predicting Online Purchases Using Conversion Prediction Modeli...Christopher Sneed, MSDS, PMP, CSPO
 
Dr. Erin LeDell, Machine Learning Scientist, H2O.ai at MLconf SEA - 5/20/16
Dr. Erin LeDell, Machine Learning Scientist, H2O.ai at MLconf SEA - 5/20/16Dr. Erin LeDell, Machine Learning Scientist, H2O.ai at MLconf SEA - 5/20/16
Dr. Erin LeDell, Machine Learning Scientist, H2O.ai at MLconf SEA - 5/20/16MLconf
 
Comparison of Learning Algorithms for Handwritten Digit Recognition
Comparison of Learning Algorithms for Handwritten Digit RecognitionComparison of Learning Algorithms for Handwritten Digit Recognition
Comparison of Learning Algorithms for Handwritten Digit RecognitionSafaa Alnabulsi
 
Erin LeDell, Machine Learning Scientist, H2O.ai at MLconf ATL 2016
Erin LeDell, Machine Learning Scientist, H2O.ai at MLconf ATL 2016Erin LeDell, Machine Learning Scientist, H2O.ai at MLconf ATL 2016
Erin LeDell, Machine Learning Scientist, H2O.ai at MLconf ATL 2016MLconf
 
How Machine Learning Helps Organizations to Work More Efficiently?
How Machine Learning Helps Organizations to Work More Efficiently?How Machine Learning Helps Organizations to Work More Efficiently?
How Machine Learning Helps Organizations to Work More Efficiently?Tuan Yang
 
Transfer defect learning
Transfer defect learningTransfer defect learning
Transfer defect learningSung Kim
 
DutchMLSchool 2022 - History and Developments in ML
DutchMLSchool 2022 - History and Developments in MLDutchMLSchool 2022 - History and Developments in ML
DutchMLSchool 2022 - History and Developments in MLBigML, Inc
 
Explicit Density Models
Explicit Density ModelsExplicit Density Models
Explicit Density ModelsSangwoo Mo
 
Data mining with Weka
Data mining with WekaData mining with Weka
Data mining with WekaAlbanLevy
 
Mx net image segmentation to predict and diagnose the cardiac diseases karp...
Mx net image segmentation to predict and diagnose the cardiac diseases   karp...Mx net image segmentation to predict and diagnose the cardiac diseases   karp...
Mx net image segmentation to predict and diagnose the cardiac diseases karp...KannanRamasamy25
 
Elasticsearch Sharding Strategy at Tubular Labs
Elasticsearch Sharding Strategy at Tubular LabsElasticsearch Sharding Strategy at Tubular Labs
Elasticsearch Sharding Strategy at Tubular LabsTubular Labs
 
Metamorphic Testing Thesis Defense.pptx
Metamorphic Testing Thesis Defense.pptxMetamorphic Testing Thesis Defense.pptx
Metamorphic Testing Thesis Defense.pptxentertainmentweekly11
 

Similar to adjoint10_nilsvanvelzen (20)

The Status of ML Algorithms for Structure-property Relationships Using Matb...
The Status of ML Algorithms for Structure-property Relationships Using Matb...The Status of ML Algorithms for Structure-property Relationships Using Matb...
The Status of ML Algorithms for Structure-property Relationships Using Matb...
 
ResNeSt: Split-Attention Networks
ResNeSt: Split-Attention NetworksResNeSt: Split-Attention Networks
ResNeSt: Split-Attention Networks
 
Handling Missing Attributes using Matrix Factorization 
Handling Missing Attributes using Matrix Factorization Handling Missing Attributes using Matrix Factorization 
Handling Missing Attributes using Matrix Factorization 
 
JOB SCHEDULING USING ANT COLONY OPTIMIZATION ALGORITHM
JOB SCHEDULING USING ANT COLONY OPTIMIZATION ALGORITHMJOB SCHEDULING USING ANT COLONY OPTIMIZATION ALGORITHM
JOB SCHEDULING USING ANT COLONY OPTIMIZATION ALGORITHM
 
End-to-End Object Detection with Transformers
End-to-End Object Detection with TransformersEnd-to-End Object Detection with Transformers
End-to-End Object Detection with Transformers
 
Nimrita deep learning
Nimrita deep learningNimrita deep learning
Nimrita deep learning
 
Automating Speed: A Proven Approach to Preventing Performance Regressions in ...
Automating Speed: A Proven Approach to Preventing Performance Regressions in ...Automating Speed: A Proven Approach to Preventing Performance Regressions in ...
Automating Speed: A Proven Approach to Preventing Performance Regressions in ...
 
Presentation - Predicting Online Purchases Using Conversion Prediction Modeli...
Presentation - Predicting Online Purchases Using Conversion Prediction Modeli...Presentation - Predicting Online Purchases Using Conversion Prediction Modeli...
Presentation - Predicting Online Purchases Using Conversion Prediction Modeli...
 
Dr. Erin LeDell, Machine Learning Scientist, H2O.ai at MLconf SEA - 5/20/16
Dr. Erin LeDell, Machine Learning Scientist, H2O.ai at MLconf SEA - 5/20/16Dr. Erin LeDell, Machine Learning Scientist, H2O.ai at MLconf SEA - 5/20/16
Dr. Erin LeDell, Machine Learning Scientist, H2O.ai at MLconf SEA - 5/20/16
 
Comparison of Learning Algorithms for Handwritten Digit Recognition
Comparison of Learning Algorithms for Handwritten Digit RecognitionComparison of Learning Algorithms for Handwritten Digit Recognition
Comparison of Learning Algorithms for Handwritten Digit Recognition
 
Erin LeDell, Machine Learning Scientist, H2O.ai at MLconf ATL 2016
Erin LeDell, Machine Learning Scientist, H2O.ai at MLconf ATL 2016Erin LeDell, Machine Learning Scientist, H2O.ai at MLconf ATL 2016
Erin LeDell, Machine Learning Scientist, H2O.ai at MLconf ATL 2016
 
ICML2015 Slides
ICML2015 SlidesICML2015 Slides
ICML2015 Slides
 
How Machine Learning Helps Organizations to Work More Efficiently?
How Machine Learning Helps Organizations to Work More Efficiently?How Machine Learning Helps Organizations to Work More Efficiently?
How Machine Learning Helps Organizations to Work More Efficiently?
 
Transfer defect learning
Transfer defect learningTransfer defect learning
Transfer defect learning
 
DutchMLSchool 2022 - History and Developments in ML
DutchMLSchool 2022 - History and Developments in MLDutchMLSchool 2022 - History and Developments in ML
DutchMLSchool 2022 - History and Developments in ML
 
Explicit Density Models
Explicit Density ModelsExplicit Density Models
Explicit Density Models
 
Data mining with Weka
Data mining with WekaData mining with Weka
Data mining with Weka
 
Mx net image segmentation to predict and diagnose the cardiac diseases karp...
Mx net image segmentation to predict and diagnose the cardiac diseases   karp...Mx net image segmentation to predict and diagnose the cardiac diseases   karp...
Mx net image segmentation to predict and diagnose the cardiac diseases karp...
 
Elasticsearch Sharding Strategy at Tubular Labs
Elasticsearch Sharding Strategy at Tubular LabsElasticsearch Sharding Strategy at Tubular Labs
Elasticsearch Sharding Strategy at Tubular Labs
 
Metamorphic Testing Thesis Defense.pptx
Metamorphic Testing Thesis Defense.pptxMetamorphic Testing Thesis Defense.pptx
Metamorphic Testing Thesis Defense.pptx
 

adjoint10_nilsvanvelzen

  • 1. 1Challenge the future Autolocalization techniques for ocean modelling using OpenDA Nils van Velzen, Umer Altaf, Martin Verlaan, Arnold Heemink Workshop on Meteorological Sensitivity Analysis and Data Assimilation 1-5 June 2015 Roanoke, West Virginia
  • 2. 2Challenge the future Outline • OpenDA •  Ensemble methods and localization •  Automatic localization techniques •  Experiments with NEMO model
  • 3. 3Challenge the future OpenDA: framework for Data Assimiation •  Content: –  Set of interfaces that define interactions between components –  Library of data-assimilation algorithms –  DA philosophy –  Building blocks only need to be implemented once
  • 4. 4Challenge the future OpenDA: framework for Data Assimiation • Black box coupling •  Model needs proper restart functionality •  + Easy to implemented •  + No change to model code •  - Restart/file overhead •  - localization might be difficult to implement
  • 5. 5Challenge the future Localization •  Ensemble Kalman methods: •  Analyzed ensemble is given by:
  • 6. 6Challenge the future Localization •  Covariance: low rank approximation compared to model state: •  Structural underestimation of errors •  Spurious correlations
  • 7. 7Challenge the future Localization •  Ensemble is set of “basis” vectors for representing errors and update
  • 8. 8Challenge the future Localization •  Localization of gain matrix •  Increases “dimension” of the update •  How to determine ? •  Is distance a good measure? •  What is the location of state variables
  • 11. 11Challenge the future Auto Localization •  Anderson 2004: •  Define Ng groups of Ne ensembles •  Each group has its own gain matrix •  Assume elements from gain matrices are drawn from distribution containing the “true” gain matrix. •  Minimize: •  Too much computational work for real time application •  Good for investigating good selections of weights
  • 12. 12Challenge the future Auto Localization •  Zhang and Oliver 2011: •  Create ensemble (NB) of gain matrices based on the initial ensemble using bootstrapping •  Estimation of variance of each element of the gain matrix •  Ratio between mean and variance •  Localization weights •  Balance parameter (Zhang and Oliver 2010)
  • 13. 13Challenge the future Experiment Setup Medium Case Benchmark • Free run 40 years. • State vector includes: (ub,vb,tb,sshb,un,vn,tn,sshn) Ensemble Kalman filter • 30/100 Ensemble members • SSH observations. ENVISAT, Jason-1 •  Analysis: 2 days
  • 16. 16Challenge the future Results Medium Case Benchmark • Assimilating SSH every 2 days • Assimilation period: 1 year
  • 20. 20Challenge the future Medium Case Benchmark Results •  Localization improves results •  Limitation: No. of observation
  • 21. 21Challenge the future •  NEMO-OpenDA framework is established. •  Localization is not trivial to implement •  Auto localization seems promising •  Next steps: •  More experimenting •  Combine auto localization with normal localization Acknowledgements: This work is supported by SANGOMA a European FP7-SPACE-2011 project, Grant 283580. This work was carried out with the support of the Danish Council for Strategic Research as part of the project ”HydroCast e Hydrological Forecasting and Data Assimilation”, Contract No. 11- 116880 (http:// hydrocast.dhigroup.com/). Summary