DSD-INT 2021 Towards a Deltares cloud computing service - Elzinga
•
0 likes•172 views
Presentation by Hidde Elzinga, lead software developer, at Deltares, at the webinar Towards a Deltares cloud computing service, during Delft Software Days - Edition 2021. Friday, 5 November 2021.
Recommended
More Related Content
What's hot
What's hot (19)
Similar to DSD-INT 2021 Towards a Deltares cloud computing service - Elzinga
Similar to DSD-INT 2021 Towards a Deltares cloud computing service - Elzinga (20)
More from Deltares
More from Deltares (20)
Recently uploaded
Recently uploaded (20)
DSD-INT 2021 Towards a Deltares cloud computing service - Elzinga
- 1. Hidde Elzinga 5-11-2021 Towards a Deltares cloud computing service
- 2. Table of contents 2 • Introduction • Overview • Computing service • Current developments • How to use it / Demo • Questions from us (Mentimeter) • Questions Delft Software Days - Edition 2021 (DSD-INT 2021)
- 3. Introduction 3 Why we started with cloud services • We see a growing demand from our users for online services • We want to have scalable solutions when it comes to large models, large amount of model runs and handling large datasets • Offer a different way for running models using a Web API • Make it easy to incorporate cloud services in our users workflow • Offer more automation in building models based on data • Make it easy for us to deliver the latest versions of our software and to add new functionalities (modularity) Delft Software Days - Edition 2021 (DSD-INT 2021)
- 4. Overview 4 How do we want to make the cloud services available d Deltares Marketplace Software Data Compute Model Training Support Events Research Communities Delft Software Days - Edition 2021 (DSD-INT 2021)
- 5. Overview 5 • Single Sign-On • Register for events/courses • Links to communities • Central point to get to Deltares services Sign on Services and products Courses and events News Profile Communities Example Delft Software Days - Edition 2021 (DSD-INT 2021)
- 6. Computing service 6 • Generic computing service (supporting all kinds of models, scripts etc.) • It is available as a Web API so it can be easily be integrated and used as a building block • It support multiple (internal) steps • Modular (build up from separate (micro) services) • Using MyDeltares for access This Photo by Unknown Author is licensed under CC BY-NC-ND Delft Software Days - Edition 2021 (DSD-INT 2021)
- 7. Computing service 7 Computing service MyDeltares authentication service File storage service Payment service (using credit) Delft Software Days - Edition 2021 (DSD-INT 2021)
- 9. Current developments 9 We implemented first working version (using Delft3D FM, HydroMT workflows) 2020 2021 We added a payment module and are making a test version We try to launch a first externally available version 2022 Delft Software Days - Edition 2021 (DSD-INT 2021)
- 10. How to use it (Delft3D FM workflow) 10 To be able to use it, we need the following • Valid MyDeltares login • Credit available (to pay for used resources) Delft Software Days - Edition 2021 (DSD-INT 2021)
- 11. 11 Starting a run • Start by logging on with MyDeltares credentials • Upload a zip file with the DIMR files (containing your Delft3D FM schematization) • Start a run providing − The workflow (process id) you would like to run (Delft3D FM in this case) − Name of the run − Description − The location of the DIMR files (zip file) − The length the model can run for (maximum time) − What credit to use (credit number) Delft Software Days - Edition 2021 (DSD-INT 2021) How to use it (Delft3D FM workflow)
- 12. What happens in the background when the run is requested • The maximum run costs are determined based on the maximum time • A claim is added on the selected credit • Computation starts • After the computation finishes the real costs are determined • The costs are deducted from the claim • The remainder of the claimed amount is freed 12 Delft Software Days - Edition 2021 (DSD-INT 2021) How to use it (Delft3D FM workflow)
- 13. Retrieving results when a run is finished • Using the run id (job id) query the run details • In the retrieved details the output path is specified • Download the results from the output path 13 Delft Software Days - Edition 2021 (DSD-INT 2021) How to use it (Delft3D FM workflow)
- 14. Managing runs • The computing service will provide an overview of the runs − Showing there status (running/finished) − What input was used − Where the output is (or will be) − Allowing you to stop running models − Delete old runs 14 Delft Software Days - Edition 2021 (DSD-INT 2021) How to use it (Delft3D FM workflow)
- 15. • Demo − API − Web frontend − Desktop frontend 15 Delft Software Days - Edition 2021 (DSD-INT 2021) How to use it (Delft3D FM workflow)
- 16. Questions If you want to help us test the service or have feedback/suggestions please let me know Hidde.Elzinga@Deltares.nl We love to hear what you think! 16 Delft Software Days - Edition 2021 (DSD-INT 2021)