Presentation by Gerben Boot (Deltares) at Earth Observation and Data Science Symposium, during Delft Software Days 2016. Monday 24 October 2016, Delft.

1. 24th of October 2016
(Open) Data Science in SWITCH-ON
Earth Observation and Data Science Symposium
International Delft Software Days 2016
Gerben Boot (Deltares) – Work Package Leader SWITCH-ON

2. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
Overview
• (a bit) more about SWITCH-ON…
• Open Data: where to start…
• (Open) Data science in:
• Tools
• Products and services
• Scientific collaborations
24th of October 2016

3. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
(a bit) more about SWITCH-ON…
• Sharing Water-related Information to Tackle Changes in the Hydrosphere - for Operational Needs
• EU FP7 project
• 01.11.2013 – 01.11.2017
• € 6 million (EU contribution)
24th of October 2016
Repurpose open data into products &
services, carry out collaborative research
and promote all of the above…

4. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
(a bit) more about SWITCH-ON…
• 15 partners
• Countries (7)
• Sweden, UK, Germany, Austria,
Netherlands, Italy, Greece
• Backgrounds (3)
• 2 (National) Research Institutes
• 5 Universities
• 8 SME
24th of October 2016

5. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
(open) data science in several tiles…
24th of October 2016

6. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
It all starts with (open) data…
• Knowing it exists...(somewhere)
• Attempting to access…(sometimes)
• Understanding…(somehow)
• Assuming use conditions…(somewhat)
24th of October 2016
”Information already paid for by the public should
not be paid for again each time it is accessed or
used and it should benefit European companies
and citizens to the full (EU 2012)”

7. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
Open data process…
24th of October 2016
Create data sets
Format data sets
Provide data sets online
Write abstract
Geo-relate data sets
Classify data sets
Enter metadata
Maintain metadata
Develop metadata standard
Develop classification system
Locate datasets matching keyword
Locate datasets matching geo
Listing matching data sets
Show data sample
Search using classification
Search based on geolocation
Search based on keyword
Pick data sets
Provide download service
Download dataset
Open dataset
Understand dataset
Use data set
Producer Infrastructure User
P I U

8. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
The producer’s view…
24th of October 2016
Create data sets
Format data sets
Provide data sets online
Write abstract
Geo-relate data sets
Classify data sets
Enter metadata
Maintain metadata
Develop metadata standard
Develop classification system
Locate datasets matching keyword
Locate datasets matching geo
Listing matching data sets
Show data sample
Search using classification
Search based on geolocation
Search based on keyword
Pick data sets
Provide download service
Download dataset
Open dataset
Understand dataset
Use data set
P I U
”Research is done”,
”Can’t update all portals...”

9. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
The infrastructure’s view…
24th of October 2016
Create data sets
Format data sets
Provide data sets online
Write abstract
Geo-relate data sets
Classify data sets
Enter metadata
Maintain metadata
Develop metadata standard
Develop classification system
Locate datasets matching keyword
Locate datasets matching geo
Listing matching data sets
Show data sample
Search using classification
Search based on geolocation
Search based on keyword
Pick data sets
Provide download service
Download dataset
Open dataset
Understand dataset
Use data set
P I U
”I don’t know the data…”
”..OGC, XML, WFS, HDF!”

10. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
The user’s view…
24th of October 2016
Create data sets
Format data sets
Provide data sets online
Write abstract
Geo-relate data sets
Classify data sets
Enter metadata
Maintain metadata
Develop metadata standard
Develop classification system
Locate datasets matching keyword
Locate datasets matching geo
Listing matching data sets
Show data sample
Search using classification
Search based on geolocation
Search based on keyword
Pick data sets
Provide download service
Download dataset
Open dataset
Understand dataset
Use data set
P I U
”I just want to search,
download and use the data”

11. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
The overlap…
24th of October 2016
Create data sets
Format data sets
Provide data sets online
Write abstract
Geo-relate data sets
Classify data sets
Enter metadata
Maintain metadata
Develop metadata standard
Develop classification system
Locate datasets matching keyword
Locate datasets matching geo
Listing matching data sets
Show data sample
Search using classification
Search based on geolocation
Search based on keyword
Pick data sets
Provide download service
Download dataset
Open dataset
Understand dataset
Use data set
P I U
”Mind the gap...”

12. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
SWITCH-ON tools…
24th of October 2016
Create data sets
Format data sets
Provide data sets online
Write abstract
Geo-relate data sets
Classify data sets
Enter metadata
Maintain metadata
Develop metadata standard
Develop classification system
Locate datasets matching keyword
Locate datasets matching geo
Listing matching data sets
Show data sample
Search using classification
Search based on geolocation
Search based on keyword
Pick data sets
Provide download service
Download dataset
Open dataset
Understand dataset
Use data set
P I U
”small(er) gap...”
UPLOAD TOOL
DOWNLOAD
SWITCH-ON
METADATA
LIBRARY
SEARCH
TOOL

13. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
SWITCH-ON tools:
24th of October 2016
UPLOAD TOOL
SWITCH-ON
METADATA
LIBRARY
SEARCH
TOOL
DOWNLOAD

14. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
• Relevant hydrological datasets
• Existing metadata keyword
classification: CUAHSI (extended)
• > 8300 resources (± 800 refs) of
correct(ed) metadata
• Spatial extent added (better than
‘world’ or ‘europe’)
• Varying formats
SWITCH-ON tools:
24th of October 2016
UPLOAD TOOL
SWITCH-ON
METADATA
LIBRARY
SEARCH
TOOL
DOWNLOAD

15. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
• Non commercial use or usable for
science / with acknowledgement
• Majority: direct downloadable
• Minority: send request or read-only
SWITCH-ON tools:
24th of October 2016
UPLOAD TOOL
SWITCH-ON
METADATA
LIBRARY
SEARCH
TOOL
DOWNLOAD

16. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
SWITCH-ON tools:
24th of October 2016
UPLOAD TOOL
SWITCH-ON
METADATA
LIBRARY
DOWNLOAD
SEARCH
TOOL
Expert Tool (metadata experts)
Simple Tool (consortium members, public)

17. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
• Simple map or keyword based search / result list
• Visual representation
• Keyword filtering
SWITCH-ON tools:
24th of October 2016
UPLOAD TOOL
SWITCH-ON
METADATA
LIBRARY
SEARCH
TOOL
DOWNLOAD

18. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
• Simple map or keyword based search / result list
• Visual representation
• Keyword filtering
• Metadata inspection
• Download link
SWITCH-ON tools:
24th of October 2016
UPLOAD TOOL
SWITCH-ON
METADATA
LIBRARY
SEARCH
TOOL
DOWNLOAD
Catalogue: harvestable (GEOSS)

19. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
(open) data applied in (14) products & services…
24th of October 2016

20. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
(open) data applied in (14) products & services…
24th of October 2016

21. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
(open) data applied in (14) products & services…
24th of October 2016

22. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
(open) data applied in (14) products & services…
24th of October 2016

23. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
(open) data applied in (14) products & services…
24th of October 2016

24. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
(open) data applied in (14) products & services…
24th of October 2016

25. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
(open) data applied in (14) products & services…
24th of October 2016

26. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
(open) data applied in (14) products & services…
24th of October 2016

27. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
(open) data applied in (14) products & services…
24th of October 2016

28. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
(open) data applied in (14) products & services…
24th of October 2016

29. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
(open) data applied in (14) products & services…
24th of October 2016

30. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
(open) data applied in (14) products & services…
24th of October 2016

31. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
(open) data applied in (14) products & services…
24th of October 2016

32. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
(open) data applied in (14) products & services…
24th of October 2016

33. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
(open) data applied in (14) products & services…
24th of October 2016

34. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
(open) data in collaborative research…
24th of October 2016
”For most experiments the tedious task of collecting data and preparing
it takes more than half of the project effort and it is not uncommon to run
into data-problems. Knowledge about data is essential...”
Open Virtual Water-Science Laboratory
Research infrastructure to facilitate collaboration, transparency and
repeatable computational experiments.

35. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
(open) data in collaborative research…
• Define a NEW experiment…
• JOIN an existing experiment…
• REVIEW or REPEAT a completed experiment…
24th of October 2016
Preparation phase Ongoing
(invitation to join)
Completed
(invitation to review or repeat)
Create a protocol first… River Memory
Constraining Models
Snowline changes
Rhine Model
Virtual Laboratories
Nightlights
GEEHP
Flood Change
CAPICHE
Spatial Patterns
Nutrient Estimates
Root Zone Storage

36. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
24th of October 2016

37. SWITCH-ON is an EU FP7 Collaborative project (grant agreement number 603587) under the Environment programme running from November 2013-October 2017
Thank you…
24th of October 2016
http://www.water-switch-on.eu/