SlideShare a Scribd company logo
How FAIR is GEOSS
S. Nativi (1), J. Van Bemmelen (2), M. Santoro (1), G. Colangeli (2)
O. Ochiai (3), P. De Salvo (3)
(1) Institute of Atmospheric Pollution Research,
National Research Council of Italy
(2) European Space Agency
(3) GEO Secretariat
BlueBRIDGE Workshop
3 April, 2017
GEO AND GEOSS
Group on Earth Observation and Global Earth Observation system
of systems
GEO AND GEOSS
Group on Earth Observation and Global Earth Observation system
of systems
GEO AND GEOSS
Group on Earth Observation and Global Earth Observation system
of systems
Global Earth Observation System of
Systems (GEOSS)
Together, the GEO community is creating a Global Earth
Observation System of Systems (GEOSS).
Earth observations from diverse sources, including satellite,
airborne, in-situ platforms, and citizen observatories, when
integrated together, provide powerful tools for understanding the
past and present conditions of Earth systems, as well as the
interplay between them.
GEOSS aims to better integrate observing systems and share data
by connecting existing infrastructures.
There are more than 200 million open data resources in GEOSS
from more than 150 national and regional providers such as NASA
and ESA; international organizations such as WMO and the
commercial sector such as Digital Globe.
IMPLEMENTING GEOSS
GEOSS Common Infrastructure (GCI)
GEOSS Applications
GEOSS Providers
GEOSS Application
Developers
(intermediate Users)
GEOSS
end-Users
GEOSS Applications
GEOSS ApplicationsGEOSS Applications
Enterprise
System j
… .
Enterprise
System 1
System
4Enterprise
System 3
Enterprise
System 2
… .
… .
… .
SBA 1 SBA 2
SBA 8
Enterpris
e System
K
Enterprise
System 3
System
4
Enterpris
e System
1
Enterprise
System 2 Enterprise
System Z
Enterprise
System 1
System
4Enterprise
System 2
Enterprise
System 3
GEOSS Portal
DOWNSTREAM
UPSTREAM
MIDSTREAM
GEOSS Common Infrastructure
APIs
Mediation modules
Societal Benefit Areas
Data Providers
> 200 million data resources
spanning all SBAs
GCI
M2M
Registration
GEOSS Common Infrastructure (GCI)
Enhanced GEOSS Portal - Overview
• Enhanced during 2016
• Accessible from www.geoportal.org
• Coordinated with ESA, CNR-IIA, DG-RTD, DG-JRC and
GeoSec
• Focus on engagement, delivery and advocating
• Structured in 3 phases
• 1st phase – 2016: interface restyling: completed
• 2nd phase – 2017/18: deployment of major upgrades
• 3rd phase – 2019 onwards – operations and evolutions
GEO Discovery and Access Broker (DAB)
GEO DAB is a brokering framework that interconnects hundreds
of heterogeneous and autonomous supply systems (the enterprise
systems constituting the GEO metasystem) by providing mediation,
harmonization and transformation capabilities.
GEOSS FAIRNESS
How GEOSS addresses FAIR Principles
FINDABLE
How GEOSS addresses FAIR Principles
Discovery in GEOSS
• GEOSS has to deal with the large amount of datasets
provided by the end systems, e.g. millions of (small to
medium size) products, and long EO time/space
series.
• GEOSS has to collect metadata (at least for
harvested catalogs) and provide effective
discoverability.
Adopted Solutions
• Dealing with such numbers, normally constrained
queries commonly match a large number of datasets.
• GCI addresses this challenge by returning a smaller
and/or an ordered result sets.
Views
Ranking and Paging
Ranking and Paging
No-SQL DB
Good performances on
large stores
No preliminary constraint
on data structure
Need to preliminarily
index queryable elements GEO DAB Internal
Metadata Model
Pre-calculated in batch,
based on:
Metadata Quality
Accessibility
Etc.
Calculated on-the-fly,
based on:
Query Constraints
Applied to scores
(configurable)
GEOSS View
• Definition:
– Subset of the whole GEOSS resources defined by applying,
via the DAB, a set of clauses
• Discovery clauses (e.g. spatial envelope, keywords,
sources, etc.)
• Access clauses (e.g. data format, access protocol, CRS,
etc.)
– Defined “View” exposed on the GEOSS Portal
Consumer-defined View – i.e. Client-side These
views are available only for the client application which
defined the view.
Provider-defined View –i.e. Server-side These
views are available for all client applications.
ACCESSIBLE
How GEOSS addresses FAIR Principles
Accessibility in GEOSS
• In GEOSS, main Access related challenges include:
– Visualization of data previews
• provide a fast preview service allowing users
quickly to evaluate discovered data before
deciding the download.
– Basic Transformations
• provide users with an easy (i.e. transparent)
access to the discovered data along with a set
of basic data transformations to make them
more easily processed
Accessibility in GEOSS - Visualization
• GEO DAB provides a fast preview service allowing to get data preview:
– Metadata record is augmented by adding a reference to data preview;
preview tiles at different zoom levels are generated in a batch mode.
– To store and retrieve single tiles in an efficient way, GEO DAB utilizes
a NoSQL key-value DB.
– When available, GEO DAB utilizes data provider fast preview services
by implementing the required mediation.
• GEOSS Portal uses allows Users to quickly evaluate discovered data
before deciding the download.
Accessibility in GEOSS – Basic
Transformations
• In an environment such as GEOSS, no matter which
technique is implemented there will always be cases
in which the required processing is consuming too
much time for a click-and-get pattern.
• The DAB + GEOSS Portal access transformation
allows to deliver discovered datasets according to a
common grid: format, Coordinate Reference System,
spatial and temporal extent and resolution.
• Where this transformation workflow requires a long
processing time, Users are allowed to opt for an
asynchronous version of the same services.
INTEROPERABLE
How GEOSS addresses FAIR Principles
Interoperability in GEOSS
More than 155 Brokered
Systems
About 200 M granules
Adopted Solutions – GEO DAB
• Introduction of a brokering tier (GEO DAB) dedicated
to mediation of service interfaces and metadata
models harmonization in a transparent way for both
users and data providers.
• The GEO DAB maps the diverse models onto its own
internal model, which is general enough to comprise
all the necessary concepts.
• The key features of the GEO DAB internal data and
metadata models are flexibility and extensibility
allowing adding new concepts and related attributes.
OGC CSW 2.0.2 AP ISO 1.0 INPE
OGC CSW 2.0.2 ebRIM EO CKAN
OGC CSW 2.0.2 ebRIM CIM DCAT
ESRI GEOPORTAL 10 GI-cat
OAI-PMH 2.0 ESRI GEOPORTAL 10
OpenSearch 1.1 NCML-OD
OpenSearch 1.1 ESIP BCODMO
OpenSearch GENESI DR NCML-CF
CKAN NetCDF-CF 1.4
CUAHSI HIS-Central FTP populated with supported metadata types
ESRI REST API 10.3 WAF Web Accessible Folders
OGC WCS GeoNetwork (2.2.0 or greater)
OGC WMS Ecological Markup Language2.1.1
OGC WFS 1.0.0, 1.1.0, 2.0.0 NERRS (National EstuarineResearch Reserve System)
OGC WMTS HMA CSW 2.0.2 ebRIM/CIM
OGC SOS 1.0.0, 2.0.0, 2.0.0 Hydro Profile HDF
OGC WPS 1.0.0 IADC DB (MySQL)
OGC CSW 2.0.0 Core GrADS-DS
OGC CSW 2.0.2 AP ISO 1.0 FedEO
OGC CSW 2.0.2 ebRIM/EO AP ARPA DB (based on Microsoft SQL)
OGC CSW 2.0.2 ebRIM/CIM AP ESRI Map Server
IRIS Station SHAPE files (FTP)
IRIS Event KISTERS Web - Environment ofCanada
HYRAX THREDDS SERVER 1.9 Environment Canada Hydrometric data (FTP)
OAI-PMH 2.0 - Harvesting OpenSearch 1.1
GBIF Earth Engine
DIF RASAQM
HYDRO EGASKRO
UNAVCO SITAD (Sistema Informativo TerritorialeAmbientaleDiffuso)
CDI 1.04, 1.3, 1.4 FileSystem
ISO19115-2 GDACS
THREDDS 1.0.1, 1.0.2 GeoRSS 2.0
THREDDS-NCISO 1.0.1, 1.0.2 Degree catalog service2.2
THREDDS-NCISO-PLUS 1.0.1, 1.0.2 OpenSearch GENESI DR
RE-USABLE
How GEOSS addresses FAIR Principles
Re-usability in GEOSS
• In GEOSS, challenges related to Re-usability mainly
stem from datasets heterogeneity.
• In addition, GEOSS needs to address the
requirement to support diverse (cross-)disciplinary
applications targeting different Communities and
User categories which have different needs, as for
data discovery and presentation in an informative and
significant way.
Adopted Solutions – GEOSS Portal
• User-centric, considering various user communities:
• GEO Flagships and Global initiatives
• ESA Thematic Exploitation Platforms
• SBA/Thematic Customization of search and results visualization:
– Satellite: includes smart filters for imagery (Landsat, Sentinel 2)
and SAR-type
(Sentinel 1) satellite data;
– Disater Resilience SBA: Earthquake events filters
• Focusing on providing resuable Portlets (for integration in external
Community Applications)
Adopted solutions – GEO DAB APIs
Different APIs for serving diverse Application development use cases (environments)
A set of standard Web service interfaces:
• e.g. OGC service interfaces, CKAN, OAI-PMH, FTP, etc.
A set of APIs for software developers:
• Client side APIs:
– (high-level) JavaScript library
– … . (Python)
• Server side APIs:
– REST/JSON APIs
– OpenSearch APIs
– … .
GEOSS Applications
GEOSS Application
Developers
(intermediate Users)
GEOSS
end-Users
GEOSS Applications
GEOSS ApplicationsGEOSS Applications
GEOSS Portal
DOWNSTREAM
MIDSTREAM
GEOSS Common Infrastructure
APIs
Mediation modules
Conclusions
• In the past 10 years GEOSS has developed a truly
Global and multidisciplinary System-of Systems
• A valuable framework to experiment and learn how to
deal Milti-disciplinary Interoperability challenges..
• The new GEOSS Portal + DAB platform signifcantly
improved the discoverability and accessibility of
sahred GEOSS resources, addressing more and
more User requirements.
Thank you

More Related Content

Similar to How FAIR is GEOSS

Metadata in EOSDIS
Metadata in EOSDISMetadata in EOSDIS
EPOS GNSS Data and Products TCS - What we do...
EPOS GNSS Data and Products TCS - What we do...EPOS GNSS Data and Products TCS - What we do...
EPOS GNSS Data and Products TCS - What we do...
EPOS | GNSS Data and Products
 
Geos2011 - Lorenzino Vaccari - Keynote speech
Geos2011 - Lorenzino Vaccari - Keynote speechGeos2011 - Lorenzino Vaccari - Keynote speech
Geos2011 - Lorenzino Vaccari - Keynote speech
European Commission, Joint Research Centre
 
Validation of services, data and metadata
Validation of services, data and metadataValidation of services, data and metadata
Validation of services, data and metadata
Luis Bermudez
 
MataNui - Building a Grid Data Infrastructure that "doesn't suck!"
MataNui - Building a Grid Data Infrastructure that "doesn't suck!"MataNui - Building a Grid Data Infrastructure that "doesn't suck!"
MataNui - Building a Grid Data Infrastructure that "doesn't suck!"
Guy K. Kloss
 
remotesensing-12-01253.pdf
remotesensing-12-01253.pdfremotesensing-12-01253.pdf
remotesensing-12-01253.pdf
NguyenVanTuan29
 
e-Infrastructure Integration-with gCube
e-Infrastructure Integration-with gCubee-Infrastructure Integration-with gCube
e-Infrastructure Integration-with gCube
FAO
 
Analysis Ready Data workshop - OGC presentation
Analysis Ready Data workshop - OGC presentation Analysis Ready Data workshop - OGC presentation
Analysis Ready Data workshop - OGC presentation
George Percivall
 
A Reconfigurable Component-Based Problem Solving Environment
A Reconfigurable Component-Based Problem Solving EnvironmentA Reconfigurable Component-Based Problem Solving Environment
A Reconfigurable Component-Based Problem Solving Environment
Sheila Sinclair
 
Geonetwork for Spatial Data
Geonetwork for Spatial DataGeonetwork for Spatial Data
Geonetwork for Spatial Data
Nizam GIS
 
Implementing an Open Source Spatiotemporal Search Platform for Spatial Data I...
Implementing an Open Source Spatiotemporal Search Platform for Spatial Data I...Implementing an Open Source Spatiotemporal Search Platform for Spatial Data I...
Implementing an Open Source Spatiotemporal Search Platform for Spatial Data I...
Paolo Corti
 
THE OPEN SCIENCE GRID Ruth Pordes
THE OPEN SCIENCE GRID Ruth PordesTHE OPEN SCIENCE GRID Ruth Pordes
THE OPEN SCIENCE GRID Ruth Pordes
Information Security Awareness Group
 
IEEE SIGHT Bombay section webinar talk on GIS & Remote Sensing-Introduction t...
IEEE SIGHT Bombay section webinar talk on GIS & Remote Sensing-Introduction t...IEEE SIGHT Bombay section webinar talk on GIS & Remote Sensing-Introduction t...
IEEE SIGHT Bombay section webinar talk on GIS & Remote Sensing-Introduction t...
AdityaAllamraju1
 
Geospatial Metadata and Spatial Data: It's all Greek to me!
Geospatial Metadata and Spatial Data: It's all Greek to me!Geospatial Metadata and Spatial Data: It's all Greek to me!
Geospatial Metadata and Spatial Data: It's all Greek to me!
EDINA, University of Edinburgh
 
Big Geo Data: Open Source and Open Standards
Big Geo Data: Open Source and Open StandardsBig Geo Data: Open Source and Open Standards
Big Geo Data: Open Source and Open Standards
George Percivall
 
Welcome to HDF Workshop V
Welcome to HDF Workshop VWelcome to HDF Workshop V
Welcome to HDF Workshop V
The HDF-EOS Tools and Information Center
 
Big Data for Local Context
Big Data for Local ContextBig Data for Local Context
Big Data for Local Context
George Percivall
 
Geohosting
GeohostingGeohosting
Geohosting
Karel Charvat
 
sers, Applications and the Community of Practice for the Air Quality Scenario
sers, Applications and the Community of Practice for the Air Quality Scenariosers, Applications and the Community of Practice for the Air Quality Scenario
sers, Applications and the Community of Practice for the Air Quality Scenario
Rudolf Husar
 
2008-05-05 GEOSS UIC-ADC AQ Scen W shop Toronto
2008-05-05 GEOSS UIC-ADC AQ Scen W shop Toronto2008-05-05 GEOSS UIC-ADC AQ Scen W shop Toronto
2008-05-05 GEOSS UIC-ADC AQ Scen W shop Toronto
Rudolf Husar
 

Similar to How FAIR is GEOSS (20)

Metadata in EOSDIS
Metadata in EOSDISMetadata in EOSDIS
Metadata in EOSDIS
 
EPOS GNSS Data and Products TCS - What we do...
EPOS GNSS Data and Products TCS - What we do...EPOS GNSS Data and Products TCS - What we do...
EPOS GNSS Data and Products TCS - What we do...
 
Geos2011 - Lorenzino Vaccari - Keynote speech
Geos2011 - Lorenzino Vaccari - Keynote speechGeos2011 - Lorenzino Vaccari - Keynote speech
Geos2011 - Lorenzino Vaccari - Keynote speech
 
Validation of services, data and metadata
Validation of services, data and metadataValidation of services, data and metadata
Validation of services, data and metadata
 
MataNui - Building a Grid Data Infrastructure that "doesn't suck!"
MataNui - Building a Grid Data Infrastructure that "doesn't suck!"MataNui - Building a Grid Data Infrastructure that "doesn't suck!"
MataNui - Building a Grid Data Infrastructure that "doesn't suck!"
 
remotesensing-12-01253.pdf
remotesensing-12-01253.pdfremotesensing-12-01253.pdf
remotesensing-12-01253.pdf
 
e-Infrastructure Integration-with gCube
e-Infrastructure Integration-with gCubee-Infrastructure Integration-with gCube
e-Infrastructure Integration-with gCube
 
Analysis Ready Data workshop - OGC presentation
Analysis Ready Data workshop - OGC presentation Analysis Ready Data workshop - OGC presentation
Analysis Ready Data workshop - OGC presentation
 
A Reconfigurable Component-Based Problem Solving Environment
A Reconfigurable Component-Based Problem Solving EnvironmentA Reconfigurable Component-Based Problem Solving Environment
A Reconfigurable Component-Based Problem Solving Environment
 
Geonetwork for Spatial Data
Geonetwork for Spatial DataGeonetwork for Spatial Data
Geonetwork for Spatial Data
 
Implementing an Open Source Spatiotemporal Search Platform for Spatial Data I...
Implementing an Open Source Spatiotemporal Search Platform for Spatial Data I...Implementing an Open Source Spatiotemporal Search Platform for Spatial Data I...
Implementing an Open Source Spatiotemporal Search Platform for Spatial Data I...
 
THE OPEN SCIENCE GRID Ruth Pordes
THE OPEN SCIENCE GRID Ruth PordesTHE OPEN SCIENCE GRID Ruth Pordes
THE OPEN SCIENCE GRID Ruth Pordes
 
IEEE SIGHT Bombay section webinar talk on GIS & Remote Sensing-Introduction t...
IEEE SIGHT Bombay section webinar talk on GIS & Remote Sensing-Introduction t...IEEE SIGHT Bombay section webinar talk on GIS & Remote Sensing-Introduction t...
IEEE SIGHT Bombay section webinar talk on GIS & Remote Sensing-Introduction t...
 
Geospatial Metadata and Spatial Data: It's all Greek to me!
Geospatial Metadata and Spatial Data: It's all Greek to me!Geospatial Metadata and Spatial Data: It's all Greek to me!
Geospatial Metadata and Spatial Data: It's all Greek to me!
 
Big Geo Data: Open Source and Open Standards
Big Geo Data: Open Source and Open StandardsBig Geo Data: Open Source and Open Standards
Big Geo Data: Open Source and Open Standards
 
Welcome to HDF Workshop V
Welcome to HDF Workshop VWelcome to HDF Workshop V
Welcome to HDF Workshop V
 
Big Data for Local Context
Big Data for Local ContextBig Data for Local Context
Big Data for Local Context
 
Geohosting
GeohostingGeohosting
Geohosting
 
sers, Applications and the Community of Practice for the Air Quality Scenario
sers, Applications and the Community of Practice for the Air Quality Scenariosers, Applications and the Community of Practice for the Air Quality Scenario
sers, Applications and the Community of Practice for the Air Quality Scenario
 
2008-05-05 GEOSS UIC-ADC AQ Scen W shop Toronto
2008-05-05 GEOSS UIC-ADC AQ Scen W shop Toronto2008-05-05 GEOSS UIC-ADC AQ Scen W shop Toronto
2008-05-05 GEOSS UIC-ADC AQ Scen W shop Toronto
 

More from Blue BRIDGE

PerformFISH: Consumer Driven Production - Integrating Innovative Approaches f...
PerformFISH: Consumer Driven Production - Integrating Innovative Approaches f...PerformFISH: Consumer Driven Production - Integrating Innovative Approaches f...
PerformFISH: Consumer Driven Production - Integrating Innovative Approaches f...
Blue BRIDGE
 
BlueBRIDGE supporting education
BlueBRIDGE supporting educationBlueBRIDGE supporting education
BlueBRIDGE supporting education
Blue BRIDGE
 
LME: LEARN & IOC Capacity Building Activities
LME: LEARN & IOC Capacity Building ActivitiesLME: LEARN & IOC Capacity Building Activities
LME: LEARN & IOC Capacity Building Activities
Blue BRIDGE
 
Machine Learning methods to estimate the performance of aquafarms
Machine Learning methods to estimate the performance of aquafarms Machine Learning methods to estimate the performance of aquafarms
Machine Learning methods to estimate the performance of aquafarms
Blue BRIDGE
 
Environmental observation data to detect aquaculture structures: merging Cope...
Environmental observation data to detect aquaculture structures: merging Cope...Environmental observation data to detect aquaculture structures: merging Cope...
Environmental observation data to detect aquaculture structures: merging Cope...
Blue BRIDGE
 
Application of Earth Observation (EO) Data for Detection, Characterization an...
Application of Earth Observation (EO) Data for Detection, Characterization an...Application of Earth Observation (EO) Data for Detection, Characterization an...
Application of Earth Observation (EO) Data for Detection, Characterization an...
Blue BRIDGE
 
Capacity building, validation and repeatability
Capacity building, validation and repeatabilityCapacity building, validation and repeatability
Capacity building, validation and repeatability
Blue BRIDGE
 
Fostering global data management with public tuna fisheries data
Fostering global data management with public tuna fisheries dataFostering global data management with public tuna fisheries data
Fostering global data management with public tuna fisheries data
Blue BRIDGE
 
Understanding biodiversity features in marine protected areas
Understanding biodiversity features in marine protected areasUnderstanding biodiversity features in marine protected areas
Understanding biodiversity features in marine protected areas
Blue BRIDGE
 
Panel discussion on Global Repositories of Merged Public Data
Panel discussion on Global Repositories of Merged Public DataPanel discussion on Global Repositories of Merged Public Data
Panel discussion on Global Repositories of Merged Public Data
Blue BRIDGE
 
Invasive species and climate change
Invasive species and climate changeInvasive species and climate change
Invasive species and climate change
Blue BRIDGE
 
Blue Skills
Blue SkillsBlue Skills
Blue Skills
Blue BRIDGE
 
The BIG picture - Advanced data visualization for SDG, basic stock assessment...
The BIG picture - Advanced data visualization for SDG, basic stock assessment...The BIG picture - Advanced data visualization for SDG, basic stock assessment...
The BIG picture - Advanced data visualization for SDG, basic stock assessment...
Blue BRIDGE
 
Global Record of Stocks and Fisheries (GRFS)
Global Record of Stocks and Fisheries (GRFS)Global Record of Stocks and Fisheries (GRFS)
Global Record of Stocks and Fisheries (GRFS)
Blue BRIDGE
 
Projecting global fish stocks and catches up to 2100
Projecting global fish stocks and catches up to 2100Projecting global fish stocks and catches up to 2100
Projecting global fish stocks and catches up to 2100
Blue BRIDGE
 
BlueBRIDGE: Major Achievements & future vision
BlueBRIDGE: Major Achievements & future visionBlueBRIDGE: Major Achievements & future vision
BlueBRIDGE: Major Achievements & future vision
Blue BRIDGE
 
Managing tuna fisheries data at a global scale: the Tuna Atlas VRE
Managing tuna fisheries data at a global scale: the Tuna Atlas VREManaging tuna fisheries data at a global scale: the Tuna Atlas VRE
Managing tuna fisheries data at a global scale: the Tuna Atlas VRE
Blue BRIDGE
 
SeaDataCloud – further developing the pan-European SeaDataNet infrastructure ...
SeaDataCloud – further developing the pan-European SeaDataNet infrastructure ...SeaDataCloud – further developing the pan-European SeaDataNet infrastructure ...
SeaDataCloud – further developing the pan-European SeaDataNet infrastructure ...
Blue BRIDGE
 
The BlueBRIDGE Project - Pasquale Pagano
The BlueBRIDGE Project - Pasquale PaganoThe BlueBRIDGE Project - Pasquale Pagano
The BlueBRIDGE Project - Pasquale Pagano
Blue BRIDGE
 
Thematic clouds for EOSC : The Food Cloud and the Blue Cloud
Thematic clouds for EOSC: The Food Cloud and the Blue Cloud�Thematic clouds for EOSC: The Food Cloud and the Blue Cloud�
Thematic clouds for EOSC : The Food Cloud and the Blue Cloud
Blue BRIDGE
 

More from Blue BRIDGE (20)

PerformFISH: Consumer Driven Production - Integrating Innovative Approaches f...
PerformFISH: Consumer Driven Production - Integrating Innovative Approaches f...PerformFISH: Consumer Driven Production - Integrating Innovative Approaches f...
PerformFISH: Consumer Driven Production - Integrating Innovative Approaches f...
 
BlueBRIDGE supporting education
BlueBRIDGE supporting educationBlueBRIDGE supporting education
BlueBRIDGE supporting education
 
LME: LEARN & IOC Capacity Building Activities
LME: LEARN & IOC Capacity Building ActivitiesLME: LEARN & IOC Capacity Building Activities
LME: LEARN & IOC Capacity Building Activities
 
Machine Learning methods to estimate the performance of aquafarms
Machine Learning methods to estimate the performance of aquafarms Machine Learning methods to estimate the performance of aquafarms
Machine Learning methods to estimate the performance of aquafarms
 
Environmental observation data to detect aquaculture structures: merging Cope...
Environmental observation data to detect aquaculture structures: merging Cope...Environmental observation data to detect aquaculture structures: merging Cope...
Environmental observation data to detect aquaculture structures: merging Cope...
 
Application of Earth Observation (EO) Data for Detection, Characterization an...
Application of Earth Observation (EO) Data for Detection, Characterization an...Application of Earth Observation (EO) Data for Detection, Characterization an...
Application of Earth Observation (EO) Data for Detection, Characterization an...
 
Capacity building, validation and repeatability
Capacity building, validation and repeatabilityCapacity building, validation and repeatability
Capacity building, validation and repeatability
 
Fostering global data management with public tuna fisheries data
Fostering global data management with public tuna fisheries dataFostering global data management with public tuna fisheries data
Fostering global data management with public tuna fisheries data
 
Understanding biodiversity features in marine protected areas
Understanding biodiversity features in marine protected areasUnderstanding biodiversity features in marine protected areas
Understanding biodiversity features in marine protected areas
 
Panel discussion on Global Repositories of Merged Public Data
Panel discussion on Global Repositories of Merged Public DataPanel discussion on Global Repositories of Merged Public Data
Panel discussion on Global Repositories of Merged Public Data
 
Invasive species and climate change
Invasive species and climate changeInvasive species and climate change
Invasive species and climate change
 
Blue Skills
Blue SkillsBlue Skills
Blue Skills
 
The BIG picture - Advanced data visualization for SDG, basic stock assessment...
The BIG picture - Advanced data visualization for SDG, basic stock assessment...The BIG picture - Advanced data visualization for SDG, basic stock assessment...
The BIG picture - Advanced data visualization for SDG, basic stock assessment...
 
Global Record of Stocks and Fisheries (GRFS)
Global Record of Stocks and Fisheries (GRFS)Global Record of Stocks and Fisheries (GRFS)
Global Record of Stocks and Fisheries (GRFS)
 
Projecting global fish stocks and catches up to 2100
Projecting global fish stocks and catches up to 2100Projecting global fish stocks and catches up to 2100
Projecting global fish stocks and catches up to 2100
 
BlueBRIDGE: Major Achievements & future vision
BlueBRIDGE: Major Achievements & future visionBlueBRIDGE: Major Achievements & future vision
BlueBRIDGE: Major Achievements & future vision
 
Managing tuna fisheries data at a global scale: the Tuna Atlas VRE
Managing tuna fisheries data at a global scale: the Tuna Atlas VREManaging tuna fisheries data at a global scale: the Tuna Atlas VRE
Managing tuna fisheries data at a global scale: the Tuna Atlas VRE
 
SeaDataCloud – further developing the pan-European SeaDataNet infrastructure ...
SeaDataCloud – further developing the pan-European SeaDataNet infrastructure ...SeaDataCloud – further developing the pan-European SeaDataNet infrastructure ...
SeaDataCloud – further developing the pan-European SeaDataNet infrastructure ...
 
The BlueBRIDGE Project - Pasquale Pagano
The BlueBRIDGE Project - Pasquale PaganoThe BlueBRIDGE Project - Pasquale Pagano
The BlueBRIDGE Project - Pasquale Pagano
 
Thematic clouds for EOSC : The Food Cloud and the Blue Cloud
Thematic clouds for EOSC: The Food Cloud and the Blue Cloud�Thematic clouds for EOSC: The Food Cloud and the Blue Cloud�
Thematic clouds for EOSC : The Food Cloud and the Blue Cloud
 

Recently uploaded

Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS  at Code Europe 2024Introduction of Cybersecurity with OSS  at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
Hiroshi SHIBATA
 
June Patch Tuesday
June Patch TuesdayJune Patch Tuesday
June Patch Tuesday
Ivanti
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
panagenda
 
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
Tatiana Kojar
 
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...
Jeffrey Haguewood
 
Finale of the Year: Apply for Next One!
Finale of the Year: Apply for Next One!Finale of the Year: Apply for Next One!
Finale of the Year: Apply for Next One!
GDSC PJATK
 
Azure API Management to expose backend services securely
Azure API Management to expose backend services securelyAzure API Management to expose backend services securely
Azure API Management to expose backend services securely
Dinusha Kumarasiri
 
Operating System Used by Users in day-to-day life.pptx
Operating System Used by Users in day-to-day life.pptxOperating System Used by Users in day-to-day life.pptx
Operating System Used by Users in day-to-day life.pptx
Pravash Chandra Das
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
innovationoecd
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Malak Abu Hammad
 
Nunit vs XUnit vs MSTest Differences Between These Unit Testing Frameworks.pdf
Nunit vs XUnit vs MSTest Differences Between These Unit Testing Frameworks.pdfNunit vs XUnit vs MSTest Differences Between These Unit Testing Frameworks.pdf
Nunit vs XUnit vs MSTest Differences Between These Unit Testing Frameworks.pdf
flufftailshop
 
WeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation TechniquesWeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation Techniques
Postman
 
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
alexjohnson7307
 
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdfMonitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Tosin Akinosho
 
Trusted Execution Environment for Decentralized Process Mining
Trusted Execution Environment for Decentralized Process MiningTrusted Execution Environment for Decentralized Process Mining
Trusted Execution Environment for Decentralized Process Mining
LucaBarbaro3
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
MichaelKnudsen27
 
Recommendation System using RAG Architecture
Recommendation System using RAG ArchitectureRecommendation System using RAG Architecture
Recommendation System using RAG Architecture
fredae14
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
Jason Packer
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
Zilliz
 
System Design Case Study: Building a Scalable E-Commerce Platform - Hiike
System Design Case Study: Building a Scalable E-Commerce Platform - HiikeSystem Design Case Study: Building a Scalable E-Commerce Platform - Hiike
System Design Case Study: Building a Scalable E-Commerce Platform - Hiike
Hiike
 

Recently uploaded (20)

Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS  at Code Europe 2024Introduction of Cybersecurity with OSS  at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
 
June Patch Tuesday
June Patch TuesdayJune Patch Tuesday
June Patch Tuesday
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
 
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
Skybuffer AI: Advanced Conversational and Generative AI Solution on SAP Busin...
 
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...
 
Finale of the Year: Apply for Next One!
Finale of the Year: Apply for Next One!Finale of the Year: Apply for Next One!
Finale of the Year: Apply for Next One!
 
Azure API Management to expose backend services securely
Azure API Management to expose backend services securelyAzure API Management to expose backend services securely
Azure API Management to expose backend services securely
 
Operating System Used by Users in day-to-day life.pptx
Operating System Used by Users in day-to-day life.pptxOperating System Used by Users in day-to-day life.pptx
Operating System Used by Users in day-to-day life.pptx
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
 
Nunit vs XUnit vs MSTest Differences Between These Unit Testing Frameworks.pdf
Nunit vs XUnit vs MSTest Differences Between These Unit Testing Frameworks.pdfNunit vs XUnit vs MSTest Differences Between These Unit Testing Frameworks.pdf
Nunit vs XUnit vs MSTest Differences Between These Unit Testing Frameworks.pdf
 
WeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation TechniquesWeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation Techniques
 
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
 
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdfMonitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
 
Trusted Execution Environment for Decentralized Process Mining
Trusted Execution Environment for Decentralized Process MiningTrusted Execution Environment for Decentralized Process Mining
Trusted Execution Environment for Decentralized Process Mining
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
 
Recommendation System using RAG Architecture
Recommendation System using RAG ArchitectureRecommendation System using RAG Architecture
Recommendation System using RAG Architecture
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
 
System Design Case Study: Building a Scalable E-Commerce Platform - Hiike
System Design Case Study: Building a Scalable E-Commerce Platform - HiikeSystem Design Case Study: Building a Scalable E-Commerce Platform - Hiike
System Design Case Study: Building a Scalable E-Commerce Platform - Hiike
 

How FAIR is GEOSS

  • 1. How FAIR is GEOSS S. Nativi (1), J. Van Bemmelen (2), M. Santoro (1), G. Colangeli (2) O. Ochiai (3), P. De Salvo (3) (1) Institute of Atmospheric Pollution Research, National Research Council of Italy (2) European Space Agency (3) GEO Secretariat BlueBRIDGE Workshop 3 April, 2017
  • 2. GEO AND GEOSS Group on Earth Observation and Global Earth Observation system of systems
  • 3. GEO AND GEOSS Group on Earth Observation and Global Earth Observation system of systems
  • 4. GEO AND GEOSS Group on Earth Observation and Global Earth Observation system of systems
  • 5. Global Earth Observation System of Systems (GEOSS) Together, the GEO community is creating a Global Earth Observation System of Systems (GEOSS). Earth observations from diverse sources, including satellite, airborne, in-situ platforms, and citizen observatories, when integrated together, provide powerful tools for understanding the past and present conditions of Earth systems, as well as the interplay between them. GEOSS aims to better integrate observing systems and share data by connecting existing infrastructures. There are more than 200 million open data resources in GEOSS from more than 150 national and regional providers such as NASA and ESA; international organizations such as WMO and the commercial sector such as Digital Globe.
  • 6. IMPLEMENTING GEOSS GEOSS Common Infrastructure (GCI)
  • 7. GEOSS Applications GEOSS Providers GEOSS Application Developers (intermediate Users) GEOSS end-Users GEOSS Applications GEOSS ApplicationsGEOSS Applications Enterprise System j … . Enterprise System 1 System 4Enterprise System 3 Enterprise System 2 … . … . … . SBA 1 SBA 2 SBA 8 Enterpris e System K Enterprise System 3 System 4 Enterpris e System 1 Enterprise System 2 Enterprise System Z Enterprise System 1 System 4Enterprise System 2 Enterprise System 3 GEOSS Portal DOWNSTREAM UPSTREAM MIDSTREAM GEOSS Common Infrastructure APIs Mediation modules
  • 8. Societal Benefit Areas Data Providers > 200 million data resources spanning all SBAs GCI M2M Registration GEOSS Common Infrastructure (GCI)
  • 9. Enhanced GEOSS Portal - Overview • Enhanced during 2016 • Accessible from www.geoportal.org • Coordinated with ESA, CNR-IIA, DG-RTD, DG-JRC and GeoSec • Focus on engagement, delivery and advocating • Structured in 3 phases • 1st phase – 2016: interface restyling: completed • 2nd phase – 2017/18: deployment of major upgrades • 3rd phase – 2019 onwards – operations and evolutions
  • 10. GEO Discovery and Access Broker (DAB) GEO DAB is a brokering framework that interconnects hundreds of heterogeneous and autonomous supply systems (the enterprise systems constituting the GEO metasystem) by providing mediation, harmonization and transformation capabilities.
  • 11. GEOSS FAIRNESS How GEOSS addresses FAIR Principles
  • 12. FINDABLE How GEOSS addresses FAIR Principles
  • 13. Discovery in GEOSS • GEOSS has to deal with the large amount of datasets provided by the end systems, e.g. millions of (small to medium size) products, and long EO time/space series. • GEOSS has to collect metadata (at least for harvested catalogs) and provide effective discoverability.
  • 14. Adopted Solutions • Dealing with such numbers, normally constrained queries commonly match a large number of datasets. • GCI addresses this challenge by returning a smaller and/or an ordered result sets. Views Ranking and Paging
  • 15. Ranking and Paging No-SQL DB Good performances on large stores No preliminary constraint on data structure Need to preliminarily index queryable elements GEO DAB Internal Metadata Model Pre-calculated in batch, based on: Metadata Quality Accessibility Etc. Calculated on-the-fly, based on: Query Constraints Applied to scores (configurable)
  • 16. GEOSS View • Definition: – Subset of the whole GEOSS resources defined by applying, via the DAB, a set of clauses • Discovery clauses (e.g. spatial envelope, keywords, sources, etc.) • Access clauses (e.g. data format, access protocol, CRS, etc.) – Defined “View” exposed on the GEOSS Portal Consumer-defined View – i.e. Client-side These views are available only for the client application which defined the view. Provider-defined View –i.e. Server-side These views are available for all client applications.
  • 18. Accessibility in GEOSS • In GEOSS, main Access related challenges include: – Visualization of data previews • provide a fast preview service allowing users quickly to evaluate discovered data before deciding the download. – Basic Transformations • provide users with an easy (i.e. transparent) access to the discovered data along with a set of basic data transformations to make them more easily processed
  • 19. Accessibility in GEOSS - Visualization • GEO DAB provides a fast preview service allowing to get data preview: – Metadata record is augmented by adding a reference to data preview; preview tiles at different zoom levels are generated in a batch mode. – To store and retrieve single tiles in an efficient way, GEO DAB utilizes a NoSQL key-value DB. – When available, GEO DAB utilizes data provider fast preview services by implementing the required mediation. • GEOSS Portal uses allows Users to quickly evaluate discovered data before deciding the download.
  • 20. Accessibility in GEOSS – Basic Transformations • In an environment such as GEOSS, no matter which technique is implemented there will always be cases in which the required processing is consuming too much time for a click-and-get pattern. • The DAB + GEOSS Portal access transformation allows to deliver discovered datasets according to a common grid: format, Coordinate Reference System, spatial and temporal extent and resolution. • Where this transformation workflow requires a long processing time, Users are allowed to opt for an asynchronous version of the same services.
  • 22. Interoperability in GEOSS More than 155 Brokered Systems About 200 M granules
  • 23. Adopted Solutions – GEO DAB • Introduction of a brokering tier (GEO DAB) dedicated to mediation of service interfaces and metadata models harmonization in a transparent way for both users and data providers. • The GEO DAB maps the diverse models onto its own internal model, which is general enough to comprise all the necessary concepts. • The key features of the GEO DAB internal data and metadata models are flexibility and extensibility allowing adding new concepts and related attributes. OGC CSW 2.0.2 AP ISO 1.0 INPE OGC CSW 2.0.2 ebRIM EO CKAN OGC CSW 2.0.2 ebRIM CIM DCAT ESRI GEOPORTAL 10 GI-cat OAI-PMH 2.0 ESRI GEOPORTAL 10 OpenSearch 1.1 NCML-OD OpenSearch 1.1 ESIP BCODMO OpenSearch GENESI DR NCML-CF CKAN NetCDF-CF 1.4 CUAHSI HIS-Central FTP populated with supported metadata types ESRI REST API 10.3 WAF Web Accessible Folders OGC WCS GeoNetwork (2.2.0 or greater) OGC WMS Ecological Markup Language2.1.1 OGC WFS 1.0.0, 1.1.0, 2.0.0 NERRS (National EstuarineResearch Reserve System) OGC WMTS HMA CSW 2.0.2 ebRIM/CIM OGC SOS 1.0.0, 2.0.0, 2.0.0 Hydro Profile HDF OGC WPS 1.0.0 IADC DB (MySQL) OGC CSW 2.0.0 Core GrADS-DS OGC CSW 2.0.2 AP ISO 1.0 FedEO OGC CSW 2.0.2 ebRIM/EO AP ARPA DB (based on Microsoft SQL) OGC CSW 2.0.2 ebRIM/CIM AP ESRI Map Server IRIS Station SHAPE files (FTP) IRIS Event KISTERS Web - Environment ofCanada HYRAX THREDDS SERVER 1.9 Environment Canada Hydrometric data (FTP) OAI-PMH 2.0 - Harvesting OpenSearch 1.1 GBIF Earth Engine DIF RASAQM HYDRO EGASKRO UNAVCO SITAD (Sistema Informativo TerritorialeAmbientaleDiffuso) CDI 1.04, 1.3, 1.4 FileSystem ISO19115-2 GDACS THREDDS 1.0.1, 1.0.2 GeoRSS 2.0 THREDDS-NCISO 1.0.1, 1.0.2 Degree catalog service2.2 THREDDS-NCISO-PLUS 1.0.1, 1.0.2 OpenSearch GENESI DR
  • 24. RE-USABLE How GEOSS addresses FAIR Principles
  • 25. Re-usability in GEOSS • In GEOSS, challenges related to Re-usability mainly stem from datasets heterogeneity. • In addition, GEOSS needs to address the requirement to support diverse (cross-)disciplinary applications targeting different Communities and User categories which have different needs, as for data discovery and presentation in an informative and significant way.
  • 26. Adopted Solutions – GEOSS Portal • User-centric, considering various user communities: • GEO Flagships and Global initiatives • ESA Thematic Exploitation Platforms • SBA/Thematic Customization of search and results visualization: – Satellite: includes smart filters for imagery (Landsat, Sentinel 2) and SAR-type (Sentinel 1) satellite data; – Disater Resilience SBA: Earthquake events filters • Focusing on providing resuable Portlets (for integration in external Community Applications)
  • 27. Adopted solutions – GEO DAB APIs Different APIs for serving diverse Application development use cases (environments) A set of standard Web service interfaces: • e.g. OGC service interfaces, CKAN, OAI-PMH, FTP, etc. A set of APIs for software developers: • Client side APIs: – (high-level) JavaScript library – … . (Python) • Server side APIs: – REST/JSON APIs – OpenSearch APIs – … . GEOSS Applications GEOSS Application Developers (intermediate Users) GEOSS end-Users GEOSS Applications GEOSS ApplicationsGEOSS Applications GEOSS Portal DOWNSTREAM MIDSTREAM GEOSS Common Infrastructure APIs Mediation modules
  • 28. Conclusions • In the past 10 years GEOSS has developed a truly Global and multidisciplinary System-of Systems • A valuable framework to experiment and learn how to deal Milti-disciplinary Interoperability challenges.. • The new GEOSS Portal + DAB platform signifcantly improved the discoverability and accessibility of sahred GEOSS resources, addressing more and more User requirements.