Successfully reported this slideshow.
Your SlideShare is downloading. ×

EOSC-hub & Geohazards TEP

Ad
Ad
Ad
Ad
Ad
Ad
Ad
Ad
Ad
Ad
Ad
Loading in …3
×

Check these out next

1 of 16 Ad
Advertisement

More Related Content

Slideshows for you (20)

Similar to EOSC-hub & Geohazards TEP (20)

Advertisement

More from EOSC-hub project (20)

Advertisement

EOSC-hub & Geohazards TEP

  1. 1. eosc-hub.eu @EOSC_eu EOSC-hub receives funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No. 777536. Terradue Geohazards TEP
  2. 2. 2 Motivation and driving consideration about the service Service architecture and interfaces: overview - How the user can access the service  E.g.: REST, GUI, CLIs, etc. - Service options and attributes Acceptable Usage Policy (AUP) Access policy and business model Use cases Documentation/tutorial/information 11/27/2018 Content
  3. 3. 3 The Geohazards TEP (GEP) is an enhancement of the precursor platforms (G- POD, SSEP), and is designed to support the Geohazard Supersites (GSNL) and the Geohazards community via the CEOS WG Disasters GEP is an ESA originated R&D activity on the EO ground segment to demonstrate the benefit of new technologies for large scale processing of EO data Its goal is to apply a complementary operations concept, i.e. moving User activities to the Data: users access a work environment containing the data and resources required, as opposed to downloading and replicating the data ‘at home’ Achieved developing a Platform based on virtualization & federation of satellite EO data and methods 11/27/2018 Motivation
  4. 4. 4 The GEP provides innovative responses to the geohazards community needs (services & support) - On-demand processing services to address AOI-specific analysis - Systematic processing services to address needs for “common information layers” - Massive Cloud Compute power, managing multi-tenant resources - Access to Copernicus Sentinels-1/2/3 repositories - Access to 70+ TB of EO data archives (ERS and ENVISAT), and specific data collections from EO missions, such as JAXA’s ALOS-2, ASI’s Cosmo-Skymed and DLR’s TerraSAR-X, provided under special arrangements in the framework f the CEOS WG Disaster and the GSNL. Support the generation strain rate estimates and the mapping of active faults at the global scale by providing EO InSAR and optical data and processing capacities Supports development and demonstration of advanced science products for rapid earthquake response 11/27/2018 Motivation
  5. 5. 5 The Geohazards TEP platform is a complex system composed by the following main components: - Web portal: a community portal, focusing on sharing processing results amongst users, integrating social medias and gathering users in communities. It offers a community workspace where users can interact amongst themselves and access processing job or datasets shared by the community. It offers also a completely integrated geobrowser, in which users can discover existing EO collection or EO products produced by the community, but also create new processing jobs using the available WPS services. - Data Agency including  Catalogue service: the EO data catalogue allows quickly accessing metadata about main EO satellite missions all over the world. Metadata are continuously harvested and ingested into the catalogue. The catalogue, is also used to publish user's data products (directly uploaded by the user, or retrieved from a WPS job)  Data Gateway: it manages the data access and storage. It automatically pulls data results created by the processes on the WPS provider to a dedicated storage, in order to create value-added (e.g WMS layers, time series, …), persistent and quickly available data results. It also supports programmable and systematic data caching, in order to have data ready for specific area of interest of the users 11/27/2018 Service architecture and interfaces
  6. 6. 6 GEP components (contd) - Production Center: the PC is a set of components enabling the processing services on the Geohazards TEP. It contains several heterogeneous modules enabling several specific functions from service integration to bulk and massive processing in clusters over IaaS and cloud. In particular it delivers a dynamic multi tenant cluster with the full Hadoop YARN stack - Development environment: the Developer Cloud Sandbox PaaS is the environment to integrate scientific applications written in a variety of languages (e.g. Java, C++, IDL, Python, R), then deploy, automate, manage and scale them in a very modular way. The algorithm integration is performed from within a dedicated Virtual Machine, running initially as a simulation environment (sandbox mode) that can readily scale to production (cluster mode) and then be deployed on the Production Center. It is accessed from a harmonized Shell environment and provides support tools to facilitate the data access and workflow management tasks 11/27/2018 Service architecture and interfaces
  7. 7. 711/27/2018 Service architecture and interfaces Sentinel-2 products Amazon S3 Sentinel-1/2/3 products Copernicus Scihub Sentinel-1 products Alaska Satellite Facility Data Agency Terradue Sentinel-1 products (Sentinel 2/3 upcoming) CNES PEPS SH B AS F PEP S AW S T 2 Sentinel-1/2/3 products National hubs (AT, GR, FI …) Col lGS Landsat-8 products EarthExplorerUSG S Data Agency Metadata and Data Brokering
  8. 8. 811/27/2018 Service architecture and interfaces Federation of data centres - EGI.eu (BELNET, INFN RECAS BARI) - CNR IREA Computing Centre - Poznań Supercomputing and Networking Center … and Cloud providers - Hetzner / Terradue Private Cloud - EO IPT.PL - Amazon AWS Production Center Federation and Cloud Bursting
  9. 9. 9 GEP services can be accessed in multiple ways according to type of users and related needs. These are: - The Terradue Cloud Platform API (REST API)  see http://docs.terradue.com/t2-api/ - The Developer Cloud Sandbox tools (CLI)  see http://docs.terradue.com/developer-sandbox/ - The GEP Web Portal (GUI)  see https://terradue.github.io/doc-tep-geohazards/ In the context of EOSC-Hub the services exposed by the Geohazards TEP will be 1. Sentinel-1 High-Resolution Change Monitoring for the Alpine Region  based on DLR High-Resolution InSAR Browse service  Systematic  Accessible via GEP Web Portal and Terradue Cloud Platform API 2. EO Services for Earthquake Response and Landslides Analysis  provides a set of terrain motion services to support co-seismic displacement mapping and landslide analysis from optical and SAR images  on-demand  Accessible via GEP Web Portal 11/27/2018 Service access
  10. 10. 10 Service options for the Geohazards TEP 1. Sentinel-1 High-Res Change Monitoring for the Alpine Region  This service provides an interferometric product at 50m resolution and 25m pixel spacing systematically for every 6-day Sentinel-1 SLC pair over the Alpine Region.  It generates 6 information layers that allow characterizing the applicability of InSAR over geohazards sites (feasibility) in view of further ad-hoc processing with a variety of interferometric chains. These layers are: master and slave calibrated amplitude, terrain corrected coherence, terrain corrected interferogram, amplitude change composite and amplitude coherence composite 2. EO Services for Earthquake Response and Landslides Analysis  This App provides a set of on-demand terrain motion services supporting interferogram generation, co-seismic displacement mapping, landslide rapid mapping and landslide displacement field monitoring with Sentinel-1 and Sentinel-2 data. Service attributes - N/A 11/27/2018 Service options and attributes
  11. 11. 11 Access to the GEP services - Basic services: open and free with self registration  EO Data catalogue search functions  Public Job results visualisation - Advanced services: requires filling a User Request Form (URF) and is granted upon approval of the GEP Governance after assessment of the URF 11/27/2018 Acceptable Usage Policy
  12. 12. 12 Access policies: - Self registration for basic services - Policy-based for advanced services Payment model: - Sponsored - Subscription-based 11/27/2018 Access policies and Funding models
  13. 13. 13 As a GeoHazards expert, I want to interactively find relevant data for a given area of interest and time period, and invoke processing from a predefined set of functions over that area - Fulfilled via the service 2.  EO Services for Earthquake Response and Landslides Analysis - The users has access to a geobrowser with the possibility to do searches in the EO data catalogue and select, preview, download data - The user has access to a set of processing services that can be started on the previously selected data - The user can monitor processing progress and preview, download the generated results 11/27/2018 Featured use cases (1)
  14. 14. 14 As a GeoHazards expert, I want to regularly/systematically process data over areas of interest and have the results available As a GeoHazards expert, I want to download data via APIs - Fulfilled via the service 1.  Sentinel-1 High-Resolution Change Monitoring for the Alpine Region - Information layers are generated systematically on the Alpine region (as soon as new S-1 acquistions are available over the AoI) - Generated information layers are published in the GEP Catalogue and in a OGC compliant WMS server  The users has access to a geobrowser with the possibility to do searches in the catalogue and select, preview, download generated data  The user can access the information layer metadata and data via the Terradue Cloud Platform API and the Geoserver OGC WMS API 11/27/2018 Featured use cases (2)
  15. 15. 15 Provide link to user documentation, tutorials, etc. - https://terradue.github.io/doc-tep-geohazards/ - http://docs.terradue.com/t2-api/ - https://geohazards-tep.eo.esa.int/#! - https://geohazards-tep.eo.esa.int/#!blog 11/27/2018 Documentations
  16. 16. eosc-hub.eu @EOSC_eu Fabrizio Pacini fabrizio.pacini@terradue.com

×