SlideShare a Scribd company logo
Data access and Data extraction
Services within the Land Imagery portal
Jerome Gasperi @ CNES | HAWG - Models for scientific exploitation of EO Data
Frascati, Italy - October 12th, 2012
Land Imagery Portal
Overview
Search service
Download service

What's next
Thematic data extraction
Land Imagery Portal
The

*
PTSC

is the future French "Thematic
Center for Land Imagery"

*

temporary name, subject to change when operational
v0 (end of 2012)
Official launch of the portal
v1 (2013)
additionnal datasets from CNES and partners, SSO
integration, etc.
Search service
Metadata are stored within an
internal structure including
necessary properties to be compliant
with INSPIRE and HMA
metadata requirement
Additional information can be stored
beside metadata
(e.g. thematic classification)
Offers multiple search interface
(OpenSearch, CSW ISO - INSPIRE,
CSW EO - HMA)

Users

Registry index

OpenSearch

Indexes each data providers
metadata using dedicated
connectors (OpenSearch,
CSW CIM or CSW ISO)

MUSCATE

Kalideos

SPOT Archives

SPIRIT

CNES
CSW CIM

based on SITOOLS

POSTEL

CSW ISO

OpenSearch

PTSC

Metacatalog

Geoportal catalog
v1

IGN

GEOSUD catalog

GEOSUD

v1

Data providers

v?
Metadata are stored within an
internal structure including
necessary properties to be compliant
with INSPIRE and HMA
metadata requirement
Additional information can be stored
beside metadata
(e.g. thematic classification)

HMA

Offers multiple search interface
(OpenSearch, CSW ISO - INSPIRE,
CSW EO - HMA)

Users

Registry index

OpenSearch

Indexes each data providers
metadata using dedicated
connectors (OpenSearch,
CSW CIM or CSW ISO)

MUSCATE

Kalideos

SPOT Archives

SPIRIT

CNES
CSW CIM

based on SITOOLS

POSTEL

CSW ISO

OpenSearch
INSPIRE

PTSC

Metacatalog

Geoportal catalog
v1

IGN

GEOSUD catalog

GEOSUD

v1

Data providers

v?
Metadata are stored within an
internal structure including
necessary properties to be compliant
with INSPIRE and HMA
metadata requirement
Additional information can be stored
beside metadata
(e.g. thematic classification)

HMA

Offers multiple search interface
(OpenSearch, CSW ISO - INSPIRE,
CSW EO - HMA)

Users

Registry index

OpenSearch

Indexes each data providers
metadata using dedicated
connectors (OpenSearch,
CSW CIM or CSW ISO)

MUSCATE

Kalideos

SPOT Archives

SPIRIT

CNES
CSW CIM

based on SITOOLS

POSTEL

CSW ISO

INSPIRE

V0

OpenSearch

PTSC

Metacatalog

Geoportal catalog
v1

IGN

GEOSUD catalog

GEOSUD

v1

Data providers

v?
Metadata are stored within an
internal structure including
necessary properties to be compliant
with INSPIRE and HMA
metadata requirement
Additional information can be stored
beside metadata
(e.g. thematic classification)

HMA

Offers multiple search interface
(OpenSearch, CSW ISO - INSPIRE,
CSW EO - HMA)

V1
Users

Registry index

OpenSearch

Indexes each data providers
metadata using dedicated
connectors (OpenSearch,
CSW CIM or CSW ISO)

MUSCATE

Kalideos

SPOT Archives

SPIRIT

CNES
CSW CIM

based on SITOOLS

POSTEL

CSW ISO

INSPIRE

V0

OpenSearch

PTSC

Metacatalog

Geoportal catalog
v1

IGN

GEOSUD catalog

GEOSUD

v1

Data providers

v?
Download service
Product download url is embeded within
the product metadata returned by the
search service
Two cases :
url content mimeType is "text/html"
No direct download. The url is opened in another browser tab. User follows the instructions on the
corresponding web page to download the product (this is typically the case for a product that required to
explicitely sign an NDA before downloading it)

otherwise product can be downloaded
directly
No common downloading format has been decided yet. The products are downloaded as is.
What's next
Thematic data extraction
Important note - the following slides present a proposal that will be discussed
by the PTSC partners to be integrated (or not) within the Land Imagery portal.
Thematic data extraction
?

How to search within the portal for products
that contains coastal cultivated areas ?
Orthorectified image
Orthorectified image

What we got
Orthorectified image

What we got

Characterized image
This is water
This is urban

This is forest

Orthorectified image

What we got

Characterized image
This is water
This is urban

This is forest

Orthorectified image

What we got

Characterized image

What we need
How to do this ?
SLACkER

SimpLe Automated Characterization of EaRth observation products
SLACkER uses GLC 2000 classification to
perform an automatic and location based
characterization of products
Global Land Cover 2000
World land cover
TIFF file ~ 650 Mo
1 km resolution
1 color = 1 thematic class
22 classes
OpenSearch

PTSC

Metacatalog
Identifier
Description
Copyright
Acquisition date
Acquisition angles
Thumbnail
...
+ Footprint

1. Get footprint bounding box

2. Get GLC2000 area

0. Get metadata
3. Process characterization

4. Store results

SLACkER
Processing result example
Tag table images within database glc2000
>> Add classification columns
>> Processing 10
Crop GLC2000 raster : 24137 6169 156 119
Polygonize extracted raster
Process footprint against Global Land Cover
Store classification
=> 40.89% of Deserts (10 + 14 + 19)
=> 31.89% of Herbaceous (9 + 11 + 12 + 13)
=> 14.71% of Water (20)
=> 9.27% of Cultivated (15 + 16 + 17 + 18)
=> 3.2% of Forests (1 + 2 + 3 + 4 + 5 + 6)
(
(
(
(
(
(
(
(
(
(

INPUT : metadata

OUTPUT : additional thematics info stored
beside the metadata within the Metacatalog

28.65 % of 14 : Sparse Herbaceous or sparse Shrub Cover )
6.1 % of 18 : Mosaic: Cropland / Shrub or Grass Cover )
12.24 % of 19 : Bare Areas )
31.88 % of 12 : Shrub Cover, closed-open, deciduous )
2.5 % of 3 : Tree Cover, broadleaved, deciduous, open )
14.71 % of 20 : Water Bodies (natural & artificial) )
0.13 % of 15 : Regularly flooded Shrub and/or Herbaceous Cover )
2.81 % of 16 : Cultivated and managed areas )
0.69 % of 4 : Tree Cover, needle-leaved, evergreen )
0.21 % of 17 : Mosaic: Cropland / Tree Cover / Other natural vegetation )
Thematic sliders

SPOT cover - 1,300,000 scenes
Search for coastal cultivated area ?
Coastal cultivated area
Search results

(footprints displayed in black over the map)
costal...

...cultivated area
Thematic classification
is displayed within
the result metadata
https://vimeo.com/51045597
Data access and data extraction services within the Land Imagery Portal

More Related Content

What's hot

Semantic Technology In Oracle Database 12c
Semantic Technology In Oracle Database 12cSemantic Technology In Oracle Database 12c
Semantic Technology In Oracle Database 12c
Martin Toshev
 
GeoServer on steroids
GeoServer on steroidsGeoServer on steroids
GeoServer on steroids
GeoSolutions
 
Enterprise class deployment for GeoServer and GeoWebcache Optimizing perform...
Enterprise class deployment  for GeoServer and GeoWebcache Optimizing perform...Enterprise class deployment  for GeoServer and GeoWebcache Optimizing perform...
Enterprise class deployment for GeoServer and GeoWebcache Optimizing perform...
GeoSolutions
 
Raster Data In GeoServer And GeoTools: Achievements, Issues And Future Develo...
Raster Data In GeoServer And GeoTools: Achievements, Issues And Future Develo...Raster Data In GeoServer And GeoTools: Achievements, Issues And Future Develo...
Raster Data In GeoServer And GeoTools: Achievements, Issues And Future Develo...
GeoSolutions
 
BigDataEurope @BDVA Summit2016 2: Societal Pilots
BigDataEurope @BDVA Summit2016 2: Societal PilotsBigDataEurope @BDVA Summit2016 2: Societal Pilots
BigDataEurope @BDVA Summit2016 2: Societal Pilots
BigData_Europe
 
The DBpedia databus
The DBpedia databusThe DBpedia databus
The DBpedia databus
Leipziger Semantic Web Tag
 
ADO CONTROLS - Database usage
ADO CONTROLS - Database usageADO CONTROLS - Database usage
ADO CONTROLS - Database usage
Muralidharan Radhakrishnan
 
Bridging ICESat and ICESat-2 Standard Data Products
Bridging ICESat and ICESat-2 Standard Data ProductsBridging ICESat and ICESat-2 Standard Data Products
Bridging ICESat and ICESat-2 Standard Data Products
The HDF-EOS Tools and Information Center
 
Solr in Drupal
Solr in DrupalSolr in Drupal
Solr in Drupal
Péter Király
 
Advanced GeoServer Security with GeoFence
Advanced GeoServer Security with GeoFenceAdvanced GeoServer Security with GeoFence
Advanced GeoServer Security with GeoFence
GeoSolutions
 
Apache Big_Data Europe event: "Integrators at work! Real-life applications of...
Apache Big_Data Europe event: "Integrators at work! Real-life applications of...Apache Big_Data Europe event: "Integrators at work! Real-life applications of...
Apache Big_Data Europe event: "Integrators at work! Real-life applications of...
Hajira Jabeen
 
Maps4 finland 28.8.2012, jari reini
Maps4 finland 28.8.2012, jari reiniMaps4 finland 28.8.2012, jari reini
Maps4 finland 28.8.2012, jari reini
Olli Rinne
 
ckan 2.0 Introduction
ckan 2.0 Introductionckan 2.0 Introduction
ckan 2.0 Introduction
Chengjen Lee
 
HDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFView
HDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFViewHDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFView
HDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFView
The HDF-EOS Tools and Information Center
 
GeoNetwork, The Open Source Solution for the interoperable management of ge...
GeoNetwork, The Open Source Solution  for the interoperable management  of ge...GeoNetwork, The Open Source Solution  for the interoperable management  of ge...
GeoNetwork, The Open Source Solution for the interoperable management of ge...
GeoSolutions
 
Advanced Cartographic Map Rendering In GeoServer
Advanced Cartographic Map Rendering In GeoServerAdvanced Cartographic Map Rendering In GeoServer
Advanced Cartographic Map Rendering In GeoServer
GeoSolutions
 
State of GeoServer - FOSS4G 2016
State of GeoServer - FOSS4G 2016State of GeoServer - FOSS4G 2016
State of GeoServer - FOSS4G 2016
GeoSolutions
 
Crunching Data In GeoServer: Mastering Rendering Transformations, WPS Process...
Crunching Data In GeoServer: Mastering Rendering Transformations, WPS Process...Crunching Data In GeoServer: Mastering Rendering Transformations, WPS Process...
Crunching Data In GeoServer: Mastering Rendering Transformations, WPS Process...
GeoSolutions
 
Ukgovld registry-intro
Ukgovld registry-introUkgovld registry-intro
Ukgovld registry-intro
Dave Reynolds
 
HDF Group Support for NPP/NPOESS/JPSS
HDF Group Support for NPP/NPOESS/JPSSHDF Group Support for NPP/NPOESS/JPSS
HDF Group Support for NPP/NPOESS/JPSS
The HDF-EOS Tools and Information Center
 

What's hot (20)

Semantic Technology In Oracle Database 12c
Semantic Technology In Oracle Database 12cSemantic Technology In Oracle Database 12c
Semantic Technology In Oracle Database 12c
 
GeoServer on steroids
GeoServer on steroidsGeoServer on steroids
GeoServer on steroids
 
Enterprise class deployment for GeoServer and GeoWebcache Optimizing perform...
Enterprise class deployment  for GeoServer and GeoWebcache Optimizing perform...Enterprise class deployment  for GeoServer and GeoWebcache Optimizing perform...
Enterprise class deployment for GeoServer and GeoWebcache Optimizing perform...
 
Raster Data In GeoServer And GeoTools: Achievements, Issues And Future Develo...
Raster Data In GeoServer And GeoTools: Achievements, Issues And Future Develo...Raster Data In GeoServer And GeoTools: Achievements, Issues And Future Develo...
Raster Data In GeoServer And GeoTools: Achievements, Issues And Future Develo...
 
BigDataEurope @BDVA Summit2016 2: Societal Pilots
BigDataEurope @BDVA Summit2016 2: Societal PilotsBigDataEurope @BDVA Summit2016 2: Societal Pilots
BigDataEurope @BDVA Summit2016 2: Societal Pilots
 
The DBpedia databus
The DBpedia databusThe DBpedia databus
The DBpedia databus
 
ADO CONTROLS - Database usage
ADO CONTROLS - Database usageADO CONTROLS - Database usage
ADO CONTROLS - Database usage
 
Bridging ICESat and ICESat-2 Standard Data Products
Bridging ICESat and ICESat-2 Standard Data ProductsBridging ICESat and ICESat-2 Standard Data Products
Bridging ICESat and ICESat-2 Standard Data Products
 
Solr in Drupal
Solr in DrupalSolr in Drupal
Solr in Drupal
 
Advanced GeoServer Security with GeoFence
Advanced GeoServer Security with GeoFenceAdvanced GeoServer Security with GeoFence
Advanced GeoServer Security with GeoFence
 
Apache Big_Data Europe event: "Integrators at work! Real-life applications of...
Apache Big_Data Europe event: "Integrators at work! Real-life applications of...Apache Big_Data Europe event: "Integrators at work! Real-life applications of...
Apache Big_Data Europe event: "Integrators at work! Real-life applications of...
 
Maps4 finland 28.8.2012, jari reini
Maps4 finland 28.8.2012, jari reiniMaps4 finland 28.8.2012, jari reini
Maps4 finland 28.8.2012, jari reini
 
ckan 2.0 Introduction
ckan 2.0 Introductionckan 2.0 Introduction
ckan 2.0 Introduction
 
HDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFView
HDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFViewHDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFView
HDF-EOS to GeoTIFF Conversion Tool & HDF-EOS Plug-in for HDFView
 
GeoNetwork, The Open Source Solution for the interoperable management of ge...
GeoNetwork, The Open Source Solution  for the interoperable management  of ge...GeoNetwork, The Open Source Solution  for the interoperable management  of ge...
GeoNetwork, The Open Source Solution for the interoperable management of ge...
 
Advanced Cartographic Map Rendering In GeoServer
Advanced Cartographic Map Rendering In GeoServerAdvanced Cartographic Map Rendering In GeoServer
Advanced Cartographic Map Rendering In GeoServer
 
State of GeoServer - FOSS4G 2016
State of GeoServer - FOSS4G 2016State of GeoServer - FOSS4G 2016
State of GeoServer - FOSS4G 2016
 
Crunching Data In GeoServer: Mastering Rendering Transformations, WPS Process...
Crunching Data In GeoServer: Mastering Rendering Transformations, WPS Process...Crunching Data In GeoServer: Mastering Rendering Transformations, WPS Process...
Crunching Data In GeoServer: Mastering Rendering Transformations, WPS Process...
 
Ukgovld registry-intro
Ukgovld registry-introUkgovld registry-intro
Ukgovld registry-intro
 
HDF Group Support for NPP/NPOESS/JPSS
HDF Group Support for NPP/NPOESS/JPSSHDF Group Support for NPP/NPOESS/JPSS
HDF Group Support for NPP/NPOESS/JPSS
 

Similar to Data access and data extraction services within the Land Imagery Portal

Geoportal4everybody
Geoportal4everybodyGeoportal4everybody
Geoportal4everybody
Karel Charvat
 
The new CIARD RING , a machine-readable directory of datasets for agriculture
The new CIARD RING, a machine-readable directory of datasets for agricultureThe new CIARD RING, a machine-readable directory of datasets for agriculture
The new CIARD RING , a machine-readable directory of datasets for agriculture
Valeria Pesce
 
Geohosting
GeohostingGeohosting
Geohosting
Karel Charvat
 
FOSS4G Belgium 2018 - DCAT-AP Schema-plugin for GeoNetwork
FOSS4G Belgium 2018 - DCAT-AP Schema-plugin for GeoNetworkFOSS4G Belgium 2018 - DCAT-AP Schema-plugin for GeoNetwork
FOSS4G Belgium 2018 - DCAT-AP Schema-plugin for GeoNetwork
Goedertier Stijn
 
Data Skipping Technology Yosef Moatti
Data Skipping Technology Yosef MoattiData Skipping Technology Yosef Moatti
Data Skipping Technology Yosef Moatti
Big Data Value Association
 
Data Skipping Technology
Data Skipping TechnologyData Skipping Technology
Data Skipping Technology
Big Data Value Association
 
Thrombus Training Dec. 2013
Thrombus Training Dec. 2013Thrombus Training Dec. 2013
Thrombus Training Dec. 2013
CREATIS
 
Maximizing Data Lake ROI with Data Virtualization: A Technical Demonstration
Maximizing Data Lake ROI with Data Virtualization: A Technical DemonstrationMaximizing Data Lake ROI with Data Virtualization: A Technical Demonstration
Maximizing Data Lake ROI with Data Virtualization: A Technical Demonstration
Denodo
 
Metadata in EOSDIS
Metadata in EOSDISMetadata in EOSDIS
Enterprise guide to building a Data Mesh
Enterprise guide to building a Data MeshEnterprise guide to building a Data Mesh
Enterprise guide to building a Data Mesh
Sion Smith
 
Best practices and lessons learnt from Running Apache NiFi at Renault
Best practices and lessons learnt from Running Apache NiFi at RenaultBest practices and lessons learnt from Running Apache NiFi at Renault
Best practices and lessons learnt from Running Apache NiFi at Renault
DataWorks Summit
 
20100707 e z_rmll_gig_v1
20100707 e z_rmll_gig_v120100707 e z_rmll_gig_v1
20100707 e z_rmll_gig_v1
Gilles Guirand
 
Flagis linked open_data_stijn_goedertier
Flagis linked open_data_stijn_goedertierFlagis linked open_data_stijn_goedertier
Flagis linked open_data_stijn_goedertier
Flagis VZW
 
Micka Manual
Micka ManualMicka Manual
Micka Manual
SDIEDU
 
Big Data: Using free Bluemix Analytics Exchange Data with Big SQL
Big Data: Using free Bluemix Analytics Exchange Data with Big SQL Big Data: Using free Bluemix Analytics Exchange Data with Big SQL
Big Data: Using free Bluemix Analytics Exchange Data with Big SQL
Cynthia Saracco
 
Maps4Finland 28.8.2012, Jari Reini
Maps4Finland 28.8.2012, Jari ReiniMaps4Finland 28.8.2012, Jari Reini
Maps4Finland 28.8.2012, Jari Reini
Apps4Finland
 
PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...
PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...
PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...
Andreas Schreiber
 
DSD-INT 2015 - RSS Sentinel Toolbox - J. Manuel Delgado Blasco
DSD-INT 2015 - RSS Sentinel Toolbox - J. Manuel Delgado BlascoDSD-INT 2015 - RSS Sentinel Toolbox - J. Manuel Delgado Blasco
DSD-INT 2015 - RSS Sentinel Toolbox - J. Manuel Delgado Blasco
Deltares
 
Large Scale On-Demand Image Processing For Disaster Relief
Large Scale On-Demand Image Processing For Disaster ReliefLarge Scale On-Demand Image Processing For Disaster Relief
Large Scale On-Demand Image Processing For Disaster Relief
Robert Grossman
 
Intro elasticsearch taswarbhatti
Intro elasticsearch taswarbhattiIntro elasticsearch taswarbhatti
Intro elasticsearch taswarbhatti
Taswar Bhatti
 

Similar to Data access and data extraction services within the Land Imagery Portal (20)

Geoportal4everybody
Geoportal4everybodyGeoportal4everybody
Geoportal4everybody
 
The new CIARD RING , a machine-readable directory of datasets for agriculture
The new CIARD RING, a machine-readable directory of datasets for agricultureThe new CIARD RING, a machine-readable directory of datasets for agriculture
The new CIARD RING , a machine-readable directory of datasets for agriculture
 
Geohosting
GeohostingGeohosting
Geohosting
 
FOSS4G Belgium 2018 - DCAT-AP Schema-plugin for GeoNetwork
FOSS4G Belgium 2018 - DCAT-AP Schema-plugin for GeoNetworkFOSS4G Belgium 2018 - DCAT-AP Schema-plugin for GeoNetwork
FOSS4G Belgium 2018 - DCAT-AP Schema-plugin for GeoNetwork
 
Data Skipping Technology Yosef Moatti
Data Skipping Technology Yosef MoattiData Skipping Technology Yosef Moatti
Data Skipping Technology Yosef Moatti
 
Data Skipping Technology
Data Skipping TechnologyData Skipping Technology
Data Skipping Technology
 
Thrombus Training Dec. 2013
Thrombus Training Dec. 2013Thrombus Training Dec. 2013
Thrombus Training Dec. 2013
 
Maximizing Data Lake ROI with Data Virtualization: A Technical Demonstration
Maximizing Data Lake ROI with Data Virtualization: A Technical DemonstrationMaximizing Data Lake ROI with Data Virtualization: A Technical Demonstration
Maximizing Data Lake ROI with Data Virtualization: A Technical Demonstration
 
Metadata in EOSDIS
Metadata in EOSDISMetadata in EOSDIS
Metadata in EOSDIS
 
Enterprise guide to building a Data Mesh
Enterprise guide to building a Data MeshEnterprise guide to building a Data Mesh
Enterprise guide to building a Data Mesh
 
Best practices and lessons learnt from Running Apache NiFi at Renault
Best practices and lessons learnt from Running Apache NiFi at RenaultBest practices and lessons learnt from Running Apache NiFi at Renault
Best practices and lessons learnt from Running Apache NiFi at Renault
 
20100707 e z_rmll_gig_v1
20100707 e z_rmll_gig_v120100707 e z_rmll_gig_v1
20100707 e z_rmll_gig_v1
 
Flagis linked open_data_stijn_goedertier
Flagis linked open_data_stijn_goedertierFlagis linked open_data_stijn_goedertier
Flagis linked open_data_stijn_goedertier
 
Micka Manual
Micka ManualMicka Manual
Micka Manual
 
Big Data: Using free Bluemix Analytics Exchange Data with Big SQL
Big Data: Using free Bluemix Analytics Exchange Data with Big SQL Big Data: Using free Bluemix Analytics Exchange Data with Big SQL
Big Data: Using free Bluemix Analytics Exchange Data with Big SQL
 
Maps4Finland 28.8.2012, Jari Reini
Maps4Finland 28.8.2012, Jari ReiniMaps4Finland 28.8.2012, Jari Reini
Maps4Finland 28.8.2012, Jari Reini
 
PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...
PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...
PyModESt: A Python Framework for Staging of Geo-referenced Data on the Coll...
 
DSD-INT 2015 - RSS Sentinel Toolbox - J. Manuel Delgado Blasco
DSD-INT 2015 - RSS Sentinel Toolbox - J. Manuel Delgado BlascoDSD-INT 2015 - RSS Sentinel Toolbox - J. Manuel Delgado Blasco
DSD-INT 2015 - RSS Sentinel Toolbox - J. Manuel Delgado Blasco
 
Large Scale On-Demand Image Processing For Disaster Relief
Large Scale On-Demand Image Processing For Disaster ReliefLarge Scale On-Demand Image Processing For Disaster Relief
Large Scale On-Demand Image Processing For Disaster Relief
 
Intro elasticsearch taswarbhatti
Intro elasticsearch taswarbhattiIntro elasticsearch taswarbhatti
Intro elasticsearch taswarbhatti
 

More from Gasperi Jerome

Big data from space - Module Big Data ISAE 2017
Big data from space - Module Big Data ISAE 2017Big data from space - Module Big Data ISAE 2017
Big data from space - Module Big Data ISAE 2017
Gasperi Jerome
 
Le Big Data et les données Copernicus
Le Big Data et les données CopernicusLe Big Data et les données Copernicus
Le Big Data et les données Copernicus
Gasperi Jerome
 
2016.02.18 big data from space toulouse data science
2016.02.18   big data from space    toulouse data science2016.02.18   big data from space    toulouse data science
2016.02.18 big data from space toulouse data science
Gasperi Jerome
 
2015.11.12 big data from space - cusi toulouse
2015.11.12   big data from space - cusi toulouse2015.11.12   big data from space - cusi toulouse
2015.11.12 big data from space - cusi toulouse
Gasperi Jerome
 
Big Data - Accès et traitement des données d’Observation de laTerre
Big Data - Accès et traitement des données d’Observation de laTerreBig Data - Accès et traitement des données d’Observation de laTerre
Big Data - Accès et traitement des données d’Observation de laTerre
Gasperi Jerome
 
Semantic search within Earth Observation products databases based on automati...
Semantic search within Earth Observation products databases based on automati...Semantic search within Earth Observation products databases based on automati...
Semantic search within Earth Observation products databases based on automati...
Gasperi Jerome
 
2014.09.04 federated ground segments - toulouse
2014.09.04   federated ground segments - toulouse2014.09.04   federated ground segments - toulouse
2014.09.04 federated ground segments - toulouse
Gasperi Jerome
 
Web Processing Service
Web Processing ServiceWeb Processing Service
Web Processing Service
Gasperi Jerome
 
2014.04.22 - HyDre - Hydroweb Distribution Server
2014.04.22 - HyDre - Hydroweb Distribution Server2014.04.22 - HyDre - Hydroweb Distribution Server
2014.04.22 - HyDre - Hydroweb Distribution Server
Gasperi Jerome
 
Semantic search for Earth Observation products
Semantic search for Earth Observation productsSemantic search for Earth Observation products
Semantic search for Earth Observation products
Gasperi Jerome
 
RESTo - restful semantic search tool for geospatial
RESTo - restful semantic search tool for geospatialRESTo - restful semantic search tool for geospatial
RESTo - restful semantic search tool for geospatial
Gasperi Jerome
 
Single Sign On with OAuth and OpenID
Single Sign On with OAuth and OpenIDSingle Sign On with OAuth and OpenID
Single Sign On with OAuth and OpenID
Gasperi Jerome
 
CNES Data Center
CNES Data CenterCNES Data Center
CNES Data Center
Gasperi Jerome
 
CNES OpenSearch implementations
CNES OpenSearch implementationsCNES OpenSearch implementations
CNES OpenSearch implementations
Gasperi Jerome
 
Web Processing Service
Web Processing ServiceWeb Processing Service
Web Processing Service
Gasperi Jerome
 
Unify Earth Observation products access with OpenSearch
Unify Earth Observation products access with OpenSearchUnify Earth Observation products access with OpenSearch
Unify Earth Observation products access with OpenSearch
Gasperi Jerome
 
CNES activities on semantic search
CNES activities on semantic searchCNES activities on semantic search
CNES activities on semantic search
Gasperi Jerome
 
Traitements de données à la demande - Introduction au Web Processing Service
Traitements de données à la demande - Introduction au Web Processing ServiceTraitements de données à la demande - Introduction au Web Processing Service
Traitements de données à la demande - Introduction au Web Processing Service
Gasperi Jerome
 
Semantic search applied to Earth Observation products
Semantic search applied to Earth Observation productsSemantic search applied to Earth Observation products
Semantic search applied to Earth Observation products
Gasperi Jerome
 
Accès à l’information satellitaire dans un contexte réactif de catastrophe na...
Accès à l’information satellitaire dans un contexte réactif de catastrophe na...Accès à l’information satellitaire dans un contexte réactif de catastrophe na...
Accès à l’information satellitaire dans un contexte réactif de catastrophe na...
Gasperi Jerome
 

More from Gasperi Jerome (20)

Big data from space - Module Big Data ISAE 2017
Big data from space - Module Big Data ISAE 2017Big data from space - Module Big Data ISAE 2017
Big data from space - Module Big Data ISAE 2017
 
Le Big Data et les données Copernicus
Le Big Data et les données CopernicusLe Big Data et les données Copernicus
Le Big Data et les données Copernicus
 
2016.02.18 big data from space toulouse data science
2016.02.18   big data from space    toulouse data science2016.02.18   big data from space    toulouse data science
2016.02.18 big data from space toulouse data science
 
2015.11.12 big data from space - cusi toulouse
2015.11.12   big data from space - cusi toulouse2015.11.12   big data from space - cusi toulouse
2015.11.12 big data from space - cusi toulouse
 
Big Data - Accès et traitement des données d’Observation de laTerre
Big Data - Accès et traitement des données d’Observation de laTerreBig Data - Accès et traitement des données d’Observation de laTerre
Big Data - Accès et traitement des données d’Observation de laTerre
 
Semantic search within Earth Observation products databases based on automati...
Semantic search within Earth Observation products databases based on automati...Semantic search within Earth Observation products databases based on automati...
Semantic search within Earth Observation products databases based on automati...
 
2014.09.04 federated ground segments - toulouse
2014.09.04   federated ground segments - toulouse2014.09.04   federated ground segments - toulouse
2014.09.04 federated ground segments - toulouse
 
Web Processing Service
Web Processing ServiceWeb Processing Service
Web Processing Service
 
2014.04.22 - HyDre - Hydroweb Distribution Server
2014.04.22 - HyDre - Hydroweb Distribution Server2014.04.22 - HyDre - Hydroweb Distribution Server
2014.04.22 - HyDre - Hydroweb Distribution Server
 
Semantic search for Earth Observation products
Semantic search for Earth Observation productsSemantic search for Earth Observation products
Semantic search for Earth Observation products
 
RESTo - restful semantic search tool for geospatial
RESTo - restful semantic search tool for geospatialRESTo - restful semantic search tool for geospatial
RESTo - restful semantic search tool for geospatial
 
Single Sign On with OAuth and OpenID
Single Sign On with OAuth and OpenIDSingle Sign On with OAuth and OpenID
Single Sign On with OAuth and OpenID
 
CNES Data Center
CNES Data CenterCNES Data Center
CNES Data Center
 
CNES OpenSearch implementations
CNES OpenSearch implementationsCNES OpenSearch implementations
CNES OpenSearch implementations
 
Web Processing Service
Web Processing ServiceWeb Processing Service
Web Processing Service
 
Unify Earth Observation products access with OpenSearch
Unify Earth Observation products access with OpenSearchUnify Earth Observation products access with OpenSearch
Unify Earth Observation products access with OpenSearch
 
CNES activities on semantic search
CNES activities on semantic searchCNES activities on semantic search
CNES activities on semantic search
 
Traitements de données à la demande - Introduction au Web Processing Service
Traitements de données à la demande - Introduction au Web Processing ServiceTraitements de données à la demande - Introduction au Web Processing Service
Traitements de données à la demande - Introduction au Web Processing Service
 
Semantic search applied to Earth Observation products
Semantic search applied to Earth Observation productsSemantic search applied to Earth Observation products
Semantic search applied to Earth Observation products
 
Accès à l’information satellitaire dans un contexte réactif de catastrophe na...
Accès à l’information satellitaire dans un contexte réactif de catastrophe na...Accès à l’information satellitaire dans un contexte réactif de catastrophe na...
Accès à l’information satellitaire dans un contexte réactif de catastrophe na...
 

Recently uploaded

Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
ssuserfac0301
 
Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
AstuteBusiness
 
Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)
Jakub Marek
 
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
saastr
 
5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides
DanBrown980551
 
AWS Cloud Cost Optimization Presentation.pptx
AWS Cloud Cost Optimization Presentation.pptxAWS Cloud Cost Optimization Presentation.pptx
AWS Cloud Cost Optimization Presentation.pptx
HarisZaheer8
 
Azure API Management to expose backend services securely
Azure API Management to expose backend services securelyAzure API Management to expose backend services securely
Azure API Management to expose backend services securely
Dinusha Kumarasiri
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
Chart Kalyan
 
System Design Case Study: Building a Scalable E-Commerce Platform - Hiike
System Design Case Study: Building a Scalable E-Commerce Platform - HiikeSystem Design Case Study: Building a Scalable E-Commerce Platform - Hiike
System Design Case Study: Building a Scalable E-Commerce Platform - Hiike
Hiike
 
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
alexjohnson7307
 
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracyGraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
Tomaz Bratanic
 
June Patch Tuesday
June Patch TuesdayJune Patch Tuesday
June Patch Tuesday
Ivanti
 
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERPBest 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
Pixlogix Infotech
 
WeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation TechniquesWeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation Techniques
Postman
 
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
saastr
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Safe Software
 
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying AheadDigital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Wask
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
panagenda
 
Serial Arm Control in Real Time Presentation
Serial Arm Control in Real Time PresentationSerial Arm Control in Real Time Presentation
Serial Arm Control in Real Time Presentation
tolgahangng
 
FREE A4 Cyber Security Awareness Posters-Social Engineering part 3
FREE A4 Cyber Security Awareness  Posters-Social Engineering part 3FREE A4 Cyber Security Awareness  Posters-Social Engineering part 3
FREE A4 Cyber Security Awareness Posters-Social Engineering part 3
Data Hops
 

Recently uploaded (20)

Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
 
Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
 
Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)
 
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
 
5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides
 
AWS Cloud Cost Optimization Presentation.pptx
AWS Cloud Cost Optimization Presentation.pptxAWS Cloud Cost Optimization Presentation.pptx
AWS Cloud Cost Optimization Presentation.pptx
 
Azure API Management to expose backend services securely
Azure API Management to expose backend services securelyAzure API Management to expose backend services securely
Azure API Management to expose backend services securely
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
 
System Design Case Study: Building a Scalable E-Commerce Platform - Hiike
System Design Case Study: Building a Scalable E-Commerce Platform - HiikeSystem Design Case Study: Building a Scalable E-Commerce Platform - Hiike
System Design Case Study: Building a Scalable E-Commerce Platform - Hiike
 
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
 
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracyGraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
 
June Patch Tuesday
June Patch TuesdayJune Patch Tuesday
June Patch Tuesday
 
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERPBest 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
 
WeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation TechniquesWeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation Techniques
 
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
 
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying AheadDigital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying Ahead
 
HCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAUHCL Notes and Domino License Cost Reduction in the World of DLAU
HCL Notes and Domino License Cost Reduction in the World of DLAU
 
Serial Arm Control in Real Time Presentation
Serial Arm Control in Real Time PresentationSerial Arm Control in Real Time Presentation
Serial Arm Control in Real Time Presentation
 
FREE A4 Cyber Security Awareness Posters-Social Engineering part 3
FREE A4 Cyber Security Awareness  Posters-Social Engineering part 3FREE A4 Cyber Security Awareness  Posters-Social Engineering part 3
FREE A4 Cyber Security Awareness Posters-Social Engineering part 3
 

Data access and data extraction services within the Land Imagery Portal

  • 1. Data access and Data extraction Services within the Land Imagery portal Jerome Gasperi @ CNES | HAWG - Models for scientific exploitation of EO Data Frascati, Italy - October 12th, 2012
  • 2. Land Imagery Portal Overview Search service Download service What's next Thematic data extraction
  • 4. The * PTSC is the future French "Thematic Center for Land Imagery" * temporary name, subject to change when operational
  • 5. v0 (end of 2012) Official launch of the portal v1 (2013) additionnal datasets from CNES and partners, SSO integration, etc.
  • 7. Metadata are stored within an internal structure including necessary properties to be compliant with INSPIRE and HMA metadata requirement Additional information can be stored beside metadata (e.g. thematic classification) Offers multiple search interface (OpenSearch, CSW ISO - INSPIRE, CSW EO - HMA) Users Registry index OpenSearch Indexes each data providers metadata using dedicated connectors (OpenSearch, CSW CIM or CSW ISO) MUSCATE Kalideos SPOT Archives SPIRIT CNES CSW CIM based on SITOOLS POSTEL CSW ISO OpenSearch PTSC Metacatalog Geoportal catalog v1 IGN GEOSUD catalog GEOSUD v1 Data providers v?
  • 8. Metadata are stored within an internal structure including necessary properties to be compliant with INSPIRE and HMA metadata requirement Additional information can be stored beside metadata (e.g. thematic classification) HMA Offers multiple search interface (OpenSearch, CSW ISO - INSPIRE, CSW EO - HMA) Users Registry index OpenSearch Indexes each data providers metadata using dedicated connectors (OpenSearch, CSW CIM or CSW ISO) MUSCATE Kalideos SPOT Archives SPIRIT CNES CSW CIM based on SITOOLS POSTEL CSW ISO OpenSearch INSPIRE PTSC Metacatalog Geoportal catalog v1 IGN GEOSUD catalog GEOSUD v1 Data providers v?
  • 9. Metadata are stored within an internal structure including necessary properties to be compliant with INSPIRE and HMA metadata requirement Additional information can be stored beside metadata (e.g. thematic classification) HMA Offers multiple search interface (OpenSearch, CSW ISO - INSPIRE, CSW EO - HMA) Users Registry index OpenSearch Indexes each data providers metadata using dedicated connectors (OpenSearch, CSW CIM or CSW ISO) MUSCATE Kalideos SPOT Archives SPIRIT CNES CSW CIM based on SITOOLS POSTEL CSW ISO INSPIRE V0 OpenSearch PTSC Metacatalog Geoportal catalog v1 IGN GEOSUD catalog GEOSUD v1 Data providers v?
  • 10. Metadata are stored within an internal structure including necessary properties to be compliant with INSPIRE and HMA metadata requirement Additional information can be stored beside metadata (e.g. thematic classification) HMA Offers multiple search interface (OpenSearch, CSW ISO - INSPIRE, CSW EO - HMA) V1 Users Registry index OpenSearch Indexes each data providers metadata using dedicated connectors (OpenSearch, CSW CIM or CSW ISO) MUSCATE Kalideos SPOT Archives SPIRIT CNES CSW CIM based on SITOOLS POSTEL CSW ISO INSPIRE V0 OpenSearch PTSC Metacatalog Geoportal catalog v1 IGN GEOSUD catalog GEOSUD v1 Data providers v?
  • 12. Product download url is embeded within the product metadata returned by the search service
  • 13. Two cases : url content mimeType is "text/html" No direct download. The url is opened in another browser tab. User follows the instructions on the corresponding web page to download the product (this is typically the case for a product that required to explicitely sign an NDA before downloading it) otherwise product can be downloaded directly No common downloading format has been decided yet. The products are downloaded as is.
  • 15. Important note - the following slides present a proposal that will be discussed by the PTSC partners to be integrated (or not) within the Land Imagery portal.
  • 17. ? How to search within the portal for products that contains coastal cultivated areas ?
  • 20. Orthorectified image What we got Characterized image
  • 21. This is water This is urban This is forest Orthorectified image What we got Characterized image
  • 22. This is water This is urban This is forest Orthorectified image What we got Characterized image What we need
  • 23. How to do this ?
  • 24. SLACkER SimpLe Automated Characterization of EaRth observation products
  • 25. SLACkER uses GLC 2000 classification to perform an automatic and location based characterization of products
  • 26. Global Land Cover 2000 World land cover TIFF file ~ 650 Mo 1 km resolution 1 color = 1 thematic class 22 classes
  • 27. OpenSearch PTSC Metacatalog Identifier Description Copyright Acquisition date Acquisition angles Thumbnail ... + Footprint 1. Get footprint bounding box 2. Get GLC2000 area 0. Get metadata 3. Process characterization 4. Store results SLACkER
  • 28. Processing result example Tag table images within database glc2000 >> Add classification columns >> Processing 10 Crop GLC2000 raster : 24137 6169 156 119 Polygonize extracted raster Process footprint against Global Land Cover Store classification => 40.89% of Deserts (10 + 14 + 19) => 31.89% of Herbaceous (9 + 11 + 12 + 13) => 14.71% of Water (20) => 9.27% of Cultivated (15 + 16 + 17 + 18) => 3.2% of Forests (1 + 2 + 3 + 4 + 5 + 6) ( ( ( ( ( ( ( ( ( ( INPUT : metadata OUTPUT : additional thematics info stored beside the metadata within the Metacatalog 28.65 % of 14 : Sparse Herbaceous or sparse Shrub Cover ) 6.1 % of 18 : Mosaic: Cropland / Shrub or Grass Cover ) 12.24 % of 19 : Bare Areas ) 31.88 % of 12 : Shrub Cover, closed-open, deciduous ) 2.5 % of 3 : Tree Cover, broadleaved, deciduous, open ) 14.71 % of 20 : Water Bodies (natural & artificial) ) 0.13 % of 15 : Regularly flooded Shrub and/or Herbaceous Cover ) 2.81 % of 16 : Cultivated and managed areas ) 0.69 % of 4 : Tree Cover, needle-leaved, evergreen ) 0.21 % of 17 : Mosaic: Cropland / Tree Cover / Other natural vegetation )
  • 29. Thematic sliders SPOT cover - 1,300,000 scenes
  • 30. Search for coastal cultivated area ?
  • 31. Coastal cultivated area Search results (footprints displayed in black over the map)
  • 32. costal... ...cultivated area Thematic classification is displayed within the result metadata