Cloud Computing & Web Processing Services
https://speakerdeck.com/jjrom/cloud-computing-and-web-processing-services

Jérôm...
Cloud Computing

Introduction
What we have done
Issues

Web Processing Services

Introduction
What we have done
Issues

Wh...
R&T Cloud Computing (2011)
Use a cloud infrastructure to process Earth Observation data
?
host

build

consume

IAAS

PAAS

SAAS
host

build

consume

IAAS

PAAS

SAAS
Private or public ?
process

to

1 €
1 time

store

+

5 €
per year

access

0.5 €
each time

(Very) approximative computations for a 20x20 km...
process

to

1 €
1 time

store

+

5 €
per year

access

0.5 €
each time

(Very) approximative computations for a 20x20 km...
Data security and user privacy cannot
be guaranteed in public clouds
Majority of cloud providers are subject to government...
...so we choose a private solution
What we have
done

Web browser

eNovance (Paris)
What we have
done

Data

SRTM tile
Web browser

eNovance (Paris)
What we have
done

Data

Processing (Orfeo Toolbox)

SRTM tile
Web browser

eNovance (Paris)
What we have
done

Data

Processing (Orfeo Toolbox)

SRTM tile
Hill Shading

Web browser

eNovance (Paris)
What we have
done

Data

Processing (Orfeo Toolbox)

SRTM tile
Hill Shading

Projecting

Web browser

eNovance (Paris)
What we have
done

Data

Processing (Orfeo Toolbox)

VISUALIZE

SRTM tile

WMS Server

Hill Shading

Projecting

Tiling

W...
Conclusions
Private cloud technologies are quite simple to implement. They reduce
the cost of operation and maintenance by sharing a c...
However...
However...
Transfering large volumes of data is problematic
However...
Transfering large volumes of data is problematic
This is true for upload and download
...so
...so
Data and processes should be colocated
...so
Data and processes should be colocated
Processing results should be downloaded only if needed
...so
Data and processes should be colocated
Processing results should be downloaded only if needed
Better to offer a Web ...
...so
Data and processes should be colocated
Processing results should be downloaded only if needed
Better to offer a Web ...
Web Processing Service (2012-2013)
Set WPS on top of Orfeo Toolbox processing chains
Web Processing Services (WPS) is an OGC standard which defines
interfaces to publish, describe and execute geospatial proc...
Web application

WPS

Processing a
What we have
done

From pixel...

Remote sensing image
What we have
done

From pixel...

Remote sensing image

...to information

Land cover thematic map
Orfeo Toolbox

Processing

http://orfeo-toolbox.org

Constellation

WPS

http://www.constellation-sdi.org

mapshup
http://...
Processing

Orfeo Toolbox

Remote sensing image library
Open Source
Developped by the French Space Agency
Processing

Orfeo Toolbox

More than 70 high level processing chains
orthorectification
segmentation
classification
etc.
Processing

Supervised learning

Based on SVM
(http://en.wikipedia.org/wiki/Support_vector_machine)

(land cover is comput...
WPS

Constellation

Geospatial Networking Services
OGC/ISO implementations
Multi platform (JAVA)
OpenSource
WMS

WFS

CSW
...
Web
application

mapshup

Improves access to geospatial data
HTML + javascript
Based on OpenLayers and jQuery
Web
application

mapshup

Supported data sources
WMS

WFS

CSW

WPS

OpenSearch

KML

Google
maps

Bing
maps

WMTS

OpenSt...
See WPS demo

Web
application

https://vimeo.com/67288678

mapshup

Supported data sources
WMS

WFS

CSW

WPS

OpenSearch
...
What have
we done ?

https://vimeo.com/67288677
Conclusions
WPS 1.0 lacks a true asynchronous process management...
There is no way to cancel a launched process !
However...
However...
WPS 2.0 defines a set of process management operations - GetStatus,
Delete, Pause and Resume
However...
WPS 2.0 defines a set of process management operations - GetStatus,
Delete, Pause and Resume
This is a must hav...
However...
WPS 2.0 defines a set of process management operations - GetStatus,
Delete, Pause and Resume
This is a must hav...
What's next
WPS on the cloud - OGC OWS-10 Testbeb
Orthorectifying images hosted by a cloud infrastructure using
WPS standard
In kind contribution to the «Open Mobility» thr...
Services
Client

1

SEARCH

3

PROCESS
WPS Server

4

+

CSW Server

Metadata

2

Processing

Raw images
Result

Orthorect...
3. Result is displayed within the map trough a WMS

1. Select raw image to orthorectify within
Landsat
CSW catalogLaat
loc...
Cloud Computing & Web Processing Services
https://speakerdeck.com/jjrom/cloud-computing-and-web-processing-services

Jérôm...
Upcoming SlideShare
Loading in …5
×

Cloud computing and web processing services

680 views

Published on

Toulouse, CNES - 2013.10.01
RTSTechniques de l'Information et de la Communication

Synthesis of R&T projects on Cloud Computing and WPS - i.e. OpenStack cloud based solution for processing SRTM data followed by Land Cover classification through WPS

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
680
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
19
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Cloud computing and web processing services

  1. 1. Cloud Computing & Web Processing Services https://speakerdeck.com/jjrom/cloud-computing-and-web-processing-services Jérôme Gasperi Jerome.Gasperi@cnes.fr RTS Techniques de l'Information et de la Communication CNES - Toulouse, France - October 1st, 2013
  2. 2. Cloud Computing Introduction What we have done Issues Web Processing Services Introduction What we have done Issues What's next ? WPS on the cloud
  3. 3. R&T Cloud Computing (2011) Use a cloud infrastructure to process Earth Observation data
  4. 4. ?
  5. 5. host build consume IAAS PAAS SAAS
  6. 6. host build consume IAAS PAAS SAAS
  7. 7. Private or public ?
  8. 8. process to 1 € 1 time store + 5 € per year access 0.5 € each time (Very) approximative computations for a 20x20 km PA+XS Pleiades product (4 Go) - based on Amazon EC2 and S3 pricing (2012)
  9. 9. process to 1 € 1 time store + 5 € per year access 0.5 € each time (Very) approximative computations for a 20x20 km PA+XS Pleiades product (4 Go) - based on Amazon EC2 and S3 pricing (2012)
  10. 10. Data security and user privacy cannot be guaranteed in public clouds Majority of cloud providers are subject to governmental law (e.g. US patriot act)
  11. 11. ...so we choose a private solution
  12. 12. What we have done Web browser eNovance (Paris)
  13. 13. What we have done Data SRTM tile Web browser eNovance (Paris)
  14. 14. What we have done Data Processing (Orfeo Toolbox) SRTM tile Web browser eNovance (Paris)
  15. 15. What we have done Data Processing (Orfeo Toolbox) SRTM tile Hill Shading Web browser eNovance (Paris)
  16. 16. What we have done Data Processing (Orfeo Toolbox) SRTM tile Hill Shading Projecting Web browser eNovance (Paris)
  17. 17. What we have done Data Processing (Orfeo Toolbox) VISUALIZE SRTM tile WMS Server Hill Shading Projecting Tiling Web browser eNovance (Paris)
  18. 18. Conclusions
  19. 19. Private cloud technologies are quite simple to implement. They reduce the cost of operation and maintenance by sharing a common infrastructure across multiple projects
  20. 20. However...
  21. 21. However... Transfering large volumes of data is problematic
  22. 22. However... Transfering large volumes of data is problematic This is true for upload and download
  23. 23. ...so
  24. 24. ...so Data and processes should be colocated
  25. 25. ...so Data and processes should be colocated Processing results should be downloaded only if needed
  26. 26. ...so Data and processes should be colocated Processing results should be downloaded only if needed Better to offer a Web service to visualize/manipulate results
  27. 27. ...so Data and processes should be colocated Processing results should be downloaded only if needed Better to offer a Web service to visualize/manipulate results Standardize processes inputs/outputs description (e.g. WPS)
  28. 28. Web Processing Service (2012-2013) Set WPS on top of Orfeo Toolbox processing chains
  29. 29. Web Processing Services (WPS) is an OGC standard which defines interfaces to publish, describe and execute geospatial processes
  30. 30. Web application WPS Processing a
  31. 31. What we have done From pixel... Remote sensing image
  32. 32. What we have done From pixel... Remote sensing image ...to information Land cover thematic map
  33. 33. Orfeo Toolbox Processing http://orfeo-toolbox.org Constellation WPS http://www.constellation-sdi.org mapshup http://mapshup.info Web application
  34. 34. Processing Orfeo Toolbox Remote sensing image library Open Source Developped by the French Space Agency
  35. 35. Processing Orfeo Toolbox More than 70 high level processing chains orthorectification segmentation classification etc.
  36. 36. Processing Supervised learning Based on SVM (http://en.wikipedia.org/wiki/Support_vector_machine) (land cover is computed from a set of "well known areas" given by user) Orfeo Toolbox More than 70 high level processing chains orthorectification segmentation classification etc.
  37. 37. WPS Constellation Geospatial Networking Services OGC/ISO implementations Multi platform (JAVA) OpenSource WMS WFS CSW WPS
  38. 38. Web application mapshup Improves access to geospatial data HTML + javascript Based on OpenLayers and jQuery
  39. 39. Web application mapshup Supported data sources WMS WFS CSW WPS OpenSearch KML Google maps Bing maps WMTS OpenStreetMap MapBox Youtube Wikipedia GeoRSS Flickr etc.
  40. 40. See WPS demo Web application https://vimeo.com/67288678 mapshup Supported data sources WMS WFS CSW WPS OpenSearch KML Google maps Bing maps WMTS OpenStreetMap MapBox Youtube Wikipedia GeoRSS Flickr etc.
  41. 41. What have we done ? https://vimeo.com/67288677
  42. 42. Conclusions
  43. 43. WPS 1.0 lacks a true asynchronous process management... There is no way to cancel a launched process !
  44. 44. However...
  45. 45. However... WPS 2.0 defines a set of process management operations - GetStatus, Delete, Pause and Resume
  46. 46. However... WPS 2.0 defines a set of process management operations - GetStatus, Delete, Pause and Resume This is a must have to deploy asynchronous WPS on the cloud
  47. 47. However... WPS 2.0 defines a set of process management operations - GetStatus, Delete, Pause and Resume This is a must have to deploy asynchronous WPS on the cloud Should be an official OGC standard by the end of 2013
  48. 48. What's next WPS on the cloud - OGC OWS-10 Testbeb
  49. 49. Orthorectifying images hosted by a cloud infrastructure using WPS standard In kind contribution to the «Open Mobility» thread of the OGC OWS-10 Testbeb Final delivery and demonstration April/May 2014
  50. 50. Services Client 1 SEARCH 3 PROCESS WPS Server 4 + CSW Server Metadata 2 Processing Raw images Result Orthorectify VISUALIZE Services Data (Pléiades samples) (OTB) WMS Server Interoute (location : UK) Quality WPS Server VISUALIZE WMS Server Processing Assess Quality Improve Quality Astrium GEO
  51. 51. 3. Result is displayed within the map trough a WMS 1. Select raw image to orthorectify within Landsat CSW catalogLaat located on the Landsat 2. Click on '+' to process a new orthorectification. Process parameters are set by user and sent to an asynchronous WPS orthorectification process located on the Landsat 4. Orthorectified image quality can be checked through "Assess Quality" WPS process located on the Landsat Result is displayed within the map as a WMS quality layer stored on the
  52. 52. Cloud Computing & Web Processing Services https://speakerdeck.com/jjrom/cloud-computing-and-web-processing-services Jérôme Gasperi Jerome.Gasperi@cnes.fr RTS Techniques de l'Information et de la Communication CNES - Toulouse, France - October 1st, 2013

×