Service Support Environment


Published on

  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • EO Ground segment modules, with standard internal interfaces EXTERNAL INTERFACES that allow the interoperability between different Ground Sgements. Indicate which are the level of co-operation and interoperability that will allow the users to improve the data access and data sustainability
  • Replace with current
  • Service Support Environment

    1. 1. Case Study: ESA Service Support Environment (SSE) Yves Coene, SPACEBEL P.G. Marchetti, ESA EOP-G
    2. 2. Table of Contents <ul><li>Overview </li></ul><ul><li>Tools </li></ul><ul><li>Standards </li></ul><ul><li>Conclusion </li></ul>
    3. 3. SSE Objectives <ul><li>Orchestrate synchronous and asynchronous EO Services for online and offline processes </li></ul><ul><li>Provide an overarching infrastructure, neutrally managed by ESA </li></ul><ul><li>Empower service providers through a business process management (BPM) platform </li></ul><ul><li>Easily deploy and deliver services to users from own infrastructure </li></ul><ul><li>Minimize service providers’ upfront investments </li></ul><ul><li>Open standards to facilitate adoption and evolution </li></ul>
    4. 4. PROBLEM (Real Life Decision Support) O il spill detection processor ERS SAR online data access Ship detection processor ERS SAR online data access ERS SAR catalogue Envisat ASAR catalogue RadarSat catalogue Wave height & direction model <ul><li>Parallel cross catalogue search </li></ul><ul><li>On-line data access ERS and ENVISAT </li></ul><ul><li>Ship detection </li></ul><ul><li>Oil spill detection </li></ul><ul><li>Create layers by transformation, reprojection, rescaling and mosaicing. </li></ul>Need : Protect Environment after oil spill
    5. 5. Approach <ul><li>SOA </li></ul><ul><ul><li>Approach to develop reusable services </li></ul></ul><ul><ul><li>Loosly coupled </li></ul></ul><ul><ul><li>Expose functionality in modular fashion </li></ul></ul><ul><ul><li>Avoids duplication </li></ul></ul><ul><ul><li>Reduces total number of processes </li></ul></ul><ul><ul><li>Combine services according to a business process: &quot; orchestration &quot;. </li></ul></ul><ul><ul><li>SOA implemented using Web services </li></ul></ul>
    6. 6. Approach <ul><li>SSE Portal </li></ul><ul><ul><li>RedHat Linux Entreprise Edition </li></ul></ul><ul><ul><li>J2EE Application Server: JBoss </li></ul></ul><ul><ul><li>Workflow engine: Oracle BPEL Process Manager 2.1.2 </li></ul></ul><ul><ul><li>Presentation layer: Apache Struts, Java Server Pages, XSLT transformation of SOAP payloads </li></ul></ul><ul><ul><li>Persistency: Oracle Database 9i </li></ul></ul><ul><ul><li>Hosted by ESA/ESRIN in Frascati (Italy) </li></ul></ul><ul><ul><li>Types of users: end-users and service providers </li></ul></ul>
    7. 7. Approach <ul><li>Workflow Engine </li></ul><ul><ul><li>Standard workflow definition language (BPEL) </li></ul></ul><ul><ul><li>Domain (sandbox) per service provider </li></ul></ul><ul><ul><li>API to create service provider &quot;domains&quot; dynamically </li></ul></ul><ul><ul><li>API to list flows in a domain </li></ul></ul><ul><ul><li>API to start synchronous and asynchronous flows </li></ul></ul><ul><ul><li>API to get flow status (BPEL scope names) </li></ul></ul><ul><ul><li>JMS to receive workflow results </li></ul></ul><ul><ul><li>Large SOAP payloads (GML up to 15 MB) </li></ul></ul>
    8. 8. Approach SSE Toolbox
    9. 9. Table of Contents <ul><li>Overview </li></ul><ul><li>Tools </li></ul><ul><li>Standards </li></ul><ul><li>Conclusion </li></ul>
    10. 10. Service Publishing Steps <ul><li>Publish service as Web service </li></ul><ul><ul><li>SSE Toolbox </li></ul></ul><ul><li>Orchestrate services </li></ul><ul><ul><li>BPEL Designer : creating workflows </li></ul></ul><ul><ul><li>or use default workflows </li></ul></ul><ul><li>Register service on SSE Portal </li></ul><ul><ul><li>Fill out Web form and configure AOI component </li></ul></ul><ul><li>Monitor service processes &quot;in-flight&quot; </li></ul><ul><ul><li>BPEL Console </li></ul></ul>
    11. 11. Step 1: Toolbox <ul><li>Allows easy Web service “publishing” </li></ul><ul><li>Provides a generic gateway towards service providers’ infrastructure (e.g. DBMS, file system, API, FTP) </li></ul><ul><li>Interface towards the Service Provider infrastructure based on widely accepted IT standards </li></ul><ul><li>Permits to translate local terms into SSE ones (no need to change Service Provider infrastructure) </li></ul><ul><li>Free download from SSE Portal (open-source) </li></ul><ul><li>Based on SUN JWSDP </li></ul>
    12. 12. Step 2: Service Orchestration <ul><li>BPEL Designer to chain services ... </li></ul>
    13. 13. Step 2: Service Orchestration <ul><li>BPEL Designer </li></ul><ul><ul><li>Based on Eclipse ( </li></ul></ul><ul><ul><li>BPEL plugin is free download </li></ul></ul><ul><ul><li>Allows service provider to define service flows </li></ul></ul><ul><ul><li>Service flows can be uploaded to SSE Portal into service provider's domain </li></ul></ul>
    14. 14. Step 2: Service Orchestration <ul><li>ws-inspection </li></ul><ul><ul><li>Service discovery from &quot;BPEL Designer&quot; </li></ul></ul>
    15. 15. Orchestration Example “ Carbon flux over Belgium in GeoTIFF format (Kyoto Protocol verification)” User needs: Data Provider Data Provider Value Adder Service Provider Format Conversion Clipping Spot Vegetation Sensor S10 Net Flux of Carbon Map (HDF) HDF GeoTIFF Europe Belgium Automation of Business Process
    16. 16. Step 3: Service Registration 2 - define operation & interaction 1 - select service category 3 - describe the service 4 – bindings: a.o. WSDL 5 - register!
    17. 17. Step 4: Service Monitoring Workflow console to monitor service instances
    18. 18. Step 4: Service Monitoring <ul><li>Supports 100% manual services via task list </li></ul><ul><li>Service provider can enters service result as text (e.g. URL) </li></ul><ul><li>Also manual services can be &quot;chained&quot; </li></ul>
    19. 19. Table of Contents <ul><li>Overview </li></ul><ul><li>Tools </li></ul><ul><li>Standards </li></ul><ul><li>Conclusion </li></ul>
    20. 20. <ul><li>WSDL (W3C) </li></ul><ul><ul><li>WSDL file for each service, generated by SSE Toolbox </li></ul></ul><ul><ul><li>Defines available service operations </li></ul></ul><ul><ul><li>Each operation has parameters. Types defined in XML Schema (W3C) </li></ul></ul><ul><ul><li>Operations have (mainly) SOAP bindings </li></ul></ul><ul><ul><li>Apache WSIF (WS Invocation Framework) allows using WSDL for other bindings such as XML/HTTP (OGC WMS, WFS, WCS), email, etc. </li></ul></ul>
    21. 21. Interaction Model <ul><li>Predefined &quot;basic&quot; operations per service: </li></ul><ul><ul><li>Search: returns matching catalogue entries </li></ul></ul><ul><ul><li>Present: retrieves all available &quot;metadata&quot;. </li></ul></ul><ul><ul><li>Request Quotation: returns information about the service, e.g. feasibility, pricing, alternatives etc. </li></ul></ul><ul><ul><li>Order: activates the service. </li></ul></ul><ul><li>Customised operations: </li></ul><ul><ul><li>Can be mapped to a workflow </li></ul></ul><ul><ul><li>Workflow can call any Web service </li></ul></ul>
    22. 22. Interaction Model <ul><li>WS-Interoperability ( </li></ul><ul><ul><li>Request/Response (synchronous) </li></ul></ul><ul><ul><li>Basic callback (asynchronous) </li></ul></ul>
    23. 23. <ul><li>ws-addressing (W3C) </li></ul><ul><ul><li>asynchronous communication: correlation of messages. </li></ul></ul><ul><li>SOAP (W3C) </li></ul><ul><ul><li>message-based (i.e. document-style) </li></ul></ul><ul><ul><li>Over HTTP, firewall-friendly, platform neutral </li></ul></ul><ul><ul><li>Optional use of HTTPS / SSL </li></ul></ul><ul><ul><li>De-facto standard: J2EE and Microsoft .NET </li></ul></ul><ul><ul><li>Interface is formalised using WSDL </li></ul></ul>
    24. 24. <ul><li>BPEL (OASIS) </li></ul><ul><ul><li>Standard to orchestrate Web services into process flows </li></ul></ul><ul><ul><li>Invoke Web services synchronous / asynchronous </li></ul></ul><ul><ul><li>Manipulate XML documents (XPath, XSLT) </li></ul></ul><ul><ul><li>Rich language: if / while / parallel, exceptions, events etc. </li></ul></ul><ul><ul><li>Expose process flow as Web service </li></ul></ul><ul><ul><li>Many implementations: SeeBeyond, IBM, Oracle, Intersystems etc. </li></ul></ul>
    25. 25. EO Catalogue Access <ul><li>Currently ESA EOLI-XML ICD (SOAP): Search/Present </li></ul><ul><li>OGC Catalog 2.0 ( C atalogue S ervices for the W eb) being investigated. </li></ul><ul><li>EOLI-XML may become OGC Profile (Harmony Project with OGCE) </li></ul>
    26. 26. <ul><li>Data distribution mechanisms </li></ul><ul><ul><li>SOAP : data included in SOAP payload </li></ul></ul><ul><ul><li>FTP/HTTP : URL passed in SOAP payload </li></ul></ul><ul><ul><li>WFS - to publish service results (vector data) </li></ul></ul><ul><ul><li>WCS - to publish service results (raster data) </li></ul></ul><ul><ul><li>ESA DDS – data delivery via satellite </li></ul></ul>
    27. 27. Data Distribution via DDS <ul><li>DDS is additional way to disseminate service results, e.g. in Africa. </li></ul><ul><li>SSE as front-end for product distribution by service providers. </li></ul>NPP * Service VITO Format Conversion Service GIM AOI selection (SSE) Data Dissemination System NPP-Africa -GeoTIFF NPP-Africa -GeoTIFF NPP input + AOI description + required format NPP-Africa -HDF
    28. 28. Data Distribution via DDS <ul><li>Send &quot;data&quot; via ESA DDS as last &quot;step&quot; in any SSE service workflow. </li></ul><ul><li>Uses Eutelsat C-band </li></ul>
    29. 29. <ul><li>OGC Standards </li></ul><ul><ul><li>GML for AOI encoding </li></ul></ul><ul><ul><li>GML for service results </li></ul></ul>
    30. 30. <ul><li>OGC Standards </li></ul><ul><ul><li>WMS: Catalogue search results can be shown on map </li></ul></ul><ul><ul><li>Web Map Context: allow to save/load context </li></ul></ul>
    31. 31. <ul><li>Gazetteer (Alexandria) to select circular AOI </li></ul>
    32. 32. Table of Contents <ul><li>Overview </li></ul><ul><li>Tools </li></ul><ul><li>Standards </li></ul><ul><li>Conclusion </li></ul>
    33. 33. RESULTS <ul><li>SSE is operational </li></ul><ul><ul><li>http:// </li></ul></ul><ul><li>Integrated and automated business processes </li></ul><ul><li>In-flight process activity monitoring </li></ul><ul><li>Over 20 service partners </li></ul><ul><li>Sample applications </li></ul><ul><ul><li>Multi-catalogue access, on-line data access, oil spill detection, fire risk, Kyoto protocol verification, desert locust, land use, snow cover, tidal currents, etc. </li></ul></ul>
    34. 34. CRITICAL SUCCESS FACTORS: Lessons Learned <ul><li>Provide an overarching infrastructure </li></ul><ul><ul><li>Extensible in response to service partner requirements </li></ul></ul><ul><ul><li>Neutral, to foster emergence of a “network” </li></ul></ul><ul><li>Empower service partners </li></ul><ul><ul><li>Easily promote and extend own services </li></ul></ul><ul><ul><li>Maintain full control on own IT infrastructure and intellectual property rights (IPR) </li></ul></ul><ul><li>Use open standards to </li></ul><ul><ul><li>Minimize upfront investments </li></ul></ul><ul><ul><li>Improve cost-efficiency </li></ul></ul>
    35. 35. More info <ul><li>SSE CD-ROM available from ESA EO Helpdesk </li></ul><ul><ul><li>Flash presentation </li></ul></ul><ul><ul><li>SSE and BPEL White Papers </li></ul></ul><ul><ul><li>SSE User Manuals </li></ul></ul><ul><ul><li>Software: Toolbox, Eclipse, BPEL Designer </li></ul></ul><ul><li> (Documents section) </li></ul>Thank you !