Ellip is a global collaborative platform prepared for the data-driven economy. It connects consumers and producers of resources, interacting on the platform to produce software items, service endpoints, data assets. Ellip is moreover a work environment leveraging earth observation standards and an “Open Cloud” strategy.
2. Agenda
● Ellip Solutions
“Platform-as-a-Service”
Purpose, users & stakeholders, offering
5min
● Learn about the Ellip Solutions &
Data Processing services
Review of the platform capabilities, services & interfaces
15min
● Use cases
Examples of implementation
10min
● Resources to help you start
Registration, documentation, communication channels
10min
● Q&A
10min
3. Agenda
● Ellip Solutions
“Platform-as-a-Service”
Purpose, users & stakeholders, offering
5min
● Learn about the Ellip Solutions &
Data Processing services
Review of the platform capabilities, services & interfaces
15min
● Use cases
Examples of implementation
10min
● Resources to help you start
Registration, documentation, communication channels
10min
● Q&A
10min
4. About us
● Terradue is a SME based in Rome, founded in
2006 with support of ESA BIC
● From day one providing support to
application builders in Earth sciences, to
use satellite EO data as information source
● Cloud Platform-as-a-Service & APIs (ellip) for
the transfer in production of scalable
software applications
● Business model: Platform-centered (PaaS,
SaaS), collaborative workplaces for value
adders to interact & co-create
https://www.terradue.com
6. Purpose
● A collaborative platform:
○ Consumers and producers of resources
interacting on the platform
○ Resources: software items, service
endpoints, data assets
● A work environment leveraging earth
observation standards
● An “Open Cloud” strategy
7. Ellip: an Open Cloud strategy
▪ The Ellip subscribers remain the owners of
their created assets, and decide how to
share these on the platform, for other users
to find and reuse these assets.
▪ They are also empowered to decide on the
target production environment of their
packaged applications (no lock in with
Cloud provider)
Producers
Consumers
9. Ellip Solutions on Terradue Cloud Platform
Value Adders who collaborate on ellip:
Producers
Consumers
consumers & producers, interacting
10. Ellip Solutions on Terradue Cloud Platform
Explorer
Subscribers
Scaler
Subscribers
Value Adders who collaborate on ellip
Producers
Consumers
Explorer Subscribers
explore new opportunities to make data
processing more efficient and reusable
within non-specialist communities
Scaler Subscribers
scale up processing applications onto
production environments, and deliver
turnkey information layers to their
stakeholders
Premium Subscribers
full access end-to-end
(explorer + scaler)
11. Users & stakeholders
● Customer subscriptions
○ Explorer: a software engineer integrates an algorithm
“as-a-Service”, getting modularity, portability, scalability
○ Scaler: a service manager allocates system resource(s)
for the application package usage goals
○ Member: domain specialists access and run the service in
production to generate data products over AOIs / TOIs
● Stakeholders
○ ESA
○ OGC
○ EC projects
Explorer
Subscribers
Scaler
Subscribers
Member
Registrants
12. Ellip Solutions & Ellip-powered systems
Explorer
Subscribers
Scaler
Subscribers
13. Ellip Solutions & Ellip-powered systems
Scaler
Subscribers
Member
Registrants
-powered systems
My community Portal
14. Ellip Solutions & Ellip-powered systems
Explorer
Subscribers
Scaler
Subscribers
Member
Registrants
My community Portal
-powered systems
15. Ellip Solutions & Ellip-powered systems
Explorer
Subscribers
Scaler
Subscribers
Member
Registrants
Operations Support team
( extract )
16. • Flexible Business model
for the sustainability of
platform operations:
• Public funding
• Commercial revenues
• Costs sharing
• Ad-hoc Partner
Programs for:
• Processor providers
• IaaS* providers
• Data providers
Summary
EXPLORER
Low cost
Application integration
environment
For
Sensor data
science
experts
SCALER
Low cost
Hosted data processing
environment
For
Information
management
experts
* IaaS: cloud computing Infrastructure-as-a-Service
ULTIMATE PARTNER
For Resource Providers
PREMIUM
PARTNER
All in one
System life-cycle
management
environment
For
System integration
& operation
teams
17. Agenda
● Ellip Solutions
“Platform-as-a-Service”
Purpose, users & stakeholders, offering
5min
● Learn about the Ellip Solutions &
Data Processing services
Review of the platform capabilities, services & interfaces
15min
● Use cases
Examples of implementation
10min
● Resources to help you start
Registration, documentation, communication channels
10min
● Q&A
10min
18. Key features
● Ellip Dashboard
● Ellip Studio
● Ellip Launchpads
● Ellip Infohubs
● Ellip Exchange
● EO Application Packages (quick overview)
19. Ellip Dashboard
Ellip Studio Ellip Infohubs
Ellip Launchpads
access to the
Ellip Solutions
https://ellip.terradue.com
20. ● Integration environment for the test & validation of EO data processing
components developed in several programming language:
○ C/C++, Java, Python, R, Matlab, IDL
Automated build & packaging, based on workflow code wrappers to ensure scalability
● Explorer Subscribers: they explore new opportunities to make data
processing algorithms available as Cloud appliances on the Platform’s
marketplace (Ellip Exchange)
Explorer
Subscribers
Scaler
Subscribers
Value Adders who collaborate on ellip
Ellip Exchange as the core enabler of
Ellip as a ‘collaborative workplace’:
. Reproducible experiments as code
. Interactive data visualisations
. Application code
. Packaged applications
. Application Tutorials
. Running WPS @ Cloud Providers
. New information layers
. OWS Context templates
. ad-hoc Community Portals
Ellip Studio for Explorers
22. ● Cloud bursting (deployer engine) to selected Production environment
(Cloud providers) to deliver scalable data processing capabilities
● Production environment accessed by EO-based data product
specialists, in order to configure scalable data processing services that will
deliver value-added products to their user communities.
● Scaler Subscribers: they scale up production environments to deploy
and run pre-packaged processing services on a selected Cloud Provider.
Explorer
Subscribers
Scaler
Subscribers
Value Adders who collaborate on ellip
Ellip Launchpads for Scalers
23. ● The application (e.g. Python, R, JAVA, shell
script, C++) is containerized, and registered in
a Containers Registry
● The application package is created in Common
Workflow Language
● The application is deployed in a given Platform
● The service is available for execution with the
OGC API Processes specification
● The Platform host converts the OGC API
Processes requests in a CWL execution request
Ellip Launchpads for Scalers
24. ● Stakeholders engagement environments defined for target user
communities as Information hubs (Infohubs), to deliver data analysis
systems (e.g. a Geobrowser App) and data exploitation tools (incl. for the
post-processing of newly generated information layers).
● Scaler Subscribers: they scale up their engagement with stakeholders, in
order to deliver ellip-powered services to them.
Member
Subscribers
Explorer
Subscribers
Scaler
Subscribers
Value Adders who collaborate on ellip
Ellip Infohubs for Scalers
27. Ellip Exchange
is the core enabler
of Ellip as a
‘collaborative
workplace’
V
e
s
t
i
b
u
l
u
m
c
o
n
g
u
e
V
e
s
t
i
b
u
l
u
m
c
o
n
g
u
e
V
e
s
t
i
b
u
l
u
m
c
o
n
g
u
e
V
e
s
t
i
b
u
l
u
m
c
o
n
g
u
e
Ellip
Exchange
E
l
l
i
p
I
n
f
o
h
u
b
s
E
l
l
i
p
N
o
t
e
b
o
o
k
s
E
l
l
i
p
L
a
u
n
c
h
p
a
d
s
E
l
l
i
p
S
t
u
d
i
o
. Application code
. Packaged application
. Tutorial
. Running WPS
at a selected
Cloud Provider
. New
information
layers
. Reproducible experiment as code
. Interactive data visualisations
. OWS Context template
. ad-hoc Community Portal
Resources
Resources
Resources
Resources
Source Code Git Repo (incl. Jupyter Notebook files)
Software Library not Publicly available
Application Package
ADES instance on a given Cloud Provider
?processing queue (high or low priority) on an ADES?
Deployed application (processing service endpoint)
Data Source repos not Publicly available
Catalog collections not Publicly available
Data product files
Data Products as an Information Layer (service)
Geobrowser App template definition
Geobrowser App instance on a given Portal
31. Agenda
● Ellip Solutions
“Platform-as-a-Service”
Purpose, users & stakeholders, offering
5min
● Learn about the Ellip Solutions &
Data Processing services
Review of the platform capabilities, services & interfaces
15min
● Use cases
Examples of implementation
10min
● Resources to help you start
Registration, documentation, communication channels
10min
● Q&A
10min
32. Use Cases
● Use Case 1: Adapt my application for the
automated use of the new Copernicus
Dataspaces (CDS) data repository
● Use Case 2: Deploy an Application Package
on a ‘standardized’ Platform host, via the
OGC Process API
● Use Case 3: Configure a user dashboard
(e.g. a custom geobrowser)
33. Use Case 1
Ellip Studio
Adapt my application for the
automated use of the new
Copernicus Dataspaces (CDS)
data repository
34. Ellip Studio access Code server
From your Ellip Studio environment, edit the Application Package
“app-package.cwl” file as follows:
● Add the "entryname: config.yml" section that
contains “Plugins" and “Credentials” sub-sections,
with the information related to “CDS" config info
● Assign the config.yml file that will be generated in
the Docker container, to the variable “config_file”
● Finally, in the Stars command, you need to add the
flag -si to select the provider “CDS”, and the config
file:
Stars copy --harvest -v -rel -r 4 -si
CDS -conf=${config_file} -o ./
${reference}
https://www.commonwl.org
35. Use Case 2
Ellip Launchpads
Deploy an Application Package on
a compliant Platform host via the
OGC Process API
36. Ellip Launchpads load your Deploy Notebook
Objective: Deploy an App-Package from a private
repo into ADES
● Authenticate to access the Gitlab repository
connected to your Ellip Studio
● Define Service Name and Version
● Read the content of the App Package from
private repo
● Replace username and password for CDS
● Upload the App-Package on the deployment
space
● Deploy the App-Package CWL on the ADES
server
● Check if the service has been deployed
successfully
● Discover information on the deployed service
38. Ellip Infohubs my communities
The initial page provides with the browse and search functions over the
communities managed by the user:
39. Ellip Infohubs my communities
The initial page provides with the browse and search functions over the
communities managed by the user:
40. Ellip Infohubs new community
Create a new community via the button “+ Create new”.
This will open an input form simply asking for basic properties: Identifier, Title, Description,
Icon url. This allows to create a new community to be saved as “private” to the user.
Once saved, the user will be able to edit more advanced properties.
41. Ellip Infohubs geobrowser editor
The default view (tab “My personal apps”) lists the previously created
applications, allows to search for such existing applications, and
allows to create a new one (cf. button “+Create new”).
42. Ellip Infohubs geobrowser editor
A second view (tab “My shared apps”) lists the previously created
applications that have been shared in the user shared indexes.
43. Ellip Infohubs editor: properties
Finally, when creating a new Application, the user is accessing a group
of input forms, allowing the configuration of the resources to be
connected to the new information hub, and the definition of some
visualisation settings for the application users.
44. Ellip Infohubs editor: basemaps
Select the styling of the map layout that will support spatial interactions
with content in the application (navigation, zoom, …).
46. Ellip Infohubs editor: data collections
Data collections can be grouped using a “first level” context. Each
context with several collections will appear as a dropdown menu
button on the geobrowser application.
47. Ellip Infohubs editor: data features
To enable additional data features to be presented to the users in your application:
● Data search: to allow to search over defined data collections and list search results within a Search Result tab
● Feature Basket: to allow user to temporarily save datasets returned by search results into a dedicated Feature basket
● Data Packages: to allow the user to load/save data packages
● Store Upload: to allow user to upload local data on his private storage
● Timebar: to allow user to search using the timebar
● Time series: to allow user to visualize results as time series on a dedicated view
● Geobrowser plugins: to browse a list of available geobrowser Plugins and select
48. Ellip Infohubs editor: wps services
Allow user to process new jobs from a list of available processing
services, visualize the results on the map and share it with other
users, as well as access shared jobs from other users.
49. Ellip Infohubs editor: save
To finalise the application, and save it in a personal space (my
personal apps) or in a shared space (my shared apps).
50. Agenda
● Ellip Solutions
“Platform-as-a-Service”
Purpose, users & stakeholders, offering
5min
● Learn about the Ellip Solutions &
Data Processing services
Review of the platform capabilities, services & interfaces
15min
● Use cases
Examples of implementation
10min
● Resources to help you start
Registration, documentation, communication channels
10min
● Q&A
10min
52. Ellip Studio tutorials
https://gitlab.com/app-packages/terradue/[
app_package].git
Ellip Studio workspace
https://gitlab.com/[project]/[company]/
[ellip_username]
Ellip Studio workspace
Run Build
Ellip Studio workspace
Git
clone
CWL on Kubernetes
Container registry
Push
Run
https://gitlab.com/[project]/[company]/
[ellip_username]
Ellip Studio workspace
Push
CI Container registry
Learn to automate Container Registry
updates of the App Package, for use
by referenced Production servers
Use Application Package source
from third party, test data access
Learn to build your own application
package
Test for scalability, use Ellip
Studio’s pre-prod environment
53. Ellip Studio tutorials
Ellip Studio implements the OGC Best Practice for Earth Observation Application Package, a set of
recommendations for application design patterns, package encoding, container and data interfaces
54. Agenda
● Ellip Solutions
“Platform-as-a-Service”
Purpose, users & stakeholders, offering
5min
● Learn about the Ellip Solutions &
Data Processing services
Review of the platform capabilities, services & interfaces
15min
● Use cases
Examples of implementation
10min
● Resources to help you start
Registration, documentation, communication channels
10min
● Q&A
10min