Pasquale Pagano's presentation at BlueBRIDGE Workshop, 11 January, Brussels

1. BlueBRIDGE receives funding from the European Union’s Horizon 2020
research and innovation programme under grant agreement No. 675680 www.bluebridge-vres.euBlueBRIDGE receives funding from the European Union’s Horizon 2020
research and innovation programme under grant agreement No. 675680 www.bluebridge-vres.eu
Collaborating with e-infrastructures
for innovative data management solutions
Pasquale Pagano (CNR-ISTI)
Project technical director
pasquale.pagano@isti.cnr.it
Understanding how ecosystems of EU
e-infrastructures can boost Blue Growth
11 January 2017
Brussels, Belgium

2. BlueBRIDGE Services Offer
Tailored services addressing three heterogeneous domains
One common infrastructure
BlueBRIDGE
Infrastructure
"Understanding how ecosystems of EU e-Infrastructures can boost Blue Growth", 11 January 2017, Brussels 2

3. BlueBRIDGE Infrastructure Services Offer
3
Data services addressing the whole data management value chain
Infrastructure services addressing the access and management of
infrastructure resources
"Understanding how ecosystems of EU e-Infrastructures can boost Blue Growth", 11 January 2017, Brussels

4. BlueBRIDGE hides ICT complexities
4
Storage
Database GIS NoSQL
Computing
D4Science EGI SeaDataNet
Data
OSCAR Copernicus
"Understanding how ecosystems of EU e-Infrastructures can boost Blue Growth", 11 January 2017, Brussels

5. BlueBRIDGE hides ICT complexities
Data and
Services
Hosted by different
Organizations
Accessible through
different Protocols
Described with
different Metadata
Policies
Different Licenses
Different Terms of Use
Different approaches
for Credits
Heterogeneity
Provide Discovery,
Access, Use
Support Validation,
Curation,
Harmonization
Trace Provenance
5
BlueBRIDGE provides solutions for dealing with modern science
increasingly global, multi-disciplinary and networked
"Understanding how ecosystems of EU e-Infrastructures can boost Blue Growth", 11 January 2017, Brussels

6. BlueBRIDGE realizes an open scientific
infrastructure ecosystem
• >800 data providers
• >19k temporal datasets
• >50k spatial datasets
• >350 physical and chemical
variables with global coverage
spanning the last ten years
• 40k data analysis/month
Data
• 5 EGI sites
• 4 D4Science sites
• 4 Organization sites
• 1000 CPUs
• 400 TB storages
• 4 TB Memory
Computing
• >250 services
• >180 analytical models
• >500 software components
integrated
Services
6
BlueBRIDGE provides access to Data, Computing, and Services
BlueBRIDGE simplifies
the integration of new community services
the exploitation of community-specific analytical models
The analysis of community/user data
"Understanding how ecosystems of EU e-Infrastructures can boost Blue Growth", 11 January 2017, Brussels

7. BlueBRIDGE supports data analytics
• are multidisciplinary, involve members belonging to diverse organisations
• require to access data and services that are spread among many providers
Dynamic groups addressing specific questions/problems
• Without relying on pre-organised and costly supporting environments managed
by dedicated organizations
BlueBRIDGE builds and operates their own VRE
• BlueBRIDGE allows to operate on remote resources via dedicated
interfaces
With limited or no additional costs for the resource providers
7
Not performed by individuals but group of data analysts
"Understanding how ecosystems of EU e-Infrastructures can boost Blue Growth", 11 January 2017, Brussels

8. BlueBRIDGE supports data analytics
via sharing of data and workflows
8
Support collaborative data analysis and experimentation
via a virtual workspace
Enable secure and controlled data sharing
Manage heterogeneous data access policies
Implement Traceability and Reproducibility-Repeatability-
Reusability
Information objects can be
• files, dataset, workflows, experiments, etc.
• organized into folders
Users can
• share with selected users
• disseminate via persistent public URLs
"Understanding how ecosystems of EU e-Infrastructures can boost Blue Growth", 11 January 2017, Brussels

9. "Understanding how ecosystems of EU e-Infrastructures can boost Blue Growth", 11 January 2017, Brussels
Software Integration
9
Download the (python, R, Java, …)
script and the user’s data
Execute script
Collect output
Destroy local copies of I/O and script
Save Output on the User’s Workspace, with provenance info
Scientist provides a
method to analyse data
User’s data
BB
Infrastructure

10. Collaborative Experiments
10
WS
Shared online folders
Inputs
Outputs
Results
Computational system
In the e-Infrastructure
Through third party software
"Understanding how ecosystems of EU e-Infrastructures can boost Blue Growth", 11 January 2017, Brussels

11. Enabling New Workflow
11
Script provider
Updates the script on
his private Workspace
The BB service
downloads
the script on-the-fly
A user executes
an experiment
on his/her data
The output, the input and the
parameters can be shared with
another user
This user can
execute the
experiment again
and share the
computation with
other users
1
2
3
4
5
6
7
8
9
5
"Understanding how ecosystems of EU e-Infrastructures can boost Blue Growth", 11 January 2017, Brussels

12. "Understanding how ecosystems of EU e-Infrastructures can boost Blue Growth", 11 January 2017, Brussels
Access, integrate, process and analyse
very heterogeneous resources
• BlueBRIDGE is close to community needs
12
BB
standard
secure
collabora
tion
Easy-to-
use
Simplify
Integration
applications
methods
data
Promote
Collaboration
Sharing
Publication
Provenance
Re-use

13. Very different purposes
• BlueBRIDGE delivers tailored environments
• Same capabilities, different access policies
• Same capabilities, access to different datasets
• Different capabilities
• BlueBRIDGE supports all the scientific phases
• Testing of new methods and algorithms
• Validation of methods and algorithms
• Provision of production services
13"Understanding how ecosystems of EU e-Infrastructures can boost Blue Growth", 11 January 2017, Brussels

14. "Understanding how ecosystems of EU e-Infrastructures can boost Blue Growth", 11 January 2017, Brussels
Very different purposes
14
BlueBRIDGE Common Facilities
BlueBRIDGE for Ecosystem
Approach to Fisheries
BlueBRIDGE for Aquaculture
BlueBRIDGE for Education

15. "Understanding how ecosystems of EU e-Infrastructures can boost Blue Growth", 11 January 2017, Brussels
Conclusions
• BlueBRIDGE simplifies the integration of user
applications into e-infrastructure
• BlueBRIDGE promotes access to an integrated
environment where personal applications are
managed as enabling technologies
• BlueBRIDGE delivers a community-cloud where
virtual services hide cloud and related
technologies
• BlueBRIDGE delivers an open Infrastructure
Ecosystem contributing to Blue Growth
15
BB manages
BB supports
BB operates
Users exploits
Policies
Authz
ToU
Training
Adoption
Use
Monitoring
Accounting
Provision
Security
Discover
Access
Re-use
Share

16. Thank You
Questions?
16