www.eudat.euEUDAT receives funding from the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No. 654065
Cross e-Infrastructure
collaborations
Putting the EOSC vision into practice
24th January 2018
Giuseppe Fiameni
g.fiameni@cineca.it
Agenda
Putting the EOSC vision into practice - January 24 2018
Time slot Title Chair
9:00 10:30 Coupling data and HPC resources
together to enable large scientific
projects: the EUDAT-PRACE case
Giuseppe Fiameni
(CINECA)
10:30 11:00 Coffee Break
11:00 12:30 Making data and cloud resources
interoperable using EUDAT and EGI
services
Michaela Barth (SNIC)
12:30 13:30 Lunch Break
13:30 15:00 Computing e-infrastructure with extreme
large datasets
Ognjen Prnjat (GRNET)
15:00 15:30 Coffee Break
15:30 16:30 Collaboration with SMEs and commercial
stakeholders
David Wright (UCL)
Coupling data and HPC resources
together to enable large scientific
projects: the EUDAT-PRACE case
Putting the EOSC vision into practice - January 24
2018
Agenda
Putting the EOSC vision into practice - January 24 2018
Time slot Title Chair
9:15 9:30 General Introduction - Giuseppe
Fiameni (CINECA)
Giuseppe Fiameni
(CINECA)
9:30 10:00 MULTINANO: Modelling of multi-
scale phenomena in nano-
suspension.
Matteo Alberghini
(Polytechnic University of
Turin, Italy)
10:00 10:20 Hybrid simulations of plasma
turbulence in support of space
missions: toward an archive for
numerical results with EUDAT
services
Luca Franci - (University of
Florence, Italy)
10:20 10:30 Charge transfer dynamics by time
dependent density functional theory
Olivier Rouchon (CINES)
Background
• The amount of data produced exceed the ability to
manage them individually, leading to the development
of a new analytic field named High Performance Data
Analytics where data and computing services need to
interact closely with each other.
• A large variety of services already exists but e-
Infrastructures have evolved along different dimensions
creating separate offerings for computing and data.
• Scientific communities do not access low level
computing and data services directly, but rather work
with portals and workflows to perform complex tasks.
Putting the EOSC vision into practice - January 24 2018
6
Need for interoperability
• Ensure the interoperability of EUDAT with other e-
Infrastructures, including PRACE, lowering technical and
policy barriers by piloting concrete use cases with user
communities
• Provide European researchers and industries with seamless
access to data and computing resources for cross-utilization
use cases
• Implement the Open Science vision where resources of any
kind and size are accessible without any technical barrier
Putting the EOSC vision into practice - January 24 2018
PRACE is an international not-for-profit association
under Belgian law, with its seat in Brussels.
PRACE counts 25 members and 2 observers.
The PRACE Hosting Members are France, Germany,
Italy, Spain, and Switzerland.
PRACE is governed by the PRACE Council in which
each member has a seat. The daily management of
the association is delegated to the Board of Directors.
PRACE is funded by its members as well as through a
series of implementation projects supported by the
European Commission.
Partnership for Advanced Computing in Europe
Putting the EOSC vision into practice - January 24 2018
How to achieve interoperability?
• Joint Open Calls for proposals
• EUDAT offering data services and resources
through regular PRACE calls
• Review process is transparent to users
• Joint training activities
• PRACE project investigators involved into EUDAT
Data Management webinars and courses
• Continuous technical discussion and developments of
new components
• Definition of the EUDAT Workspace area
• Synchronization of authentication credentials for
single sign-on
• EUDAT clients as part of the PRACE Common
Production Environment
Putting the EOSC vision into practice - January 24 2018
THE REFERENCE DATA DOMAIN
Putting the EOSC vision into practice - January 24 2018
EUDAT Data Domain modeled on the ANDS1 Data Curation Continuum
1. Australian National Data Service organization – www.ands.org.au
CDI Data Domain
12
EUDAT Data Domain modeled on the ANDS1 Data Curation Continuum
1. Australian National Data Service organization – www.ands.org.au
CDI Data Domain
13
• EUDAT contributed to different PRACE DECI calls by
offering access to data resources
 DECI Call 13 - 5 pilots with ~350TB of storage space requested
 DECI Call 14 – 2 pilots with ~120TB of storage space requested
 Approximately 20% of all applicants request access to EUDAT
data services
• Federation of user credentials
 One of the use cases of the AARC project
• Training on Data Management Plan
 PRACE users invited to participate to regular EUDAT webinars
 PRACE Days 2017
• Use of B2SHARE to deposit PRACE documents and
make them publicly available
Collaboration activities
Acronym Title Field Countr
y
Data
require
ments in
TB
during
the
PRACE
project
Data
requirements
in TB after
the PRACE
project
Duration of
the access
to this data
service
after the
PRACE
allocation
PRACE Site EUDAT Site
HybTurb3D Hybrid 3D
simulations of
turbulence and
kinetic instabilities
at ion scales in the
expanding solar
wind
Astro Sciences IT 140 TB 140 TB 24 months SurfSARA CINECA
MULTINANO Multiscale
simulations of
nanoparticle
suspensions
Engineering IT 30 TB 30 TB 24 months MPCD CINECA
HiResClimate High Resolution
EC-Earth
Simulations
Earth Sciences IE 150TB 150TB 12 months KTH EPCC
AFiD Effect of rotation
and surface
roughness on heat
transport in
turbulent flow
Engineering NL 11TB 10TB for 24
months
1TB for long-
term storage
and
publication
10TB for 24
months
1TB for
long-term
storage and
publication
EPCC SurfSARA
CHARTERED Charge transfer
dynamics by time
dependent density
functional theory
Materials Science SE 30TB 30TB 24 months IT4I KTH/PDC
Total 448TB
Acronym Title Field Country Data
requirem
ents in
TB
during
the
PRACE
project
Data
requirement
s in TB after
the PRACE
project
Duration
of the
access to
this data
service
after the
PRACE
allocation
PRACE Site EUDAT Site
CHARTERED2 Charge transfer
dynamics by time
dependent
density functional
theory
Materials
Science
SE 30TB 30TB 24 months IT4I KTH/PDC
subgridEoR The effects of
small-scale
structure and halo
stochasticity on
Cosmic
Reionization
Astrophysics 100TB 100TB 36 months TBD BSC or JSC
Total 130TB
PRACE user data requirements
• Workspace area to deposit large data sets so to bridge the
gap between two PRACE grants (Temporary storage area)
• Long-term preservation of simulation results
• Sharing of intermediate results, simulations input,
parameters  B2DROP
• Publication of relevant results for reference, citation, access
 B2SHARE
• Consultancy on data management practices and plans
Putting the EOSC vision into practice - January 24 2018
Synchronization of users credential
• PRACE users profile
attribute are
synchronized with the
EUDAT B2ACCESS
service to grant them
access EUDAT
services seamlessly
• Work done in
collaboration with
AARC project
Putting the EOSC vision into practice - January 24 2018
Workspace
Registered Data
Domain
User space
Data
Data
MD
Digital
Object
Module
EUDAT
Post
processing
Post
processing
User scripts
Workflows
Putting the EOSC vision into practice - January 24 2018
AFiD
• The AFiD project has been
awarded as part of the DECI-
13 call.
• This project is in the field of
Engineering, focusing on
“Effect of rotation and surface
roughness on heat transport
in turbulent flow”.
• The data requirements from
EUDAT pilot is 11 TB during
and after the PRACE project.
Putting the EOSC vision into practice - January 24 2018
Chartered 1 & 2
• The CHARTERED project has
been awarded as part of the
DECI-14 call.
• This project is in the field of
Materials Science, focusing on
“Charge transfer dynamics by
time dependent density
functional theory”.
• The data requirements from
EUDAT pilot is 20 TB during
and after the PRACE project.
Putting the EOSC vision into practice - January 24 2018
Next joint call to be announced soon

Putting the EOSC vision into practice - January 24 2018
www.eudat.eu
Many thanks for your attention!

Cross e-Infrastructure collaborations

  • 1.
    www.eudat.euEUDAT receives fundingfrom the European Union's Horizon 2020 programme - DG CONNECT e-Infrastructures. Contract No. 654065 Cross e-Infrastructure collaborations Putting the EOSC vision into practice 24th January 2018 Giuseppe Fiameni g.fiameni@cineca.it
  • 2.
    Agenda Putting the EOSCvision into practice - January 24 2018 Time slot Title Chair 9:00 10:30 Coupling data and HPC resources together to enable large scientific projects: the EUDAT-PRACE case Giuseppe Fiameni (CINECA) 10:30 11:00 Coffee Break 11:00 12:30 Making data and cloud resources interoperable using EUDAT and EGI services Michaela Barth (SNIC) 12:30 13:30 Lunch Break 13:30 15:00 Computing e-infrastructure with extreme large datasets Ognjen Prnjat (GRNET) 15:00 15:30 Coffee Break 15:30 16:30 Collaboration with SMEs and commercial stakeholders David Wright (UCL)
  • 3.
    Coupling data andHPC resources together to enable large scientific projects: the EUDAT-PRACE case Putting the EOSC vision into practice - January 24 2018
  • 4.
    Agenda Putting the EOSCvision into practice - January 24 2018 Time slot Title Chair 9:15 9:30 General Introduction - Giuseppe Fiameni (CINECA) Giuseppe Fiameni (CINECA) 9:30 10:00 MULTINANO: Modelling of multi- scale phenomena in nano- suspension. Matteo Alberghini (Polytechnic University of Turin, Italy) 10:00 10:20 Hybrid simulations of plasma turbulence in support of space missions: toward an archive for numerical results with EUDAT services Luca Franci - (University of Florence, Italy) 10:20 10:30 Charge transfer dynamics by time dependent density functional theory Olivier Rouchon (CINES)
  • 5.
    Background • The amountof data produced exceed the ability to manage them individually, leading to the development of a new analytic field named High Performance Data Analytics where data and computing services need to interact closely with each other. • A large variety of services already exists but e- Infrastructures have evolved along different dimensions creating separate offerings for computing and data. • Scientific communities do not access low level computing and data services directly, but rather work with portals and workflows to perform complex tasks. Putting the EOSC vision into practice - January 24 2018
  • 6.
    6 Need for interoperability •Ensure the interoperability of EUDAT with other e- Infrastructures, including PRACE, lowering technical and policy barriers by piloting concrete use cases with user communities • Provide European researchers and industries with seamless access to data and computing resources for cross-utilization use cases • Implement the Open Science vision where resources of any kind and size are accessible without any technical barrier Putting the EOSC vision into practice - January 24 2018
  • 7.
    PRACE is aninternational not-for-profit association under Belgian law, with its seat in Brussels. PRACE counts 25 members and 2 observers. The PRACE Hosting Members are France, Germany, Italy, Spain, and Switzerland. PRACE is governed by the PRACE Council in which each member has a seat. The daily management of the association is delegated to the Board of Directors. PRACE is funded by its members as well as through a series of implementation projects supported by the European Commission. Partnership for Advanced Computing in Europe Putting the EOSC vision into practice - January 24 2018
  • 8.
    How to achieveinteroperability? • Joint Open Calls for proposals • EUDAT offering data services and resources through regular PRACE calls • Review process is transparent to users • Joint training activities • PRACE project investigators involved into EUDAT Data Management webinars and courses • Continuous technical discussion and developments of new components • Definition of the EUDAT Workspace area • Synchronization of authentication credentials for single sign-on • EUDAT clients as part of the PRACE Common Production Environment Putting the EOSC vision into practice - January 24 2018
  • 9.
    THE REFERENCE DATADOMAIN Putting the EOSC vision into practice - January 24 2018
  • 10.
    EUDAT Data Domainmodeled on the ANDS1 Data Curation Continuum 1. Australian National Data Service organization – www.ands.org.au CDI Data Domain 12
  • 11.
    EUDAT Data Domainmodeled on the ANDS1 Data Curation Continuum 1. Australian National Data Service organization – www.ands.org.au CDI Data Domain 13
  • 12.
    • EUDAT contributedto different PRACE DECI calls by offering access to data resources  DECI Call 13 - 5 pilots with ~350TB of storage space requested  DECI Call 14 – 2 pilots with ~120TB of storage space requested  Approximately 20% of all applicants request access to EUDAT data services • Federation of user credentials  One of the use cases of the AARC project • Training on Data Management Plan  PRACE users invited to participate to regular EUDAT webinars  PRACE Days 2017 • Use of B2SHARE to deposit PRACE documents and make them publicly available Collaboration activities
  • 13.
    Acronym Title FieldCountr y Data require ments in TB during the PRACE project Data requirements in TB after the PRACE project Duration of the access to this data service after the PRACE allocation PRACE Site EUDAT Site HybTurb3D Hybrid 3D simulations of turbulence and kinetic instabilities at ion scales in the expanding solar wind Astro Sciences IT 140 TB 140 TB 24 months SurfSARA CINECA MULTINANO Multiscale simulations of nanoparticle suspensions Engineering IT 30 TB 30 TB 24 months MPCD CINECA HiResClimate High Resolution EC-Earth Simulations Earth Sciences IE 150TB 150TB 12 months KTH EPCC AFiD Effect of rotation and surface roughness on heat transport in turbulent flow Engineering NL 11TB 10TB for 24 months 1TB for long- term storage and publication 10TB for 24 months 1TB for long-term storage and publication EPCC SurfSARA CHARTERED Charge transfer dynamics by time dependent density functional theory Materials Science SE 30TB 30TB 24 months IT4I KTH/PDC Total 448TB
  • 14.
    Acronym Title FieldCountry Data requirem ents in TB during the PRACE project Data requirement s in TB after the PRACE project Duration of the access to this data service after the PRACE allocation PRACE Site EUDAT Site CHARTERED2 Charge transfer dynamics by time dependent density functional theory Materials Science SE 30TB 30TB 24 months IT4I KTH/PDC subgridEoR The effects of small-scale structure and halo stochasticity on Cosmic Reionization Astrophysics 100TB 100TB 36 months TBD BSC or JSC Total 130TB
  • 15.
    PRACE user datarequirements • Workspace area to deposit large data sets so to bridge the gap between two PRACE grants (Temporary storage area) • Long-term preservation of simulation results • Sharing of intermediate results, simulations input, parameters  B2DROP • Publication of relevant results for reference, citation, access  B2SHARE • Consultancy on data management practices and plans Putting the EOSC vision into practice - January 24 2018
  • 16.
    Synchronization of userscredential • PRACE users profile attribute are synchronized with the EUDAT B2ACCESS service to grant them access EUDAT services seamlessly • Work done in collaboration with AARC project Putting the EOSC vision into practice - January 24 2018
  • 17.
  • 18.
    AFiD • The AFiDproject has been awarded as part of the DECI- 13 call. • This project is in the field of Engineering, focusing on “Effect of rotation and surface roughness on heat transport in turbulent flow”. • The data requirements from EUDAT pilot is 11 TB during and after the PRACE project. Putting the EOSC vision into practice - January 24 2018
  • 19.
    Chartered 1 &2 • The CHARTERED project has been awarded as part of the DECI-14 call. • This project is in the field of Materials Science, focusing on “Charge transfer dynamics by time dependent density functional theory”. • The data requirements from EUDAT pilot is 20 TB during and after the PRACE project. Putting the EOSC vision into practice - January 24 2018
  • 20.
    Next joint callto be announced soon  Putting the EOSC vision into practice - January 24 2018
  • 21.