The document discusses Work Package 4 (WP4) of the ESCAPE project, which aims to connect astronomy research infrastructures to the European Open Science Cloud (EOSC) through the Virtual Observatory (VO) framework. WP4 has three main tasks: 1) Integrating astronomy VO data and services into EOSC, 2) Implementing FAIR data principles for astronomy through the VO, and 3) Adding value to astronomy archive content. The document provides details on the objectives, activities, partnerships and deliverables for each of the WP4 tasks.

1. Funded by the European Union’s
Horizon 2020 - Grant N° 824064
ESCAPE - The European Science Cluster of Astronomy & Particle Physics ESFRI Research Infrastructures has received funding
from the European Union’s Horizon 2020 research and innovation programme under the Grant Agreement n° 824064.
WP4: ‘CEVO’
Connecting ESFRI projects to EOSC through
the Virtual Observatory framework
Mark ALLEN
Strasbourg astronomical Data Centre (CDS)
Observatoire astronomique de Strasbourg - CNRS
Annecy, 8 February 2019

2. Funded by the European Union’s
Horizon 2020 - Grant N° 824064
WP4 Objectives
Assess and implement the connection of ESFRI and
other astronomy research infrastructures to the EOSC
by the Virtual Observatory
Refine and pursue implementation of FAIR principles
for astronomy data via common interoperability
standards - extending the VO to new communities
Establish data stewardship practices for adding value to
scientific content of ESFRI data archives
13/02/2019 Mark Allen 2

3. Funded by the European Union’s
Horizon 2020 - Grant N° 824064
Connecting ESFRI to the EOSC via the VO
In practice: ESFRI-VO-EOSC connection
• Inclusion of VO registry will be a key factor
• Implement FAIR principles via the use of common
interoperability standards
• VO next-steps of connection to computing, and
extension to new communities (in particular EST)
• Stewardship – technical and human. Adding value
to the scientific content
Following all steps of EOSC evolution :
• EOSCpilot, EOSC-hub, eInfraCentral, …
13/02/2019 Mark Allen 3

4. Funded by the European Union’s
Horizon 2020 - Grant N° 824064
WP4 Tasks
Task 4.1 Integration of astronomy VO data and services
into the EOSC
Lead: Marco Molinaro (INAF)
Task 4.2 Implementation of FAIR principles for ESFRI data
through the Virtual Observatory
Lead: Françoise Genova (CNRS-ObAS)
Task 4.3 Adding value to trusted content in astronomy
archives
Co-leads: Mark Allen (CNRS-ObAS) & Martino Romaniello (ESO)
13/02/2019 Mark Allen 4

5. Funded by the European Union’s
Horizon 2020 - Grant N° 824064
WP4 Partners
13/02/2019 Mark Allen 5
Partners bringing experience from European Virtual Observatory projects
Partners from ESFRIs and astronomy Research Infrastructures

6. Funded by the European Union’s
Horizon 2020 - Grant N° 824064
Current list of main contacts
• CNRS-ObAS : Mark Allen
• CNRS-CPPM : Paschal Coyle
• CTAO : Matthias Fuessling
• EGO-Virgo : Michele
Punturo
• ESO : Martino Romaniello
• INAF : Marco Molinaro
• INTA : Enrique Solano
• JIVE : Arpad Szomoru
• KIS : Nazaret Bello González
• NWI-I-ASTRON : Michiel van
Haarlem
• ObsParis : Catherine Boisson
• ROB : Véronique Delouille
• SKAO : Rosie Bolton
• UEDIN : Andy Lawrence
• UHEI : Joachim Wambsganss
WP3 connection in Task 4.3:
• HITS: Kai Polsterer
13/02/2019 Mark Allen 6
e-cevo@escape2020.eu --- Mailing list active after the kick-off

7. Funded by the European Union’s
Horizon 2020 - Grant N° 824064
Task 4.1 Integration of astronomy VO data
and services into the EOSC
• Map the VO framework to EOSC
• Aim to include the VO enabled archive services from
ESFRI into EOSC
• VO Registry in EOSC
13/02/2019 Mark Allen 7
Federation Services
Processing & Analysis
Data Management,
Curation & Preservation
Access, Deposition &
Sharing
Discover & Reuse
VO Registry
VOSpace
VO Data Access Layer &
Data Model standards
VO Single-
Sign-On
VO Semantics standards
VO format standards
VO query
languages
VO Web service
standards
VO application
standards
Science platform VO
access (new)
EOSC
IVOA standards
• Portfolio of astronomy
VO services
• Contribution to EOSC
hybrid cloud
• Containerised domain-
specific services

8. Funded by the European Union’s
Horizon 2020 - Grant N° 824064
Task 4.1 - overview
“Integration of astronomy VO data and services into the EOSC”
- Interfacing the VO framework with EOSC
- VO registry federated as EOSC catalogue/s
- Astronomy vocabularies as EOSC services
- Portfolio of astronomy VO services
- EOSC Hybrid Cloud contribution
- Domain-specific services containerisation
WP5 (ESAP) coordination on computing “close” to data
WP2 (DIOS) coordination to test the above on the “data lake” solution
(of course) collaboration with the other WP4 Tasks to work on latest VO
standards and data resource integration in the EOSC.

9. Funded by the European Union’s
Horizon 2020 - Grant N° 824064
Task 4.1 - keyword description
Service catalogue
Customer-facing list of all live services offered along with relevant
information about these services / can be regarded as a filtered
version of and customers’ view on the service portfolio.
(EOSC-hub) Service portfolio
external - composed of customer-facing services that are offered
via the EOSC Hub. The evolution of this portfolio is regulated by the
EOSC-hub Rules of participation (to be defined).
internal - composed of the supporting services needed to operate
the EOSC Hub.

10. Funded by the European Union’s
Horizon 2020 - Grant N° 824064
Task 4.1 - partners expected contribution
INAF will coordinate and work on the integration of VO services into the EOSC.
- Interfacing to EOSC projects’ activities and support to vocabulary integration
is expected from CNRS-ObAS.
- Support to Registry integration is expected from UHEI.
- Support to containerisation is expected from UEDIN.
Analysis reports on the full task activity will be provided (D4.4 & D4.7)
- all listed partners:
- the above plus CNRS-CPPM, CTAO, EGO-Virgo, ESO, INTA, JIVE, KIS, NWO-I-ASTRON,
ObsParis, ORB, SKAO
- will be asked to provide feedback on the integration of their resources and
will be asked to comment on the deliverable documents.

11. Funded by the European Union’s
Horizon 2020 - Grant N° 824064
Task 4.1 - tentative roadmap
- Clarify “level of compliance” within EOSC (architecture check)
- Identify EOSC attachment points
- requires EOSC projects interaction
- detailed Task 4.1 input to project plan for CEVO (month 6)
- VO Registry integration
- standards
- data resources
- service resources
- Vocabulary integration
- Standards implementation containerisation
- Build-up of the portfolio
- after defining its solution: EOSC integrated, VO managed

12. Funded by the European Union’s
Horizon 2020 - Grant N° 824064
Task 4.2 Implementation of FAIR principles for
ESFRI data through the Virtual Observatory
Definition and adoption of common open IVOA
standards for interoperability based on ESFRI
requirements
Connection to EOSC through Task 4.1
13/02/2019 Mark Allen 12

13. Funded by the European Union’s
Horizon 2020 - Grant N° 824064
Task 4.2 Activities: Requirements and VO update
Gathering requirements from ESFRIs/RIs on their
use of the VO framework and its connection to
EOSC
Initial priorities interferometric data (SKA and JIVE),
event based data (CTA, EGO/VIRGO, SKA), scalability for
extremely large data sets and their use in the science
platform (WP5)
EST – new participant in VO interoperability
Update definition of standards and representation
of ESFRI/RI interests in IVOA
13/02/2019 Mark Allen 13

14. Funded by the European Union’s
Horizon 2020 - Grant N° 824064
Task 4.2 Activities: problem solving platform
and support to science community
Establish a practical problem-solving platform
Expertise and documentation for common solutions to
support implementation by ESFRI/RIs
One Hands-on Training (M24)
Support of the science community
Vizualisation tools multi-wavelength/multi-messenger
Two Hands-On Schools providing reusable materials
Use cases a essential feature of the schools
Engagement with RDA
13/02/2019 Mark Allen 14

15. Funded by the European Union’s
Horizon 2020 - Grant N° 824064
Task 4.2 - Partner expected contribution
All ESFRIs/RI to contribute requirements, feedback
and implementation, incl. test. Specific effort on
ORB & KIS (EST): Solar VO – a new domain for the VO
JIVE, SKA: interferometric data
ASTERICS demonstrated the power of direct
involvement of ESFRIs/RIs in the IVOA
All VO teams contribute their expertise, in
particular
INAF: expertise in VO standards, scalability, and liaison
with Task 4.1 and WP5
INTA: scientific schools
UEDIN: time-domain, scalability, a link to WP5
UHEI: support to implementation
13/02/2019 Mark Allen 15

16. Funded by the European Union’s
Horizon 2020 - Grant N° 824064
Task 4.2 - Liaisons
Liaisons with WP5
Liaisons with EOSC
Liaisons with RDA
13/02/2019 Mark Allen 16

17. Funded by the European Union’s
Horizon 2020 - Grant N° 824064
Task 4.2 - Tentative initial schedule
Status of the VO framework at the end of ASTERICS
First contact with the ESFRIs/RIs to gather their
initial requirements and feedback
IVOA Interoperability meeting, May 2019, Paris
Task 4.2 input to Work Plan: D4.1 (M6)
13/02/2019 Mark Allen 17

18. Funded by the European Union’s
Horizon 2020 - Grant N° 824064
Task 4.3 Adding value to trusted content
in astronomy archives
Next generation functionalities for creation and
publication of high-level, value-added data products
from ESFRIs
• Assessment and application of new techniques –
machine learning analytics. (connection to WP3)
• Specific example applied to ESO archives data products
• Identification of stewardship best practices
• Curation and publication of next-generation data
products via ESFRI archives
• Technical and human aspects
13/02/2019 Mark Allen 18

19. Funded by the European Union’s
Horizon 2020 - Grant N° 824064
The ESO Science Archive
Collection and distribution point of the data of
ESO’s La Silla Paranal Observatory (optical and
near-infrared)
Will be extended to ELT data
Content creation and dissemination
Collection and publication of raw data
Generation and publication of in-house processed data
Collection, verification and publication of contributed
processed data
ESO Archive Science Portal
Searches by physical characteristics of the assets
Signal-to-noise, wavelength coverage and resolution, spatial
resolution, sensitivity
08/02/2019 Mark Allen, Martino Romaniello 19

20. Funded by the European Union’s
Horizon 2020 - Grant N° 824064
The ESO Science Archive
Archive distinct users
08/02/2019 Mark Allen, Martino Romaniello 20
Raw
Processed
(by ESO)
(contributed)
Archive publications

21. Funded by the European Union’s
Horizon 2020 - Grant N° 824064
13/02/2019 Mark Allen

22. Funded by the European Union’s
Horizon 2020 - Grant N° 824064
13/02/2019 Mark Allen

23. Funded by the European Union’s
Horizon 2020 - Grant N° 824064
13/02/2019 Mark Allen 23

24. Funded by the European Union’s
Horizon 2020 - Grant N° 824064
13/02/2019 Mark Allen

25. Funded by the European Union’s
Horizon 2020 - Grant N° 824064
Task 4.3: object classification
Goal: further curate the content to classify the archive
assets by the nature of the astronomical objects
Once the classification is available, archive users can use
it to identify assets by object type
Much demanded from users
Scope: prototype the concept, tune the solution to the
actual archive content
Start from spectra, then consider also images
Data: optical near-infrared (La Silla Paranal Observatory)
and sub- and millimeter (ALMA Observatory)
08/02/2019
Mark Allen, Martino Romaniello 26

26. Funded by the European Union’s
Horizon 2020 - Grant N° 824064
Task 4.3: stewardship best practices
Collecting, verifying and publishing processed data
contributed by the community is a staple of ESO’s data
policy
Currently it is mostly done by the large teams
responsible for large, coherent observing programmes
Highly successful, but covers only a fraction of the data
Goal: establish a diffuse culture and best practices for
astronomical data curation
Extend the base of potential contributors to smaller groups /
individual users
08/02/2019 Mark Allen, Martino Romaniello 27

27. Funded by the European Union’s
Horizon 2020 - Grant N° 824064
Task 4.3 - Partner expected contribution
ESO and CDS to lead
Strong connection to WP3 – HITS partner
Application of machine learning for archive content
Demonstrator (month 30)
Potential for application to other ESFRIs
All WP4 partners to contribute :
Expertise to define best practices for stewardship
Of next generation ESFRI data products & data generated and
deposited by the community
Activities to be defined in Work Plan (month 6)
Deliverable report at end of project (month 40)
08/02/2019 Mark Allen, Martino Romaniello 28

28. Funded by the European Union’s
Horizon 2020 - Grant N° 824064
Partnerships
WP4 — WP3 - Machine Learning classification
WP4 — WP5 - Platform – exploration as one
mode of interface between VO and EOSC services
WP4 — WP2 - Connection to computing
Direct liaison needed with technical EOSC
expertise at WP/task level
EST – connection to Euro-VO partners (just begun
in ASTERICS)
13/02/2019 Mark Allen 29

29. Funded by the European Union’s
Horizon 2020 - Grant N° 824064
First meeting points
ASTERICS DADI Technology Forum, Feb 26-28
DADI EST meeting, ASTERICS-ESCAPE transition
Participation by DADI and ESCAPE WP4 EST partners (KIS, ROB)
Hack-a-thon time for looking at the real data
Radio Astronomy and the VO meeting (Feb 28)
(following Tech forum)
Gathering wide range of stakeholders
ASTERICS, AENEAS …
Specific visits being defined (EST – Brussels March 2019)
IVOA Interoperability meeting (May 13-17, 2019)
WP4 Communications
13/02/2019 Mark Allen 30

30. Funded by the European Union’s
Horizon 2020 - Grant N° 824064
WP4 Deliverables
13/02/2019 Mark Allen 31
Aug 2019 – aim earlier
March 2020
May 2020
July 2020
July 2021
Dec 2021
March 2022
May 2022

31. Funded by the European Union’s
Horizon 2020 - Grant N° 824064
WP4 Milestones
13/02/2019 Mark Allen 32