SlideShare a Scribd company logo
DEEP-Hybrid-DataCloud has received funding from the European Union’s Horizon 2020
research and innovation programme under grant agreement No 777435.
DEEP general presentation
Brief project overview
Jesús Marco de Lucas, Álvaro López García
{marco,aloga}@ifca.unican.es
Spanish National Research Council
DEEP & XDC Kick of Meeting
Bologna, Italy
January 24, 2018
https://deep-hybrid-datacloud.eu Jan 24, 2018 2/12
DEEP-Hybrid-DataCloud: context
● H2020 project, EINFRA-21 call
– Topic: Platorm-driven e-Infrastructure towards the European Open Science Cloud
– Scope: Computng e-infrastructure with extreme large datasets
● (…) prototypes to cope with very large data resources (...)
● (…) sofware layers supportng applicatons such as modelling, simulaton, patern recogniton, visualisaton, etc. (...)
● (…) supported by robust mathematcal methods and tools (...)
● (…) Clean slate approaches to high-performance computng and data management (…)
● DEEP-Hybrid-DatCloud: Designing and Enabling E-Infrastructures for intensive data Processing
in a Hybrid DataCloud
– Started as a spin-of project (together with XDC) from INDIGO-DataCloud technologies
– Submited in March 2017
– Started November 1st 2017
– Grant agreement number 777435
● Global objectie: Promote the use of intensiie computnn seriices by diferent research
communites and areas, an the support by the corresponding e-Infrastructure providers and
open source projects
https://deep-hybrid-datacloud.eu Jan 24, 2018 3/12
DEEP project objectives
● Focus on intensiie computnn techniques for the analysis of iery larne datasets considering demanding use cases
– Pilot applicatons from diferent research communites
– Three techniques of wide interest: deep learning, post processing and on-line analysis of data streams
– Improved list of requirements for e-Infrastructures → future generaton
● Eiolie up to producton level intensiie computnn seriices exploitng specialized hardware
– New solutons to beter interact with bare metal resources in the cloud
– Use of hardware accelerators such as GPUs and low-latency interconnects
● Intenrate intensive computng services under a hybrid cloud approach
– Assuring interoperability with existng EOSC
– Expanding over multple IaaS using high level networking technologies
– Enrich orchestraton tools for supportng multple services and providers
● Defne a “DEEP as a Seriice” soluton to ofer an adequate integraton path to developers of fnal applicatons
– Implement a catalon of the most useful services and applicatons as well defned buildinn blocks
– Ofer a DeiOps approach for the applicaton development
● Analyse the complementarity with other onnoinn projects targetng added value services for the cloud
– In partcular those related to the management of extremely large datasets
– Explore diferent e-Infrastructures and complementary services
– Identfcaton, integraton and/or co-development of missing functonalites
https://deep-hybrid-datacloud.eu Jan 24, 2018 4/12
DEEP pilot use cases
● Three techniques of wide interest, involving
– Large, heterogeneous data sets
– Intensive computng demands that would beneft from using hardware accelerators (GPUs, low
latency interconnects)
● Deep learning
– Pilot cases: stem cells, biodiversity applicatons, medical image
– Provide a general, distributed architecture and pipeline to train deep learning (and other)
models
● Post-processing
– Pilot cases: post-processing of HPC simulatons
– Flexible pipeline for the analysis of simulaton data generated at HPC resources
● On-line analysis of data streams
– Pilot case: intrusion detecton systems
– Provide an architecture able to analyze massive on-line data streams, also with historical records
https://deep-hybrid-datacloud.eu Jan 24, 2018 5/12
DEEP consortium
● Balanced set of partners
– Strong technological background on development, implementaton,
deployment and operaton of federated e-Infrastructures
● 9 academic partners
– CSIC, LIP, INFN, PSNC, KIT, UPV, CESNET, IISAS, HMGU
● 1 industrial partner
– Atos
● 6 countries
– Spain, Italy, Poland, Germany, Czech Republic, Slovakia
https://deep-hybrid-datacloud.eu Jan 24, 2018 6/12
WP leaders and deputies
● WP1 (NA): Project Management and Exploitaton
– Project oversight, quality management, admin, etc.
– Leader: CSIC, deputy: Atos
● WP2 (NA): Intensive Computng Pilot Applicatons
– Defniton and understanding of pilot usage scenarios
– Leader: HMGU, deputy: KIT
● WP3 (SA): Testbed and Integraton with EOSC services
– Project service actvites: testbeds, tools, integratons
– Leader: LIP, deputy: PSNC
● WP4 (JRA): Accelerated High Performance Computng in the Cloud
– Support for accelerators and HPC resources
– Leader: IISAS, deputy: INFN
● WP5 (JRA): High Level Hybrid Cloud solutons
– Platorm provisioning, delivering the executon platorm for WPP5
– Leader: INFN, deputy: CESNET
● WP6 (JRA): DEEP as a Service
– Deliver fnal soluton to the users
– Leader: CSIC, deputy: UPV
● WP7: Ethics requirements
– Leader: CSIC
https://deep-hybrid-datacloud.eu Jan 24, 2018 7/12
Project governance
● Steering Commitee
– Driving the project executon
● Consortum Assembly
– Legal project partners
– Strategic project decisions
● Cooperaton Open Board
– Partners and stakeholders from Europe and
relevant projects and initatves
– Interact with Steering Commitee to defne
the agenda, interests and proposals for
discussion
● Advisory Board
– External board
– Integrated by experts from relevant
stakeholders
https://deep-hybrid-datacloud.eu Jan 24, 2018 8/12
INDIGO Components and evolution (I)
● INDIGO Orchestrator
– Hybrid support on multple sites
– Support to specifying specialized computng hardware
● Infrastructure Mananer
– Hybrid Clouds support involving specialized computng hardware
● uDocker
– Support for GPUs and specialized hardware to be further developed
● Cloud Informaton System
– Missing informaton about accelerators or special hardware at a provider
– React faster to changes in the infrastructure (faster publicaton and propagaton
of informaton)
https://deep-hybrid-datacloud.eu Jan 24, 2018 9/12
INDIGO Components and evolution (I)
● OpenStack/OpenNebula
– Extensions be needed to properly support accelerators: improving scheduling strategies,
easier confguraton and improved documentaton.
● PaaS layer
– Accelerator support
● Docker
– Use as container technology for applicatons
● LXC
– Use as alternatve hypervisor
● Ansible
– Contextualizaton and confguraton tool, further development of modules
● INDIGO Virtual Router
– Improvements to reach producton level
https://deep-hybrid-datacloud.eu Jan 24, 2018 10/12
DEEP work programme
● WPe have defned diferent phases for the project
● Plan and requirements (Nov 2017 – Jan 2018)
● Inital desinn (Feb – Apr 2018)
● First prototype (May – Oct 2018)
– in-situ integraton meetng to take place: conclude the integraton of the frst testbed prototype, supportng
at least two inital pilot applicatons
– June 2018: Santander Meetng
● Second prototype
– Improvement of design and proposed solutons (frst quarter of 2019)
– Integraton towards a “second prototype” (mid 2019)
● Full Pilot testbed
– Integraton of all the Pilot applicatons and their tuning for high performance
● Promoton and exploitaton (2020)
– Improve the support and fnal quality of the solutons
– Promote the exploitaton in the EOSC framework, following the integraton actvites
https://deep-hybrid-datacloud.eu Jan 24, 2018 11/12
Contacts
WPeb page:
htps://deep-hybrid-datacloud.eu
Email:
info@deep-hybrid-datacloud.eu
htps://twiter.com/DEEPeeu
https://deep-hybrid-datacloud.eu
This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 777435.
Thank you
Any Questions?

More Related Content

What's hot

BigDataEurope @BDVA Summit2016 1: The BDE Platform
BigDataEurope @BDVA Summit2016 1: The BDE PlatformBigDataEurope @BDVA Summit2016 1: The BDE Platform
BigDataEurope @BDVA Summit2016 1: The BDE Platform
BigData_Europe
 
Apache Big_Data Europe event: "Integrators at work! Real-life applications of...
Apache Big_Data Europe event: "Integrators at work! Real-life applications of...Apache Big_Data Europe event: "Integrators at work! Real-life applications of...
Apache Big_Data Europe event: "Integrators at work! Real-life applications of...
BigData_Europe
 
Platform introduction & Summary
Platform introduction & SummaryPlatform introduction & Summary
Platform introduction & Summary
BigData_Europe
 
Science Demonstrator Session: Physics and Astrophysics
Science Demonstrator Session: Physics and AstrophysicsScience Demonstrator Session: Physics and Astrophysics
Science Demonstrator Session: Physics and Astrophysics
EOSCpilot .eu
 
Processing malaria HTS results using KNIME: a tutorial
Processing malaria HTS results using KNIME: a tutorialProcessing malaria HTS results using KNIME: a tutorial
Processing malaria HTS results using KNIME: a tutorial
Greg Landrum
 
BDE-BDVA Webinar: BDE Technical Overview
BDE-BDVA Webinar: BDE Technical OverviewBDE-BDVA Webinar: BDE Technical Overview
BDE-BDVA Webinar: BDE Technical Overview
BigData_Europe
 
SAMOS 2018: LEGaTO: first steps towards energy-efficient toolset for heteroge...
SAMOS 2018: LEGaTO: first steps towards energy-efficient toolset for heteroge...SAMOS 2018: LEGaTO: first steps towards energy-efficient toolset for heteroge...
SAMOS 2018: LEGaTO: first steps towards energy-efficient toolset for heteroge...
LEGATO project
 
IMPACT at OCR Summit
IMPACT at OCR SummitIMPACT at OCR Summit
IMPACT at OCR Summit
cneudecker
 
Building earth observation applications with NextGEOSS - webinar
Building earth observation applications with NextGEOSS - webinarBuilding earth observation applications with NextGEOSS - webinar
Building earth observation applications with NextGEOSS - webinar
terradue
 
SC1 Workshop 2 General Introduction to BDE
SC1 Workshop 2 General Introduction to BDESC1 Workshop 2 General Introduction to BDE
SC1 Workshop 2 General Introduction to BDE
BigData_Europe
 
Big Data Europe SC6 WS #3: Big Data Europe Platform: Apps, challenges, goals ...
Big Data Europe SC6 WS #3: Big Data Europe Platform: Apps, challenges, goals ...Big Data Europe SC6 WS #3: Big Data Europe Platform: Apps, challenges, goals ...
Big Data Europe SC6 WS #3: Big Data Europe Platform: Apps, challenges, goals ...
BigData_Europe
 
HNSciCloud Status Update
HNSciCloud Status UpdateHNSciCloud Status Update
HNSciCloud Status Update
Helix Nebula The Science Cloud
 
Open DMPs: Machine Actionable open data management planning (Presentation at ...
Open DMPs: Machine Actionable open data management planning (Presentation at ...Open DMPs: Machine Actionable open data management planning (Presentation at ...
Open DMPs: Machine Actionable open data management planning (Presentation at ...
OpenAIRE
 
Release webinar: Sansa and Ontario
Release webinar: Sansa and OntarioRelease webinar: Sansa and Ontario
Release webinar: Sansa and Ontario
BigData_Europe
 
SC1 Workshop 2 Technical overview
SC1 Workshop 2 Technical overviewSC1 Workshop 2 Technical overview
SC1 Workshop 2 Technical overview
BigData_Europe
 
Cloud Computing Needs for Earth Observation Data Analysis: EGI and EOSC-hub
Cloud Computing Needs for Earth Observation Data Analysis: EGI and EOSC-hubCloud Computing Needs for Earth Observation Data Analysis: EGI and EOSC-hub
Cloud Computing Needs for Earth Observation Data Analysis: EGI and EOSC-hub
Björn Backeberg
 
Interactive and reproducible data analysis with the open-source KNIME Analyti...
Interactive and reproducible data analysis with the open-source KNIME Analyti...Interactive and reproducible data analysis with the open-source KNIME Analyti...
Interactive and reproducible data analysis with the open-source KNIME Analyti...
Greg Landrum
 
h5web: a web-based viewer of HDF5 files
h5web: a web-based viewer of HDF5 filesh5web: a web-based viewer of HDF5 files
h5web: a web-based viewer of HDF5 files
PaNOSC
 
HNSciCloud Overview
HNSciCloud OverviewHNSciCloud Overview
HNSciCloud Overview
Helix Nebula The Science Cloud
 
FOSS4G Belgium 2018 - DCAT-AP Schema-plugin for GeoNetwork
FOSS4G Belgium 2018 - DCAT-AP Schema-plugin for GeoNetworkFOSS4G Belgium 2018 - DCAT-AP Schema-plugin for GeoNetwork
FOSS4G Belgium 2018 - DCAT-AP Schema-plugin for GeoNetwork
Goedertier Stijn
 

What's hot (20)

BigDataEurope @BDVA Summit2016 1: The BDE Platform
BigDataEurope @BDVA Summit2016 1: The BDE PlatformBigDataEurope @BDVA Summit2016 1: The BDE Platform
BigDataEurope @BDVA Summit2016 1: The BDE Platform
 
Apache Big_Data Europe event: "Integrators at work! Real-life applications of...
Apache Big_Data Europe event: "Integrators at work! Real-life applications of...Apache Big_Data Europe event: "Integrators at work! Real-life applications of...
Apache Big_Data Europe event: "Integrators at work! Real-life applications of...
 
Platform introduction & Summary
Platform introduction & SummaryPlatform introduction & Summary
Platform introduction & Summary
 
Science Demonstrator Session: Physics and Astrophysics
Science Demonstrator Session: Physics and AstrophysicsScience Demonstrator Session: Physics and Astrophysics
Science Demonstrator Session: Physics and Astrophysics
 
Processing malaria HTS results using KNIME: a tutorial
Processing malaria HTS results using KNIME: a tutorialProcessing malaria HTS results using KNIME: a tutorial
Processing malaria HTS results using KNIME: a tutorial
 
BDE-BDVA Webinar: BDE Technical Overview
BDE-BDVA Webinar: BDE Technical OverviewBDE-BDVA Webinar: BDE Technical Overview
BDE-BDVA Webinar: BDE Technical Overview
 
SAMOS 2018: LEGaTO: first steps towards energy-efficient toolset for heteroge...
SAMOS 2018: LEGaTO: first steps towards energy-efficient toolset for heteroge...SAMOS 2018: LEGaTO: first steps towards energy-efficient toolset for heteroge...
SAMOS 2018: LEGaTO: first steps towards energy-efficient toolset for heteroge...
 
IMPACT at OCR Summit
IMPACT at OCR SummitIMPACT at OCR Summit
IMPACT at OCR Summit
 
Building earth observation applications with NextGEOSS - webinar
Building earth observation applications with NextGEOSS - webinarBuilding earth observation applications with NextGEOSS - webinar
Building earth observation applications with NextGEOSS - webinar
 
SC1 Workshop 2 General Introduction to BDE
SC1 Workshop 2 General Introduction to BDESC1 Workshop 2 General Introduction to BDE
SC1 Workshop 2 General Introduction to BDE
 
Big Data Europe SC6 WS #3: Big Data Europe Platform: Apps, challenges, goals ...
Big Data Europe SC6 WS #3: Big Data Europe Platform: Apps, challenges, goals ...Big Data Europe SC6 WS #3: Big Data Europe Platform: Apps, challenges, goals ...
Big Data Europe SC6 WS #3: Big Data Europe Platform: Apps, challenges, goals ...
 
HNSciCloud Status Update
HNSciCloud Status UpdateHNSciCloud Status Update
HNSciCloud Status Update
 
Open DMPs: Machine Actionable open data management planning (Presentation at ...
Open DMPs: Machine Actionable open data management planning (Presentation at ...Open DMPs: Machine Actionable open data management planning (Presentation at ...
Open DMPs: Machine Actionable open data management planning (Presentation at ...
 
Release webinar: Sansa and Ontario
Release webinar: Sansa and OntarioRelease webinar: Sansa and Ontario
Release webinar: Sansa and Ontario
 
SC1 Workshop 2 Technical overview
SC1 Workshop 2 Technical overviewSC1 Workshop 2 Technical overview
SC1 Workshop 2 Technical overview
 
Cloud Computing Needs for Earth Observation Data Analysis: EGI and EOSC-hub
Cloud Computing Needs for Earth Observation Data Analysis: EGI and EOSC-hubCloud Computing Needs for Earth Observation Data Analysis: EGI and EOSC-hub
Cloud Computing Needs for Earth Observation Data Analysis: EGI and EOSC-hub
 
Interactive and reproducible data analysis with the open-source KNIME Analyti...
Interactive and reproducible data analysis with the open-source KNIME Analyti...Interactive and reproducible data analysis with the open-source KNIME Analyti...
Interactive and reproducible data analysis with the open-source KNIME Analyti...
 
h5web: a web-based viewer of HDF5 files
h5web: a web-based viewer of HDF5 filesh5web: a web-based viewer of HDF5 files
h5web: a web-based viewer of HDF5 files
 
HNSciCloud Overview
HNSciCloud OverviewHNSciCloud Overview
HNSciCloud Overview
 
FOSS4G Belgium 2018 - DCAT-AP Schema-plugin for GeoNetwork
FOSS4G Belgium 2018 - DCAT-AP Schema-plugin for GeoNetworkFOSS4G Belgium 2018 - DCAT-AP Schema-plugin for GeoNetwork
FOSS4G Belgium 2018 - DCAT-AP Schema-plugin for GeoNetwork
 

Similar to DEEP general presentation

RNP Cloud Infrastructure model, services and challenges
RNP Cloud Infrastructure model, services and challengesRNP Cloud Infrastructure model, services and challenges
RNP Cloud Infrastructure model, services and challenges
EUBrasilCloudFORUM .
 
GLENNA: The Nordic cloud
GLENNA: The Nordic cloud GLENNA: The Nordic cloud
GLENNA: The Nordic cloud
EOSC-hub project
 
CTE Phase III
CTE Phase IIICTE Phase III
CTE Phase III
Jeffrey Wallace
 
RINA IRATI Korea-EU Workshop 2013
RINA IRATI Korea-EU Workshop 2013RINA IRATI Korea-EU Workshop 2013
RINA IRATI Korea-EU Workshop 2013
Eleni Trouva
 
EUDAT B2STAGE & EOSC-hub
EUDAT B2STAGE & EOSC-hubEUDAT B2STAGE & EOSC-hub
EUDAT B2STAGE & EOSC-hub
EOSC-hub project
 
OGC Interfaces in Thematic Exploitation Platforms
OGC Interfaces in Thematic Exploitation PlatformsOGC Interfaces in Thematic Exploitation Platforms
OGC Interfaces in Thematic Exploitation Platforms
terradue
 
5th Content Providers Community Call
5th Content Providers Community Call5th Content Providers Community Call
5th Content Providers Community Call
OpenAIRE
 
OpenStackDay - XIFI Federation
OpenStackDay - XIFI FederationOpenStackDay - XIFI Federation
OpenStackDay - XIFI Federation
Alessandro Martellone
 
BDV Webinar Series - Lara - Deep Learning for Everybody
BDV Webinar Series - Lara - Deep Learning for EverybodyBDV Webinar Series - Lara - Deep Learning for Everybody
BDV Webinar Series - Lara - Deep Learning for Everybody
Big Data Value Association
 
HNSciCloud Overview
HNSciCloud Overview HNSciCloud Overview
HNSciCloud Overview
Helix Nebula The Science Cloud
 
Opening the Path to Technical Excellence
Opening the Path to Technical ExcellenceOpening the Path to Technical Excellence
Opening the Path to Technical Excellence
NETWAYS
 
OpenNebulaConf 2013 - Keynote: Opening the Path to Technical Excellence by Jo...
OpenNebulaConf 2013 - Keynote: Opening the Path to Technical Excellence by Jo...OpenNebulaConf 2013 - Keynote: Opening the Path to Technical Excellence by Jo...
OpenNebulaConf 2013 - Keynote: Opening the Path to Technical Excellence by Jo...
OpenNebula Project
 
General Introduction to technologies that will be seen in the school
General Introduction to technologies that will be seen in the school General Introduction to technologies that will be seen in the school
General Introduction to technologies that will be seen in the school
ISSGC Summer School
 
AntoineLambertResume
AntoineLambertResumeAntoineLambertResume
AntoineLambertResume
Antoine Lambert
 
Cross e-Infrastructure collaborations
Cross e-Infrastructure collaborationsCross e-Infrastructure collaborations
Cross e-Infrastructure collaborations
EUDAT
 
Gergely Sipos (EGI): Exploiting scientific data in the international context ...
Gergely Sipos (EGI): Exploiting scientific data in the international context ...Gergely Sipos (EGI): Exploiting scientific data in the international context ...
Gergely Sipos (EGI): Exploiting scientific data in the international context ...
Gergely Sipos
 
The Extreme Data Cloud (XDC) Project
The Extreme Data Cloud (XDC) ProjectThe Extreme Data Cloud (XDC) Project
The Extreme Data Cloud (XDC) Project
EUDAT
 
Superfluidity, Infrastructure for mixed workloads in Mobile Edge Computing - ...
Superfluidity, Infrastructure for mixed workloads in Mobile Edge Computing - ...Superfluidity, Infrastructure for mixed workloads in Mobile Edge Computing - ...
Superfluidity, Infrastructure for mixed workloads in Mobile Edge Computing - ...
Cloud Native Day Tel Aviv
 
Anastasios_Fakas
Anastasios_FakasAnastasios_Fakas
Anastasios_Fakas
Anastasios Fakas
 
OpenStack in Action 4! Daniel Pays & Régis Allègre - Cloudwatt Public Cloud: ...
OpenStack in Action 4! Daniel Pays & Régis Allègre - Cloudwatt Public Cloud: ...OpenStack in Action 4! Daniel Pays & Régis Allègre - Cloudwatt Public Cloud: ...
OpenStack in Action 4! Daniel Pays & Régis Allègre - Cloudwatt Public Cloud: ...
eNovance
 

Similar to DEEP general presentation (20)

RNP Cloud Infrastructure model, services and challenges
RNP Cloud Infrastructure model, services and challengesRNP Cloud Infrastructure model, services and challenges
RNP Cloud Infrastructure model, services and challenges
 
GLENNA: The Nordic cloud
GLENNA: The Nordic cloud GLENNA: The Nordic cloud
GLENNA: The Nordic cloud
 
CTE Phase III
CTE Phase IIICTE Phase III
CTE Phase III
 
RINA IRATI Korea-EU Workshop 2013
RINA IRATI Korea-EU Workshop 2013RINA IRATI Korea-EU Workshop 2013
RINA IRATI Korea-EU Workshop 2013
 
EUDAT B2STAGE & EOSC-hub
EUDAT B2STAGE & EOSC-hubEUDAT B2STAGE & EOSC-hub
EUDAT B2STAGE & EOSC-hub
 
OGC Interfaces in Thematic Exploitation Platforms
OGC Interfaces in Thematic Exploitation PlatformsOGC Interfaces in Thematic Exploitation Platforms
OGC Interfaces in Thematic Exploitation Platforms
 
5th Content Providers Community Call
5th Content Providers Community Call5th Content Providers Community Call
5th Content Providers Community Call
 
OpenStackDay - XIFI Federation
OpenStackDay - XIFI FederationOpenStackDay - XIFI Federation
OpenStackDay - XIFI Federation
 
BDV Webinar Series - Lara - Deep Learning for Everybody
BDV Webinar Series - Lara - Deep Learning for EverybodyBDV Webinar Series - Lara - Deep Learning for Everybody
BDV Webinar Series - Lara - Deep Learning for Everybody
 
HNSciCloud Overview
HNSciCloud Overview HNSciCloud Overview
HNSciCloud Overview
 
Opening the Path to Technical Excellence
Opening the Path to Technical ExcellenceOpening the Path to Technical Excellence
Opening the Path to Technical Excellence
 
OpenNebulaConf 2013 - Keynote: Opening the Path to Technical Excellence by Jo...
OpenNebulaConf 2013 - Keynote: Opening the Path to Technical Excellence by Jo...OpenNebulaConf 2013 - Keynote: Opening the Path to Technical Excellence by Jo...
OpenNebulaConf 2013 - Keynote: Opening the Path to Technical Excellence by Jo...
 
General Introduction to technologies that will be seen in the school
General Introduction to technologies that will be seen in the school General Introduction to technologies that will be seen in the school
General Introduction to technologies that will be seen in the school
 
AntoineLambertResume
AntoineLambertResumeAntoineLambertResume
AntoineLambertResume
 
Cross e-Infrastructure collaborations
Cross e-Infrastructure collaborationsCross e-Infrastructure collaborations
Cross e-Infrastructure collaborations
 
Gergely Sipos (EGI): Exploiting scientific data in the international context ...
Gergely Sipos (EGI): Exploiting scientific data in the international context ...Gergely Sipos (EGI): Exploiting scientific data in the international context ...
Gergely Sipos (EGI): Exploiting scientific data in the international context ...
 
The Extreme Data Cloud (XDC) Project
The Extreme Data Cloud (XDC) ProjectThe Extreme Data Cloud (XDC) Project
The Extreme Data Cloud (XDC) Project
 
Superfluidity, Infrastructure for mixed workloads in Mobile Edge Computing - ...
Superfluidity, Infrastructure for mixed workloads in Mobile Edge Computing - ...Superfluidity, Infrastructure for mixed workloads in Mobile Edge Computing - ...
Superfluidity, Infrastructure for mixed workloads in Mobile Edge Computing - ...
 
Anastasios_Fakas
Anastasios_FakasAnastasios_Fakas
Anastasios_Fakas
 
OpenStack in Action 4! Daniel Pays & Régis Allègre - Cloudwatt Public Cloud: ...
OpenStack in Action 4! Daniel Pays & Régis Allègre - Cloudwatt Public Cloud: ...OpenStack in Action 4! Daniel Pays & Régis Allègre - Cloudwatt Public Cloud: ...
OpenStack in Action 4! Daniel Pays & Régis Allègre - Cloudwatt Public Cloud: ...
 

More from EUDAT

EUDAT_Brochure_Generica_Jan_UPDATED(5).pdf
EUDAT_Brochure_Generica_Jan_UPDATED(5).pdfEUDAT_Brochure_Generica_Jan_UPDATED(5).pdf
EUDAT_Brochure_Generica_Jan_UPDATED(5).pdf
EUDAT
 
EUDAT Booklet Mar22 (2).pdf
EUDAT Booklet Mar22 (2).pdfEUDAT Booklet Mar22 (2).pdf
EUDAT Booklet Mar22 (2).pdf
EUDAT
 
EUDAT_Brochure_Generica_Jan_UPDATED (1).pdf
EUDAT_Brochure_Generica_Jan_UPDATED (1).pdfEUDAT_Brochure_Generica_Jan_UPDATED (1).pdf
EUDAT_Brochure_Generica_Jan_UPDATED (1).pdf
EUDAT
 
EUDAT Brochure - B2HANDLE.pdf
EUDAT Brochure - B2HANDLE.pdfEUDAT Brochure - B2HANDLE.pdf
EUDAT Brochure - B2HANDLE.pdf
EUDAT
 
EUDAT Brochure - B2DROP.pdf
EUDAT Brochure - B2DROP.pdfEUDAT Brochure - B2DROP.pdf
EUDAT Brochure - B2DROP.pdf
EUDAT
 
EUDAT Brochure - B2SHARE.pdf
EUDAT Brochure - B2SHARE.pdfEUDAT Brochure - B2SHARE.pdf
EUDAT Brochure - B2SHARE.pdf
EUDAT
 
EUDAT Brochure - B2SAFE.pdf
EUDAT Brochure - B2SAFE.pdfEUDAT Brochure - B2SAFE.pdf
EUDAT Brochure - B2SAFE.pdf
EUDAT
 
EUDAT Brochure - B2FIND(1).pdf
EUDAT Brochure - B2FIND(1).pdfEUDAT Brochure - B2FIND(1).pdf
EUDAT Brochure - B2FIND(1).pdf
EUDAT
 
EUDAT Brochure - B2ACCESS.pdf
EUDAT Brochure - B2ACCESS.pdfEUDAT Brochure - B2ACCESS.pdf
EUDAT Brochure - B2ACCESS.pdf
EUDAT
 
Rob Carrillo - Writing effective service documentation for EUDAT services
Rob Carrillo - Writing effective service documentation for EUDAT servicesRob Carrillo - Writing effective service documentation for EUDAT services
Rob Carrillo - Writing effective service documentation for EUDAT services
EUDAT
 
Ariyo - EUDAT CDI B2 services documentation
Ariyo - EUDAT CDI B2 services documentationAriyo - EUDAT CDI B2 services documentation
Ariyo - EUDAT CDI B2 services documentation
EUDAT
 
Introduction to eudat and its services
Introduction to eudat and its servicesIntroduction to eudat and its services
Introduction to eudat and its services
EUDAT
 
Using B2NOTE: The U.Porto Pilot
Using B2NOTE: The U.Porto PilotUsing B2NOTE: The U.Porto Pilot
Using B2NOTE: The U.Porto Pilot
EUDAT
 
OpenAIRE Advance - Kick off last week
OpenAIRE Advance - Kick off last weekOpenAIRE Advance - Kick off last week
OpenAIRE Advance - Kick off last week
EUDAT
 
European Open Science Cloud - Skills workshop
European Open Science Cloud - Skills workshopEuropean Open Science Cloud - Skills workshop
European Open Science Cloud - Skills workshop
EUDAT
 
Linking service capabilities to data stweardship competences for professional...
Linking service capabilities to data stweardship competences for professional...Linking service capabilities to data stweardship competences for professional...
Linking service capabilities to data stweardship competences for professional...
EUDAT
 
FAIRness of training materials
FAIRness of training materialsFAIRness of training materials
FAIRness of training materials
EUDAT
 
Training by EOSC-hub - Integrating and Managing services for the European Ope...
Training by EOSC-hub - Integrating and Managing services for the European Ope...Training by EOSC-hub - Integrating and Managing services for the European Ope...
Training by EOSC-hub - Integrating and Managing services for the European Ope...
EUDAT
 
Draft Governance Framework for the EOSC
Draft Governance Framework for the EOSCDraft Governance Framework for the EOSC
Draft Governance Framework for the EOSC
EUDAT
 
Building Interoperable AAI for Researchers
Building Interoperable AAI for ResearchersBuilding Interoperable AAI for Researchers
Building Interoperable AAI for Researchers
EUDAT
 

More from EUDAT (20)

EUDAT_Brochure_Generica_Jan_UPDATED(5).pdf
EUDAT_Brochure_Generica_Jan_UPDATED(5).pdfEUDAT_Brochure_Generica_Jan_UPDATED(5).pdf
EUDAT_Brochure_Generica_Jan_UPDATED(5).pdf
 
EUDAT Booklet Mar22 (2).pdf
EUDAT Booklet Mar22 (2).pdfEUDAT Booklet Mar22 (2).pdf
EUDAT Booklet Mar22 (2).pdf
 
EUDAT_Brochure_Generica_Jan_UPDATED (1).pdf
EUDAT_Brochure_Generica_Jan_UPDATED (1).pdfEUDAT_Brochure_Generica_Jan_UPDATED (1).pdf
EUDAT_Brochure_Generica_Jan_UPDATED (1).pdf
 
EUDAT Brochure - B2HANDLE.pdf
EUDAT Brochure - B2HANDLE.pdfEUDAT Brochure - B2HANDLE.pdf
EUDAT Brochure - B2HANDLE.pdf
 
EUDAT Brochure - B2DROP.pdf
EUDAT Brochure - B2DROP.pdfEUDAT Brochure - B2DROP.pdf
EUDAT Brochure - B2DROP.pdf
 
EUDAT Brochure - B2SHARE.pdf
EUDAT Brochure - B2SHARE.pdfEUDAT Brochure - B2SHARE.pdf
EUDAT Brochure - B2SHARE.pdf
 
EUDAT Brochure - B2SAFE.pdf
EUDAT Brochure - B2SAFE.pdfEUDAT Brochure - B2SAFE.pdf
EUDAT Brochure - B2SAFE.pdf
 
EUDAT Brochure - B2FIND(1).pdf
EUDAT Brochure - B2FIND(1).pdfEUDAT Brochure - B2FIND(1).pdf
EUDAT Brochure - B2FIND(1).pdf
 
EUDAT Brochure - B2ACCESS.pdf
EUDAT Brochure - B2ACCESS.pdfEUDAT Brochure - B2ACCESS.pdf
EUDAT Brochure - B2ACCESS.pdf
 
Rob Carrillo - Writing effective service documentation for EUDAT services
Rob Carrillo - Writing effective service documentation for EUDAT servicesRob Carrillo - Writing effective service documentation for EUDAT services
Rob Carrillo - Writing effective service documentation for EUDAT services
 
Ariyo - EUDAT CDI B2 services documentation
Ariyo - EUDAT CDI B2 services documentationAriyo - EUDAT CDI B2 services documentation
Ariyo - EUDAT CDI B2 services documentation
 
Introduction to eudat and its services
Introduction to eudat and its servicesIntroduction to eudat and its services
Introduction to eudat and its services
 
Using B2NOTE: The U.Porto Pilot
Using B2NOTE: The U.Porto PilotUsing B2NOTE: The U.Porto Pilot
Using B2NOTE: The U.Porto Pilot
 
OpenAIRE Advance - Kick off last week
OpenAIRE Advance - Kick off last weekOpenAIRE Advance - Kick off last week
OpenAIRE Advance - Kick off last week
 
European Open Science Cloud - Skills workshop
European Open Science Cloud - Skills workshopEuropean Open Science Cloud - Skills workshop
European Open Science Cloud - Skills workshop
 
Linking service capabilities to data stweardship competences for professional...
Linking service capabilities to data stweardship competences for professional...Linking service capabilities to data stweardship competences for professional...
Linking service capabilities to data stweardship competences for professional...
 
FAIRness of training materials
FAIRness of training materialsFAIRness of training materials
FAIRness of training materials
 
Training by EOSC-hub - Integrating and Managing services for the European Ope...
Training by EOSC-hub - Integrating and Managing services for the European Ope...Training by EOSC-hub - Integrating and Managing services for the European Ope...
Training by EOSC-hub - Integrating and Managing services for the European Ope...
 
Draft Governance Framework for the EOSC
Draft Governance Framework for the EOSCDraft Governance Framework for the EOSC
Draft Governance Framework for the EOSC
 
Building Interoperable AAI for Researchers
Building Interoperable AAI for ResearchersBuilding Interoperable AAI for Researchers
Building Interoperable AAI for Researchers
 

Recently uploaded

Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
SOFTTECHHUB
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
Matthew Sinclair
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
DanBrown980551
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Albert Hoitingh
 
Data structures and Algorithms in Python.pdf
Data structures and Algorithms in Python.pdfData structures and Algorithms in Python.pdf
Data structures and Algorithms in Python.pdf
TIPNGVN2
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
Ana-Maria Mihalceanu
 
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Nexer Digital
 
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
Neo4j
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
James Anderson
 
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
Neo4j
 
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
sonjaschweigert1
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
Alpen-Adria-Universität
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
DianaGray10
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
KatiaHIMEUR1
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
danishmna97
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
Matthew Sinclair
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
Matthew Sinclair
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
Kari Kakkonen
 
Pushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 daysPushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 days
Adtran
 
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
名前 です男
 

Recently uploaded (20)

Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
 
Data structures and Algorithms in Python.pdf
Data structures and Algorithms in Python.pdfData structures and Algorithms in Python.pdf
Data structures and Algorithms in Python.pdf
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
 
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
 
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
 
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...
 
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
 
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
 
Pushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 daysPushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 days
 
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
みなさんこんにちはこれ何文字まで入るの?40文字以下不可とか本当に意味わからないけどこれ限界文字数書いてないからマジでやばい文字数いけるんじゃないの?えこ...
 

DEEP general presentation

  • 1. DEEP-Hybrid-DataCloud has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 777435. DEEP general presentation Brief project overview Jesús Marco de Lucas, Álvaro López García {marco,aloga}@ifca.unican.es Spanish National Research Council DEEP & XDC Kick of Meeting Bologna, Italy January 24, 2018
  • 2. https://deep-hybrid-datacloud.eu Jan 24, 2018 2/12 DEEP-Hybrid-DataCloud: context ● H2020 project, EINFRA-21 call – Topic: Platorm-driven e-Infrastructure towards the European Open Science Cloud – Scope: Computng e-infrastructure with extreme large datasets ● (…) prototypes to cope with very large data resources (...) ● (…) sofware layers supportng applicatons such as modelling, simulaton, patern recogniton, visualisaton, etc. (...) ● (…) supported by robust mathematcal methods and tools (...) ● (…) Clean slate approaches to high-performance computng and data management (…) ● DEEP-Hybrid-DatCloud: Designing and Enabling E-Infrastructures for intensive data Processing in a Hybrid DataCloud – Started as a spin-of project (together with XDC) from INDIGO-DataCloud technologies – Submited in March 2017 – Started November 1st 2017 – Grant agreement number 777435 ● Global objectie: Promote the use of intensiie computnn seriices by diferent research communites and areas, an the support by the corresponding e-Infrastructure providers and open source projects
  • 3. https://deep-hybrid-datacloud.eu Jan 24, 2018 3/12 DEEP project objectives ● Focus on intensiie computnn techniques for the analysis of iery larne datasets considering demanding use cases – Pilot applicatons from diferent research communites – Three techniques of wide interest: deep learning, post processing and on-line analysis of data streams – Improved list of requirements for e-Infrastructures → future generaton ● Eiolie up to producton level intensiie computnn seriices exploitng specialized hardware – New solutons to beter interact with bare metal resources in the cloud – Use of hardware accelerators such as GPUs and low-latency interconnects ● Intenrate intensive computng services under a hybrid cloud approach – Assuring interoperability with existng EOSC – Expanding over multple IaaS using high level networking technologies – Enrich orchestraton tools for supportng multple services and providers ● Defne a “DEEP as a Seriice” soluton to ofer an adequate integraton path to developers of fnal applicatons – Implement a catalon of the most useful services and applicatons as well defned buildinn blocks – Ofer a DeiOps approach for the applicaton development ● Analyse the complementarity with other onnoinn projects targetng added value services for the cloud – In partcular those related to the management of extremely large datasets – Explore diferent e-Infrastructures and complementary services – Identfcaton, integraton and/or co-development of missing functonalites
  • 4. https://deep-hybrid-datacloud.eu Jan 24, 2018 4/12 DEEP pilot use cases ● Three techniques of wide interest, involving – Large, heterogeneous data sets – Intensive computng demands that would beneft from using hardware accelerators (GPUs, low latency interconnects) ● Deep learning – Pilot cases: stem cells, biodiversity applicatons, medical image – Provide a general, distributed architecture and pipeline to train deep learning (and other) models ● Post-processing – Pilot cases: post-processing of HPC simulatons – Flexible pipeline for the analysis of simulaton data generated at HPC resources ● On-line analysis of data streams – Pilot case: intrusion detecton systems – Provide an architecture able to analyze massive on-line data streams, also with historical records
  • 5. https://deep-hybrid-datacloud.eu Jan 24, 2018 5/12 DEEP consortium ● Balanced set of partners – Strong technological background on development, implementaton, deployment and operaton of federated e-Infrastructures ● 9 academic partners – CSIC, LIP, INFN, PSNC, KIT, UPV, CESNET, IISAS, HMGU ● 1 industrial partner – Atos ● 6 countries – Spain, Italy, Poland, Germany, Czech Republic, Slovakia
  • 6. https://deep-hybrid-datacloud.eu Jan 24, 2018 6/12 WP leaders and deputies ● WP1 (NA): Project Management and Exploitaton – Project oversight, quality management, admin, etc. – Leader: CSIC, deputy: Atos ● WP2 (NA): Intensive Computng Pilot Applicatons – Defniton and understanding of pilot usage scenarios – Leader: HMGU, deputy: KIT ● WP3 (SA): Testbed and Integraton with EOSC services – Project service actvites: testbeds, tools, integratons – Leader: LIP, deputy: PSNC ● WP4 (JRA): Accelerated High Performance Computng in the Cloud – Support for accelerators and HPC resources – Leader: IISAS, deputy: INFN ● WP5 (JRA): High Level Hybrid Cloud solutons – Platorm provisioning, delivering the executon platorm for WPP5 – Leader: INFN, deputy: CESNET ● WP6 (JRA): DEEP as a Service – Deliver fnal soluton to the users – Leader: CSIC, deputy: UPV ● WP7: Ethics requirements – Leader: CSIC
  • 7. https://deep-hybrid-datacloud.eu Jan 24, 2018 7/12 Project governance ● Steering Commitee – Driving the project executon ● Consortum Assembly – Legal project partners – Strategic project decisions ● Cooperaton Open Board – Partners and stakeholders from Europe and relevant projects and initatves – Interact with Steering Commitee to defne the agenda, interests and proposals for discussion ● Advisory Board – External board – Integrated by experts from relevant stakeholders
  • 8. https://deep-hybrid-datacloud.eu Jan 24, 2018 8/12 INDIGO Components and evolution (I) ● INDIGO Orchestrator – Hybrid support on multple sites – Support to specifying specialized computng hardware ● Infrastructure Mananer – Hybrid Clouds support involving specialized computng hardware ● uDocker – Support for GPUs and specialized hardware to be further developed ● Cloud Informaton System – Missing informaton about accelerators or special hardware at a provider – React faster to changes in the infrastructure (faster publicaton and propagaton of informaton)
  • 9. https://deep-hybrid-datacloud.eu Jan 24, 2018 9/12 INDIGO Components and evolution (I) ● OpenStack/OpenNebula – Extensions be needed to properly support accelerators: improving scheduling strategies, easier confguraton and improved documentaton. ● PaaS layer – Accelerator support ● Docker – Use as container technology for applicatons ● LXC – Use as alternatve hypervisor ● Ansible – Contextualizaton and confguraton tool, further development of modules ● INDIGO Virtual Router – Improvements to reach producton level
  • 10. https://deep-hybrid-datacloud.eu Jan 24, 2018 10/12 DEEP work programme ● WPe have defned diferent phases for the project ● Plan and requirements (Nov 2017 – Jan 2018) ● Inital desinn (Feb – Apr 2018) ● First prototype (May – Oct 2018) – in-situ integraton meetng to take place: conclude the integraton of the frst testbed prototype, supportng at least two inital pilot applicatons – June 2018: Santander Meetng ● Second prototype – Improvement of design and proposed solutons (frst quarter of 2019) – Integraton towards a “second prototype” (mid 2019) ● Full Pilot testbed – Integraton of all the Pilot applicatons and their tuning for high performance ● Promoton and exploitaton (2020) – Improve the support and fnal quality of the solutons – Promote the exploitaton in the EOSC framework, following the integraton actvites
  • 11. https://deep-hybrid-datacloud.eu Jan 24, 2018 11/12 Contacts WPeb page: htps://deep-hybrid-datacloud.eu Email: info@deep-hybrid-datacloud.eu htps://twiter.com/DEEPeeu
  • 12. https://deep-hybrid-datacloud.eu This project has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 777435. Thank you Any Questions?