Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Upcoming SlideShare
What to Upload to SlideShare
Next
Download to read offline and view in fullscreen.

Share

Updates from Hungary (Jozsef Kovacs)

Download to read offline

Updates from Hungary (Jozsef Kovacs)
(EOSC hub week, Malaga, 16 - 20 April 2018)

Related Books

Free with a 30 day trial from Scribd

See all

Related Audiobooks

Free with a 30 day trial from Scribd

See all
  • Be the first to like this

Updates from Hungary (Jozsef Kovacs)

  1. 1. Cloud of the Hungarian Academy of Sciences and its role in the national e-infrastructure Jozsef Kovacs, Peter Kacsuk, Robert Lovas
  2. 2. EOSC-hub public day, Malaga, 16-17 April, 2018 Activities of the Hungarian NGI • Providing IaaS Cloud systems: • MTA Cloud for the researchers of the Hungarian Academy of Sciences • https://cloud.mta.hu • NIIF Cloud for the Hungarian universities • https://niif.hu/en/cloud • Plan to create a Hungarian National Node in the European Research Data Alliance (RDA) with the participation • of the cloud providers of the above mentioned 2 clouds • of some hungarian libraries • of several academic institutes using large scientific data
  3. 3. EOSC-hub public day, Malaga, 16-17 April, 2018 MTA Cloud is an alliance of cloud sites The goal was to build an open, multi-cloud architecture to which other clouds could join later. Therefore MTA Cloud is organized as an alliance of cloud sites. Currently two sites are involved: • MTA SZTAKI • MTA Wigner Data Center Alliance means: • The user interface to register and authenticate for the users is common • The applied cloud middleware is the same (OpenStack) • The webpage of MTA Cloud is common • The management of the system is a joint activity of SZTAKI and Wigner Data Center • The training and user support activities are common
  4. 4. EOSC-hub public day, Malaga, 16-17 April, 2018 Current capacity of MTA Cloud Wigner site: 800 vCPU 2.5 TB RAM 400 TB HDD SZTAKI site: 360 vCPU 832 GB RAM 164 TB HDD Computing capacity is already fully used but the storage capacity is currently underutilized
  5. 5. EOSC-hub public day, Malaga, 16-17 April, 2018 Additional capacity under development Wigner site: a. Compute extension: 2 x Intel Xeon E5-2660 v2 processor (40 vCPU) 128 GB memory 1 TB disk 4 nVidia V100 GPU cards b. Storage extension: 2 x Intel Xeon E5-2630 v2 processor 64 GB memory 6 TB disk SZTAKI site: 3 computing nodes (64 vCPUs + 512 GB RAM + 1 GPU) 1 computing node (40 vCPUs + 128 GB RAM) 1 GPU computing accelerator 15x250 GB SSD storage for CEPH
  6. 6. EOSC-hub public day, Malaga, 16-17 April, 2018 Services of MTA Cloud • IaaS resource provision based on the capacity mentioned before • PaaS services: • Occopus cloud orchestrator • Data Avenue file transfer service • Hadoop cluster • Swarm cluster • WS-PGRADE/gUSE science gateway and workflow system • Flowbster stream-oriented workflow system • All of them are supported by detailed tutorials at MTA Cloud web page
  7. 7. EOSC-hub public day, Malaga, 16-17 April, 2018 Occopus: hybrid cloud orchestrator • Wide range of supported resources (ec2, nova, occi, cloudbroker, cloudsigma, docker, [azure]) • Hybrid cloud support • Multiple configuration tool support • Different usage possibilities • Simple YAML format • Double layered schema-checking Occopus CloudSigma plugin Docker Worker CloudSigma CloudSigma API MTA Cloud NOVA API Docker Worker NOVA plugin Deploy Docker WW M Deploy Containers C B A Occopus DOCKER plugin B A C Docker Master • Dynamic reconfiguration • Health-checking • Auto-healing • Manual scaling • Multiple node implementations • Authenticator-selection • Easily extensible architecture
  8. 8. EOSC-hub public day, Malaga, 16-17 April, 2018 Flowbster: workflow choreography The goal of Flowbster is to enable • The quick deployment of the workflow as a pipeline infrastructure in the cloud by Occopus • Once the pipeline infrastructure is created in the cloud it is activated and data elements of the data set to be processed flow through the pipeline • As the data set flows through the pipeline its data elements are processed as defined by the Flowbster workflow A one_file two_file out_file B one_file two_file out_file C one_file two_file out_file D one_file two_file out_file Data set to be processed Processed data set Amazon S3 MTA Cloud S3 MTA Cloud service
  9. 9. EOSC-hub public day, Malaga, 16-17 April, 2018 Example: Autodock virtual infrastructure in cloud Vina Vina Generator Vina Collector Step 2: Deploy Autodock VI in MTA Cloud MTA Cloud Repository VI descriptor Step 1: Take VI descriptor of Autodock VI from MTA Cloud Repo Inputs: + Vina config + Receptor molecule + Ligand set Vina config Ligand sets All docking resuts Output: 5 Best docking results Step 3: Run autodock appl in MTA cloud with 100.000 ligands
  10. 10. EOSC-hub public day, Malaga, 16-17 April, 2018 Building Hadoop cluster by Occopus in the MTA Cloud Occopus Hadoop Slaves Hadoop Master Descriptors Step 1: Deploy Occopus Step 2: Download Hadoop descriptors Step 3: Personalize descriptors Step 4: Deploy Hadoop cluster (based on the personalized descriptors) Step 5: Run MapReduce jobs HDFS HDFS HDFS HDFS
  11. 11. EOSC-hub public day, Malaga, 16-17 April, 2018 Usage of MTA Cloud • Web page lists all the projects running on MTA Cloud • Currently 52 projects from 17 research institutes Name of the project Goal of the project Research institute Project director
  12. 12. EOSC-hub public day, Malaga, 16-17 April, 2018 Summary of MTA Cloud • MTA Cloud has been in production since October 2016 • After one year of usage there were more than 40 projects that used nearly the whole set of computing resources • As a result significant extension of MTA Cloud is on its way • MTA Cloud is getting more and more popular, currently 52 projects are hosted Maintenance and user support of PaaS services are supported by the Cloudifacturing EU project
  13. 13. EOSC-hub public day, Malaga, 16-17 April, 2018 Duration: 2017-2021 Budget: 9.7 MEUR URL: www.cloudifacturing.eu Consortium: Fraunhofer (coordinator), DIHs (Digital Innovation Hubs), ISV (Independent Software Vendors), manufacturing SMEs, etc. CloudiFacturing is bringing together the outcomes of two previous European initiatives “CloudFlow” (www.eu- cloudflow.eu) and “cloudSME” (www.cloudsme-project.eu).
  14. 14. EOSC-hub public day, Malaga, 16-17 April, 2018 Open Call 4/17/201814 https://www.cloudifacturing.eu/open-calls/
  15. 15. EOSC-hub public day, Malaga, 16-17 April, 2018 Some details from the call 4/17/201815 … welcome use cases that a) simulate manufacturing processes or manufacturing tools, b) leverage factory data to learn from it, and c) optimize manufacturing processes and/or manufacturability of goods. The use cases need to be driven by the end user; in other words, a manufacturing company, preferably an SME. If you are interested in our Open Call or you have questions, please contact one of our local DIHs spread all over Europe: For southeast and northeast Europe: • Gabor Vicze: gabor.vicze@innomine.com, Innomine, Hungary or • Tomáš Karásek: tomas.karasek@vsb.cz, Technical University of Ostrava, Czech Republic For southwest Europe: • Elena Femenía: efemenia@localeurope.net, Innsomnia, Spain 2M EUR will be distributed through open calls during the project. https://www.cloudifacturing.eu/open-calls/
  16. 16. EOSC-hub public day, Malaga, 16-17 April, 2018 Thank you for your attention. jozsef.kovacs@sztaki.mta.hu (Cloud expert of MTA SZTAKI) peter.kacsuk@sztaki.mta.hu (Technical director of MTA Cloud) robert.lovas@sztaki.mta.hu (Cloudifacturing contact of MTA SZTAKI) http://cloud.mta.hu (hungarian) http://www.cloudifacturing.eu

Updates from Hungary (Jozsef Kovacs) (EOSC hub week, Malaga, 16 - 20 April 2018)

Views

Total views

328

On Slideshare

0

From embeds

0

Number of embeds

1

Actions

Downloads

3

Shares

0

Comments

0

Likes

0

×