Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

The AGINFRA+ Virtual Research Environment (VRE)

41 views

Published on

Massimiliano Assante from CNR on The AGINFRA+ Virtual Research Environment (VRE).

Joint Workshop on Food Risk Assessment Research & Practice
24th November 2017, Wageningen University & Research, Netherlands

Published in: Software
  • Be the first to comment

  • Be the first to like this

The AGINFRA+ Virtual Research Environment (VRE)

  1. 1. WWW.PLUS.AGINFRA.EU AGINFRA PLUS - Accelerating user-driven e-infrastructure innovation in Food & Agriculture has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 731001. The AGINFRA+ Virtual Research Environment (VRE) Food Risk Assessment Research & Practice Wageningen, Netherland | 22 NOV 2017 D4Science Operations Manager | CNR Massimiliano Assante, PhD
  2. 2. WWW.PLUS.AGINFRA.EU The D4Science infrastructure Data Infrastructure combining over 500 software components into a coherent and centrally managed system of hardware, software, and data resources Data Analytics & Processing Layer (WP3) Progress and current status
  3. 3. WWW.PLUS.AGINFRA.EU D4Science Identity D4Science is • connecting +3900 scientists in 44 countries • integrating data from +50 heterogeneous providers • executing +50,000 models & algorithms/month • providing access to over a billion quality records in repositories worldwide • operating with 99,7% service availability D4Science hosts 100+ Virtual Research Environments to serve the biological, ecological, environmental, social mining, culture heritage, and statistical communities world-wide. Data Analytics & Processing Layer (WP3) Progress and current status
  4. 4. WWW.PLUS.AGINFRA.EU D4Science for Geeks • uses cloud-computing technologies to manage +300 servers (more than 5 TB Ram, +1700 CPUs, 400 TB storage) • is monitored via Nagios and Ganglia • is maintained via Ansible (Application Deployment + Configuration Management + Continuous Delivery) • is governed by deployment and operation policies • has established SLA • is operated according to defined Terms of Use Data Analytics & Processing Layer (WP3) Progress and current status
  5. 5. WWW.PLUS.AGINFRA.EU Storage as Service 01/02/2018 Intr odu ctio n to Exis ting Tec hno logi es and Ena 5 to host and maintain data Database High-availability Standard Ready-to-use Cloud Storage Scalable Reliable Secure Geographical DB Scalable OGC Standard Privacy and Attribution
  6. 6. WWW.PLUS.AGINFRA.EU Applications as a Service 01/02/2018 Intr odu ctio n to Exis ting Tec hno logi es and Ena 6 to curate and manage data Metadata Generation Geospatial Data Biodiversity Data Statistical Data Textual Data Harmonization Disambiguate Validate Integrate and Consistency Check Data Exchange OGC protocols DarwinCore SDMX DublinCore
  7. 7. WWW.PLUS.AGINFRA.EU Computing as Service 01/02/2018 Intr odu ctio n to Exis ting Tec hno logi es and Ena 7 to process and extract knowledge Scalable Easy to Manage Across Boundaries Tailored Elastic Assignment of Computing Assignment of Processors Virtual Research Environment Rich and Heterogeneous High Throughput Map-Reduce Parallel R
  8. 8. WWW.PLUS.AGINFRA.EU Born from the user needs 01/02/2018 Intr odu ctio n to Exis ting Tec hno logi es and Ena 8 to analyze datasets to manage the full data life-cycle from import to validation, curation, harmonization and publication to reduce the costs of data maintenance to host applications in a secure and scalable environment to maintain and preserve data to securely delivery data to known users to access authoritative datasets to mash-up data to analyse big datasets to validate datasets and provide a standard access to them
  9. 9. WWW.PLUS.AGINFRA.EU Virtual Research Environment Dat a Ana lyti cs & Pro ces sing Lay er (W to access, share and collaborate Share Database Tables Workflow Files Communicate Post Comments Likes Organize Dynamic VRE Creation Secure Policy Control
  10. 10. WWW.PLUS.AGINFRA.EU https://aginfra.d4science.org/home Project communication & data exchanging tools 10 SocialNetworking Applications Private Cloud Storage Activity Tracker & WIKI Data analytics and processing platform
  11. 11. WWW.PLUS.AGINFRA.EU AGINFRA VRE Page structure and Apps Project communication & data exchanging tools 11 Posting to other VRE users News Feed About area Managers & Groups Recent documents added to VRE folder Available apps VREPageandApplications
  12. 12. WWW.PLUS.AGINFRA.EU Posting messages to other VRE users • Paste links, attach files, use #hashtags, mention people Project communication & data exchanging tools 12 Attach file from Desktop Notify VRE users (via email by default) VREPageandApplications
  13. 13. WWW.PLUS.AGINFRA.EU Post replies via email • It is possible to reply to post via email Project communication & data exchanging tools 13 Start typing your reply … VREPageandApplications
  14. 14. WWW.PLUS.AGINFRA.EU Top topics Project communication & data exchanging tools 14 Top Topics VREPageandApplications
  15. 15. WWW.PLUS.AGINFRA.EU VRE Members Project communication & data exchanging tools 15 VREPageandApplications
  16. 16. WWW.PLUS.AGINFRA.EU The Dockbar Always on top: Home, Workspace (WS), Messages, Notifications, Search WS or #Topic, User Profile. Project communication & data exchanging tools 16 Workspace HomeSocial
  17. 17. WWW.PLUS.AGINFRA.EU Workspace Exploring the workspace Project communication & data exchanging tools 17
  18. 18. WWW.PLUS.AGINFRA.EU Folders • Private, Shared and VRE Folders • Managing permissions Links • Sharable Link • Public Link • Public folder links File Uploads • Multiple File Uploads • Drag & Drop Worth a note • History • Notifications • Versioning Exploiting the Workspace, main features Project communication & data exchanging tools 18 ExploitingtheWorkspace
  19. 19. WWW.PLUS.AGINFRA.EU Messages Project communication & data exchanging tools 19
  20. 20. WWW.PLUS.AGINFRA.EU Notifications Project communication & data exchanging tools 20 NotificationsPage
  21. 21. WWW.PLUS.AGINFRA.EU User Profile Project communication & data exchanging tools 21
  22. 22. WWW.PLUS.AGINFRA.EU Activity Tracker integrated Project communication & data exchanging tools 22 Fully-fledged and customizable Redmine instance avaibalbe by SSO VREPageandApplications
  23. 23. WWW.PLUS.AGINFRA.EU Integrated Wiki Project communication & data exchanging tools 23 VREPageandApplications
  24. 24. WWW.PLUS.AGINFRA.EU Help scientists in computational statistics experiments Supply precooked state-of-the-art algorithms as-a-Service Perform calculations by using Map-Reduce in a seamless way to the users Share input, results, parameters and comments with colleagues by means of Virtual Research Environment Data Analytics & Processing Layer (WP3) - Progress and current status - M. Assante Data Miner & Rstudio Cluster Data Miner D4Science Computational Facilities Sharing Setup and execution
  25. 25. WWW.PLUS.AGINFRA.EU CONSORTIUM WWW.PLUS.AGINFRA.EU Thank you! @maxassante linkedin.com/in/maxassante

×