SlideShare a Scribd company logo
1 of 88
Download to read offline
EUDAT services
Pablo Ródenas Barquero
HPC support and application consultant @ BSC
21/Jun/2018 MareData (València)
Index:
• BSC brief introduction
• EUDAT overview
• EUDAT services suite
BSC in brief
Barcelona Supercomputing Center
Centro Nacional de Supercomputación
Spanish Government 60%
Catalonian Government 30%
Univ. Politècnica de Catalunya (UPC) 10%
BSC-CNS is
a consortium
that includes
BSC-CNS objectives
Supercomputing services
to Spanish and
EU researchers
R&D in Computer,
Life, Earth and
Engineering Sciences
PhD programme,
technology transfer,
public engagement
People and Resources
Data as of 31st
of December 2017
2017 executed budget
Mission of BSC Scientific Departments
Earth
Sciences
CASE
Computer
Sciences
Life
Sciences
To influence the way machines are built, programmed
and used: programming models, performance tools,
Big Data, computer architecture, energy efficiency
To develop and implement global and
regional state-of-the-art models for
short-term air quality forecast and long-term
climate applications
To understand living organisms by means of
theoretical and computational methods
(molecular modeling, genomics, proteomics)
To develop scientific and engineering software to
efficiently exploit super-computing capabilities
(biomedical, geophysics, atmospheric, energy, social
and economic simulations)
BSC & The Global IT Industry
IBM-BSC
Deep Learning
Center
Intel-BSC
Exascale Lab
BSC-Microsoft
Research Centre
NVIDIA GPU
Center of
Excellence
Collaborations with Industry
Research into advanced technologies
for the exploration of hydrocarbons,
subterranean and subsea reserve
modelling and fluid flows
Research on wind farms
optimization and wing energy
production forecasts
Collaboration agreement for the
development of advanced systems
of deep learning with applications
to banking services
BSC’s dust storm forecast system
licensed to be used to improve
the safety of business flights.
Research on the protein-drug mechanism of
action in Nuclear Hormone receptors and
developments on PELE method to perform
protein energy landscape explorations
Simulation of fluid-structure
interaction problem with the
multi-physics software Alya
The MareNostrum 4 supercomputer
Total peak performance:
13,7 Pflops/s
80%
Access: prace-ri.eu/hpc_acces
16%
Access: bsc.es/res-intranet
4%
MareNostrum is managed by the Operations team that takes care of its
availability, security and performance. An important task of this team is
to support scientists in the usage of MareNostrum, as well as to help
them in the improvement of their applications getting better research
results.
– System administration area: includes MareNostrum’s pure system
administration, security, resource management, networking & helpdesk.
– User support area: includes direct user support with knowledge in
programming models, libraries, tools, applications, etc.
Operations teamOperations department
• The main objectives for the HPC-Support team are :
– Solve the request of researchers using the BSC HPC-Resources
– Installation and debugging applications
– Enabling and porting codes to the new architectures.
– Assisting users for efficient use of supercomputing resources
– Optimization and scalability studies
– Parallelization assistance
– Benchmarking
– Manage accounting information and users accounts
– Specific support for scientific codes
HPC Support tasksHPC support tasks
EUDAT overview
• A pan-European initiative building a sustainable
cross-disciplinary and cross-national data
infrastructure providing a set of shared services for
accessing and preserving research data
• Close collaboration with research communities to
optimally support their data management needs
and deliver the appropriate technical services
EUDAT - European Data
Infrastructure
A truly pan-European
Infrastructure
EUDAT offers common data services,
supporting multiple research communities as
well as individuals, through a geographically
distributed, resilient network of 36 European
organisations
Our vision is to enable European
researchers and practitioners
from any research discipline to
preserve, find, access, and
process data in a trusted
environment, as part of a
Collaborative Data
Infrastructure
EUDAT Vision & Mission
● Vision: Data is shared and
preserved across borders and
disciplines thereby enhancing the
value and quality of research at
large.
● Mission: To enable data
stewardship within and between
European Research Communities
through a Collaborative Data
Infrastructure, a common model
and service infrastructure for
managing data spanning all
European research data centres
and community data repositories.
What is the EUDAT CDI?
• The EUDAT CDI is a collaboration
between Service Providers and
Research Communities working as part
of a common framework for
developing and operating an
interoperable layer of common data
services
• Generic Service Providers have
regional, organisational or national
mandates to support scientific
research, usually from different
disciplines.
• Thematic Service Providers are
(discipline-specific) organisations
mandated to support a
well-defined scientific community
or group of users.
Community-Driven Solutions
PHYSICAL SCIENCES
& ENGINEERING
SOCIAL SCIENCES &
HUMANITIES
MATERIALS &
ANALYTICAL FACILITIES
ENVIRONMENTAL SCIENCES
MAPPER
BIOMEDICAL & MEDICAL
SCIENCES
EUDAT services (the so called B2 Service Suite) are
designed, built and implemented based on user
community requirements.
• EUDAT started in 2011 as an initiative to face the
data deluge and the increasing complexities and
costs of isolated solutions
• EUDAT initiative funded by EC projects
• EUDAT 2011-2014 25 partners 16ME
• EUDAT2020 2015-2018 37 partners 20ME
• Participate in European Open Science Cloud:
• EOSC-hub 2018-2020 100 partners 33ME
A bit of EUDAT history
EUDAT services suite
• EUDAT offers a complete set of research
data services, expertise and technology
solutions to all European scientists and
researchers.
• These shared services and storage resources
are distributed across 15 European countries.
• Data are safely stored alongside some of
Europe’s most powerful supercomputers.
EUDAT Services Suite
EUDAT Services Suite
http://www.eudat.eu/services
Secure Access to Services
b2access.eudat.eu
www.eudat.eu
B2ACCESS
B2ACCESS is an easy-to-use and secure authentication
and authorization platform which can be integrated
with any service and supports different methods of
authentication.
• The federated cross-infrastructure Authorisation and
Authentication Framework
• Enables single sign-on access to the EUDAT services
• Easy to use and secure
• Developed on top of the Unity Open Source
security framework
What is B2ACCESS?
b2access.eudat.eu
• EUDAT users to authenticate themselves using a
variety of credentials. The following log-in options
are supported:
• User's Home Organisation Identity Provider
• Social account
• B2ACCESS ID
Using B2ACCESS
In order to support a
wide range of IdPs we
have joined the EduGain
federation!
b2access.eudat.eu
• End users can
access the
portal via this
link
https://b2acc
ess.eudat.eu/
• This portal
allows the user
to log in using
one of three
different
methods
Account Registration
b2access.eudat.eu
• In order to register with B2ACCESS, you need to first
log in
• After log in, you can register with the B2ACCESS
system, to create your unique B2ACCESS account
• If you log in with a credential not associated with
your B2ACCESS account, you can choose to
associate it with your B2ACCESS account, or create
another one
Registration is a two-stage
process
b2access.eudat.eu
• Use the search bar to seek, then click the name of your home
organisation in the Log in with your Organisation ID tab and click
Authenticate
• You are then redirected to the login page of your home
organisation.
• Provide your credentials and login.
• After successful login, if you are not registered yet with these
credentials, you will be offered two possibilities:
• Register an account: a new local account will be created
• Associate an account: an existing local account will be
associated with your external identity
• Fill in the registration form presented
• Agree to the Terms of Use and Data Privacy Statement and submit
• B2ACCESS will send you an email confirming that your registration
request was accepted
Registering-Home Organisation
Identity Provider
b2access.eudat.eu
• Click the Google Account link in the Google Authentication tab and
click Authenticate
• You are then redirected to the login page of Google.
• Provide your credentials and login.
• Give Google permission to publish your attributes to B2ACCESS
• If you are not registered yet, you will be offered two possibilities:
• Register an account: a new local account will be created
• Associate an account: an existing local account will be associated
with your Google identity
• Fill in the name of your home organisation and (optionally) apply for
membership in one of the presented groups
• Agree to the Terms of Use and Data Privacy Statement and submit
• B2ACCESS will send you an email confirming that your registration
request was accepted
Registering – Social Account
b2access.eudat.eu
• Click on the Register a new account link
• You will be offered three registration forms to choose from:
• OAuth Client Registration Form (not covered in this tutorial)
• Create B2ACCESS Account (username only)
• Create B2ACCESS Account (certificate + optional username)
• Choose Create B2ACCESS Account (username only) - here you have to fill
in the required data
• Or choose Create B2ACCESS Account (certificate + optional username) –
for this a valid X.509 certificate installed in your browser can reduce the
amount of typing required
• Example DN: CN=joe user, O=Example University, OU=students, C=TV
• Agree to the Terms of Use and Data Privacy Statement and submit
Registering – B2ACCESS ID
b2access.eudat.eu
Logging In
• After registering
you can log in
with your
B2ACCESS ID at
https://b2access.
eudat.eu/
• You can log in
using either your
organisational ID,
social ID
or B2ACCESS ID.
b2access.eudat.eu
• Click the name of your Home Organisation in
the Log in with your Organisation ID tab:
• Scroll through the list to find your Home
Organisation
• Or type the name of your Home Organisation
in the search box
• After selecting your Home Organisation, click
the Authenticate button
• You are redirected to the log-in page provided by
your home organisation. Provide your credentials
and login.
Log In - Home Organisation
Identity Provider
b2access.eudat.eu
• Click the Google Account link in the Google
Authentication tab and click Authenticate
• Provided that you have previously registered, you
will automatically login
Log in – Social Account
b2access.eudat.eu
• Click the Login with native B2ACCESS ID 
• Fill in your username and password in the two input
fields and click Authenticate
• Provided that you have previously registered, you
will automatically login
Log in – B2ACCESS ID
b2access.eudat.eu
• You may not get a “Registration successful” message.
• This is a known issue; registrations are successful
irrespective of that.
• Sometimes the captcha appears only partially on the
screen.
• Cancelling and retrying seems to work.
• B2ACCESS requires certain attributes provided by your
Home Organisation Identity Provider. If these attributes
are not provided, login / registration will fail. 
• You can inform the EUDAT support team via this link
http://eudat.eu/support-request?service=B2ACCESS
Possible Issues
b2access.eudat.eu
Profile Management
• To access your user profile
page, please log in
https://b2access.eudat.eu/
• You can see details about
your account
• You can schedule to
immediately remove, or
disable and in the future
deactivate your account.
b2access.eudat.eu
Temporary Account Deactivation
• If necessary, accounts can be temporarily
deactivated for a chosen number of days.
• To do so-
• Log in to B2ACCESS- Profile management page -
Click Remove account button.
• Select the option Disable immediately and remove after a
grace period. Choose the number of days you want the
account to be suspended.
• Confirm your choice.
• The account  will be automatically removed if the
user does not log in during this deactivation period.
Account Deactivation and
Removal
b2access.eudat.eu
Permanent Account Removal
• To remove an account:
• Log in to B2ACCESS. - Profile management page.
Click Remove account button.
• Select the option Remove immediately.
• Confirm your choice.
• Removing or deactivating an account with one of your
identities does not affect accounts registered with other
identities. E.g. if you remove your account registered with
your Google identity you are still able to use your
native B2ACCESS account.  
• You can register a new account with the same identity and
same data (e.g. membership in the groups) after removing
the old one.
Account Deactivation and
Removal
b2access.eudat.eu
Profile Management
• To access your user profile
page, please log in
https://b2access.eudat.eu/
• You can see details about
your account
• You can schedule to
immediately remove, or
disable and in the future
deactivate your account.
• You can also manage your
credentials
b2access.eudat.eu
Credentials Management
• Add or change your
B2ACCESS password
b2access.eudat.eu
Credentials Management
• Add or change your
B2ACCESS password
b2access.eudat.eu
b2access.eudat.eu
• An easy-to-use and secure
authentication and
authorization platform
integrated with any services
• The user may log in by using
different methods of
authentication:
• Home organisation identity
provider
• Social ID
• EUDAT ID
• Allows group-, community-
and service managers to
specify authorisation decisions
Features:
• Easy integration in any service
• Reliable and light-weight
• Powerful management interface
b2drop.eudat.eu
www.eudat.eu
Sync and Share Research Data
B2DROP
EUDAT’s Personal Cloud Storage Service
B2DROP is a secure and trusted data exchange service for
researchers and scientists to keep their research data
synchronized and up-to-date and to exchange with others.
b2drop.eudat.eu
• Store and exchange data with
colleagues and team members,
including research data not
finalized for publishing
• share data with fine-grained
access controls
• synchronize multiple versions of
data across different platforms
An ideal solution for researchers and scientists to:
Features:
• 20GB storage per user
• Trusted storage: data stays in
Europe
• Daily tape backups of all files
Introduction
b2drop.eudat.eu
What type of data can I store?
• Any kind of temporary research data, uploaded
from your local or departmental storage device as
digital objects
• Primary data or processed data
• Both empirical and theoretical data
• Data as the basis for a publication
• Any kind of format and file: papers, spreadsheets,
audio-visual media, provided the data source or
purpose of the data has a scientific background.
b2drop.eudat.eu
Terms and Conditions
• For researchers and communities to share and store
research data.
• Not for personal, recreational, political or commercial
use
• No unlawful or inappropriate content
• Potential sanctions: account suspension, termination,
deletion of content or criminal proceedings
• Availability defined by SLA – no guaranteed availability
at any specific instance
Complete text:
https://b2drop.eudat.eu/themes/b2drop/terms-of-use.html
b2drop.eudat.eu
Security
• Your privacy is important to us. Only you and those you
share your files with can see your data. In urgent matters
an administrator could access your files
• Data are stored at Juelich Supercomputing Centre
• Daily backups of all files in B2DROP are taken and kept
on tape in a different location at Juelich
• User Information security
• Also stored at Juelich
• User info is not encrypted
• Transfer to 3rd
party (e.g. in case of moving the
service to another partner): b2drop.eudat.eu would
be moved to a different location
b2drop.eudat.eu
Using the web interface 1/4
• Upload of a file (max. 10 GB)
• Click the “+” button
• Click the “Upload” menu
• Browse your computer, select
a file and click “Open”.
• …or simply drag and drop
onto the B2DROP window
• Keeping versions
• Files with similar names will be
noticed by B2DROP: “One file
conflict”. You can choose
what version(s) you’d like to
keep.
b2drop.eudat.eu
On B2DROP Versioning
• Automatic file versioning
• Access to the previous versions is straightforward
on the web GUI and the desktop client
• The latest file gets overwritten by the selected
version, with other versions retained.
• To preserve disk space, B2DROP preserves a
subset of the versions, progressively reducing the
number of retained versions as time goes by.
Note that B2DROP removes older saved versions
and/or stops maintaining versions when the user
exceeds 50% of their quota.
b2drop.eudat.eu
Using the web interface 2/4
• Create a folder
• Click “+”, then “Folder”
• Name folder + enter
• Create a new text file
• Click “+”, then “Text file”
• Name file + enter
• Use the pop-up editor to edit the file
• Exiting the editor saves the file
• Rename, delete and download files and
folders
• Select the object to operate on
• Click the “…” button
• Select the desired option
b2drop.eudat.eu
Using the web interface 3/4
• Create new contacts
• Click dropdown menu next to “Files”
• Select “Contacts”
• Click “+ New contact”
• Or import from Variant Call Format file
• Click on “Settings”, then “Import”
• Create new groups
• Select a contact
• Add a Group name in the “Groups”
field
b2drop.eudat.eu
Using the web interface 4/4
• Sharing files and folders
• Click “Files” from “Contacts”
dropdown
• Select object to share and click
the share icon
• Via contact or e-mail address
• Add password protection, allow
upload access, set an expiration
time on the sharing
• Unsharing: by clicking the ticked
box ‘Share link’.
b2drop.eudat.eu
Installing the B2DROP client
• To install the desktop app:
• Click on your username on the right
• Select “Personal”
• Click “Sync clients” on the left
• Click on the appropriate app. You will be
directed to the ownCloud website.
• Select Windows, Mac or Linux as needed and
follow the instructions
• After installing you need to configure the program by
entering the address https://b2drop.eudat.eu/
• Please log in using your B2DROP username (email
address) and password
• ownCloud will now appear on your file browser
Note that using this client allows you to work on your files while offline,
and synchronise when you reconnect to the network.
My Username
b2drop.eudat.eu
Mount your folder
• You can mount B2DROP as a drive to your desktop
machines via WebDAV
• Your B2DROP folder then appears in your file browser
• You can work on files, which will synchronise
automatically with the B2DROP server on save
• Supported for
• MacOS
• Linux Distributions
• Windows
Note that mounting your folder through WebDAV only works
while you are connected to the network.
b2drop.eudat.eu
Mount your folder - MacOS
Mount B2DROP in your “Finder”:
1. Click on “Go” on the drop-down menu and then
“Connect to server”
2. Enter
https://b2drop.eudat.eu/remote.php/webdav/
when prompted
3. Log in with your username (email address) and
password.
You can also mount B2DROP with Cyberduck by
providing the above-mentioned information to the
client.
b2drop.eudat.eu
Mount your folder - Linux
You can mount B2DROP with NAUTILUS:
1. Select “Go to File → Connect to server”
2. Type in: davs://b2drop.eudat.eu/remote.php/webdav
3. Log in with your username (email address) and password.
Mounting via davfs is also possible, but it requires sudo
access.
Log in with your username (email address) and password
To unmount use the following command:
The instructions above have been tested on Ubuntu but they should
work for every Linux distribution supporting the NAUTILUS or GNOME
file system.
b2drop.eudat.eu
Mount your folder - Windows
Map B2DROP as a network drive:
1. Enter
https://b2drop.eudat.eu/remote.php/webdav/ as
a folder
2. Log in with your username (email address) and
password.
Note that you may need to set your computer to
allow Basic Authentication; please follow the Microsoft
instructions for this. Because B2DROP is available under
https, Option "1 - Basic authentication enabled for
Secure Sockets Layer (SSL) shares only" should suffice
for Windows Vista and later.
b2drop.eudat.eu
Support
https://eudat.eu/support-request?Service=B2DROP
Store and Publish Research Data
b2share.eudat.eu
www.eudat.eu
B2SHARE
B2SHARE is a user-friendly, reliable and trustworthy way for
researchers, scientific communities and scientists to store and
publish small-scale research data from diverse contexts.
b2share.eudat.eu
• Store data safely at a trusted
and certified data centre
• Preserve data to guarantee
long-term persistence
• Publish data and make it
findable and accessible
A winning solution for researchers, scientists and
communities to:
Features:
• Metadata management
• Permanent PIDs
• Open Access support
b2share.eudat.eu
What’s the B2SHARE added-value?
Your data is ...
• Hosted so there are no hardware or network
worries on depositor side
• Assigned a permanent ID which means it is
always retraceable to you
• Stored alongside queryable & findable
metadata and automatically available via the
B2FIND metadata catalogue
• Managed and stored by a trusted and certified
data centre
b2share.eudat.eu
What can users do?
• Users can …
• Search for data sets that are publicly accessible
• Deposit and share data (only registered users)
• Download data (only registered users)
• What happens to data once users have deposited it?
• EUDAT has no claim over the data
deposited in B2SHARE and depositors
remain entirely responsible for the
data they deposit.
• EUDAT retains the right of archiving, i.
e. creating replicas at trusted centers
to take care of long-term persistence.
b2share.eudat.eu
What data can users upload?
• Research data
• Primary data
• Processed data
• Data as basis for
a publication
• Empirical data
• Theoretical data
In virtually any kind of format....
•Papers
•Spreadsheets
•Audio-visual media,
Just a note...
Make sure that you are allowed to upload your data and are
compliant with all data protection laws regarding sensitive data and
restrictions on where this data is stored. Unrelated personal data
should not be stored on B2SHARE.
• Data source or purpose of the data is scientific
• Unlimited file uploads.
• 2GB per file
(for larger files then contact EUDAT via
http://eudat.eu/support-request?Service=B2SHARE
)
b2share.eudat.eu
Search for data sets
• Click on “Search” at https://b2share.eudat.eu
Data Collections and PIDs
b2share.eudat.eu
Register to deposit and share data
• Easy and quick registration at https://b2share.eudat.eu
b2share.eudat.eu
How do I deposit data? (1/2)
• Click on “Deposit”
b2share.eudat.eu
How do I deposit data? (2/2)
• 3 simple steps:
2. Select a domain or project
specific metadata set to describe
the resource(s)
1. Select and upload one or several
data resources either by dragging
and dropping from your file browser
3. Fill in the metadata form: the more information you add
the easier your data will be to find for others
Open Access:
• Select “ON” to make your data
accessible to registered members only
• Select “OFF” and everyone can see your
data
Find Research Data
b2find.eudat.eu
www.eudat.eu
B2FIND
B2FIND is a simple, user-friendly metadata catalogue of
research data collections stored in EUDAT data centres
and other repositories.
b2drop.eudat.eu
What is B2FIND?
B2FIND
• is the metadata service of EUDAT
• is based on a comprehensive joint
metadata catalogue of research
data collections stored in EUDAT
data centres and other
repositories
• provides a powerful and
user-friendly discovery service on
metadata covering a wide range
of research communities
b2find.eudat.eu
This image is licensed under the Creative
Commons CC0 Public Domain
Taken from
http://res.publicdomainfiles.com/pdf_view
/60/13534595416502.png
b2drop.eudat.eu
Where is B2FIND in the EUDAT suite?
B2FIND
• stores metadata
through other EUDAT
services such as
B2SHARE to provide
access to data
objects within the
EUDAT CDI
• is used in inter-service
use cases, e.g. to
identify links to data
collections, which will
be transferred to HPC
platforms through
B2STAGE
b2drop.eudat.eu
With B2FIND you can...
B2FIND – Find Research Data
• Browse through the large amounts of
data that EUDAT stores from a broad
range of disciplines
• Search the whole catalogue, which
comprises collections of scientific
data, irrespective of their origin,
discipline or community
• Carry out faceted searches for
• geospatial or temporal coverage
and
• textual properties, such as
‘Creator’ or ‘Publisher’ and many
other facets
• Find and access scientific data
objects relevant for your work
b2drop.eudat.eu
Data from a
great selection of subjects
B2FIND has a truly cross-community
approach
• Metadata are harvested from a
wide range of research areas
• From Climate Research to
Social Sciences
• From Biodiversity to Linguistics
• From Archaeology to
Seismology
• This necessitates the transformation
and homogenisation of the diverse
metadata to achieve the usage of
a common vocabulary for the
whole catalogue This image is licensed under the Creative
Attribution-NoDerivs 2.0 Generic (CC
BY-ND 2.0), taken from
https://www.flickr.com/photos/denverjeffr
ey/304220561
b2find.eudat.eu
Metadata Ingestion Workflow
MD Generation
MD Harvesting
MD Mapping and
Validation
MD Uploading and
Indexer
Data
Provider
on
Community site
Service
Provider
on
EUDAT site
MD Repository
and Provider
• The transformation process
is part of the metadata
ingestion (MD Mapping
and Validation) shown in
the diagram
• The individual workflow
steps are described in
detail in the related
presentation ‘B2FIND
Integration’
• Note: While the original
metadata are restructured,
re-formatted and indexed
to allow discovery and
faceted search there is no
change to the content
B2FIND communities
B2FIND – Find Research Data
• B2FIND initially indexed metadata
• harvested from EUDAT core
communities (such as ENES and
CLARIN) and
• stored through the B2SHARE
EUDAT service
• EUDAT extended and is extending
the service to other external and
reliable data and metadata
providers
• The list of currently integrated
communities is available at
http://b2find.eudat.eu/group/
b2drop.eudat.eu
B2FIND MD Catalogue
Ingestion status
• > 470000 records
• 17 communities
• (16 external + B2SHARE)
b2drop.eudat.eu
B2FIND Discovery Portal
Search and browse datasets
• Search and browse
all data sets via
Keyword searches
• Results displayed in
easy to read
format and listed in
order of relevance
to your search
B2FIND provides ‘faceted’
search for
• Free text
• Location
• Temporal coverage
• Publication year
• Textual facets:
• Communities
• Tags
• Creator
• Discipline
• Publisher etc.
B2FIND Discovery Portal
Faceted Search
Dataset view provides
• Display of metadata
• Geo spatial extent
• Title and abstract
• Associated tags
• Table of field-value pairs
• Links to data resources
b2drop.eudat.eu
Data Access
Resolved link to
data object
Link to (another landing page of)
the data object
View of originally
harvested metadata record
b2find.eudat.eu
• Seek data objects and collections
using powerful metadata searches
• Catalogue community data by
means of selected metadata
• Browse through multi-disciplinary
data collections filtered by
content, provenance and
temporal keywords
A metadata catalogue service to:
Features:
• Simple to use
• Standards-based
• Comprehensive catalogue
Replicate Research Data Safely
eudat.eu/b2safe
www.eudat.eu
B2SAFE
B2SAFE is a robust, safe and highly available service which allows
community and departmental repositories to implement data
management policies on research data that can be distributed
across multiple administrative domains in a trustworthy manner.
eudat.eu/b2safe
• Replicate research data into
multiple secure data stores
• Preserve research data in the
long term
• Steward distributed data via
policy-driven workflows
• Co-locate data with different
communities
• Benefit from economies of scale
The ideal solution for repositories
and archives to:
Features:
• Large-scale storage
• Robust, resilient, highly available
• Policy-driven workflows
• Permanent Persistent Identifiers
Get Data to Computation
eudat.eu/b2stage
www.eudat.eu
B2STAGE
B2STAGE is a reliable, efficient, light-weight and easy-to-use
service to transfer research data sets between EUDAT storage
resources and high-performance computing (HPC) workspaces
eudat.eu/b2stage
• Move large amounts of data
between data stores and
high-performance compute
resources
• Re-ingest computational results
back into EUDAT
• Deposit large data sets onto
EUDAT resources for long-term
preservation
Facilitating communities to:
Features:
• High-speed transfer
• Reliable and light-weight
• Manages permanent PIDs
Data Discovery and Identification
b2handle.eudat.eu
www.eudat.eu
B2HANDLE
B2HANDLE provides an abstraction layer to a physical
location of a data object allowing researchers to
reliably cite and refer to data in the long term.
b2handle.eudat.eu
• Enables EUDAT services and user
communities to assign PIDs to
different kinds of managed
objects stored in the EUDAT CDI.
• Follows policies to register data
and make it long term referable
and citable
• Provides lasting references to
the physical location of data
objects
Features:
• Reliability through mutual PID mirroring
• Python library
• Simple integration with any service
For more info:
b2drop.eudat.eu
eudat.eu/services/userdoc/b2drop
b2share.eudat.eu
eudat.eu/services/userdoc/b2share
eudat.eu/services/userdoc/b2safe
b2find.eudat.eu
eudat.eu/services/userdoc/b2find
b2access.eudat.eu
eudat.eu/services/userdoc/b2access-usage
eudat.eu/services/userdoc/b2handle
eudat.eu/b2stage
eudat.eu/services/userdoc/b2stage
Extra tools
• License selector:
• Helps you to choose the right license for your
data
• Accessible via b2share
https://www.eudat.eu/services/userdoc/license-selector
• Easy data management plan creator:
• Allows the creation of data management plans
https://easydmp.eudat.eu
Thank you!
pablo.rodenas@bsc.es

More Related Content

Similar to EUDAT services overview

OSFair2017 Workshop | Service provisioning for excellent sciences
OSFair2017 Workshop | Service provisioning for excellent sciencesOSFair2017 Workshop | Service provisioning for excellent sciences
OSFair2017 Workshop | Service provisioning for excellent sciencesOpen Science Fair
 
NDS Relevant Update from the NIH Data Science (ADDS) Office
NDS Relevant Update from the NIH Data Science (ADDS) OfficeNDS Relevant Update from the NIH Data Science (ADDS) Office
NDS Relevant Update from the NIH Data Science (ADDS) OfficePhilip Bourne
 
A Collaborative Environment to Boost Co-Production of Sustainable Public Serv...
A Collaborative Environment to Boost Co-Production of Sustainable Public Serv...A Collaborative Environment to Boost Co-Production of Sustainable Public Serv...
A Collaborative Environment to Boost Co-Production of Sustainable Public Serv...Diego López-de-Ipiña González-de-Artaza
 
Trust and identity
Trust and identityTrust and identity
Trust and identityJisc
 
Integrating and managing services for the European Open Science Cloud
Integrating and managing services for the European Open Science CloudIntegrating and managing services for the European Open Science Cloud
Integrating and managing services for the European Open Science CloudOpenAIRE
 
Bonazzi commons bd2 k ahm 2016 v2
Bonazzi commons bd2 k ahm 2016 v2Bonazzi commons bd2 k ahm 2016 v2
Bonazzi commons bd2 k ahm 2016 v2Vivien Bonazzi
 
COMSODE networking session at ICT Lisbon 2015
COMSODE networking session at ICT Lisbon 2015COMSODE networking session at ICT Lisbon 2015
COMSODE networking session at ICT Lisbon 2015Comsode - FP7 project
 
EGI-EUDAT interoperability| www.eudat.eu |
EGI-EUDAT interoperability| www.eudat.eu | EGI-EUDAT interoperability| www.eudat.eu |
EGI-EUDAT interoperability| www.eudat.eu | EUDAT
 
Fostering multi-stakeholder collaboration through co-production and rewarding
Fostering multi-stakeholder collaboration through co-production and rewarding Fostering multi-stakeholder collaboration through co-production and rewarding
Fostering multi-stakeholder collaboration through co-production and rewarding Diego López-de-Ipiña González-de-Artaza
 
Data Harvesting, Curation and Fusion Model to Support Public Service Recommen...
Data Harvesting, Curation and Fusion Model to Support Public Service Recommen...Data Harvesting, Curation and Fusion Model to Support Public Service Recommen...
Data Harvesting, Curation and Fusion Model to Support Public Service Recommen...Gayane Sedrakyan
 
Data Harvesting, Curation and Fusion Model to Support Public Service Recommen...
Data Harvesting, Curation and Fusion Model to Support Public Service Recommen...Data Harvesting, Curation and Fusion Model to Support Public Service Recommen...
Data Harvesting, Curation and Fusion Model to Support Public Service Recommen...Citadelh2020
 
The European Innovation Partnership on Water Online Marketplace
The European Innovation Partnership on Water Online MarketplaceThe European Innovation Partnership on Water Online Marketplace
The European Innovation Partnership on Water Online MarketplaceMartin Kaltenböck
 
Summary of Day 1
Summary of Day 1Summary of Day 1
Summary of Day 1Europeana
 
BS 8878: Systematic Approaches to Documenting Web Accessibility Policies and ...
BS 8878: Systematic Approaches to Documenting Web Accessibility Policies and ...BS 8878: Systematic Approaches to Documenting Web Accessibility Policies and ...
BS 8878: Systematic Approaches to Documenting Web Accessibility Policies and ...lisbk
 
Deep-Learning and HPC to Boost Biomedical applications for health
Deep-Learning and HPC to Boost Biomedical applications for healthDeep-Learning and HPC to Boost Biomedical applications for health
Deep-Learning and HPC to Boost Biomedical applications for healthBig Data Value Association
 

Similar to EUDAT services overview (20)

OSFair2017 Workshop | Service provisioning for excellent sciences
OSFair2017 Workshop | Service provisioning for excellent sciencesOSFair2017 Workshop | Service provisioning for excellent sciences
OSFair2017 Workshop | Service provisioning for excellent sciences
 
NDS Relevant Update from the NIH Data Science (ADDS) Office
NDS Relevant Update from the NIH Data Science (ADDS) OfficeNDS Relevant Update from the NIH Data Science (ADDS) Office
NDS Relevant Update from the NIH Data Science (ADDS) Office
 
Inti escem-tours2012-acs
Inti escem-tours2012-acsInti escem-tours2012-acs
Inti escem-tours2012-acs
 
A Collaborative Environment to Boost Co-Production of Sustainable Public Serv...
A Collaborative Environment to Boost Co-Production of Sustainable Public Serv...A Collaborative Environment to Boost Co-Production of Sustainable Public Serv...
A Collaborative Environment to Boost Co-Production of Sustainable Public Serv...
 
Trust and identity
Trust and identityTrust and identity
Trust and identity
 
Integrating and managing services for the European Open Science Cloud
Integrating and managing services for the European Open Science CloudIntegrating and managing services for the European Open Science Cloud
Integrating and managing services for the European Open Science Cloud
 
Bonazzi commons bd2 k ahm 2016 v2
Bonazzi commons bd2 k ahm 2016 v2Bonazzi commons bd2 k ahm 2016 v2
Bonazzi commons bd2 k ahm 2016 v2
 
COMSODE networking session at ICT Lisbon 2015
COMSODE networking session at ICT Lisbon 2015COMSODE networking session at ICT Lisbon 2015
COMSODE networking session at ICT Lisbon 2015
 
CSPA: The Future of Statistical Production
CSPA: The Future of Statistical ProductionCSPA: The Future of Statistical Production
CSPA: The Future of Statistical Production
 
EGI-EUDAT interoperability| www.eudat.eu |
EGI-EUDAT interoperability| www.eudat.eu | EGI-EUDAT interoperability| www.eudat.eu |
EGI-EUDAT interoperability| www.eudat.eu |
 
Husqvarna Group
Husqvarna GroupHusqvarna Group
Husqvarna Group
 
Fostering multi-stakeholder collaboration through co-production and rewarding
Fostering multi-stakeholder collaboration through co-production and rewarding Fostering multi-stakeholder collaboration through co-production and rewarding
Fostering multi-stakeholder collaboration through co-production and rewarding
 
Data Harvesting, Curation and Fusion Model to Support Public Service Recommen...
Data Harvesting, Curation and Fusion Model to Support Public Service Recommen...Data Harvesting, Curation and Fusion Model to Support Public Service Recommen...
Data Harvesting, Curation and Fusion Model to Support Public Service Recommen...
 
Data Harvesting, Curation and Fusion Model to Support Public Service Recommen...
Data Harvesting, Curation and Fusion Model to Support Public Service Recommen...Data Harvesting, Curation and Fusion Model to Support Public Service Recommen...
Data Harvesting, Curation and Fusion Model to Support Public Service Recommen...
 
The European Innovation Partnership on Water Online Marketplace
The European Innovation Partnership on Water Online MarketplaceThe European Innovation Partnership on Water Online Marketplace
The European Innovation Partnership on Water Online Marketplace
 
PrácticaParticipación-INTERLINK-realizingcoproduction_final.pdf
PrácticaParticipación-INTERLINK-realizingcoproduction_final.pdfPrácticaParticipación-INTERLINK-realizingcoproduction_final.pdf
PrácticaParticipación-INTERLINK-realizingcoproduction_final.pdf
 
Final .pptx
Final .pptxFinal .pptx
Final .pptx
 
Summary of Day 1
Summary of Day 1Summary of Day 1
Summary of Day 1
 
BS 8878: Systematic Approaches to Documenting Web Accessibility Policies and ...
BS 8878: Systematic Approaches to Documenting Web Accessibility Policies and ...BS 8878: Systematic Approaches to Documenting Web Accessibility Policies and ...
BS 8878: Systematic Approaches to Documenting Web Accessibility Policies and ...
 
Deep-Learning and HPC to Boost Biomedical applications for health
Deep-Learning and HPC to Boost Biomedical applications for healthDeep-Learning and HPC to Boost Biomedical applications for health
Deep-Learning and HPC to Boost Biomedical applications for health
 

More from maredata

The Spanish Open Research Data Network. Lessons learned
The Spanish Open Research Data Network. Lessons learnedThe Spanish Open Research Data Network. Lessons learned
The Spanish Open Research Data Network. Lessons learnedmaredata
 
Ernest Abadal. Maredata 2018: presentacion
Ernest Abadal. Maredata 2018: presentacionErnest Abadal. Maredata 2018: presentacion
Ernest Abadal. Maredata 2018: presentacionmaredata
 
José Norberto Mazón: Integración de los datos en entornos institucionales.
José Norberto Mazón: Integración de los datos en entornos institucionales. José Norberto Mazón: Integración de los datos en entornos institucionales.
José Norberto Mazón: Integración de los datos en entornos institucionales. maredata
 
Eva Méndez: Política europea y EOSC
Eva Méndez: Política europea y EOSCEva Méndez: Política europea y EOSC
Eva Méndez: Política europea y EOSCmaredata
 
Remedios Melero Síntesis de recomendaciones sobre datos de investigación
Remedios Melero Síntesis de recomendaciones sobre datos de investigaciónRemedios Melero Síntesis de recomendaciones sobre datos de investigación
Remedios Melero Síntesis de recomendaciones sobre datos de investigaciónmaredata
 
Antonia Ferrer: Aplicación del blockchain a los datos
Antonia Ferrer: Aplicación del blockchain a los datosAntonia Ferrer: Aplicación del blockchain a los datos
Antonia Ferrer: Aplicación del blockchain a los datosmaredata
 
Ernest Abadal: Los resultados de la red
Ernest Abadal: Los resultados de la redErnest Abadal: Los resultados de la red
Ernest Abadal: Los resultados de la redmaredata
 
Remedios Melero Recomendaciones finales
Remedios Melero Recomendaciones finales Remedios Melero Recomendaciones finales
Remedios Melero Recomendaciones finales maredata
 
Laura Frías
Laura FríasLaura Frías
Laura Fríasmaredata
 
Gobinda Chowdhury
Gobinda ChowdhuryGobinda Chowdhury
Gobinda Chowdhurymaredata
 
Taller Gestión de datos de investigación
Taller Gestión de datos de investigaciónTaller Gestión de datos de investigación
Taller Gestión de datos de investigaciónmaredata
 
CuratorE-UC3M
CuratorE-UC3MCuratorE-UC3M
CuratorE-UC3Mmaredata
 
Europa requisitos y servicios en torno a los datos de investigacion
Europa requisitos y servicios en torno a los datos de investigacionEuropa requisitos y servicios en torno a los datos de investigacion
Europa requisitos y servicios en torno a los datos de investigacionmaredata
 
Modelos para publicar, consumir y medir la reutilización de los datos derivad...
Modelos para publicar, consumir y medir la reutilización de los datos derivad...Modelos para publicar, consumir y medir la reutilización de los datos derivad...
Modelos para publicar, consumir y medir la reutilización de los datos derivad...maredata
 
Lineas de investigación grupo KIMO
Lineas de investigación grupo KIMOLineas de investigación grupo KIMO
Lineas de investigación grupo KIMOmaredata
 
Datos de investigación en el marco del proyecto "Acceso abierto a la ciencia ...
Datos de investigación en el marco del proyecto "Acceso abierto a la ciencia ...Datos de investigación en el marco del proyecto "Acceso abierto a la ciencia ...
Datos de investigación en el marco del proyecto "Acceso abierto a la ciencia ...maredata
 
Pre evento iodc2
Pre evento iodc2Pre evento iodc2
Pre evento iodc2maredata
 
Maredata 20161005
Maredata 20161005Maredata 20161005
Maredata 20161005maredata
 
Makx dekkers metadatos, datos y licencias
Makx dekkers   metadatos, datos y licenciasMakx dekkers   metadatos, datos y licencias
Makx dekkers metadatos, datos y licenciasmaredata
 
Hercules maredata-octubre2016-final
Hercules maredata-octubre2016-finalHercules maredata-octubre2016-final
Hercules maredata-octubre2016-finalmaredata
 

More from maredata (20)

The Spanish Open Research Data Network. Lessons learned
The Spanish Open Research Data Network. Lessons learnedThe Spanish Open Research Data Network. Lessons learned
The Spanish Open Research Data Network. Lessons learned
 
Ernest Abadal. Maredata 2018: presentacion
Ernest Abadal. Maredata 2018: presentacionErnest Abadal. Maredata 2018: presentacion
Ernest Abadal. Maredata 2018: presentacion
 
José Norberto Mazón: Integración de los datos en entornos institucionales.
José Norberto Mazón: Integración de los datos en entornos institucionales. José Norberto Mazón: Integración de los datos en entornos institucionales.
José Norberto Mazón: Integración de los datos en entornos institucionales.
 
Eva Méndez: Política europea y EOSC
Eva Méndez: Política europea y EOSCEva Méndez: Política europea y EOSC
Eva Méndez: Política europea y EOSC
 
Remedios Melero Síntesis de recomendaciones sobre datos de investigación
Remedios Melero Síntesis de recomendaciones sobre datos de investigaciónRemedios Melero Síntesis de recomendaciones sobre datos de investigación
Remedios Melero Síntesis de recomendaciones sobre datos de investigación
 
Antonia Ferrer: Aplicación del blockchain a los datos
Antonia Ferrer: Aplicación del blockchain a los datosAntonia Ferrer: Aplicación del blockchain a los datos
Antonia Ferrer: Aplicación del blockchain a los datos
 
Ernest Abadal: Los resultados de la red
Ernest Abadal: Los resultados de la redErnest Abadal: Los resultados de la red
Ernest Abadal: Los resultados de la red
 
Remedios Melero Recomendaciones finales
Remedios Melero Recomendaciones finales Remedios Melero Recomendaciones finales
Remedios Melero Recomendaciones finales
 
Laura Frías
Laura FríasLaura Frías
Laura Frías
 
Gobinda Chowdhury
Gobinda ChowdhuryGobinda Chowdhury
Gobinda Chowdhury
 
Taller Gestión de datos de investigación
Taller Gestión de datos de investigaciónTaller Gestión de datos de investigación
Taller Gestión de datos de investigación
 
CuratorE-UC3M
CuratorE-UC3MCuratorE-UC3M
CuratorE-UC3M
 
Europa requisitos y servicios en torno a los datos de investigacion
Europa requisitos y servicios en torno a los datos de investigacionEuropa requisitos y servicios en torno a los datos de investigacion
Europa requisitos y servicios en torno a los datos de investigacion
 
Modelos para publicar, consumir y medir la reutilización de los datos derivad...
Modelos para publicar, consumir y medir la reutilización de los datos derivad...Modelos para publicar, consumir y medir la reutilización de los datos derivad...
Modelos para publicar, consumir y medir la reutilización de los datos derivad...
 
Lineas de investigación grupo KIMO
Lineas de investigación grupo KIMOLineas de investigación grupo KIMO
Lineas de investigación grupo KIMO
 
Datos de investigación en el marco del proyecto "Acceso abierto a la ciencia ...
Datos de investigación en el marco del proyecto "Acceso abierto a la ciencia ...Datos de investigación en el marco del proyecto "Acceso abierto a la ciencia ...
Datos de investigación en el marco del proyecto "Acceso abierto a la ciencia ...
 
Pre evento iodc2
Pre evento iodc2Pre evento iodc2
Pre evento iodc2
 
Maredata 20161005
Maredata 20161005Maredata 20161005
Maredata 20161005
 
Makx dekkers metadatos, datos y licencias
Makx dekkers   metadatos, datos y licenciasMakx dekkers   metadatos, datos y licencias
Makx dekkers metadatos, datos y licencias
 
Hercules maredata-octubre2016-final
Hercules maredata-octubre2016-finalHercules maredata-octubre2016-final
Hercules maredata-octubre2016-final
 

Recently uploaded

Navi Mumbai Call Girls Service Pooja 9892124323 Real Russian Girls Looking Mo...
Navi Mumbai Call Girls Service Pooja 9892124323 Real Russian Girls Looking Mo...Navi Mumbai Call Girls Service Pooja 9892124323 Real Russian Girls Looking Mo...
Navi Mumbai Call Girls Service Pooja 9892124323 Real Russian Girls Looking Mo...Pooja Nehwal
 
Simulation-based Testing of Unmanned Aerial Vehicles with Aerialist
Simulation-based Testing of Unmanned Aerial Vehicles with AerialistSimulation-based Testing of Unmanned Aerial Vehicles with Aerialist
Simulation-based Testing of Unmanned Aerial Vehicles with AerialistSebastiano Panichella
 
Governance and Nation-Building in Nigeria: Some Reflections on Options for Po...
Governance and Nation-Building in Nigeria: Some Reflections on Options for Po...Governance and Nation-Building in Nigeria: Some Reflections on Options for Po...
Governance and Nation-Building in Nigeria: Some Reflections on Options for Po...Kayode Fayemi
 
OSCamp Kubernetes 2024 | A Tester's Guide to CI_CD as an Automated Quality Co...
OSCamp Kubernetes 2024 | A Tester's Guide to CI_CD as an Automated Quality Co...OSCamp Kubernetes 2024 | A Tester's Guide to CI_CD as an Automated Quality Co...
OSCamp Kubernetes 2024 | A Tester's Guide to CI_CD as an Automated Quality Co...NETWAYS
 
LANDMARKS AND MONUMENTS IN NIGERIA.pptx
LANDMARKS  AND MONUMENTS IN NIGERIA.pptxLANDMARKS  AND MONUMENTS IN NIGERIA.pptx
LANDMARKS AND MONUMENTS IN NIGERIA.pptxBasil Achie
 
The 3rd Intl. Workshop on NL-based Software Engineering
The 3rd Intl. Workshop on NL-based Software EngineeringThe 3rd Intl. Workshop on NL-based Software Engineering
The 3rd Intl. Workshop on NL-based Software EngineeringSebastiano Panichella
 
Call Girls in Sarojini Nagar Market Delhi 💯 Call Us 🔝8264348440🔝
Call Girls in Sarojini Nagar Market Delhi 💯 Call Us 🔝8264348440🔝Call Girls in Sarojini Nagar Market Delhi 💯 Call Us 🔝8264348440🔝
Call Girls in Sarojini Nagar Market Delhi 💯 Call Us 🔝8264348440🔝soniya singh
 
Philippine History cavite Mutiny Report.ppt
Philippine History cavite Mutiny Report.pptPhilippine History cavite Mutiny Report.ppt
Philippine History cavite Mutiny Report.pptssuser319dad
 
Presentation for the Strategic Dialogue on the Future of Agriculture, Brussel...
Presentation for the Strategic Dialogue on the Future of Agriculture, Brussel...Presentation for the Strategic Dialogue on the Future of Agriculture, Brussel...
Presentation for the Strategic Dialogue on the Future of Agriculture, Brussel...Krijn Poppe
 
Night 7k Call Girls Noida Sector 128 Call Me: 8448380779
Night 7k Call Girls Noida Sector 128 Call Me: 8448380779Night 7k Call Girls Noida Sector 128 Call Me: 8448380779
Night 7k Call Girls Noida Sector 128 Call Me: 8448380779Delhi Call girls
 
Work Remotely with Confluence ACE 2.pptx
Work Remotely with Confluence ACE 2.pptxWork Remotely with Confluence ACE 2.pptx
Work Remotely with Confluence ACE 2.pptxmavinoikein
 
Microsoft Copilot AI for Everyone - created by AI
Microsoft Copilot AI for Everyone - created by AIMicrosoft Copilot AI for Everyone - created by AI
Microsoft Copilot AI for Everyone - created by AITatiana Gurgel
 
Motivation and Theory Maslow and Murray pdf
Motivation and Theory Maslow and Murray pdfMotivation and Theory Maslow and Murray pdf
Motivation and Theory Maslow and Murray pdfakankshagupta7348026
 
OSCamp Kubernetes 2024 | Zero-Touch OS-Infrastruktur für Container und Kubern...
OSCamp Kubernetes 2024 | Zero-Touch OS-Infrastruktur für Container und Kubern...OSCamp Kubernetes 2024 | Zero-Touch OS-Infrastruktur für Container und Kubern...
OSCamp Kubernetes 2024 | Zero-Touch OS-Infrastruktur für Container und Kubern...NETWAYS
 
CTAC 2024 Valencia - Sven Zoelle - Most Crucial Invest to Digitalisation_slid...
CTAC 2024 Valencia - Sven Zoelle - Most Crucial Invest to Digitalisation_slid...CTAC 2024 Valencia - Sven Zoelle - Most Crucial Invest to Digitalisation_slid...
CTAC 2024 Valencia - Sven Zoelle - Most Crucial Invest to Digitalisation_slid...henrik385807
 
Exploring protein-protein interactions by Weak Affinity Chromatography (WAC) ...
Exploring protein-protein interactions by Weak Affinity Chromatography (WAC) ...Exploring protein-protein interactions by Weak Affinity Chromatography (WAC) ...
Exploring protein-protein interactions by Weak Affinity Chromatography (WAC) ...Salam Al-Karadaghi
 
Call Girls in Rohini Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Rohini Delhi 💯Call Us 🔝8264348440🔝Call Girls in Rohini Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Rohini Delhi 💯Call Us 🔝8264348440🔝soniya singh
 
OSCamp Kubernetes 2024 | SRE Challenges in Monolith to Microservices Shift at...
OSCamp Kubernetes 2024 | SRE Challenges in Monolith to Microservices Shift at...OSCamp Kubernetes 2024 | SRE Challenges in Monolith to Microservices Shift at...
OSCamp Kubernetes 2024 | SRE Challenges in Monolith to Microservices Shift at...NETWAYS
 
George Lever - eCommerce Day Chile 2024
George Lever -  eCommerce Day Chile 2024George Lever -  eCommerce Day Chile 2024
George Lever - eCommerce Day Chile 2024eCommerce Institute
 
Open Source Strategy in Logistics 2015_Henrik Hankedvz-d-nl-log-conference.pdf
Open Source Strategy in Logistics 2015_Henrik Hankedvz-d-nl-log-conference.pdfOpen Source Strategy in Logistics 2015_Henrik Hankedvz-d-nl-log-conference.pdf
Open Source Strategy in Logistics 2015_Henrik Hankedvz-d-nl-log-conference.pdfhenrik385807
 

Recently uploaded (20)

Navi Mumbai Call Girls Service Pooja 9892124323 Real Russian Girls Looking Mo...
Navi Mumbai Call Girls Service Pooja 9892124323 Real Russian Girls Looking Mo...Navi Mumbai Call Girls Service Pooja 9892124323 Real Russian Girls Looking Mo...
Navi Mumbai Call Girls Service Pooja 9892124323 Real Russian Girls Looking Mo...
 
Simulation-based Testing of Unmanned Aerial Vehicles with Aerialist
Simulation-based Testing of Unmanned Aerial Vehicles with AerialistSimulation-based Testing of Unmanned Aerial Vehicles with Aerialist
Simulation-based Testing of Unmanned Aerial Vehicles with Aerialist
 
Governance and Nation-Building in Nigeria: Some Reflections on Options for Po...
Governance and Nation-Building in Nigeria: Some Reflections on Options for Po...Governance and Nation-Building in Nigeria: Some Reflections on Options for Po...
Governance and Nation-Building in Nigeria: Some Reflections on Options for Po...
 
OSCamp Kubernetes 2024 | A Tester's Guide to CI_CD as an Automated Quality Co...
OSCamp Kubernetes 2024 | A Tester's Guide to CI_CD as an Automated Quality Co...OSCamp Kubernetes 2024 | A Tester's Guide to CI_CD as an Automated Quality Co...
OSCamp Kubernetes 2024 | A Tester's Guide to CI_CD as an Automated Quality Co...
 
LANDMARKS AND MONUMENTS IN NIGERIA.pptx
LANDMARKS  AND MONUMENTS IN NIGERIA.pptxLANDMARKS  AND MONUMENTS IN NIGERIA.pptx
LANDMARKS AND MONUMENTS IN NIGERIA.pptx
 
The 3rd Intl. Workshop on NL-based Software Engineering
The 3rd Intl. Workshop on NL-based Software EngineeringThe 3rd Intl. Workshop on NL-based Software Engineering
The 3rd Intl. Workshop on NL-based Software Engineering
 
Call Girls in Sarojini Nagar Market Delhi 💯 Call Us 🔝8264348440🔝
Call Girls in Sarojini Nagar Market Delhi 💯 Call Us 🔝8264348440🔝Call Girls in Sarojini Nagar Market Delhi 💯 Call Us 🔝8264348440🔝
Call Girls in Sarojini Nagar Market Delhi 💯 Call Us 🔝8264348440🔝
 
Philippine History cavite Mutiny Report.ppt
Philippine History cavite Mutiny Report.pptPhilippine History cavite Mutiny Report.ppt
Philippine History cavite Mutiny Report.ppt
 
Presentation for the Strategic Dialogue on the Future of Agriculture, Brussel...
Presentation for the Strategic Dialogue on the Future of Agriculture, Brussel...Presentation for the Strategic Dialogue on the Future of Agriculture, Brussel...
Presentation for the Strategic Dialogue on the Future of Agriculture, Brussel...
 
Night 7k Call Girls Noida Sector 128 Call Me: 8448380779
Night 7k Call Girls Noida Sector 128 Call Me: 8448380779Night 7k Call Girls Noida Sector 128 Call Me: 8448380779
Night 7k Call Girls Noida Sector 128 Call Me: 8448380779
 
Work Remotely with Confluence ACE 2.pptx
Work Remotely with Confluence ACE 2.pptxWork Remotely with Confluence ACE 2.pptx
Work Remotely with Confluence ACE 2.pptx
 
Microsoft Copilot AI for Everyone - created by AI
Microsoft Copilot AI for Everyone - created by AIMicrosoft Copilot AI for Everyone - created by AI
Microsoft Copilot AI for Everyone - created by AI
 
Motivation and Theory Maslow and Murray pdf
Motivation and Theory Maslow and Murray pdfMotivation and Theory Maslow and Murray pdf
Motivation and Theory Maslow and Murray pdf
 
OSCamp Kubernetes 2024 | Zero-Touch OS-Infrastruktur für Container und Kubern...
OSCamp Kubernetes 2024 | Zero-Touch OS-Infrastruktur für Container und Kubern...OSCamp Kubernetes 2024 | Zero-Touch OS-Infrastruktur für Container und Kubern...
OSCamp Kubernetes 2024 | Zero-Touch OS-Infrastruktur für Container und Kubern...
 
CTAC 2024 Valencia - Sven Zoelle - Most Crucial Invest to Digitalisation_slid...
CTAC 2024 Valencia - Sven Zoelle - Most Crucial Invest to Digitalisation_slid...CTAC 2024 Valencia - Sven Zoelle - Most Crucial Invest to Digitalisation_slid...
CTAC 2024 Valencia - Sven Zoelle - Most Crucial Invest to Digitalisation_slid...
 
Exploring protein-protein interactions by Weak Affinity Chromatography (WAC) ...
Exploring protein-protein interactions by Weak Affinity Chromatography (WAC) ...Exploring protein-protein interactions by Weak Affinity Chromatography (WAC) ...
Exploring protein-protein interactions by Weak Affinity Chromatography (WAC) ...
 
Call Girls in Rohini Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Rohini Delhi 💯Call Us 🔝8264348440🔝Call Girls in Rohini Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Rohini Delhi 💯Call Us 🔝8264348440🔝
 
OSCamp Kubernetes 2024 | SRE Challenges in Monolith to Microservices Shift at...
OSCamp Kubernetes 2024 | SRE Challenges in Monolith to Microservices Shift at...OSCamp Kubernetes 2024 | SRE Challenges in Monolith to Microservices Shift at...
OSCamp Kubernetes 2024 | SRE Challenges in Monolith to Microservices Shift at...
 
George Lever - eCommerce Day Chile 2024
George Lever -  eCommerce Day Chile 2024George Lever -  eCommerce Day Chile 2024
George Lever - eCommerce Day Chile 2024
 
Open Source Strategy in Logistics 2015_Henrik Hankedvz-d-nl-log-conference.pdf
Open Source Strategy in Logistics 2015_Henrik Hankedvz-d-nl-log-conference.pdfOpen Source Strategy in Logistics 2015_Henrik Hankedvz-d-nl-log-conference.pdf
Open Source Strategy in Logistics 2015_Henrik Hankedvz-d-nl-log-conference.pdf
 

EUDAT services overview

  • 1. EUDAT services Pablo Ródenas Barquero HPC support and application consultant @ BSC 21/Jun/2018 MareData (València)
  • 2. Index: • BSC brief introduction • EUDAT overview • EUDAT services suite
  • 4. Barcelona Supercomputing Center Centro Nacional de Supercomputación Spanish Government 60% Catalonian Government 30% Univ. Politècnica de Catalunya (UPC) 10% BSC-CNS is a consortium that includes BSC-CNS objectives Supercomputing services to Spanish and EU researchers R&D in Computer, Life, Earth and Engineering Sciences PhD programme, technology transfer, public engagement
  • 5. People and Resources Data as of 31st of December 2017 2017 executed budget
  • 6. Mission of BSC Scientific Departments Earth Sciences CASE Computer Sciences Life Sciences To influence the way machines are built, programmed and used: programming models, performance tools, Big Data, computer architecture, energy efficiency To develop and implement global and regional state-of-the-art models for short-term air quality forecast and long-term climate applications To understand living organisms by means of theoretical and computational methods (molecular modeling, genomics, proteomics) To develop scientific and engineering software to efficiently exploit super-computing capabilities (biomedical, geophysics, atmospheric, energy, social and economic simulations)
  • 7. BSC & The Global IT Industry IBM-BSC Deep Learning Center Intel-BSC Exascale Lab BSC-Microsoft Research Centre NVIDIA GPU Center of Excellence
  • 8. Collaborations with Industry Research into advanced technologies for the exploration of hydrocarbons, subterranean and subsea reserve modelling and fluid flows Research on wind farms optimization and wing energy production forecasts Collaboration agreement for the development of advanced systems of deep learning with applications to banking services BSC’s dust storm forecast system licensed to be used to improve the safety of business flights. Research on the protein-drug mechanism of action in Nuclear Hormone receptors and developments on PELE method to perform protein energy landscape explorations Simulation of fluid-structure interaction problem with the multi-physics software Alya
  • 9. The MareNostrum 4 supercomputer Total peak performance: 13,7 Pflops/s 80% Access: prace-ri.eu/hpc_acces 16% Access: bsc.es/res-intranet 4%
  • 10. MareNostrum is managed by the Operations team that takes care of its availability, security and performance. An important task of this team is to support scientists in the usage of MareNostrum, as well as to help them in the improvement of their applications getting better research results. – System administration area: includes MareNostrum’s pure system administration, security, resource management, networking & helpdesk. – User support area: includes direct user support with knowledge in programming models, libraries, tools, applications, etc. Operations teamOperations department
  • 11. • The main objectives for the HPC-Support team are : – Solve the request of researchers using the BSC HPC-Resources – Installation and debugging applications – Enabling and porting codes to the new architectures. – Assisting users for efficient use of supercomputing resources – Optimization and scalability studies – Parallelization assistance – Benchmarking – Manage accounting information and users accounts – Specific support for scientific codes HPC Support tasksHPC support tasks
  • 13. • A pan-European initiative building a sustainable cross-disciplinary and cross-national data infrastructure providing a set of shared services for accessing and preserving research data • Close collaboration with research communities to optimally support their data management needs and deliver the appropriate technical services EUDAT - European Data Infrastructure
  • 14. A truly pan-European Infrastructure EUDAT offers common data services, supporting multiple research communities as well as individuals, through a geographically distributed, resilient network of 36 European organisations Our vision is to enable European researchers and practitioners from any research discipline to preserve, find, access, and process data in a trusted environment, as part of a Collaborative Data Infrastructure
  • 15. EUDAT Vision & Mission ● Vision: Data is shared and preserved across borders and disciplines thereby enhancing the value and quality of research at large. ● Mission: To enable data stewardship within and between European Research Communities through a Collaborative Data Infrastructure, a common model and service infrastructure for managing data spanning all European research data centres and community data repositories.
  • 16. What is the EUDAT CDI? • The EUDAT CDI is a collaboration between Service Providers and Research Communities working as part of a common framework for developing and operating an interoperable layer of common data services • Generic Service Providers have regional, organisational or national mandates to support scientific research, usually from different disciplines. • Thematic Service Providers are (discipline-specific) organisations mandated to support a well-defined scientific community or group of users.
  • 17. Community-Driven Solutions PHYSICAL SCIENCES & ENGINEERING SOCIAL SCIENCES & HUMANITIES MATERIALS & ANALYTICAL FACILITIES ENVIRONMENTAL SCIENCES MAPPER BIOMEDICAL & MEDICAL SCIENCES EUDAT services (the so called B2 Service Suite) are designed, built and implemented based on user community requirements.
  • 18. • EUDAT started in 2011 as an initiative to face the data deluge and the increasing complexities and costs of isolated solutions • EUDAT initiative funded by EC projects • EUDAT 2011-2014 25 partners 16ME • EUDAT2020 2015-2018 37 partners 20ME • Participate in European Open Science Cloud: • EOSC-hub 2018-2020 100 partners 33ME A bit of EUDAT history
  • 20. • EUDAT offers a complete set of research data services, expertise and technology solutions to all European scientists and researchers. • These shared services and storage resources are distributed across 15 European countries. • Data are safely stored alongside some of Europe’s most powerful supercomputers. EUDAT Services Suite
  • 22. Secure Access to Services b2access.eudat.eu www.eudat.eu B2ACCESS B2ACCESS is an easy-to-use and secure authentication and authorization platform which can be integrated with any service and supports different methods of authentication.
  • 23. • The federated cross-infrastructure Authorisation and Authentication Framework • Enables single sign-on access to the EUDAT services • Easy to use and secure • Developed on top of the Unity Open Source security framework What is B2ACCESS? b2access.eudat.eu
  • 24. • EUDAT users to authenticate themselves using a variety of credentials. The following log-in options are supported: • User's Home Organisation Identity Provider • Social account • B2ACCESS ID Using B2ACCESS In order to support a wide range of IdPs we have joined the EduGain federation! b2access.eudat.eu
  • 25. • End users can access the portal via this link https://b2acc ess.eudat.eu/ • This portal allows the user to log in using one of three different methods Account Registration b2access.eudat.eu
  • 26. • In order to register with B2ACCESS, you need to first log in • After log in, you can register with the B2ACCESS system, to create your unique B2ACCESS account • If you log in with a credential not associated with your B2ACCESS account, you can choose to associate it with your B2ACCESS account, or create another one Registration is a two-stage process b2access.eudat.eu
  • 27. • Use the search bar to seek, then click the name of your home organisation in the Log in with your Organisation ID tab and click Authenticate • You are then redirected to the login page of your home organisation. • Provide your credentials and login. • After successful login, if you are not registered yet with these credentials, you will be offered two possibilities: • Register an account: a new local account will be created • Associate an account: an existing local account will be associated with your external identity • Fill in the registration form presented • Agree to the Terms of Use and Data Privacy Statement and submit • B2ACCESS will send you an email confirming that your registration request was accepted Registering-Home Organisation Identity Provider b2access.eudat.eu
  • 28. • Click the Google Account link in the Google Authentication tab and click Authenticate • You are then redirected to the login page of Google. • Provide your credentials and login. • Give Google permission to publish your attributes to B2ACCESS • If you are not registered yet, you will be offered two possibilities: • Register an account: a new local account will be created • Associate an account: an existing local account will be associated with your Google identity • Fill in the name of your home organisation and (optionally) apply for membership in one of the presented groups • Agree to the Terms of Use and Data Privacy Statement and submit • B2ACCESS will send you an email confirming that your registration request was accepted Registering – Social Account b2access.eudat.eu
  • 29. • Click on the Register a new account link • You will be offered three registration forms to choose from: • OAuth Client Registration Form (not covered in this tutorial) • Create B2ACCESS Account (username only) • Create B2ACCESS Account (certificate + optional username) • Choose Create B2ACCESS Account (username only) - here you have to fill in the required data • Or choose Create B2ACCESS Account (certificate + optional username) – for this a valid X.509 certificate installed in your browser can reduce the amount of typing required • Example DN: CN=joe user, O=Example University, OU=students, C=TV • Agree to the Terms of Use and Data Privacy Statement and submit Registering – B2ACCESS ID b2access.eudat.eu
  • 30. Logging In • After registering you can log in with your B2ACCESS ID at https://b2access. eudat.eu/ • You can log in using either your organisational ID, social ID or B2ACCESS ID. b2access.eudat.eu
  • 31. • Click the name of your Home Organisation in the Log in with your Organisation ID tab: • Scroll through the list to find your Home Organisation • Or type the name of your Home Organisation in the search box • After selecting your Home Organisation, click the Authenticate button • You are redirected to the log-in page provided by your home organisation. Provide your credentials and login. Log In - Home Organisation Identity Provider b2access.eudat.eu
  • 32. • Click the Google Account link in the Google Authentication tab and click Authenticate • Provided that you have previously registered, you will automatically login Log in – Social Account b2access.eudat.eu
  • 33. • Click the Login with native B2ACCESS ID  • Fill in your username and password in the two input fields and click Authenticate • Provided that you have previously registered, you will automatically login Log in – B2ACCESS ID b2access.eudat.eu
  • 34. • You may not get a “Registration successful” message. • This is a known issue; registrations are successful irrespective of that. • Sometimes the captcha appears only partially on the screen. • Cancelling and retrying seems to work. • B2ACCESS requires certain attributes provided by your Home Organisation Identity Provider. If these attributes are not provided, login / registration will fail.  • You can inform the EUDAT support team via this link http://eudat.eu/support-request?service=B2ACCESS Possible Issues b2access.eudat.eu
  • 35. Profile Management • To access your user profile page, please log in https://b2access.eudat.eu/ • You can see details about your account • You can schedule to immediately remove, or disable and in the future deactivate your account. b2access.eudat.eu
  • 36. Temporary Account Deactivation • If necessary, accounts can be temporarily deactivated for a chosen number of days. • To do so- • Log in to B2ACCESS- Profile management page - Click Remove account button. • Select the option Disable immediately and remove after a grace period. Choose the number of days you want the account to be suspended. • Confirm your choice. • The account  will be automatically removed if the user does not log in during this deactivation period. Account Deactivation and Removal b2access.eudat.eu
  • 37. Permanent Account Removal • To remove an account: • Log in to B2ACCESS. - Profile management page. Click Remove account button. • Select the option Remove immediately. • Confirm your choice. • Removing or deactivating an account with one of your identities does not affect accounts registered with other identities. E.g. if you remove your account registered with your Google identity you are still able to use your native B2ACCESS account.   • You can register a new account with the same identity and same data (e.g. membership in the groups) after removing the old one. Account Deactivation and Removal b2access.eudat.eu
  • 38. Profile Management • To access your user profile page, please log in https://b2access.eudat.eu/ • You can see details about your account • You can schedule to immediately remove, or disable and in the future deactivate your account. • You can also manage your credentials b2access.eudat.eu
  • 39. Credentials Management • Add or change your B2ACCESS password b2access.eudat.eu
  • 40. Credentials Management • Add or change your B2ACCESS password b2access.eudat.eu
  • 41. b2access.eudat.eu • An easy-to-use and secure authentication and authorization platform integrated with any services • The user may log in by using different methods of authentication: • Home organisation identity provider • Social ID • EUDAT ID • Allows group-, community- and service managers to specify authorisation decisions Features: • Easy integration in any service • Reliable and light-weight • Powerful management interface
  • 42. b2drop.eudat.eu www.eudat.eu Sync and Share Research Data B2DROP EUDAT’s Personal Cloud Storage Service B2DROP is a secure and trusted data exchange service for researchers and scientists to keep their research data synchronized and up-to-date and to exchange with others.
  • 43. b2drop.eudat.eu • Store and exchange data with colleagues and team members, including research data not finalized for publishing • share data with fine-grained access controls • synchronize multiple versions of data across different platforms An ideal solution for researchers and scientists to: Features: • 20GB storage per user • Trusted storage: data stays in Europe • Daily tape backups of all files Introduction
  • 44. b2drop.eudat.eu What type of data can I store? • Any kind of temporary research data, uploaded from your local or departmental storage device as digital objects • Primary data or processed data • Both empirical and theoretical data • Data as the basis for a publication • Any kind of format and file: papers, spreadsheets, audio-visual media, provided the data source or purpose of the data has a scientific background.
  • 45. b2drop.eudat.eu Terms and Conditions • For researchers and communities to share and store research data. • Not for personal, recreational, political or commercial use • No unlawful or inappropriate content • Potential sanctions: account suspension, termination, deletion of content or criminal proceedings • Availability defined by SLA – no guaranteed availability at any specific instance Complete text: https://b2drop.eudat.eu/themes/b2drop/terms-of-use.html
  • 46. b2drop.eudat.eu Security • Your privacy is important to us. Only you and those you share your files with can see your data. In urgent matters an administrator could access your files • Data are stored at Juelich Supercomputing Centre • Daily backups of all files in B2DROP are taken and kept on tape in a different location at Juelich • User Information security • Also stored at Juelich • User info is not encrypted • Transfer to 3rd party (e.g. in case of moving the service to another partner): b2drop.eudat.eu would be moved to a different location
  • 47. b2drop.eudat.eu Using the web interface 1/4 • Upload of a file (max. 10 GB) • Click the “+” button • Click the “Upload” menu • Browse your computer, select a file and click “Open”. • …or simply drag and drop onto the B2DROP window • Keeping versions • Files with similar names will be noticed by B2DROP: “One file conflict”. You can choose what version(s) you’d like to keep.
  • 48. b2drop.eudat.eu On B2DROP Versioning • Automatic file versioning • Access to the previous versions is straightforward on the web GUI and the desktop client • The latest file gets overwritten by the selected version, with other versions retained. • To preserve disk space, B2DROP preserves a subset of the versions, progressively reducing the number of retained versions as time goes by. Note that B2DROP removes older saved versions and/or stops maintaining versions when the user exceeds 50% of their quota.
  • 49. b2drop.eudat.eu Using the web interface 2/4 • Create a folder • Click “+”, then “Folder” • Name folder + enter • Create a new text file • Click “+”, then “Text file” • Name file + enter • Use the pop-up editor to edit the file • Exiting the editor saves the file • Rename, delete and download files and folders • Select the object to operate on • Click the “…” button • Select the desired option
  • 50. b2drop.eudat.eu Using the web interface 3/4 • Create new contacts • Click dropdown menu next to “Files” • Select “Contacts” • Click “+ New contact” • Or import from Variant Call Format file • Click on “Settings”, then “Import” • Create new groups • Select a contact • Add a Group name in the “Groups” field
  • 51. b2drop.eudat.eu Using the web interface 4/4 • Sharing files and folders • Click “Files” from “Contacts” dropdown • Select object to share and click the share icon • Via contact or e-mail address • Add password protection, allow upload access, set an expiration time on the sharing • Unsharing: by clicking the ticked box ‘Share link’.
  • 52. b2drop.eudat.eu Installing the B2DROP client • To install the desktop app: • Click on your username on the right • Select “Personal” • Click “Sync clients” on the left • Click on the appropriate app. You will be directed to the ownCloud website. • Select Windows, Mac or Linux as needed and follow the instructions • After installing you need to configure the program by entering the address https://b2drop.eudat.eu/ • Please log in using your B2DROP username (email address) and password • ownCloud will now appear on your file browser Note that using this client allows you to work on your files while offline, and synchronise when you reconnect to the network. My Username
  • 53. b2drop.eudat.eu Mount your folder • You can mount B2DROP as a drive to your desktop machines via WebDAV • Your B2DROP folder then appears in your file browser • You can work on files, which will synchronise automatically with the B2DROP server on save • Supported for • MacOS • Linux Distributions • Windows Note that mounting your folder through WebDAV only works while you are connected to the network.
  • 54. b2drop.eudat.eu Mount your folder - MacOS Mount B2DROP in your “Finder”: 1. Click on “Go” on the drop-down menu and then “Connect to server” 2. Enter https://b2drop.eudat.eu/remote.php/webdav/ when prompted 3. Log in with your username (email address) and password. You can also mount B2DROP with Cyberduck by providing the above-mentioned information to the client.
  • 55. b2drop.eudat.eu Mount your folder - Linux You can mount B2DROP with NAUTILUS: 1. Select “Go to File → Connect to server” 2. Type in: davs://b2drop.eudat.eu/remote.php/webdav 3. Log in with your username (email address) and password. Mounting via davfs is also possible, but it requires sudo access. Log in with your username (email address) and password To unmount use the following command: The instructions above have been tested on Ubuntu but they should work for every Linux distribution supporting the NAUTILUS or GNOME file system.
  • 56. b2drop.eudat.eu Mount your folder - Windows Map B2DROP as a network drive: 1. Enter https://b2drop.eudat.eu/remote.php/webdav/ as a folder 2. Log in with your username (email address) and password. Note that you may need to set your computer to allow Basic Authentication; please follow the Microsoft instructions for this. Because B2DROP is available under https, Option "1 - Basic authentication enabled for Secure Sockets Layer (SSL) shares only" should suffice for Windows Vista and later.
  • 58. Store and Publish Research Data b2share.eudat.eu www.eudat.eu B2SHARE B2SHARE is a user-friendly, reliable and trustworthy way for researchers, scientific communities and scientists to store and publish small-scale research data from diverse contexts.
  • 59. b2share.eudat.eu • Store data safely at a trusted and certified data centre • Preserve data to guarantee long-term persistence • Publish data and make it findable and accessible A winning solution for researchers, scientists and communities to: Features: • Metadata management • Permanent PIDs • Open Access support
  • 60. b2share.eudat.eu What’s the B2SHARE added-value? Your data is ... • Hosted so there are no hardware or network worries on depositor side • Assigned a permanent ID which means it is always retraceable to you • Stored alongside queryable & findable metadata and automatically available via the B2FIND metadata catalogue • Managed and stored by a trusted and certified data centre
  • 61. b2share.eudat.eu What can users do? • Users can … • Search for data sets that are publicly accessible • Deposit and share data (only registered users) • Download data (only registered users) • What happens to data once users have deposited it? • EUDAT has no claim over the data deposited in B2SHARE and depositors remain entirely responsible for the data they deposit. • EUDAT retains the right of archiving, i. e. creating replicas at trusted centers to take care of long-term persistence.
  • 62. b2share.eudat.eu What data can users upload? • Research data • Primary data • Processed data • Data as basis for a publication • Empirical data • Theoretical data In virtually any kind of format.... •Papers •Spreadsheets •Audio-visual media, Just a note... Make sure that you are allowed to upload your data and are compliant with all data protection laws regarding sensitive data and restrictions on where this data is stored. Unrelated personal data should not be stored on B2SHARE. • Data source or purpose of the data is scientific • Unlimited file uploads. • 2GB per file (for larger files then contact EUDAT via http://eudat.eu/support-request?Service=B2SHARE )
  • 63. b2share.eudat.eu Search for data sets • Click on “Search” at https://b2share.eudat.eu
  • 65. b2share.eudat.eu Register to deposit and share data • Easy and quick registration at https://b2share.eudat.eu
  • 66. b2share.eudat.eu How do I deposit data? (1/2) • Click on “Deposit”
  • 67. b2share.eudat.eu How do I deposit data? (2/2) • 3 simple steps: 2. Select a domain or project specific metadata set to describe the resource(s) 1. Select and upload one or several data resources either by dragging and dropping from your file browser 3. Fill in the metadata form: the more information you add the easier your data will be to find for others Open Access: • Select “ON” to make your data accessible to registered members only • Select “OFF” and everyone can see your data
  • 68. Find Research Data b2find.eudat.eu www.eudat.eu B2FIND B2FIND is a simple, user-friendly metadata catalogue of research data collections stored in EUDAT data centres and other repositories.
  • 69. b2drop.eudat.eu What is B2FIND? B2FIND • is the metadata service of EUDAT • is based on a comprehensive joint metadata catalogue of research data collections stored in EUDAT data centres and other repositories • provides a powerful and user-friendly discovery service on metadata covering a wide range of research communities b2find.eudat.eu This image is licensed under the Creative Commons CC0 Public Domain Taken from http://res.publicdomainfiles.com/pdf_view /60/13534595416502.png
  • 70. b2drop.eudat.eu Where is B2FIND in the EUDAT suite? B2FIND • stores metadata through other EUDAT services such as B2SHARE to provide access to data objects within the EUDAT CDI • is used in inter-service use cases, e.g. to identify links to data collections, which will be transferred to HPC platforms through B2STAGE
  • 71. b2drop.eudat.eu With B2FIND you can... B2FIND – Find Research Data • Browse through the large amounts of data that EUDAT stores from a broad range of disciplines • Search the whole catalogue, which comprises collections of scientific data, irrespective of their origin, discipline or community • Carry out faceted searches for • geospatial or temporal coverage and • textual properties, such as ‘Creator’ or ‘Publisher’ and many other facets • Find and access scientific data objects relevant for your work
  • 72. b2drop.eudat.eu Data from a great selection of subjects B2FIND has a truly cross-community approach • Metadata are harvested from a wide range of research areas • From Climate Research to Social Sciences • From Biodiversity to Linguistics • From Archaeology to Seismology • This necessitates the transformation and homogenisation of the diverse metadata to achieve the usage of a common vocabulary for the whole catalogue This image is licensed under the Creative Attribution-NoDerivs 2.0 Generic (CC BY-ND 2.0), taken from https://www.flickr.com/photos/denverjeffr ey/304220561
  • 73. b2find.eudat.eu Metadata Ingestion Workflow MD Generation MD Harvesting MD Mapping and Validation MD Uploading and Indexer Data Provider on Community site Service Provider on EUDAT site MD Repository and Provider • The transformation process is part of the metadata ingestion (MD Mapping and Validation) shown in the diagram • The individual workflow steps are described in detail in the related presentation ‘B2FIND Integration’ • Note: While the original metadata are restructured, re-formatted and indexed to allow discovery and faceted search there is no change to the content
  • 74. B2FIND communities B2FIND – Find Research Data • B2FIND initially indexed metadata • harvested from EUDAT core communities (such as ENES and CLARIN) and • stored through the B2SHARE EUDAT service • EUDAT extended and is extending the service to other external and reliable data and metadata providers • The list of currently integrated communities is available at http://b2find.eudat.eu/group/
  • 75. b2drop.eudat.eu B2FIND MD Catalogue Ingestion status • > 470000 records • 17 communities • (16 external + B2SHARE)
  • 76. b2drop.eudat.eu B2FIND Discovery Portal Search and browse datasets • Search and browse all data sets via Keyword searches • Results displayed in easy to read format and listed in order of relevance to your search
  • 77. B2FIND provides ‘faceted’ search for • Free text • Location • Temporal coverage • Publication year • Textual facets: • Communities • Tags • Creator • Discipline • Publisher etc. B2FIND Discovery Portal Faceted Search Dataset view provides • Display of metadata • Geo spatial extent • Title and abstract • Associated tags • Table of field-value pairs • Links to data resources
  • 78. b2drop.eudat.eu Data Access Resolved link to data object Link to (another landing page of) the data object View of originally harvested metadata record
  • 79. b2find.eudat.eu • Seek data objects and collections using powerful metadata searches • Catalogue community data by means of selected metadata • Browse through multi-disciplinary data collections filtered by content, provenance and temporal keywords A metadata catalogue service to: Features: • Simple to use • Standards-based • Comprehensive catalogue
  • 80. Replicate Research Data Safely eudat.eu/b2safe www.eudat.eu B2SAFE B2SAFE is a robust, safe and highly available service which allows community and departmental repositories to implement data management policies on research data that can be distributed across multiple administrative domains in a trustworthy manner.
  • 81. eudat.eu/b2safe • Replicate research data into multiple secure data stores • Preserve research data in the long term • Steward distributed data via policy-driven workflows • Co-locate data with different communities • Benefit from economies of scale The ideal solution for repositories and archives to: Features: • Large-scale storage • Robust, resilient, highly available • Policy-driven workflows • Permanent Persistent Identifiers
  • 82. Get Data to Computation eudat.eu/b2stage www.eudat.eu B2STAGE B2STAGE is a reliable, efficient, light-weight and easy-to-use service to transfer research data sets between EUDAT storage resources and high-performance computing (HPC) workspaces
  • 83. eudat.eu/b2stage • Move large amounts of data between data stores and high-performance compute resources • Re-ingest computational results back into EUDAT • Deposit large data sets onto EUDAT resources for long-term preservation Facilitating communities to: Features: • High-speed transfer • Reliable and light-weight • Manages permanent PIDs
  • 84. Data Discovery and Identification b2handle.eudat.eu www.eudat.eu B2HANDLE B2HANDLE provides an abstraction layer to a physical location of a data object allowing researchers to reliably cite and refer to data in the long term.
  • 85. b2handle.eudat.eu • Enables EUDAT services and user communities to assign PIDs to different kinds of managed objects stored in the EUDAT CDI. • Follows policies to register data and make it long term referable and citable • Provides lasting references to the physical location of data objects Features: • Reliability through mutual PID mirroring • Python library • Simple integration with any service
  • 87. Extra tools • License selector: • Helps you to choose the right license for your data • Accessible via b2share https://www.eudat.eu/services/userdoc/license-selector • Easy data management plan creator: • Allows the creation of data management plans https://easydmp.eudat.eu