INTRODUCING SURF
Annette Langedijk
RDNL course “Essentials 4 Data Support”
Amsterdam, 22 November 2018
We are SURF
Education
Flexible education
Diverse learning resources
Using study data
Research
Unlimited access
World-class facilities
Stimulating Open Science
Cooperative facilities
On campus
Security in the digital world
User-centred
Fields of work
Current Science
5
Turbulance modelling
Protein structure
prediction
Weather prediction
High energy physics Astronomy
Genetics
Cartography Linguistics
The data revolution
Challenges faced by scientists
Compute power laptop
Secure data storage
Transfer big amounts of data
Share data with colleagues abroad
Software availability
Complex user interfaces
…
7
The national digital infrastructure
Access to a wide range of reliable services to
process, analyse, store and share data
Available to all researchers, independent of the
scientific domain
Superior digital infrastructure is crucial to the Dutch
knowledge economy
There’s a world outside…
There are (commercial) alternatives to the national infrastructure
Be aware of:
• Hourly accounting
• Data transfer costs
• Legal issues
9
National e-infrastructure?
or
Host your own hardware?
Use public cloud providers?
Technical considerations
‘Fit’ to the problem
Ease of use
Scalability
Organizational considerations
Collaboration
Training, Support & Consultancy
Legal issues
Costs
About SURF
11
From floppy to cloud:
making software available to
institutions and users
eduroam: securely
online, anywhere
SECURE, RELIABLE WI-FI 1500 LOCATIONS IN THE NETHERLANDS 25,000 LOCATIONS IN 89 COUNTRIES
SURF network
A reliable network for member
institutions since 1988
11,000 km of FIBRE OPTICS in the
SURFnet network
LOCATIONS with EDUROAM:
1,500 in THE NETHERLANDS
25,000WORLDWIDE in 89 countries
Identity Management Services
SURFconext
- access to cloud services
- federative login
(Institutional account, log in once,
receive access everywhere)
Science collaboration zone (pilot)
- access to (research) specific services
- federative login
AND
- guests
- teams
- international
14
Identity
Providers
Service
Providers
surfspot.nl : smart deals for research & education
SOFTWARE PRODUCTS SOLD
Top 3:
1 Office 365 ProPlus
2 IBM SPSS Statistics 24
3 Office 2016 Professional Plus
16
What SURFsara does for research
Compute services
Supercomputing
Cluster computing
Visualisation
Data processing
Scalable data analytics
Grid services
HPC cloud
Data services
Online data services
Data preservation services
Data management services
RESEARCH
DATA
LIFECYCLE
Access
Analyse
Report
Integrate
Optimise
Store
(Re)search
Translate
Compute
Computing services
17
Dutch Supercomputer Cartesius
large scale parallel applications
Lisa Computer Cluster
processing power with user friendliness
Visualisation
powerfull remote visualization
Stored research data
50.5 PB
On 01-01-2018
+ 28,5 % vs last year
Scalable Data Analytics
Exploration / Mining of Big Data
Streaming data (real time analysis)
Spark framework, flexible infrastructure built on Kubernetes, training with Jupyter notebooks
18
https://twinl.surfsara.nl/
“2 to 6 million tweets/day”
Prof. Antal van den Bosch
Radboud University, Meertens Institute
https://twinl.surfsara.nl/
19
Data services in the Netherlands
20
Archive
Data ingest service
SURF object storage
SURF Data services
21
Data ingest service
Archive
SURF object storage
SURFfilesender
(a safe alternative for WeTransfer)
• Send files up to 500 GB
• Up to 2 GB encryption in new version
• Temporary storage of files in the Netherlands (privacy)
• free
SURF Research DriveSURFdriveSidebySide
ü Personal storage (incl. sharing files)
ü Store up to 250 GB per user
ü Secure and Simple
ü High Availability , 24/7 Support
ü Annual contract per institution
ü Flexible storage for cooperating
Research Teams
ü Unlimited storage capability per
Research Team
ü Data Stewardship
ü Integration possibilities with SURF
compute, data and public provider
cloud services
ü Pay per Use
SURF Data Management Platform: enabling Data Orchestration *
DATA MANAGEMENT PLATFORM
External
Storage
Object
Store
?
User Interfaces
Local
Storage
Plugins
Apps
Services
- Metadata handling
- Data repositories
- Dropbox-like
services
- Notebooks
* In development
POWERED BY
SURF is more..
than just big systems
26
Consultancy Training
Knowledge Exchange
SURF Support4Research: the long tail
27
The Support4Research support triangle
28
scientist
Local ICT
support
Shape
collaboration
Advice, training,
hands-on support
Advice, training,
hands-on support
Train-the-trainer
SURF
SURF Training, Knowledge exchange
29
30
More information? surf.nl/research
THANK YOU!
31
www.surf.nl
annette.langedijk@surfsara.nl
Driving innovation together

Introducing SURF

  • 1.
    INTRODUCING SURF Annette Langedijk RDNLcourse “Essentials 4 Data Support” Amsterdam, 22 November 2018
  • 2.
  • 3.
    Education Flexible education Diverse learningresources Using study data Research Unlimited access World-class facilities Stimulating Open Science Cooperative facilities On campus Security in the digital world User-centred Fields of work
  • 4.
    Current Science 5 Turbulance modelling Proteinstructure prediction Weather prediction High energy physics Astronomy Genetics Cartography Linguistics
  • 5.
  • 6.
    Challenges faced byscientists Compute power laptop Secure data storage Transfer big amounts of data Share data with colleagues abroad Software availability Complex user interfaces … 7
  • 7.
    The national digitalinfrastructure Access to a wide range of reliable services to process, analyse, store and share data Available to all researchers, independent of the scientific domain Superior digital infrastructure is crucial to the Dutch knowledge economy
  • 8.
    There’s a worldoutside… There are (commercial) alternatives to the national infrastructure Be aware of: • Hourly accounting • Data transfer costs • Legal issues 9
  • 9.
    National e-infrastructure? or Host yourown hardware? Use public cloud providers? Technical considerations ‘Fit’ to the problem Ease of use Scalability Organizational considerations Collaboration Training, Support & Consultancy Legal issues Costs
  • 10.
  • 11.
    From floppy tocloud: making software available to institutions and users eduroam: securely online, anywhere SECURE, RELIABLE WI-FI 1500 LOCATIONS IN THE NETHERLANDS 25,000 LOCATIONS IN 89 COUNTRIES
  • 12.
    SURF network A reliablenetwork for member institutions since 1988 11,000 km of FIBRE OPTICS in the SURFnet network LOCATIONS with EDUROAM: 1,500 in THE NETHERLANDS 25,000WORLDWIDE in 89 countries
  • 13.
    Identity Management Services SURFconext -access to cloud services - federative login (Institutional account, log in once, receive access everywhere) Science collaboration zone (pilot) - access to (research) specific services - federative login AND - guests - teams - international 14 Identity Providers Service Providers
  • 14.
    surfspot.nl : smartdeals for research & education SOFTWARE PRODUCTS SOLD Top 3: 1 Office 365 ProPlus 2 IBM SPSS Statistics 24 3 Office 2016 Professional Plus
  • 15.
    16 What SURFsara doesfor research Compute services Supercomputing Cluster computing Visualisation Data processing Scalable data analytics Grid services HPC cloud Data services Online data services Data preservation services Data management services RESEARCH DATA LIFECYCLE Access Analyse Report Integrate Optimise Store (Re)search Translate Compute
  • 16.
    Computing services 17 Dutch SupercomputerCartesius large scale parallel applications Lisa Computer Cluster processing power with user friendliness Visualisation powerfull remote visualization Stored research data 50.5 PB On 01-01-2018 + 28,5 % vs last year
  • 17.
    Scalable Data Analytics Exploration/ Mining of Big Data Streaming data (real time analysis) Spark framework, flexible infrastructure built on Kubernetes, training with Jupyter notebooks 18 https://twinl.surfsara.nl/ “2 to 6 million tweets/day” Prof. Antal van den Bosch Radboud University, Meertens Institute
  • 18.
  • 19.
    Data services inthe Netherlands 20 Archive Data ingest service SURF object storage
  • 20.
    SURF Data services 21 Dataingest service Archive SURF object storage
  • 21.
    SURFfilesender (a safe alternativefor WeTransfer) • Send files up to 500 GB • Up to 2 GB encryption in new version • Temporary storage of files in the Netherlands (privacy) • free
  • 23.
    SURF Research DriveSURFdriveSidebySide üPersonal storage (incl. sharing files) ü Store up to 250 GB per user ü Secure and Simple ü High Availability , 24/7 Support ü Annual contract per institution ü Flexible storage for cooperating Research Teams ü Unlimited storage capability per Research Team ü Data Stewardship ü Integration possibilities with SURF compute, data and public provider cloud services ü Pay per Use
  • 24.
    SURF Data ManagementPlatform: enabling Data Orchestration * DATA MANAGEMENT PLATFORM External Storage Object Store ? User Interfaces Local Storage Plugins Apps Services - Metadata handling - Data repositories - Dropbox-like services - Notebooks * In development POWERED BY
  • 25.
    SURF is more.. thanjust big systems 26 Consultancy Training Knowledge Exchange
  • 26.
  • 27.
    The Support4Research supporttriangle 28 scientist Local ICT support Shape collaboration Advice, training, hands-on support Advice, training, hands-on support Train-the-trainer SURF
  • 28.
  • 29.
  • 30.