The Chasm of Cyberinfrastructures
Harold Teunissen et al.
#I2SUMMIT14, April 2014
A Dutch Perspective
Early adopters
2The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Serving Dutch Higher Education
3The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Cyberinfra Corp.
• All ICT activities for Higher Education an...
Core Elements
5The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Adapted from: Berman, 2001 & Lippincott, 2011
...
Big Hype
6The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
2005
130 EB
2010
1,227 EB
2015
7,910 EXABYTE
2020
1,000 ZETABYTE?
2000
Out or in control?
7The Chasm of Cyberinfrastructur...
Entropy
8The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
KNOWLEDGE
CHAOS
Too Big
Data
Required Processing Pow...
Long tail of science
9The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
# of researchers
Scale
Large
Scale, Mul...
Secret of their success
10The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Vision of Cyberinfra
11The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Glueing the components…
12The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
GLUE
…or just patchwork?
13The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Network BNetwork A
Network C
Just within our reach
14The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
We started building
15The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
http://static4.depositphotos.com/
10009...
Generic resource broker
16The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
• Interfacing to domain specific resource brokers
• Aggregatio...
Technical Challenges
18The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Organizational Differences
19The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Financial Hurdles
20The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
“How to eat an elephant?”
21The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
ENLIGHTEN YOUR RESEARCH
The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Enlighten your research
22
Radio Astr...
SURF Outreach & Support
23The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Erasmus MC
TU Delft
WUR
RUG
Life Science Grid
Cluster
LUMC
AMC
VU MC
Complete Genomics,
LA, CA. (BGI)
BGI, Hong Kong
EYR3 ...
Big Data Big Deal! - #tnc2013 - Maastricht, NL
Chasm
25The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Source...
Big Data Big Deal! - #tnc2013 - Maastricht, NL
Bandwidth on demand
26The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denv...
Rethinking the vision
27The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Physical Infrastructure Layer
Data Ce...
Virtualization of resources
28The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Infastructure Virtualization
Ph...
Coordinated virtualization
29The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Infastructure Virtualization
Phy...
Link to the applications
30The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Physical Infrastructure Layer
Data...
Orchestration of infrastructure
31The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Cyberinfastructure as a Ser...
Inspired by: Brocade, “DS of the Future” & S. Peng et al., “DSaaS”, 2013
Cyberinfrastructure as a Service
32The Chasm of C...
Inspired by: Brocade, “DS of the Future” & S. Peng et al., “DSaaS”, 2013
Standards and implementations
33The Chasm of Cybe...
Ideal world
34The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Inspired by: S. Peng et al., 2013
Cyberinfastru...
Quite a challenge
35The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Cyberinfastructure as a Service
Infastruc...
?
Federation of CIaaS
36The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Cyberinfrastructure as a Service
Infa...
Big Data Big Deal! - #tnc2013 - Maastricht, NL
Outlook
37The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
Inno...
harold.teunissen@surfnet.nl haroldteunissen
Upcoming SlideShare
Loading in …5
×

The chasm of cyberinfrastructures

380 views

Published on


The Cyber Infrastructure (CI) vision has been around for a couple of years. The development of such infrastructure requires a radical design philosophy and a foundation to build upon. It needs the development of an architecture that defines the components, their organizations and their interactions. Since the CI has an international scope and connections, this specification will as much as possible be done in international cooperation and leads to international standards and agreements.


The main challenge of a CI is to provide an unified and standardized way for the composition of trustworthy, multi-domain and on-demand services for an international research group (or virtual organization). These services can be network resources, storage and HPC, but also collaboration tools for writing papers and exchanging research data. The CI demands a form of service orchestration where virtualization and management of services and resources in a distributed, heterogeneous environment is essential.

Published in: Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
380
On SlideShare
0
From Embeds
0
Number of Embeds
6
Actions
Shares
0
Downloads
5
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

The chasm of cyberinfrastructures

  1. 1. The Chasm of Cyberinfrastructures Harold Teunissen et al. #I2SUMMIT14, April 2014 A Dutch Perspective
  2. 2. Early adopters 2The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  3. 3. Serving Dutch Higher Education 3The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  4. 4. The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Cyberinfra Corp. • All ICT activities for Higher Education and Research in the Netherlands are under one umbrella 4 Shared Professional Services Scientific Computing
 & Data Commercial ICT Products & Services National Research & Education Network eScience Collaboration and Tools
  5. 5. Core Elements 5The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Adapted from: Berman, 2001 & Lippincott, 2011 CYBERINFRASTRUCTURE People & Training Broadband Network Connectivity Large Databases & Libraries InstrumentationHigh Performance Computing Collaboration
  6. 6. Big Hype 6The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  7. 7. 2005 130 EB 2010 1,227 EB 2015 7,910 EXABYTE 2020 1,000 ZETABYTE? 2000 Out or in control? 7The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  8. 8. Entropy 8The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. KNOWLEDGE CHAOS Too Big Data Required Processing Power AmountofData Max. Available
 Processing Power
  9. 9. Long tail of science 9The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. # of researchers Scale Large Scale, Multi- Disciplinary and Complex Small Scale but getting complexer ACCELERATION
  10. 10. Secret of their success 10The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  11. 11. Vision of Cyberinfra 11The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  12. 12. Glueing the components… 12The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. GLUE
  13. 13. …or just patchwork? 13The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  14. 14. Network BNetwork A Network C Just within our reach 14The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  15. 15. We started building 15The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. http://static4.depositphotos.com/ 1000992/514/i/950/ depositphotos_5146031-Laboratory- glassware.jpg
  16. 16. Generic resource broker 16The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  17. 17. The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. • Interfacing to domain specific resource brokers • Aggregation of available resources provided by specific brokers • Authorisation based on federated identity attributes • Advance reservation • Reporting and monitoring • Scheduling • Brokering • Accounting • Auditing Ultimate functionality 17
  18. 18. Technical Challenges 18The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  19. 19. Organizational Differences 19The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  20. 20. Financial Hurdles 20The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  21. 21. “How to eat an elephant?” 21The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  22. 22. ENLIGHTEN YOUR RESEARCH The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Enlighten your research 22 Radio Astronomy — Pulsar Research Climate Modeling for Scientist and Decision Makers CineGRID — 4K+ Video Distribution Testbed Next Generation DNA Sequencing Jungle Computing Centralized Imaging for Large Scale Population Imaging Contest
  23. 23. SURF Outreach & Support 23The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  24. 24. Erasmus MC TU Delft WUR RUG Life Science Grid Cluster LUMC AMC VU MC Complete Genomics, LA, CA. (BGI) BGI, Hong Kong EYR3 : NG DNA SQ 24The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  25. 25. Big Data Big Deal! - #tnc2013 - Maastricht, NL Chasm 25The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Source: Geoffrey A. Moore c.s. Techies Visionaries Pragmatics Conservatives Laggards Chasm WAITING TO HAPPEN ...solutions
 and convenience ...technology and performance time #ofcustomers
  26. 26. Big Data Big Deal! - #tnc2013 - Maastricht, NL Bandwidth on demand 26The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Source: Geoffrey A. Moore c.s. Techies Visionaries Chasm ALMOST HAPPENING time #ofcustomers … The Rest 7-9 YEARS 20142006 2009 2016
  27. 27. Rethinking the vision 27The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Physical Infrastructure Layer Data Center (Storage & Compute) Network Constellation Science DMZ S3
  28. 28. Virtualization of resources 28The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Infastructure Virtualization Physical Infrastructure Layer Data Center (Storage & Compute) Network Constellation Science DMZ S3
  29. 29. Coordinated virtualization 29The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Infastructure Virtualization Physical Infrastructure Layer Coordinated Infrastructure Virtualization Data Center Virtualization Network Vitualization Instrumentation Virtualization Data Center (Storage & Compute) Network Constellation Science DMZ S3
  30. 30. Link to the applications 30The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Physical Infrastructure Layer Data Center (Storage & Compute) Network Constellation Science DMZ S3 Cyberinfastructure as a Service Infastructure Virtualization Coordinated Infrastructure Virtualization Data Center Virtualization Network Vitualization Instrumentation Virtualization
  31. 31. Orchestration of infrastructure 31The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Cyberinfastructure as a Service Physical Infrastructure Layer Virtual Cyberinfrastructure
 Composition & Orchestration Virtual Cyberinfrastructure Operation & Management Data Center (Storage & Compute) Network Constellation Science DMZ S3 Applications Applications Applications Business Logic Infastructure Virtualization Coordinated Infrastructure Virtualization Data Center Virtualization Network Vitualization Instrumentation Virtualization
  32. 32. Inspired by: Brocade, “DS of the Future” & S. Peng et al., “DSaaS”, 2013 Cyberinfrastructure as a Service 32The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Cyberinfastructure as a Service Physical Infrastructure Layer Virtual Cyberinfrastructure
 Composition & Orchestration Virtual Cyberinfrastructure Operation & Management Data Center (Storage & Compute) Network Constellation Science DMZ S3 Applications Applications Applications Business Logic Infastructure Virtualization Coordinated Infrastructure Virtualization Data Center Virtualization Network Vitualization Instrumentation Virtualization CIaaS
  33. 33. Inspired by: Brocade, “DS of the Future” & S. Peng et al., “DSaaS”, 2013 Standards and implementations 33The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Cyberinfastructure as a Service Physical Infrastructure Layer Virtual Cyberinfrastructure
 Composition & Orchestration Virtual Cyberinfrastructure Operation & Management Data Center (Storage & Compute) Network Constellation Science DMZ S3 Applications Applications Applications Business Logic Infastructure Virtualization Coordinated Infrastructure Virtualization Data Center Virtualization Network Vitualization Instrumentation Virtualization CIaaS OpenFlow FortNOX Fresco NSI OSCARS FlowScale Beacon FlowVisor OpenStack OCCI Maestro vSphere Hypervisor
  34. 34. Ideal world 34The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Inspired by: S. Peng et al., 2013 Cyberinfastructure as a Service Infastructure Virtualization Physical Infrastructure Layer CIaaS Data Center Network Science DMZ S3 Virtual Collaboration
  35. 35. Quite a challenge 35The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Cyberinfastructure as a Service Infastructure Virtualization Physical Infrastructure Layer Data Center Network Science DMZ S3 Domain I Domain II Domain III Domain IV Domain V CIaaS Virtual Collaboration
  36. 36. ? Federation of CIaaS 36The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Cyberinfrastructure as a Service Infastructure Virtualization Physical Infrastructure Layer Virtual Data Center Composition & Orchestration Virtual Data Center Operation & Management Coordinated Infrastructure Virtualization Data Center Virtualization Network Vitualization Instrumentation Virtualization Data Center Network Science DMZ S3 ?
  37. 37. Big Data Big Deal! - #tnc2013 - Maastricht, NL Outlook 37The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Innovation Trigger Peak of Inflated
 Expectation Through of Disillusions Slope of Enlightment Plateau of Productivity Software Defined Networking SDN VIRTUALIZATION SDx time Expectations Source: Gartner July 2013 JULY 2013 5-10 YEARS 2-5 YEARS TO REACH PLATEAU LESS THAN 2 YEARS OpenFlow OpenStack
  38. 38. harold.teunissen@surfnet.nl haroldteunissen

×