The chasm of cyberinfrastructures

  • 143 views
Uploaded on


The Cyber Infrastructure (CI) vision has been around for a couple of years. The development of such infrastructure requires a radical design philosophy and a foundation to build upon. It needs the development of an architecture that defines the components, their organizations and their interactions. Since the CI has an international scope and connections, this specification will as much as possible be done in international cooperation and leads to international standards and agreements.


The main challenge of a CI is to provide an unified and standardized way for the composition of trustworthy, multi-domain and on-demand services for an international research group (or virtual organization). These services can be network resources, storage and HPC, but also collaboration tools for writing papers and exchanging research data. The CI demands a form of service orchestration where virtualization and management of services and resources in a distributed, heterogeneous environment is essential.

More in: Education
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads

Views

Total Views
143
On Slideshare
0
From Embeds
0
Number of Embeds
2

Actions

Shares
Downloads
4
Comments
0
Likes
0

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. The Chasm of Cyberinfrastructures Harold Teunissen et al. #I2SUMMIT14, April 2014 A Dutch Perspective
  • 2. Early adopters 2The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  • 3. Serving Dutch Higher Education 3The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  • 4. The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Cyberinfra Corp. • All ICT activities for Higher Education and Research in the Netherlands are under one umbrella 4 Shared Professional Services Scientific Computing
 & Data Commercial ICT Products & Services National Research & Education Network eScience Collaboration and Tools
  • 5. Core Elements 5The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Adapted from: Berman, 2001 & Lippincott, 2011 CYBERINFRASTRUCTURE People & Training Broadband Network Connectivity Large Databases & Libraries InstrumentationHigh Performance Computing Collaboration
  • 6. Big Hype 6The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  • 7. 2005 130 EB 2010 1,227 EB 2015 7,910 EXABYTE 2020 1,000 ZETABYTE? 2000 Out or in control? 7The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  • 8. Entropy 8The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. KNOWLEDGE CHAOS Too Big Data Required Processing Power AmountofData Max. Available
 Processing Power
  • 9. Long tail of science 9The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. # of researchers Scale Large Scale, Multi- Disciplinary and Complex Small Scale but getting complexer ACCELERATION
  • 10. Secret of their success 10The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  • 11. Vision of Cyberinfra 11The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  • 12. Glueing the components… 12The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. GLUE
  • 13. …or just patchwork? 13The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  • 14. Network BNetwork A Network C Just within our reach 14The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  • 15. We started building 15The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. http://static4.depositphotos.com/ 1000992/514/i/950/ depositphotos_5146031-Laboratory- glassware.jpg
  • 16. Generic resource broker 16The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  • 17. The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. • Interfacing to domain specific resource brokers • Aggregation of available resources provided by specific brokers • Authorisation based on federated identity attributes • Advance reservation • Reporting and monitoring • Scheduling • Brokering • Accounting • Auditing Ultimate functionality 17
  • 18. Technical Challenges 18The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  • 19. Organizational Differences 19The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  • 20. Financial Hurdles 20The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  • 21. “How to eat an elephant?” 21The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  • 22. ENLIGHTEN YOUR RESEARCH The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Enlighten your research 22 Radio Astronomy — Pulsar Research Climate Modeling for Scientist and Decision Makers CineGRID — 4K+ Video Distribution Testbed Next Generation DNA Sequencing Jungle Computing Centralized Imaging for Large Scale Population Imaging Contest
  • 23. SURF Outreach & Support 23The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  • 24. Erasmus MC TU Delft WUR RUG Life Science Grid Cluster LUMC AMC VU MC Complete Genomics, LA, CA. (BGI) BGI, Hong Kong EYR3 : NG DNA SQ 24The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO.
  • 25. Big Data Big Deal! - #tnc2013 - Maastricht, NL Chasm 25The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Source: Geoffrey A. Moore c.s. Techies Visionaries Pragmatics Conservatives Laggards Chasm WAITING TO HAPPEN ...solutions
 and convenience ...technology and performance time #ofcustomers
  • 26. Big Data Big Deal! - #tnc2013 - Maastricht, NL Bandwidth on demand 26The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Source: Geoffrey A. Moore c.s. Techies Visionaries Chasm ALMOST HAPPENING time #ofcustomers … The Rest 7-9 YEARS 20142006 2009 2016
  • 27. Rethinking the vision 27The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Physical Infrastructure Layer Data Center (Storage & Compute) Network Constellation Science DMZ S3
  • 28. Virtualization of resources 28The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Infastructure Virtualization Physical Infrastructure Layer Data Center (Storage & Compute) Network Constellation Science DMZ S3
  • 29. Coordinated virtualization 29The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Infastructure Virtualization Physical Infrastructure Layer Coordinated Infrastructure Virtualization Data Center Virtualization Network Vitualization Instrumentation Virtualization Data Center (Storage & Compute) Network Constellation Science DMZ S3
  • 30. Link to the applications 30The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Physical Infrastructure Layer Data Center (Storage & Compute) Network Constellation Science DMZ S3 Cyberinfastructure as a Service Infastructure Virtualization Coordinated Infrastructure Virtualization Data Center Virtualization Network Vitualization Instrumentation Virtualization
  • 31. Orchestration of infrastructure 31The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Cyberinfastructure as a Service Physical Infrastructure Layer Virtual Cyberinfrastructure
 Composition & Orchestration Virtual Cyberinfrastructure Operation & Management Data Center (Storage & Compute) Network Constellation Science DMZ S3 Applications Applications Applications Business Logic Infastructure Virtualization Coordinated Infrastructure Virtualization Data Center Virtualization Network Vitualization Instrumentation Virtualization
  • 32. Inspired by: Brocade, “DS of the Future” & S. Peng et al., “DSaaS”, 2013 Cyberinfrastructure as a Service 32The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Cyberinfastructure as a Service Physical Infrastructure Layer Virtual Cyberinfrastructure
 Composition & Orchestration Virtual Cyberinfrastructure Operation & Management Data Center (Storage & Compute) Network Constellation Science DMZ S3 Applications Applications Applications Business Logic Infastructure Virtualization Coordinated Infrastructure Virtualization Data Center Virtualization Network Vitualization Instrumentation Virtualization CIaaS
  • 33. Inspired by: Brocade, “DS of the Future” & S. Peng et al., “DSaaS”, 2013 Standards and implementations 33The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Cyberinfastructure as a Service Physical Infrastructure Layer Virtual Cyberinfrastructure
 Composition & Orchestration Virtual Cyberinfrastructure Operation & Management Data Center (Storage & Compute) Network Constellation Science DMZ S3 Applications Applications Applications Business Logic Infastructure Virtualization Coordinated Infrastructure Virtualization Data Center Virtualization Network Vitualization Instrumentation Virtualization CIaaS OpenFlow FortNOX Fresco NSI OSCARS FlowScale Beacon FlowVisor OpenStack OCCI Maestro vSphere Hypervisor
  • 34. Ideal world 34The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Inspired by: S. Peng et al., 2013 Cyberinfastructure as a Service Infastructure Virtualization Physical Infrastructure Layer CIaaS Data Center Network Science DMZ S3 Virtual Collaboration
  • 35. Quite a challenge 35The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Cyberinfastructure as a Service Infastructure Virtualization Physical Infrastructure Layer Data Center Network Science DMZ S3 Domain I Domain II Domain III Domain IV Domain V CIaaS Virtual Collaboration
  • 36. ? Federation of CIaaS 36The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Cyberinfrastructure as a Service Infastructure Virtualization Physical Infrastructure Layer Virtual Data Center Composition & Orchestration Virtual Data Center Operation & Management Coordinated Infrastructure Virtualization Data Center Virtualization Network Vitualization Instrumentation Virtualization Data Center Network Science DMZ S3 ?
  • 37. Big Data Big Deal! - #tnc2013 - Maastricht, NL Outlook 37The Chasm of Cyberinfrastructure - #I2SUMMIT14 - Denver, CO. Innovation Trigger Peak of Inflated
 Expectation Through of Disillusions Slope of Enlightment Plateau of Productivity Software Defined Networking SDN VIRTUALIZATION SDx time Expectations Source: Gartner July 2013 JULY 2013 5-10 YEARS 2-5 YEARS TO REACH PLATEAU LESS THAN 2 YEARS OpenFlow OpenStack
  • 38. harold.teunissen@surfnet.nl haroldteunissen