SlideShare a Scribd company logo
©2013 Open Grid Forum 
The Open Grid Forum: 
History, Introduction and Process 
Alan Sill 
VP of Standards, OGF 
Senior Scientist, High Performance Computing Center 
Adjunct Professor of Physics 
Texas Tech University 
1 
FAS* Co-located Conferences 
September 8-12, 2013
About the Open Grid Forum: 
Open Grid Forum (OGF) is a leading global standards 
development organization operating in the areas of cloud, 
grid and related forms of advanced distributed computing. 
The OGF community pursues these topics through an open 
process for development, creation and promotion of 
relevant specifications and use cases. 
OGF actively engages partners and participants throughout 
the international arena through an open forum with open 
processes to champion architectural blueprints related to 
cloud and grid computing. 
The resulting specifications and standards enable 
pervasive adoption of advanced distributed computing 
techniques for business and research worldwide. 
© 2014 Open Grid Forum FAS* 2014: SAOS, P2P, CAC, OGF London, UK Sep 9, 2014 
2
History and Background 
• OGF began in 2001 as an organization to promote the 
advancement of distributed computing worldwide. 
• Grid Forum --> Global Grid Forum --> GGF + Enterprise 
Grid Alliance --> formation of OGF in 2005. 
• Mandate is to take on all forms of distributed computing 
and to work to promote cooperation, information exchange, 
best practices in use and standardization. 
• OGF best known for a series of important computing, 
security and network standards that form the basis for 
major science and business-based distributed computing 
(BES, GridFTP, DRMAA, JSDL, RNS, GLUE, UR, etc.). 
• Have also been working on cloud and Big Data standards 
(OCCI, WS-Agreement, DFDL, etc.) for several years. 
• Cooperative work agreements with other SDOs in place. 
© 2014 Open Grid Forum FAS* 2014: SAOS, P2P, CAC, OGF London, UK Sep 9, 2014 
3
OGF Standards 
OGF has an extensive set of applicable standards related to 
advanced distributed grid and cloud computing and 
associated storage management and network operation: 
- Job Submission and Workflow Management (JSDL, BES) 
- Federated Identity Management (FedSec-CG) 
- Virtual Organizations (VOMS) 
- Managing the Trust Eco-System (CA operations, AuthN/AuthZ) 
- Network Management (NSI, NML, NMC, NM) 
- Secure, fast multi--party data transfer (GridFTP, SRM) 
- Service Agreements (WS-Agreement, WS-Agreement Negotiation) 
- Data Format Description (DFDL) 
- Cloud Computing interfaces (OCCI) 
- Distributed resource management APIs (DRMAA, SAGA, etc.) 
- Firewall Traversal (FiTP) 
- (Many others under development) 
© 2014 Open Grid Forum FAS* 2014: SAOS, P2P, CAC, OGF London, UK Sep 9, 2014 
4
Starting Point: OGF Documents 
© 2014 Open Grid Forum FAS* 2014: SAOS, P2P, CAC, OGF London, UK Sep 9, 2014 
5 
http://ogf.org/documents
OGF Document Types 
• Informational: To inform the community about a useful idea or 
set of ideas. 
• Experimental: To inform the community about a useful 
experiment, testbed or implementation of idea or set of ideas. 
• Community Practice: To inform the community of common 
practice or process, with the objective to influence the 
community. 
• Recommendations: To document a specification, analogous 
to an Internet Standards track document. Recommendations 
are initially designated as "proposed," and following further 
experience and review may become full recommendations. 
• Further information including guidance and advice contained 
in GFD.152 at: http://ogf.org/documents/GFD.152.pdf 
© 2014 Open Grid Forum FAS* 2014: SAOS, P2P, CAC, OGF London, UK Sep 9, 2014 
6
Example: Worldwide LHC 
Computing Grid 
© 2014 Open Grid Forum FAS* 2014: SAOS, P2P, CAC, OGF London, UK Sep 9, 2014 
7 
~450,000 cpu cores 
~430 Pb storage 
Typical data transfer 
rate: ~12 GByte/sec 
Total worldwide grid 
capacity: ~2x WLCG 
across all grids and 
VOs
XSEDE: The Next Generation of 
US National Supercomputing 
Infrastructure 
The Role of Standards for Risk Reduction and 
Inter-operation in XSEDE 
Cloud and grid standards 
now power some of the 
largest academic 
supercomputing 
infrastructures in the 
world!
US National 
Cyberinfrastructure 
Blacklight 
Shared 
Memory 
4k 
Xeon 
cores 
! 
Darter 
24k 
cores 
! 
Nautilus 
Visualization 
Data 
Analytics 
! 
Keeneland 
CPU/GPGPU 
Stampede 
460K 
cores 
w. 
Xeon 
Phi 
>1000 
users 
Upgrade 
in 
2015 
Yellowstone 
Geosciences 
Wrangler 
Data 
Analytics 
Trestles 
IO-­‐intensive 
10k 
cores 
160 
GB 
SSD/Flash 
! 
Gordon 
Data 
intensive 
64 
TB 
memory 
300 
TB 
Flash 
Mem 
Open 
Science 
Grid 
High 
throughput 
Blue 
Waters 
124 
sites 
Leadership 
SuperMIC 
380 
nodes 
– 
1PF 
(Ivy 
bridge, 
Xeon 
Phi, 
GPU) 
Over 
13 
million 
service 
units/day 
typically 
delivered 
as 
of 
2014 
across 
all 
XSEDE 
supercomputing 
sites 
(about 
3 
million 
core 
hours/day), 
totaling 
about 
1.6 
billion 
core 
hours 
per 
year 
Promote an 
open, robust, 
collaborative, 
and innovative 
ecosystem 
Adopt, 
create and 
disseminat 
e 
knowledge 
Extend 
the impact 
of cyber-infrastructure 
Prepare 
the current 
and next 
generation 
Provide 
technical 
expertise and 
support 
services 
Collaborate 
with other CI 
groups and 
projects 
FutureGrid 
* 
Maverick 
Visualization 
Data 
Analytics 
Comet 
“Long 
Tail 
Science” 
47k 
cores/2 
PF 
High 
throughput 
ACI-­‐REF 
Campus 
sharing, 
NSF 
Cloud 
(shared) 
Grids 
Credit: Irene 
Qualters, US 
National Science 
Foundation
CPU 
cores 361,300 
EGI-InSPIRE RI-2E6G1I3-­‐I2n3SPIRE 
EGI international presence 
Storage Value 
(yearly 
increase) 
Disk 
(PB) 
235 
PB 
(+69%) 
Tape 
(PB) 
176 
PB 
(+32%) 
Value 
(yearly 
increase) 
across 
53 
countries 
(1.44 
M 
job/day) 
RI-­‐261323 www.egi.eu www.egi.eu 
Standards-based international collaboration
EGI Federated Cloud: A successful standards-based 
international federated cloud infrastructure 
TUD 
KTH 
FCTSG INFN 
CETA CESGA 
DANTE 
Credit: David Wallom 
Chair EGI Federated Cloud Task Force 
Members 
•70 individuals 
•40 institutions 
•13 countries 
Stakeholders 
•23 Resource Providers 
•10 Technology Providers 
•7 User Communities 
•4 Liaisons 
CESNET 
Technologies 
•OpenStack 
•OpenNebula 
•StratusLab 
•CloudStack (in 
evaluation) 
•Synnefo 
•WNoDeS 
CNRS 
BSC 
LMU 
OeRC 
Masaryk 
IFAE 
Cyfronet 
100%IT 
RADICAL 
SRCE 
FZJ 
GRNET 
GWDG 
STFC 
SARA 
EGI.eu 
Imperial 
IFCA 
IGI 
IPHC 
IN2P3 
SZTAKI 
IISAS SixSq 
Standards 
•OCCI (control) 
•OVF (images) 
•X.509 (authN) 
•CDMI (storage - under 
development) 
(Updated July 2014)
Cloud Plugfest Developer Series: 
Continuing series… 
! 
Oriented towards REAL 
DEVELOPMENT 
! 
Past events 
co-sponsored by many open 
source and standards-related 
organizations including 
OGF, DMTF, SNIA, OASIS, ETSI, 
OCEAN and OW2 
© 2014 Open Grid Forum FAS* 2014: SAOS, P2P, CAC, OGF London, UK Sep 9, 2014 
Developer-oriented 
in-person 
standards and 
software testing 
series 
Cloud Plugfest 11 
just completed! 
More events in 
planning pipeline. 
Easy to get 
involved and join 
in events as 
developers or 
project 
researchers 
http://cloudplugfest.org 
12
Conclusions and Future: 
• OGF actively engages many partners and participants 
throughout the international arena through an open forum 
with open processes to promote best practices and 
standards in advanced distributed computing. 
• OGF occupies an important role in standards and 
software development with significant uptake in advanced 
distributed computing, including cloud, grid, networking 
and large-scale data processing, transfer and handling. 
• OGF documents support a variety of flexible architectures 
for advanced scientific, community and business uses. 
• OGF’s experience has enabled distributed computing built 
on these architectures to provide more flexible, efficient 
and utility-like global infrastructures. Join us! 
© 2014 Open Grid Forum FAS* 2014: SAOS, P2P, CAC, OGF London, UK Sep 9, 2014 
13

More Related Content

What's hot

Session 23 - Intro to EGEE-III
Session 23 - Intro to EGEE-IIISession 23 - Intro to EGEE-III
Session 23 - Intro to EGEE-III
ISSGC Summer School
 
SDN-based Inter-Cloud Federation for OF@TEIN
SDN-based Inter-Cloud Federation for OF@TEINSDN-based Inter-Cloud Federation for OF@TEIN
SDN-based Inter-Cloud Federation for OF@TEIN
GIST (Gwangju Institute of Science and Technology)
 
Session 33 - Production Grids
Session 33 - Production GridsSession 33 - Production Grids
Session 33 - Production Grids
ISSGC Summer School
 
Towards a Lightweight Multi-Cloud DSL for Elastic and Transferable Cloud-nati...
Towards a Lightweight Multi-Cloud DSL for Elastic and Transferable Cloud-nati...Towards a Lightweight Multi-Cloud DSL for Elastic and Transferable Cloud-nati...
Towards a Lightweight Multi-Cloud DSL for Elastic and Transferable Cloud-nati...
Nane Kratzke
 
Lte community networks in brazil sustainable modeling, deployment and mainte...
Lte community networks in brazil  sustainable modeling, deployment and mainte...Lte community networks in brazil  sustainable modeling, deployment and mainte...
Lte community networks in brazil sustainable modeling, deployment and mainte...
Christian Esteve Rothenberg
 
Postcard: NECOS
Postcard: NECOSPostcard: NECOS
NCOIC GCC OWS-10 presentation 10 7 2013
NCOIC GCC OWS-10 presentation 10 7 2013NCOIC GCC OWS-10 presentation 10 7 2013
NCOIC GCC OWS-10 presentation 10 7 2013
GovCloud Network
 
Thoughts on Cybersecurity
Thoughts on CybersecurityThoughts on Cybersecurity
Thoughts on Cybersecurity
Frank Wuerthwein
 
Cine grid exchange@cenic2010-5
Cine grid exchange@cenic2010-5Cine grid exchange@cenic2010-5
Cine grid exchange@cenic2010-5
Jerry Sheehan
 
LambdaFabric for Machine Learning Acceleration
LambdaFabric for Machine Learning AccelerationLambdaFabric for Machine Learning Acceleration
LambdaFabric for Machine Learning Acceleration
KnuEdge
 
The Pacific Research Platform Two Years In
The Pacific Research Platform Two Years InThe Pacific Research Platform Two Years In
The Pacific Research Platform Two Years In
Larry Smarr
 
Integration of WORSICA’s thematic service in EOSC, Service QA and Dataverse
Integration of WORSICA’s thematic service in EOSC,  Service QA and DataverseIntegration of WORSICA’s thematic service in EOSC,  Service QA and Dataverse
Integration of WORSICA’s thematic service in EOSC, Service QA and Dataverse
vty
 
Bergman Enabling Computation for neuro ML external
Bergman Enabling Computation for neuro ML externalBergman Enabling Computation for neuro ML external
Bergman Enabling Computation for neuro ML external
azlefty
 
Enabling efficient movement of data into & out of a high-performance analysis...
Enabling efficient movement of data into & out of a high-performance analysis...Enabling efficient movement of data into & out of a high-performance analysis...
Enabling efficient movement of data into & out of a high-performance analysis...
Jisc
 
Archiving data from Durham to RAL using the File Transfer Service (FTS)
Archiving data from Durham to RAL using the File Transfer Service (FTS)Archiving data from Durham to RAL using the File Transfer Service (FTS)
Archiving data from Durham to RAL using the File Transfer Service (FTS)
Jisc
 
OCCIware - A Framework for Everything as a Service - Cloud Expo London 2015
OCCIware - A Framework for Everything as a Service - Cloud Expo London 2015OCCIware - A Framework for Everything as a Service - Cloud Expo London 2015
OCCIware - A Framework for Everything as a Service - Cloud Expo London 2015
Marc Dutoo
 
Hyperledger weatherreport20190219 公開版
Hyperledger weatherreport20190219 公開版Hyperledger weatherreport20190219 公開版
Hyperledger weatherreport20190219 公開版
Hyperleger Tokyo Meetup
 
Cloud-Oriented Federated Projects and Testbeds: Current Status in the US and...
Cloud-Oriented Federated Projects and Testbeds:  Current Status in the US and...Cloud-Oriented Federated Projects and Testbeds:  Current Status in the US and...
Cloud-Oriented Federated Projects and Testbeds: Current Status in the US and...
Alan Sill
 
2010 Future of Advanced Computing
2010 Future of Advanced Computing2010 Future of Advanced Computing
2010 Future of Advanced Computing
Bob Marcus
 
The Science DMZ
The Science DMZThe Science DMZ
The Science DMZ
Jisc
 

What's hot (20)

Session 23 - Intro to EGEE-III
Session 23 - Intro to EGEE-IIISession 23 - Intro to EGEE-III
Session 23 - Intro to EGEE-III
 
SDN-based Inter-Cloud Federation for OF@TEIN
SDN-based Inter-Cloud Federation for OF@TEINSDN-based Inter-Cloud Federation for OF@TEIN
SDN-based Inter-Cloud Federation for OF@TEIN
 
Session 33 - Production Grids
Session 33 - Production GridsSession 33 - Production Grids
Session 33 - Production Grids
 
Towards a Lightweight Multi-Cloud DSL for Elastic and Transferable Cloud-nati...
Towards a Lightweight Multi-Cloud DSL for Elastic and Transferable Cloud-nati...Towards a Lightweight Multi-Cloud DSL for Elastic and Transferable Cloud-nati...
Towards a Lightweight Multi-Cloud DSL for Elastic and Transferable Cloud-nati...
 
Lte community networks in brazil sustainable modeling, deployment and mainte...
Lte community networks in brazil  sustainable modeling, deployment and mainte...Lte community networks in brazil  sustainable modeling, deployment and mainte...
Lte community networks in brazil sustainable modeling, deployment and mainte...
 
Postcard: NECOS
Postcard: NECOSPostcard: NECOS
Postcard: NECOS
 
NCOIC GCC OWS-10 presentation 10 7 2013
NCOIC GCC OWS-10 presentation 10 7 2013NCOIC GCC OWS-10 presentation 10 7 2013
NCOIC GCC OWS-10 presentation 10 7 2013
 
Thoughts on Cybersecurity
Thoughts on CybersecurityThoughts on Cybersecurity
Thoughts on Cybersecurity
 
Cine grid exchange@cenic2010-5
Cine grid exchange@cenic2010-5Cine grid exchange@cenic2010-5
Cine grid exchange@cenic2010-5
 
LambdaFabric for Machine Learning Acceleration
LambdaFabric for Machine Learning AccelerationLambdaFabric for Machine Learning Acceleration
LambdaFabric for Machine Learning Acceleration
 
The Pacific Research Platform Two Years In
The Pacific Research Platform Two Years InThe Pacific Research Platform Two Years In
The Pacific Research Platform Two Years In
 
Integration of WORSICA’s thematic service in EOSC, Service QA and Dataverse
Integration of WORSICA’s thematic service in EOSC,  Service QA and DataverseIntegration of WORSICA’s thematic service in EOSC,  Service QA and Dataverse
Integration of WORSICA’s thematic service in EOSC, Service QA and Dataverse
 
Bergman Enabling Computation for neuro ML external
Bergman Enabling Computation for neuro ML externalBergman Enabling Computation for neuro ML external
Bergman Enabling Computation for neuro ML external
 
Enabling efficient movement of data into & out of a high-performance analysis...
Enabling efficient movement of data into & out of a high-performance analysis...Enabling efficient movement of data into & out of a high-performance analysis...
Enabling efficient movement of data into & out of a high-performance analysis...
 
Archiving data from Durham to RAL using the File Transfer Service (FTS)
Archiving data from Durham to RAL using the File Transfer Service (FTS)Archiving data from Durham to RAL using the File Transfer Service (FTS)
Archiving data from Durham to RAL using the File Transfer Service (FTS)
 
OCCIware - A Framework for Everything as a Service - Cloud Expo London 2015
OCCIware - A Framework for Everything as a Service - Cloud Expo London 2015OCCIware - A Framework for Everything as a Service - Cloud Expo London 2015
OCCIware - A Framework for Everything as a Service - Cloud Expo London 2015
 
Hyperledger weatherreport20190219 公開版
Hyperledger weatherreport20190219 公開版Hyperledger weatherreport20190219 公開版
Hyperledger weatherreport20190219 公開版
 
Cloud-Oriented Federated Projects and Testbeds: Current Status in the US and...
Cloud-Oriented Federated Projects and Testbeds:  Current Status in the US and...Cloud-Oriented Federated Projects and Testbeds:  Current Status in the US and...
Cloud-Oriented Federated Projects and Testbeds: Current Status in the US and...
 
2010 Future of Advanced Computing
2010 Future of Advanced Computing2010 Future of Advanced Computing
2010 Future of Advanced Computing
 
The Science DMZ
The Science DMZThe Science DMZ
The Science DMZ
 

Similar to OGF Introductory Overview - FAS* 2014

Cloud Standards in the Real World: Cloud Standards Testing for Developers
Cloud Standards in the Real World: Cloud Standards Testing for DevelopersCloud Standards in the Real World: Cloud Standards Testing for Developers
Cloud Standards in the Real World: Cloud Standards Testing for Developers
Alan Sill
 
MPLS/SDN 2013 Intercloud Standardization and Testbeds - Sill
MPLS/SDN 2013 Intercloud Standardization and Testbeds - SillMPLS/SDN 2013 Intercloud Standardization and Testbeds - Sill
MPLS/SDN 2013 Intercloud Standardization and Testbeds - Sill
Alan Sill
 
ISC Cloud13 Sill - Crossing organizational boundaries in cloud computing
ISC Cloud13 Sill - Crossing organizational boundaries in cloud computingISC Cloud13 Sill - Crossing organizational boundaries in cloud computing
ISC Cloud13 Sill - Crossing organizational boundaries in cloud computing
Alan Sill
 
The Pacific Research Platform
The Pacific Research PlatformThe Pacific Research Platform
The Pacific Research Platform
Larry Smarr
 
2016 open-source-network-softwarization
2016 open-source-network-softwarization2016 open-source-network-softwarization
2016 open-source-network-softwarization
Christian Esteve Rothenberg
 
2016 open-source-network-softwarization
2016 open-source-network-softwarization2016 open-source-network-softwarization
2016 open-source-network-softwarization
Christian Esteve Rothenberg
 
ION Malta - IETF Update
ION Malta - IETF UpdateION Malta - IETF Update
ION Costa Rica - About the IETF and How to Get Involved
ION Costa Rica - About the IETF and How to Get InvolvedION Costa Rica - About the IETF and How to Get Involved
ION Costa Rica - About the IETF and How to Get Involved
Deploy360 Programme (Internet Society)
 
ION Islamabad - What's Happening at the IETF?
ION Islamabad - What's Happening at the IETF?ION Islamabad - What's Happening at the IETF?
ION Islamabad - What's Happening at the IETF?
Deploy360 Programme (Internet Society)
 
Federated Cloud Computing
Federated Cloud ComputingFederated Cloud Computing
Federated Cloud Computing
David Wallom
 
ION Belgrade - IETF Update
ION Belgrade - IETF UpdateION Belgrade - IETF Update
ION Belgrade - IETF Update
Deploy360 Programme (Internet Society)
 
Network Softwarization on KREONET: KREONET-S
Network Softwarization on KREONET: KREONET-SNetwork Softwarization on KREONET: KREONET-S
Network Softwarization on KREONET: KREONET-S
Dongkyun Kim
 
OGF Standards Overview - Cloudscape V
OGF Standards Overview - Cloudscape VOGF Standards Overview - Cloudscape V
OGF Standards Overview - Cloudscape V
Alan Sill
 
Future Internet: Managing Innovation and Testbed
Future Internet: Managing Innovation and TestbedFuture Internet: Managing Innovation and Testbed
Future Internet: Managing Innovation and Testbed
Shinji Shimojo
 
SomeSlides
SomeSlidesSomeSlides
SomeSlides
guestd60742
 
ION Durban - What's Happening at the IETF?
ION Durban - What's Happening at the IETF?ION Durban - What's Happening at the IETF?
ION Durban - What's Happening at the IETF?
Deploy360 Programme (Internet Society)
 
Session19 Globus
Session19 GlobusSession19 Globus
Session19 Globus
ISSGC Summer School
 
SKA NZ R&D BeSTGRID Infrastructure
SKA NZ R&D BeSTGRID InfrastructureSKA NZ R&D BeSTGRID Infrastructure
SKA NZ R&D BeSTGRID Infrastructure
Nick Jones
 
Creating a Climate for Innovation on Internet2 - Eric Boyd Senior Director, S...
Creating a Climate for Innovation on Internet2 - Eric Boyd Senior Director, S...Creating a Climate for Innovation on Internet2 - Eric Boyd Senior Director, S...
Creating a Climate for Innovation on Internet2 - Eric Boyd Senior Director, S...
Ed Dodds
 
Cultivating Sustainable Software For Research
Cultivating Sustainable Software For ResearchCultivating Sustainable Software For Research
Cultivating Sustainable Software For Research
Neil Chue Hong
 

Similar to OGF Introductory Overview - FAS* 2014 (20)

Cloud Standards in the Real World: Cloud Standards Testing for Developers
Cloud Standards in the Real World: Cloud Standards Testing for DevelopersCloud Standards in the Real World: Cloud Standards Testing for Developers
Cloud Standards in the Real World: Cloud Standards Testing for Developers
 
MPLS/SDN 2013 Intercloud Standardization and Testbeds - Sill
MPLS/SDN 2013 Intercloud Standardization and Testbeds - SillMPLS/SDN 2013 Intercloud Standardization and Testbeds - Sill
MPLS/SDN 2013 Intercloud Standardization and Testbeds - Sill
 
ISC Cloud13 Sill - Crossing organizational boundaries in cloud computing
ISC Cloud13 Sill - Crossing organizational boundaries in cloud computingISC Cloud13 Sill - Crossing organizational boundaries in cloud computing
ISC Cloud13 Sill - Crossing organizational boundaries in cloud computing
 
The Pacific Research Platform
The Pacific Research PlatformThe Pacific Research Platform
The Pacific Research Platform
 
2016 open-source-network-softwarization
2016 open-source-network-softwarization2016 open-source-network-softwarization
2016 open-source-network-softwarization
 
2016 open-source-network-softwarization
2016 open-source-network-softwarization2016 open-source-network-softwarization
2016 open-source-network-softwarization
 
ION Malta - IETF Update
ION Malta - IETF UpdateION Malta - IETF Update
ION Malta - IETF Update
 
ION Costa Rica - About the IETF and How to Get Involved
ION Costa Rica - About the IETF and How to Get InvolvedION Costa Rica - About the IETF and How to Get Involved
ION Costa Rica - About the IETF and How to Get Involved
 
ION Islamabad - What's Happening at the IETF?
ION Islamabad - What's Happening at the IETF?ION Islamabad - What's Happening at the IETF?
ION Islamabad - What's Happening at the IETF?
 
Federated Cloud Computing
Federated Cloud ComputingFederated Cloud Computing
Federated Cloud Computing
 
ION Belgrade - IETF Update
ION Belgrade - IETF UpdateION Belgrade - IETF Update
ION Belgrade - IETF Update
 
Network Softwarization on KREONET: KREONET-S
Network Softwarization on KREONET: KREONET-SNetwork Softwarization on KREONET: KREONET-S
Network Softwarization on KREONET: KREONET-S
 
OGF Standards Overview - Cloudscape V
OGF Standards Overview - Cloudscape VOGF Standards Overview - Cloudscape V
OGF Standards Overview - Cloudscape V
 
Future Internet: Managing Innovation and Testbed
Future Internet: Managing Innovation and TestbedFuture Internet: Managing Innovation and Testbed
Future Internet: Managing Innovation and Testbed
 
SomeSlides
SomeSlidesSomeSlides
SomeSlides
 
ION Durban - What's Happening at the IETF?
ION Durban - What's Happening at the IETF?ION Durban - What's Happening at the IETF?
ION Durban - What's Happening at the IETF?
 
Session19 Globus
Session19 GlobusSession19 Globus
Session19 Globus
 
SKA NZ R&D BeSTGRID Infrastructure
SKA NZ R&D BeSTGRID InfrastructureSKA NZ R&D BeSTGRID Infrastructure
SKA NZ R&D BeSTGRID Infrastructure
 
Creating a Climate for Innovation on Internet2 - Eric Boyd Senior Director, S...
Creating a Climate for Innovation on Internet2 - Eric Boyd Senior Director, S...Creating a Climate for Innovation on Internet2 - Eric Boyd Senior Director, S...
Creating a Climate for Innovation on Internet2 - Eric Boyd Senior Director, S...
 
Cultivating Sustainable Software For Research
Cultivating Sustainable Software For ResearchCultivating Sustainable Software For Research
Cultivating Sustainable Software For Research
 

More from Alan Sill

Return on Investment for Research Computing and Data Support 2021-03-03
Return on Investment for Research Computing and Data Support 2021-03-03Return on Investment for Research Computing and Data Support 2021-03-03
Return on Investment for Research Computing and Data Support 2021-03-03
Alan Sill
 
Design installation-commissioning-red raider-cluster-ttu
Design installation-commissioning-red raider-cluster-ttuDesign installation-commissioning-red raider-cluster-ttu
Design installation-commissioning-red raider-cluster-ttu
Alan Sill
 
OCCI-OS tutorial
OCCI-OS tutorialOCCI-OS tutorial
OCCI-OS tutorial
Alan Sill
 
SAJACC Working Group Recommendations to NIST, Feb. 12 2013
SAJACC Working Group Recommendations to NIST, Feb. 12 2013SAJACC Working Group Recommendations to NIST, Feb. 12 2013
SAJACC Working Group Recommendations to NIST, Feb. 12 2013
Alan Sill
 
SAJACC WG Report Summary and Conclusions Jan 2013
SAJACC WG Report Summary and Conclusions  Jan 2013SAJACC WG Report Summary and Conclusions  Jan 2013
SAJACC WG Report Summary and Conclusions Jan 2013
Alan Sill
 
Requirement 5: Federated Community Cloud - Sill
Requirement 5: Federated Community Cloud - SillRequirement 5: Federated Community Cloud - Sill
Requirement 5: Federated Community Cloud - Sill
Alan Sill
 

More from Alan Sill (6)

Return on Investment for Research Computing and Data Support 2021-03-03
Return on Investment for Research Computing and Data Support 2021-03-03Return on Investment for Research Computing and Data Support 2021-03-03
Return on Investment for Research Computing and Data Support 2021-03-03
 
Design installation-commissioning-red raider-cluster-ttu
Design installation-commissioning-red raider-cluster-ttuDesign installation-commissioning-red raider-cluster-ttu
Design installation-commissioning-red raider-cluster-ttu
 
OCCI-OS tutorial
OCCI-OS tutorialOCCI-OS tutorial
OCCI-OS tutorial
 
SAJACC Working Group Recommendations to NIST, Feb. 12 2013
SAJACC Working Group Recommendations to NIST, Feb. 12 2013SAJACC Working Group Recommendations to NIST, Feb. 12 2013
SAJACC Working Group Recommendations to NIST, Feb. 12 2013
 
SAJACC WG Report Summary and Conclusions Jan 2013
SAJACC WG Report Summary and Conclusions  Jan 2013SAJACC WG Report Summary and Conclusions  Jan 2013
SAJACC WG Report Summary and Conclusions Jan 2013
 
Requirement 5: Federated Community Cloud - Sill
Requirement 5: Federated Community Cloud - SillRequirement 5: Federated Community Cloud - Sill
Requirement 5: Federated Community Cloud - Sill
 

Recently uploaded

Demystifying Neural Networks And Building Cybersecurity Applications
Demystifying Neural Networks And Building Cybersecurity ApplicationsDemystifying Neural Networks And Building Cybersecurity Applications
Demystifying Neural Networks And Building Cybersecurity Applications
Priyanka Aash
 
Garbage In, Garbage Out: Why poor data curation is killing your AI models (an...
Garbage In, Garbage Out: Why poor data curation is killing your AI models (an...Garbage In, Garbage Out: Why poor data curation is killing your AI models (an...
Garbage In, Garbage Out: Why poor data curation is killing your AI models (an...
Zilliz
 
Camunda Chapter NY Meetup July 2024.pptx
Camunda Chapter NY Meetup July 2024.pptxCamunda Chapter NY Meetup July 2024.pptx
Camunda Chapter NY Meetup July 2024.pptx
ZachWylie3
 
Acumatica vs. Sage Intacct _Construction_July (1).pptx
Acumatica vs. Sage Intacct _Construction_July (1).pptxAcumatica vs. Sage Intacct _Construction_July (1).pptx
Acumatica vs. Sage Intacct _Construction_July (1).pptx
BrainSell Technologies
 
Accelerating Migrations = Recommendations
Accelerating Migrations = RecommendationsAccelerating Migrations = Recommendations
Accelerating Migrations = Recommendations
isBullShit
 
LeadMagnet IQ Review: Unlock the Secret to Effortless Traffic and Leads.pdf
LeadMagnet IQ Review:  Unlock the Secret to Effortless Traffic and Leads.pdfLeadMagnet IQ Review:  Unlock the Secret to Effortless Traffic and Leads.pdf
LeadMagnet IQ Review: Unlock the Secret to Effortless Traffic and Leads.pdf
SelfMade bd
 
Mule Experience Hub and Release Channel with Java 17
Mule Experience Hub and Release Channel with Java 17Mule Experience Hub and Release Channel with Java 17
Mule Experience Hub and Release Channel with Java 17
Bhajan Mehta
 
The Path to General-Purpose Robots - Coatue
The Path to General-Purpose Robots - CoatueThe Path to General-Purpose Robots - Coatue
The Path to General-Purpose Robots - Coatue
Razin Mustafiz
 
Types of Weaving loom machine & it's technology
Types of Weaving loom machine & it's technologyTypes of Weaving loom machine & it's technology
Types of Weaving loom machine & it's technology
ldtexsolbl
 
CheckPoint Firewall Presentation CCSA.pdf
CheckPoint Firewall Presentation CCSA.pdfCheckPoint Firewall Presentation CCSA.pdf
CheckPoint Firewall Presentation CCSA.pdf
ssuser137992
 
Mastering OnlyFans Clone App Development: Key Strategies for Success
Mastering OnlyFans Clone App Development: Key Strategies for SuccessMastering OnlyFans Clone App Development: Key Strategies for Success
Mastering OnlyFans Clone App Development: Key Strategies for Success
David Wilson
 
Integrating Kafka with MuleSoft 4 and usecase
Integrating Kafka with MuleSoft 4 and usecaseIntegrating Kafka with MuleSoft 4 and usecase
Integrating Kafka with MuleSoft 4 and usecase
shyamraj55
 
Semantic-Aware Code Model: Elevating the Future of Software Development
Semantic-Aware Code Model: Elevating the Future of Software DevelopmentSemantic-Aware Code Model: Elevating the Future of Software Development
Semantic-Aware Code Model: Elevating the Future of Software Development
Baishakhi Ray
 
Perth MuleSoft Meetup July 2024
Perth MuleSoft Meetup July 2024Perth MuleSoft Meetup July 2024
Perth MuleSoft Meetup July 2024
Michael Price
 
BLOCKCHAIN TECHNOLOGY - Advantages and Disadvantages
BLOCKCHAIN TECHNOLOGY - Advantages and DisadvantagesBLOCKCHAIN TECHNOLOGY - Advantages and Disadvantages
BLOCKCHAIN TECHNOLOGY - Advantages and Disadvantages
SAI KAILASH R
 
Generative AI Reasoning Tech Talk - July 2024
Generative AI Reasoning Tech Talk - July 2024Generative AI Reasoning Tech Talk - July 2024
Generative AI Reasoning Tech Talk - July 2024
siddu769252
 
Discovery Series - Zero to Hero - Task Mining Session 1
Discovery Series - Zero to Hero - Task Mining Session 1Discovery Series - Zero to Hero - Task Mining Session 1
Discovery Series - Zero to Hero - Task Mining Session 1
DianaGray10
 
Smart Mobility Market:Revolutionizing Transportation.pdf
Smart Mobility Market:Revolutionizing Transportation.pdfSmart Mobility Market:Revolutionizing Transportation.pdf
Smart Mobility Market:Revolutionizing Transportation.pdf
Market.us
 
Welcome to Cyberbiosecurity. Because regular cybersecurity wasn't complicated...
Welcome to Cyberbiosecurity. Because regular cybersecurity wasn't complicated...Welcome to Cyberbiosecurity. Because regular cybersecurity wasn't complicated...
Welcome to Cyberbiosecurity. Because regular cybersecurity wasn't complicated...
Snarky Security
 
Improving Learning Content Efficiency with Reusable Learning Content
Improving Learning Content Efficiency with Reusable Learning ContentImproving Learning Content Efficiency with Reusable Learning Content
Improving Learning Content Efficiency with Reusable Learning Content
Enterprise Knowledge
 

Recently uploaded (20)

Demystifying Neural Networks And Building Cybersecurity Applications
Demystifying Neural Networks And Building Cybersecurity ApplicationsDemystifying Neural Networks And Building Cybersecurity Applications
Demystifying Neural Networks And Building Cybersecurity Applications
 
Garbage In, Garbage Out: Why poor data curation is killing your AI models (an...
Garbage In, Garbage Out: Why poor data curation is killing your AI models (an...Garbage In, Garbage Out: Why poor data curation is killing your AI models (an...
Garbage In, Garbage Out: Why poor data curation is killing your AI models (an...
 
Camunda Chapter NY Meetup July 2024.pptx
Camunda Chapter NY Meetup July 2024.pptxCamunda Chapter NY Meetup July 2024.pptx
Camunda Chapter NY Meetup July 2024.pptx
 
Acumatica vs. Sage Intacct _Construction_July (1).pptx
Acumatica vs. Sage Intacct _Construction_July (1).pptxAcumatica vs. Sage Intacct _Construction_July (1).pptx
Acumatica vs. Sage Intacct _Construction_July (1).pptx
 
Accelerating Migrations = Recommendations
Accelerating Migrations = RecommendationsAccelerating Migrations = Recommendations
Accelerating Migrations = Recommendations
 
LeadMagnet IQ Review: Unlock the Secret to Effortless Traffic and Leads.pdf
LeadMagnet IQ Review:  Unlock the Secret to Effortless Traffic and Leads.pdfLeadMagnet IQ Review:  Unlock the Secret to Effortless Traffic and Leads.pdf
LeadMagnet IQ Review: Unlock the Secret to Effortless Traffic and Leads.pdf
 
Mule Experience Hub and Release Channel with Java 17
Mule Experience Hub and Release Channel with Java 17Mule Experience Hub and Release Channel with Java 17
Mule Experience Hub and Release Channel with Java 17
 
The Path to General-Purpose Robots - Coatue
The Path to General-Purpose Robots - CoatueThe Path to General-Purpose Robots - Coatue
The Path to General-Purpose Robots - Coatue
 
Types of Weaving loom machine & it's technology
Types of Weaving loom machine & it's technologyTypes of Weaving loom machine & it's technology
Types of Weaving loom machine & it's technology
 
CheckPoint Firewall Presentation CCSA.pdf
CheckPoint Firewall Presentation CCSA.pdfCheckPoint Firewall Presentation CCSA.pdf
CheckPoint Firewall Presentation CCSA.pdf
 
Mastering OnlyFans Clone App Development: Key Strategies for Success
Mastering OnlyFans Clone App Development: Key Strategies for SuccessMastering OnlyFans Clone App Development: Key Strategies for Success
Mastering OnlyFans Clone App Development: Key Strategies for Success
 
Integrating Kafka with MuleSoft 4 and usecase
Integrating Kafka with MuleSoft 4 and usecaseIntegrating Kafka with MuleSoft 4 and usecase
Integrating Kafka with MuleSoft 4 and usecase
 
Semantic-Aware Code Model: Elevating the Future of Software Development
Semantic-Aware Code Model: Elevating the Future of Software DevelopmentSemantic-Aware Code Model: Elevating the Future of Software Development
Semantic-Aware Code Model: Elevating the Future of Software Development
 
Perth MuleSoft Meetup July 2024
Perth MuleSoft Meetup July 2024Perth MuleSoft Meetup July 2024
Perth MuleSoft Meetup July 2024
 
BLOCKCHAIN TECHNOLOGY - Advantages and Disadvantages
BLOCKCHAIN TECHNOLOGY - Advantages and DisadvantagesBLOCKCHAIN TECHNOLOGY - Advantages and Disadvantages
BLOCKCHAIN TECHNOLOGY - Advantages and Disadvantages
 
Generative AI Reasoning Tech Talk - July 2024
Generative AI Reasoning Tech Talk - July 2024Generative AI Reasoning Tech Talk - July 2024
Generative AI Reasoning Tech Talk - July 2024
 
Discovery Series - Zero to Hero - Task Mining Session 1
Discovery Series - Zero to Hero - Task Mining Session 1Discovery Series - Zero to Hero - Task Mining Session 1
Discovery Series - Zero to Hero - Task Mining Session 1
 
Smart Mobility Market:Revolutionizing Transportation.pdf
Smart Mobility Market:Revolutionizing Transportation.pdfSmart Mobility Market:Revolutionizing Transportation.pdf
Smart Mobility Market:Revolutionizing Transportation.pdf
 
Welcome to Cyberbiosecurity. Because regular cybersecurity wasn't complicated...
Welcome to Cyberbiosecurity. Because regular cybersecurity wasn't complicated...Welcome to Cyberbiosecurity. Because regular cybersecurity wasn't complicated...
Welcome to Cyberbiosecurity. Because regular cybersecurity wasn't complicated...
 
Improving Learning Content Efficiency with Reusable Learning Content
Improving Learning Content Efficiency with Reusable Learning ContentImproving Learning Content Efficiency with Reusable Learning Content
Improving Learning Content Efficiency with Reusable Learning Content
 

OGF Introductory Overview - FAS* 2014

  • 1. ©2013 Open Grid Forum The Open Grid Forum: History, Introduction and Process Alan Sill VP of Standards, OGF Senior Scientist, High Performance Computing Center Adjunct Professor of Physics Texas Tech University 1 FAS* Co-located Conferences September 8-12, 2013
  • 2. About the Open Grid Forum: Open Grid Forum (OGF) is a leading global standards development organization operating in the areas of cloud, grid and related forms of advanced distributed computing. The OGF community pursues these topics through an open process for development, creation and promotion of relevant specifications and use cases. OGF actively engages partners and participants throughout the international arena through an open forum with open processes to champion architectural blueprints related to cloud and grid computing. The resulting specifications and standards enable pervasive adoption of advanced distributed computing techniques for business and research worldwide. © 2014 Open Grid Forum FAS* 2014: SAOS, P2P, CAC, OGF London, UK Sep 9, 2014 2
  • 3. History and Background • OGF began in 2001 as an organization to promote the advancement of distributed computing worldwide. • Grid Forum --> Global Grid Forum --> GGF + Enterprise Grid Alliance --> formation of OGF in 2005. • Mandate is to take on all forms of distributed computing and to work to promote cooperation, information exchange, best practices in use and standardization. • OGF best known for a series of important computing, security and network standards that form the basis for major science and business-based distributed computing (BES, GridFTP, DRMAA, JSDL, RNS, GLUE, UR, etc.). • Have also been working on cloud and Big Data standards (OCCI, WS-Agreement, DFDL, etc.) for several years. • Cooperative work agreements with other SDOs in place. © 2014 Open Grid Forum FAS* 2014: SAOS, P2P, CAC, OGF London, UK Sep 9, 2014 3
  • 4. OGF Standards OGF has an extensive set of applicable standards related to advanced distributed grid and cloud computing and associated storage management and network operation: - Job Submission and Workflow Management (JSDL, BES) - Federated Identity Management (FedSec-CG) - Virtual Organizations (VOMS) - Managing the Trust Eco-System (CA operations, AuthN/AuthZ) - Network Management (NSI, NML, NMC, NM) - Secure, fast multi--party data transfer (GridFTP, SRM) - Service Agreements (WS-Agreement, WS-Agreement Negotiation) - Data Format Description (DFDL) - Cloud Computing interfaces (OCCI) - Distributed resource management APIs (DRMAA, SAGA, etc.) - Firewall Traversal (FiTP) - (Many others under development) © 2014 Open Grid Forum FAS* 2014: SAOS, P2P, CAC, OGF London, UK Sep 9, 2014 4
  • 5. Starting Point: OGF Documents © 2014 Open Grid Forum FAS* 2014: SAOS, P2P, CAC, OGF London, UK Sep 9, 2014 5 http://ogf.org/documents
  • 6. OGF Document Types • Informational: To inform the community about a useful idea or set of ideas. • Experimental: To inform the community about a useful experiment, testbed or implementation of idea or set of ideas. • Community Practice: To inform the community of common practice or process, with the objective to influence the community. • Recommendations: To document a specification, analogous to an Internet Standards track document. Recommendations are initially designated as "proposed," and following further experience and review may become full recommendations. • Further information including guidance and advice contained in GFD.152 at: http://ogf.org/documents/GFD.152.pdf © 2014 Open Grid Forum FAS* 2014: SAOS, P2P, CAC, OGF London, UK Sep 9, 2014 6
  • 7. Example: Worldwide LHC Computing Grid © 2014 Open Grid Forum FAS* 2014: SAOS, P2P, CAC, OGF London, UK Sep 9, 2014 7 ~450,000 cpu cores ~430 Pb storage Typical data transfer rate: ~12 GByte/sec Total worldwide grid capacity: ~2x WLCG across all grids and VOs
  • 8. XSEDE: The Next Generation of US National Supercomputing Infrastructure The Role of Standards for Risk Reduction and Inter-operation in XSEDE Cloud and grid standards now power some of the largest academic supercomputing infrastructures in the world!
  • 9. US National Cyberinfrastructure Blacklight Shared Memory 4k Xeon cores ! Darter 24k cores ! Nautilus Visualization Data Analytics ! Keeneland CPU/GPGPU Stampede 460K cores w. Xeon Phi >1000 users Upgrade in 2015 Yellowstone Geosciences Wrangler Data Analytics Trestles IO-­‐intensive 10k cores 160 GB SSD/Flash ! Gordon Data intensive 64 TB memory 300 TB Flash Mem Open Science Grid High throughput Blue Waters 124 sites Leadership SuperMIC 380 nodes – 1PF (Ivy bridge, Xeon Phi, GPU) Over 13 million service units/day typically delivered as of 2014 across all XSEDE supercomputing sites (about 3 million core hours/day), totaling about 1.6 billion core hours per year Promote an open, robust, collaborative, and innovative ecosystem Adopt, create and disseminat e knowledge Extend the impact of cyber-infrastructure Prepare the current and next generation Provide technical expertise and support services Collaborate with other CI groups and projects FutureGrid * Maverick Visualization Data Analytics Comet “Long Tail Science” 47k cores/2 PF High throughput ACI-­‐REF Campus sharing, NSF Cloud (shared) Grids Credit: Irene Qualters, US National Science Foundation
  • 10. CPU cores 361,300 EGI-InSPIRE RI-2E6G1I3-­‐I2n3SPIRE EGI international presence Storage Value (yearly increase) Disk (PB) 235 PB (+69%) Tape (PB) 176 PB (+32%) Value (yearly increase) across 53 countries (1.44 M job/day) RI-­‐261323 www.egi.eu www.egi.eu Standards-based international collaboration
  • 11. EGI Federated Cloud: A successful standards-based international federated cloud infrastructure TUD KTH FCTSG INFN CETA CESGA DANTE Credit: David Wallom Chair EGI Federated Cloud Task Force Members •70 individuals •40 institutions •13 countries Stakeholders •23 Resource Providers •10 Technology Providers •7 User Communities •4 Liaisons CESNET Technologies •OpenStack •OpenNebula •StratusLab •CloudStack (in evaluation) •Synnefo •WNoDeS CNRS BSC LMU OeRC Masaryk IFAE Cyfronet 100%IT RADICAL SRCE FZJ GRNET GWDG STFC SARA EGI.eu Imperial IFCA IGI IPHC IN2P3 SZTAKI IISAS SixSq Standards •OCCI (control) •OVF (images) •X.509 (authN) •CDMI (storage - under development) (Updated July 2014)
  • 12. Cloud Plugfest Developer Series: Continuing series… ! Oriented towards REAL DEVELOPMENT ! Past events co-sponsored by many open source and standards-related organizations including OGF, DMTF, SNIA, OASIS, ETSI, OCEAN and OW2 © 2014 Open Grid Forum FAS* 2014: SAOS, P2P, CAC, OGF London, UK Sep 9, 2014 Developer-oriented in-person standards and software testing series Cloud Plugfest 11 just completed! More events in planning pipeline. Easy to get involved and join in events as developers or project researchers http://cloudplugfest.org 12
  • 13. Conclusions and Future: • OGF actively engages many partners and participants throughout the international arena through an open forum with open processes to promote best practices and standards in advanced distributed computing. • OGF occupies an important role in standards and software development with significant uptake in advanced distributed computing, including cloud, grid, networking and large-scale data processing, transfer and handling. • OGF documents support a variety of flexible architectures for advanced scientific, community and business uses. • OGF’s experience has enabled distributed computing built on these architectures to provide more flexible, efficient and utility-like global infrastructures. Join us! © 2014 Open Grid Forum FAS* 2014: SAOS, P2P, CAC, OGF London, UK Sep 9, 2014 13