SlideShare a Scribd company logo
Grid Computing
             and
      High-Performance
         Computing
              in
            Israel
              Guy Tel-Zur, Ph.D.
The Israeli Association of Grid Technologies
             tel-zur@computer.org
        http://www.Grid.org.il
Topics
■   Background
       About the country
       Infrastructure
■   The Academy
       IAG
       The Technion, The Hebrew Univ., Ben-Gurion Univ.
■   The Industry
       IGT
■   The SEPAC Collaboration
Background
This means~500,000PCs
Overall Computing
Power: ~500 TFLOPS
  
Network Infrastructure
ILAN Statistics
                  2006




                  2008
Israel




                              IUCC




IUCC – The Inter University Computation Center
The Academy
The Israel Academic Grid
          (IAG)
• http://iag.iucc.ac.il/
• Funded by the MOST
• Steering & Technical
  Committees
• Coordinates the Israeli activity in
  EGEE, EGI and IsraGrid



   IUCC is the CA for the IAG
EGEE III

■   May 1st 2008 to April 30th 2010
■   Budget reduced by about 50%
■   Subject to severe FP7 regulations
■   SA1 to be handled through ISRAGRID

                 Vision of EGI
Formation of National Grid Initiatives (NGIs) which unite
efforts within each country, providing a single point of
contact for coordinated efforts
IsraGrid
■ A national committee recommended last July to
  establish a National Grid Computing
  Infrastructure.
■ Waiting for final approval by the Government
■ To be used only for R&D purposes
■ To be used by all the Academic institutes and
  the Israeli High-Tech industry
■ Secured access
■ Managed by the IUCC
MOSIX
A management system targeted for HPC on
x86 Linux clusters and multi-cluster
organizational grids
Main features:
 – supports parallel processes and batch jobs
 – Automatic resource discovery
 – Adaptive workload distribution by process
   migration
 Outcome: the grid and each cluster performs like a
   single computer with multiple processors
  Guest processes can’t modify resources in
  hosting nodes
The Hebrew University
        Organizational Grid

• 15 MOSIX clusters ~400 nodes
• In life-sciences, medical school, chemistry and computer
  science
• Applications:
  Nano-technology, Molecular dynamics, Protein folding,
  Genomics (BLAT, BLAST, SW), Meteorological
  weather forecast (WRF), Navier-Stokes equations and
  turbulence (CFD) , CPU simulator of new hardware
  design (SimpleScalar)
     More information at http://www.MOSIX.org
Nanco- a cluster for
           Nanotechnology
Technion
Center for Computation in Nanotechnology,
Russell-Berrie Nanotechnology Institute
Taub Computer Center                    M               M                     M
                                         P   P         P P                P       P
64 dual processor dual
core compute nodes (total
256 cores), Opteron Rev. F
8GB RAM memory/node                               Infiniband Switch
 2 master nodes for H/A ,   Operational since summer 2007
                             


also Opterons for
redundency                   Provided by Sun – integrated by EMET and Voltaire
                             




Fast DDR Infiniband         SUN and GNU compilers
                             



Interconnect                 Voltaire MPI and OpenMPI for parallelization
                             


Netapp storage              Most of codes are MPI codes – either commercial
                             or self developed
                                More info on http://phycomp.technion.ac.il/~nanco
Grid Computing at the
           Technion
Israel Institute of Technology


http://dsl.cs.technion.ac.il/index.html
                                          • Projects:
• Distributed Systems                       –   GMS
  Laboratory                                –   Super-Link Online
                                            –   The Dependable Grid
• Prof. Assaf Schuster –
  Head                                      –   EGEE
                                            –   …and more
GMS – Grid Monitoring
              System

   Distributively store all logs of a large batch
    system in local databases
   Apply distributed data mining on logs
   Implementation using Condor
   Taken up by Intel NetBatch team: started a $3M
    project
SuperLink Online
   http://bioinfo.cs.technion.ac.il/superlink-online/
     a production portal for geneticists working at hospitals

   Submitted tasks contain gene mapping results from lab
    experiments
   Portal user sees a single computer (!)
   Implemented using a hierarchy of Condor pools
    −   Highest/smallest pool in Technion (DSL)
    −   Lowest/largest in Madison (GLOW).
   In progress: linkage@home and EGEE BioMed
    implementations.
The Dependable Grid
   Provide a High Availability (HA) Library as a service for
    any Grid component

   HA for Condor matchmaker with zero loc changes (!!!)

   Part of Condor 6.8 distribution

   Deployed in many large Condor production pools

   Plans to develop and support an open-source
    distribution
Ben Gurion University of the
          Negev

 • Inter campus Condor pool

 • Grid Computing
The BGU Condor Pool




•   Started in 2000
•   Today: ~200 processors
•   Linux & Windows
•   Campus-wide project
•   Non-dedicated resources
We plan to build a new Condor pool
installation at the Soroka Medical Center in
Beer-Sheva
Grid Computing in the Negev
       - BGU, NRCN
 BGU:
 • A Certified EGEE-II Production site
 • A Pre-Production EGEE site
 NRCN:
   A small Condor pool
   40 processors, Part of the IGT Grid Lab.


   A member of the SEPAC Grid

    Collaboration
Parallel Processing
            Education
■   Cluster made of Virtual Machines (Xen)
■   “Classic” tools: MPI, OpenMP
■   “Modern” tools: Star-P, Grid Mathematica
■   Grid Computing practice: Condor, Gilda and
    UNICORE
■   Final projects on a variety of subjects: Parallel
    Image Processing, Parallel Game of Life,
    Map/Reduce, Monte Carlo…
The IDIP Group
 Inter-Disciplinary Digital Image Processing
                                         Scientific Computing,
             Physics and
                                           Optimization and
             Engineering
                                             Data Analysis




                           Applied Imaging
                               Science


• BGU Members belong to variety of departments from
the faculties of Engineering, Exact Sciences and the
School of Medicine
• Collaborations with various parties in the academia
and Industry
• More than 20 research students
Multi-scale Geometric methods
 for Filaments detection in 3D
   Development of state of the art tools
   Due to the large typical size of real 3D images and
    the high dimensionality of the coefficients space
    the computational and storage complexity are very
    high
The Israeli Association of
 Grid Technologies (IGT)
IGT Members
IGT Work Groups

•   Grid-Data Centers & Labs Utilization
      Peter Weinstein, IGT Lab Manager
•   Grid-SOA
      Ronen Yochpaz, CTO VeNotion
•   Grid-HPC
      Dr. Guy Tel-Zur, NRCN
•   Grid-Application Server
      Nati Shalom, CTO GigaSpaces
•   Grid-RDMA
      Asaf Somekh, Voltaire
•   Grid-Virtualization
      Niran Even Chen, BenefIT
IGT WEB Site
     Knowledge Sharing and Networking



16,500 Visitors per Month/ 75% from the US


1GigaByte Downloads per Month
IGT2008 – World Summit of Cloud Computing
   December 1-2, 2008, Hertzelia, Israel




 Cristophe Bisciglia                    Simone Brunozzi
 Creator of Google's Academic           Web Services Evangelist,
 Cloud Computing Initiative (ACCI)      Amazon Web Services
 Senior Software Engineer, Google




 Paul Strong                            Dr. Owen O'Malley
 Distinguished Research Scientist, eBay Owen O’Malley, Yahoo!
                                        Hadoop Architect and Apache VP for Hadoop
IGT2008 – World Summit of Cloud Computing
   December 1-2, 2008, Hertzelia, Israel




 Steve Rubinow, CIO, NYSE Euronext,             Dr. Frank Baetke
 The largest exchange in the world.             Global HPC-Technology
                                                Program Manager
                                                HPCD Richardson / Munich




  Dr. Yaron Wolfsthal
  Senior Manager, Reliable System Technologies
  IBM Research Lab in Haifa (HRL)
  IBM and EU Joint Research Initiative for Cloud Computing - RESERVOIR
The SEPAC
          Collaboration
SEPAC, The Southern European Partnership
for Advanced Computing, is a multi-national
Grid-cooperation initiated by major South-
European High Performance Computing
Centers.

The objective is to build a Grid as a highly
reliable application framework based on open
interfaces facilitating a consistent and easy-to-
use user interface for scientists and
researchers in distributed heterogeneous
environments.
The SEPAC Grid
SEPAC Future
We are looking for more sites to join us
http://www.sepac-grid.org
                   Cloud Computing
                        Layer
http://www.facebook.com/
group.php?gid=8450870046
Thanks to…
■   Prof. David Horn, TAU, Head of the IAG
■   Mr. Avner Agom, IGT General Manager
■   Prof. Amnon Barak, CS Dept., HUJI.
■   Mr. Eddie Aharonovich, CS. Dept., TAU
■   Dr. Anne Weill,The Technion
■   Dr. Ofer Levi, The Ben-Gurion Univ.
■   The SEPAC Collaboration
Questions ?

    References:
   Condor at the BGU:
    http://www.ee.bgu.ac.il/~tel-zur/condor/

   quot;An Introduction to Parallel Processing” course at the
    BGU:
    http://www.ee.bgu.ac.il/~tel-zur/teaching/2008B
   Grid Computing at the BGU:
    http://www.ee.bgu.ac.il/~tel-zur/grid.html
   IGT: http://www.grid.org.il
   EGI: http://web.eu-egi.eu/

More Related Content

Viewers also liked

Grid Computing (An Up-Coming Technology)
Grid Computing (An Up-Coming Technology)Grid Computing (An Up-Coming Technology)
Grid Computing (An Up-Coming Technology)
LJ PROJECTS
 
Grid computing 2007
Grid computing 2007Grid computing 2007
Grid computing 2007
Tank Bhavin
 
Grid Computing
Grid ComputingGrid Computing
Grid Computing
Senthil Kumar
 
Grid Computing
Grid ComputingGrid Computing
Grid Computing
Arun Basil Lal
 
68th ICREA Colloquium "The Worldwide LHC Computing Grid: Riding the computing...
68th ICREA Colloquium "The Worldwide LHC Computing Grid: Riding the computing...68th ICREA Colloquium "The Worldwide LHC Computing Grid: Riding the computing...
68th ICREA Colloquium "The Worldwide LHC Computing Grid: Riding the computing...
ICREA
 
grid computing
grid computinggrid computing
grid computing
elliando dias
 
Grid Computing
Grid ComputingGrid Computing
Grid Computing
sharmili priyadarsini
 
Grid computing
Grid computingGrid computing
Grid computing
Shashwat Shriparv
 
Grid computing by ahlam ansari
Grid computing by  ahlam ansariGrid computing by  ahlam ansari
Grid computing by ahlam ansari
أحلام انصارى
 
Grid computing ppt
Grid computing pptGrid computing ppt
Grid computing ppt
richa chaudhary
 
Grid computing & its applications
Grid computing & its applicationsGrid computing & its applications
Grid computing & its applications
Alokeparna Choudhury
 
Grid computing ppt 2003(done)
Grid computing ppt 2003(done)Grid computing ppt 2003(done)
Grid computing ppt 2003(done)
TASNEEM88
 
Grid computing
Grid computingGrid computing
Grid computing
Dikshita_Viradia
 
Grid computing
Grid computingGrid computing
Grid computing
Grid computingGrid computing
Grid computing
Ramraj Choudhary
 
Grid computing
Grid computingGrid computing
Grid computing
Keshab Nath
 
Cloud computing and Grid Computing
Cloud computing and Grid ComputingCloud computing and Grid Computing
Cloud computing and Grid Computing
prabathsl
 
Grid computing [2005]
Grid computing [2005]Grid computing [2005]
Grid computing [2005]
Raul Soto
 
Introduction to Grid Computing
Introduction to Grid ComputingIntroduction to Grid Computing
Introduction to Grid Computing
abhijeetnawal
 
Grid computing
Grid computingGrid computing
Grid computing
Chanchal Sachdeva
 

Viewers also liked (20)

Grid Computing (An Up-Coming Technology)
Grid Computing (An Up-Coming Technology)Grid Computing (An Up-Coming Technology)
Grid Computing (An Up-Coming Technology)
 
Grid computing 2007
Grid computing 2007Grid computing 2007
Grid computing 2007
 
Grid Computing
Grid ComputingGrid Computing
Grid Computing
 
Grid Computing
Grid ComputingGrid Computing
Grid Computing
 
68th ICREA Colloquium "The Worldwide LHC Computing Grid: Riding the computing...
68th ICREA Colloquium "The Worldwide LHC Computing Grid: Riding the computing...68th ICREA Colloquium "The Worldwide LHC Computing Grid: Riding the computing...
68th ICREA Colloquium "The Worldwide LHC Computing Grid: Riding the computing...
 
grid computing
grid computinggrid computing
grid computing
 
Grid Computing
Grid ComputingGrid Computing
Grid Computing
 
Grid computing
Grid computingGrid computing
Grid computing
 
Grid computing by ahlam ansari
Grid computing by  ahlam ansariGrid computing by  ahlam ansari
Grid computing by ahlam ansari
 
Grid computing ppt
Grid computing pptGrid computing ppt
Grid computing ppt
 
Grid computing & its applications
Grid computing & its applicationsGrid computing & its applications
Grid computing & its applications
 
Grid computing ppt 2003(done)
Grid computing ppt 2003(done)Grid computing ppt 2003(done)
Grid computing ppt 2003(done)
 
Grid computing
Grid computingGrid computing
Grid computing
 
Grid computing
Grid computingGrid computing
Grid computing
 
Grid computing
Grid computingGrid computing
Grid computing
 
Grid computing
Grid computingGrid computing
Grid computing
 
Cloud computing and Grid Computing
Cloud computing and Grid ComputingCloud computing and Grid Computing
Cloud computing and Grid Computing
 
Grid computing [2005]
Grid computing [2005]Grid computing [2005]
Grid computing [2005]
 
Introduction to Grid Computing
Introduction to Grid ComputingIntroduction to Grid Computing
Introduction to Grid Computing
 
Grid computing
Grid computingGrid computing
Grid computing
 

Similar to Grid Computing In Israel

OpenPOWER System Marconi100
OpenPOWER System Marconi100OpenPOWER System Marconi100
OpenPOWER System Marconi100
Ganesan Narayanasamy
 
CINECA for HCP and e-infrastructures infrastructures
CINECA for HCP and e-infrastructures infrastructuresCINECA for HCP and e-infrastructures infrastructures
CINECA for HCP and e-infrastructures infrastructures
Cineca
 
Session 33 - Production Grids
Session 33 - Production GridsSession 33 - Production Grids
Session 33 - Production Grids
ISSGC Summer School
 
Bringing Wireless Sensing to its full potential
Bringing Wireless Sensing to its full potentialBringing Wireless Sensing to its full potential
Bringing Wireless Sensing to its full potential
Adrian Hornsby
 
OpenACC and Open Hackathons Monthly Highlights August 2022
OpenACC and Open Hackathons Monthly Highlights August 2022OpenACC and Open Hackathons Monthly Highlights August 2022
OpenACC and Open Hackathons Monthly Highlights August 2022
OpenACC
 
Mastering Bio Grid
Mastering Bio GridMastering Bio Grid
Mastering Bio Grid
Keith Russell
 
Available HPC Resources at CSUC
Available HPC Resources at CSUCAvailable HPC Resources at CSUC
SNAIL Project for IoT Connectivity
SNAIL Project for IoT ConnectivitySNAIL Project for IoT Connectivity
SNAIL Project for IoT Connectivity
Daeyoung Kim
 
The Exascale Computing Project and the future of HPC
The Exascale Computing Project and the future of HPCThe Exascale Computing Project and the future of HPC
The Exascale Computing Project and the future of HPC
inside-BigData.com
 
OGF Standards Overview - ITU-T JCA Cloud
OGF Standards Overview - ITU-T JCA CloudOGF Standards Overview - ITU-T JCA Cloud
OGF Standards Overview - ITU-T JCA Cloud
Alan Sill
 
OGC Interfaces in Thematic Exploitation Platforms
OGC Interfaces in Thematic Exploitation PlatformsOGC Interfaces in Thematic Exploitation Platforms
OGC Interfaces in Thematic Exploitation Platforms
terradue
 
2017 Atlanta Regional User Seminar Introduction
2017 Atlanta Regional User Seminar Introduction2017 Atlanta Regional User Seminar Introduction
2017 Atlanta Regional User Seminar Introduction
OPAL-RT TECHNOLOGIES
 
Cytoscape: Now and Future
Cytoscape: Now and FutureCytoscape: Now and Future
Cytoscape: Now and Future
Keiichiro Ono
 
LCG project description
LCG project descriptionLCG project description
LCG project description
louisponcet
 
Clean Slate Design - O Que é?
Clean Slate Design - O Que é?Clean Slate Design - O Que é?
Clean Slate Design - O Que é?
Antonio Marcos Alberti
 
OGF Introductory Overview - OGF 44 at EGI Conference 2015
OGF Introductory Overview - OGF 44 at EGI Conference 2015OGF Introductory Overview - OGF 44 at EGI Conference 2015
OGF Introductory Overview - OGF 44 at EGI Conference 2015
Alan Sill
 
Thoughts on Cybersecurity
Thoughts on CybersecurityThoughts on Cybersecurity
Thoughts on Cybersecurity
Frank Wuerthwein
 
OpenACC and Open Hackathons Monthly Highlights: July 2022.pptx
OpenACC and Open Hackathons Monthly Highlights: July 2022.pptxOpenACC and Open Hackathons Monthly Highlights: July 2022.pptx
OpenACC and Open Hackathons Monthly Highlights: July 2022.pptx
OpenACC
 
TWISummit 2019 - Return of Reconfigurable Computing
TWISummit 2019 - Return of Reconfigurable ComputingTWISummit 2019 - Return of Reconfigurable Computing
TWISummit 2019 - Return of Reconfigurable Computing
Thoughtworks
 
Jorge gomes
Jorge gomesJorge gomes
Jorge gomes
EuroCloud
 

Similar to Grid Computing In Israel (20)

OpenPOWER System Marconi100
OpenPOWER System Marconi100OpenPOWER System Marconi100
OpenPOWER System Marconi100
 
CINECA for HCP and e-infrastructures infrastructures
CINECA for HCP and e-infrastructures infrastructuresCINECA for HCP and e-infrastructures infrastructures
CINECA for HCP and e-infrastructures infrastructures
 
Session 33 - Production Grids
Session 33 - Production GridsSession 33 - Production Grids
Session 33 - Production Grids
 
Bringing Wireless Sensing to its full potential
Bringing Wireless Sensing to its full potentialBringing Wireless Sensing to its full potential
Bringing Wireless Sensing to its full potential
 
OpenACC and Open Hackathons Monthly Highlights August 2022
OpenACC and Open Hackathons Monthly Highlights August 2022OpenACC and Open Hackathons Monthly Highlights August 2022
OpenACC and Open Hackathons Monthly Highlights August 2022
 
Mastering Bio Grid
Mastering Bio GridMastering Bio Grid
Mastering Bio Grid
 
Available HPC Resources at CSUC
Available HPC Resources at CSUCAvailable HPC Resources at CSUC
Available HPC Resources at CSUC
 
SNAIL Project for IoT Connectivity
SNAIL Project for IoT ConnectivitySNAIL Project for IoT Connectivity
SNAIL Project for IoT Connectivity
 
The Exascale Computing Project and the future of HPC
The Exascale Computing Project and the future of HPCThe Exascale Computing Project and the future of HPC
The Exascale Computing Project and the future of HPC
 
OGF Standards Overview - ITU-T JCA Cloud
OGF Standards Overview - ITU-T JCA CloudOGF Standards Overview - ITU-T JCA Cloud
OGF Standards Overview - ITU-T JCA Cloud
 
OGC Interfaces in Thematic Exploitation Platforms
OGC Interfaces in Thematic Exploitation PlatformsOGC Interfaces in Thematic Exploitation Platforms
OGC Interfaces in Thematic Exploitation Platforms
 
2017 Atlanta Regional User Seminar Introduction
2017 Atlanta Regional User Seminar Introduction2017 Atlanta Regional User Seminar Introduction
2017 Atlanta Regional User Seminar Introduction
 
Cytoscape: Now and Future
Cytoscape: Now and FutureCytoscape: Now and Future
Cytoscape: Now and Future
 
LCG project description
LCG project descriptionLCG project description
LCG project description
 
Clean Slate Design - O Que é?
Clean Slate Design - O Que é?Clean Slate Design - O Que é?
Clean Slate Design - O Que é?
 
OGF Introductory Overview - OGF 44 at EGI Conference 2015
OGF Introductory Overview - OGF 44 at EGI Conference 2015OGF Introductory Overview - OGF 44 at EGI Conference 2015
OGF Introductory Overview - OGF 44 at EGI Conference 2015
 
Thoughts on Cybersecurity
Thoughts on CybersecurityThoughts on Cybersecurity
Thoughts on Cybersecurity
 
OpenACC and Open Hackathons Monthly Highlights: July 2022.pptx
OpenACC and Open Hackathons Monthly Highlights: July 2022.pptxOpenACC and Open Hackathons Monthly Highlights: July 2022.pptx
OpenACC and Open Hackathons Monthly Highlights: July 2022.pptx
 
TWISummit 2019 - Return of Reconfigurable Computing
TWISummit 2019 - Return of Reconfigurable ComputingTWISummit 2019 - Return of Reconfigurable Computing
TWISummit 2019 - Return of Reconfigurable Computing
 
Jorge gomes
Jorge gomesJorge gomes
Jorge gomes
 

More from Guy Tel-Zur

OpenFOAM 2.4.0 installation on CentOS-7
OpenFOAM 2.4.0 installation on CentOS-7OpenFOAM 2.4.0 installation on CentOS-7
OpenFOAM 2.4.0 installation on CentOS-7
Guy Tel-Zur
 
My early experience with Mirantis OpenStack 6.0
My early experience with Mirantis OpenStack 6.0My early experience with Mirantis OpenStack 6.0
My early experience with Mirantis OpenStack 6.0
Guy Tel-Zur
 
SC13 Diary
SC13 DiarySC13 Diary
SC13 Diary
Guy Tel-Zur
 
HTCondor version 8.0 Windows Installation
HTCondor version 8.0 Windows InstallationHTCondor version 8.0 Windows Installation
HTCondor version 8.0 Windows Installation
Guy Tel-Zur
 
HTCondor flocking between two clouds
HTCondor flocking between two cloudsHTCondor flocking between two clouds
HTCondor flocking between two clouds
Guy Tel-Zur
 
HPC in the Cloud
HPC in the CloudHPC in the Cloud
HPC in the Cloud
Guy Tel-Zur
 
Sc10 slide share
Sc10 slide shareSc10 slide share
Sc10 slide share
Guy Tel-Zur
 
High performance computing
High performance computingHigh performance computing
High performance computing
Guy Tel-Zur
 
How to install a personal condor
How to install a personal condorHow to install a personal condor
How to install a personal condor
Guy Tel-Zur
 
From Grids To Clouds Guy Tel Zur May 2009
From Grids To Clouds Guy Tel Zur May 2009From Grids To Clouds Guy Tel Zur May 2009
From Grids To Clouds Guy Tel Zur May 2009
Guy Tel-Zur
 

More from Guy Tel-Zur (10)

OpenFOAM 2.4.0 installation on CentOS-7
OpenFOAM 2.4.0 installation on CentOS-7OpenFOAM 2.4.0 installation on CentOS-7
OpenFOAM 2.4.0 installation on CentOS-7
 
My early experience with Mirantis OpenStack 6.0
My early experience with Mirantis OpenStack 6.0My early experience with Mirantis OpenStack 6.0
My early experience with Mirantis OpenStack 6.0
 
SC13 Diary
SC13 DiarySC13 Diary
SC13 Diary
 
HTCondor version 8.0 Windows Installation
HTCondor version 8.0 Windows InstallationHTCondor version 8.0 Windows Installation
HTCondor version 8.0 Windows Installation
 
HTCondor flocking between two clouds
HTCondor flocking between two cloudsHTCondor flocking between two clouds
HTCondor flocking between two clouds
 
HPC in the Cloud
HPC in the CloudHPC in the Cloud
HPC in the Cloud
 
Sc10 slide share
Sc10 slide shareSc10 slide share
Sc10 slide share
 
High performance computing
High performance computingHigh performance computing
High performance computing
 
How to install a personal condor
How to install a personal condorHow to install a personal condor
How to install a personal condor
 
From Grids To Clouds Guy Tel Zur May 2009
From Grids To Clouds Guy Tel Zur May 2009From Grids To Clouds Guy Tel Zur May 2009
From Grids To Clouds Guy Tel Zur May 2009
 

Recently uploaded

Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
Zilliz
 
“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”
Claudio Di Ciccio
 
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
SOFTTECHHUB
 
Pushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 daysPushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 days
Adtran
 
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial IntelligenceAI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
IndexBug
 
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
Neo4j
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Paige Cruz
 
Mind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AIMind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AI
Kumud Singh
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
Octavian Nadolu
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
panagenda
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
Kari Kakkonen
 
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and MilvusBuilding Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
Zilliz
 
RESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for studentsRESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for students
KAMESHS29
 
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
DianaGray10
 
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
Edge AI and Vision Alliance
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
Matthew Sinclair
 
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERPBest 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
Pixlogix Infotech
 
How to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For FlutterHow to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For Flutter
Daiki Mogmet Ito
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
DianaGray10
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
DianaGray10
 

Recently uploaded (20)

Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
 
“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”
 
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
 
Pushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 daysPushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 days
 
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial IntelligenceAI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
 
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
 
Mind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AIMind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AI
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
 
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and MilvusBuilding Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
 
RESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for studentsRESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for students
 
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
 
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
“Building and Scaling AI Applications with the Nx AI Manager,” a Presentation...
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
 
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERPBest 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
 
How to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For FlutterHow to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For Flutter
 
UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5UiPath Test Automation using UiPath Test Suite series, part 5
UiPath Test Automation using UiPath Test Suite series, part 5
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
 

Grid Computing In Israel

  • 1. Grid Computing and High-Performance Computing in Israel Guy Tel-Zur, Ph.D. The Israeli Association of Grid Technologies tel-zur@computer.org http://www.Grid.org.il
  • 2. Topics ■ Background  About the country  Infrastructure ■ The Academy  IAG  The Technion, The Hebrew Univ., Ben-Gurion Univ. ■ The Industry  IGT ■ The SEPAC Collaboration
  • 6.
  • 7. ILAN Statistics 2006 2008
  • 8. Israel IUCC IUCC – The Inter University Computation Center
  • 10. The Israel Academic Grid (IAG) • http://iag.iucc.ac.il/ • Funded by the MOST • Steering & Technical Committees • Coordinates the Israeli activity in EGEE, EGI and IsraGrid IUCC is the CA for the IAG
  • 11. EGEE III ■ May 1st 2008 to April 30th 2010 ■ Budget reduced by about 50% ■ Subject to severe FP7 regulations ■ SA1 to be handled through ISRAGRID Vision of EGI Formation of National Grid Initiatives (NGIs) which unite efforts within each country, providing a single point of contact for coordinated efforts
  • 12. IsraGrid ■ A national committee recommended last July to establish a National Grid Computing Infrastructure. ■ Waiting for final approval by the Government ■ To be used only for R&D purposes ■ To be used by all the Academic institutes and the Israeli High-Tech industry ■ Secured access ■ Managed by the IUCC
  • 13. MOSIX A management system targeted for HPC on x86 Linux clusters and multi-cluster organizational grids Main features: – supports parallel processes and batch jobs – Automatic resource discovery – Adaptive workload distribution by process migration Outcome: the grid and each cluster performs like a single computer with multiple processors Guest processes can’t modify resources in hosting nodes
  • 14. The Hebrew University Organizational Grid • 15 MOSIX clusters ~400 nodes • In life-sciences, medical school, chemistry and computer science • Applications: Nano-technology, Molecular dynamics, Protein folding, Genomics (BLAT, BLAST, SW), Meteorological weather forecast (WRF), Navier-Stokes equations and turbulence (CFD) , CPU simulator of new hardware design (SimpleScalar) More information at http://www.MOSIX.org
  • 15. Nanco- a cluster for Nanotechnology Technion Center for Computation in Nanotechnology, Russell-Berrie Nanotechnology Institute Taub Computer Center M M M P P P P P P 64 dual processor dual core compute nodes (total 256 cores), Opteron Rev. F 8GB RAM memory/node Infiniband Switch  2 master nodes for H/A , Operational since summer 2007  also Opterons for redundency Provided by Sun – integrated by EMET and Voltaire  Fast DDR Infiniband SUN and GNU compilers  Interconnect Voltaire MPI and OpenMPI for parallelization  Netapp storage Most of codes are MPI codes – either commercial or self developed  More info on http://phycomp.technion.ac.il/~nanco
  • 16. Grid Computing at the Technion Israel Institute of Technology http://dsl.cs.technion.ac.il/index.html • Projects: • Distributed Systems – GMS Laboratory – Super-Link Online – The Dependable Grid • Prof. Assaf Schuster – Head – EGEE – …and more
  • 17. GMS – Grid Monitoring System  Distributively store all logs of a large batch system in local databases  Apply distributed data mining on logs  Implementation using Condor  Taken up by Intel NetBatch team: started a $3M project
  • 18. SuperLink Online  http://bioinfo.cs.technion.ac.il/superlink-online/ a production portal for geneticists working at hospitals  Submitted tasks contain gene mapping results from lab experiments  Portal user sees a single computer (!)  Implemented using a hierarchy of Condor pools − Highest/smallest pool in Technion (DSL) − Lowest/largest in Madison (GLOW).  In progress: linkage@home and EGEE BioMed implementations.
  • 19. The Dependable Grid  Provide a High Availability (HA) Library as a service for any Grid component  HA for Condor matchmaker with zero loc changes (!!!)  Part of Condor 6.8 distribution  Deployed in many large Condor production pools  Plans to develop and support an open-source distribution
  • 20. Ben Gurion University of the Negev • Inter campus Condor pool • Grid Computing
  • 21. The BGU Condor Pool • Started in 2000 • Today: ~200 processors • Linux & Windows • Campus-wide project • Non-dedicated resources
  • 22.
  • 23. We plan to build a new Condor pool installation at the Soroka Medical Center in Beer-Sheva
  • 24. Grid Computing in the Negev - BGU, NRCN BGU: • A Certified EGEE-II Production site • A Pre-Production EGEE site NRCN:  A small Condor pool  40 processors, Part of the IGT Grid Lab.  A member of the SEPAC Grid Collaboration
  • 25. Parallel Processing Education ■ Cluster made of Virtual Machines (Xen) ■ “Classic” tools: MPI, OpenMP ■ “Modern” tools: Star-P, Grid Mathematica ■ Grid Computing practice: Condor, Gilda and UNICORE ■ Final projects on a variety of subjects: Parallel Image Processing, Parallel Game of Life, Map/Reduce, Monte Carlo…
  • 26. The IDIP Group Inter-Disciplinary Digital Image Processing Scientific Computing, Physics and Optimization and Engineering Data Analysis Applied Imaging Science • BGU Members belong to variety of departments from the faculties of Engineering, Exact Sciences and the School of Medicine • Collaborations with various parties in the academia and Industry • More than 20 research students
  • 27. Multi-scale Geometric methods for Filaments detection in 3D  Development of state of the art tools  Due to the large typical size of real 3D images and the high dimensionality of the coefficients space the computational and storage complexity are very high
  • 28. The Israeli Association of Grid Technologies (IGT)
  • 30. IGT Work Groups • Grid-Data Centers & Labs Utilization Peter Weinstein, IGT Lab Manager • Grid-SOA Ronen Yochpaz, CTO VeNotion • Grid-HPC Dr. Guy Tel-Zur, NRCN • Grid-Application Server Nati Shalom, CTO GigaSpaces • Grid-RDMA Asaf Somekh, Voltaire • Grid-Virtualization Niran Even Chen, BenefIT
  • 31. IGT WEB Site Knowledge Sharing and Networking 16,500 Visitors per Month/ 75% from the US 1GigaByte Downloads per Month
  • 32. IGT2008 – World Summit of Cloud Computing December 1-2, 2008, Hertzelia, Israel Cristophe Bisciglia Simone Brunozzi Creator of Google's Academic Web Services Evangelist, Cloud Computing Initiative (ACCI) Amazon Web Services Senior Software Engineer, Google Paul Strong Dr. Owen O'Malley Distinguished Research Scientist, eBay Owen O’Malley, Yahoo! Hadoop Architect and Apache VP for Hadoop
  • 33. IGT2008 – World Summit of Cloud Computing December 1-2, 2008, Hertzelia, Israel Steve Rubinow, CIO, NYSE Euronext, Dr. Frank Baetke The largest exchange in the world. Global HPC-Technology Program Manager HPCD Richardson / Munich Dr. Yaron Wolfsthal Senior Manager, Reliable System Technologies IBM Research Lab in Haifa (HRL) IBM and EU Joint Research Initiative for Cloud Computing - RESERVOIR
  • 34. The SEPAC Collaboration SEPAC, The Southern European Partnership for Advanced Computing, is a multi-national Grid-cooperation initiated by major South- European High Performance Computing Centers. The objective is to build a Grid as a highly reliable application framework based on open interfaces facilitating a consistent and easy-to- use user interface for scientists and researchers in distributed heterogeneous environments.
  • 35.
  • 37. SEPAC Future We are looking for more sites to join us http://www.sepac-grid.org Cloud Computing Layer
  • 39. Thanks to… ■ Prof. David Horn, TAU, Head of the IAG ■ Mr. Avner Agom, IGT General Manager ■ Prof. Amnon Barak, CS Dept., HUJI. ■ Mr. Eddie Aharonovich, CS. Dept., TAU ■ Dr. Anne Weill,The Technion ■ Dr. Ofer Levi, The Ben-Gurion Univ. ■ The SEPAC Collaboration
  • 40. Questions ? References:  Condor at the BGU: http://www.ee.bgu.ac.il/~tel-zur/condor/  quot;An Introduction to Parallel Processing” course at the BGU: http://www.ee.bgu.ac.il/~tel-zur/teaching/2008B  Grid Computing at the BGU: http://www.ee.bgu.ac.il/~tel-zur/grid.html  IGT: http://www.grid.org.il  EGI: http://web.eu-egi.eu/