National Laboratory for High
     Performance Computing
              (NLHPC)
                  Eduardo'Vera
     Execu&ve(Director(.(NLHPC(.(www.nlhpc.cl
     Center(for(Mathema&cal(Modeling((CMM)


      !        !      !                  !
!                                !
Mission & Vision
       To consolidate a national facility for HPC by offering
       top quality services and advanced training to answer
              the national demand for scientific computing,
             developing links between research groups, the
                              industry and the public sector


We envision the NLHPC as a competitive facility of
world-class quality for research services in HPC
Objectives
                           CRITICAL IT PARTNER TO LARGE-SCALE AND DATA INTENSIVE
                                                RESEARCH PROJECTS BASED ON HPC

   1. To develop and support          3. To use and explore
      powerful and reliable              innovative architectures and
      computing and network              techniques to accelerate
      resources enabling national        scientific computing.
      researchers to have access
      to HPC capacity to solve        4. To trigger new industrial
      computing- and data-               initiatives in HPC.
      intensive scientific             5. To help educate the next
      problems.                          generation of scientists and
   2. To stimulate and participate       engineers in HPC.
      in the creation of a national   6. To increase social
      high-speed network for the         awareness of the role of
      transmission of research           HPC in contemporary
      data.                              society and technological
                                         development.
Estimated Scientific Demand for HPC:
A Key Issue for improving Chilean competitiveness


•   Near to 50 Chilean research
    groups (aprox. 300 researchers)
    are actually demanding HPC
    resources

•   The expansion of Chilean research
    in data-driven sciences such as
    Omics, Bioinformatics and
    Astronomy, requires a national
    facility for HPC services

•   Scientific contributions in areas
    such Molecular Simulations,
    Quantum chemistry and
    Astrophysics are highly dependent
    on the availability of HPC
    capacities

•   Astronomy will become a highly
    demanding research field for
    HPC: LSST and AURA will
    produce more than 40TB of raw
    data per night
Associative Model:
An Open Model
    NLHPC Associated Institutions
                          Universidad Católica
                            del Norte (UCN)
                                                    Chile
                           Universidad Santa
                              María (USM)

                          Universidad de Chile
                                (UChile)
                           Sponsoring Institution


                          Universidad Católica
                                  (UC)
          REUNA
         Connectivity
                            Universidad de
                           Santiago (USACH)

                                                               N

                          Universidad de Talca
                                (UTalca)


                           Universidad de la
                           Frontera (UFRO)



                              Other Chilean                 200 miles

                            institutions to be
                                 added ...
NLHPC International Network:
Global Outlook




               •   Access to advanced training

               •   Technological support network

               •   Collaboration agreements and joint research projects

               •   Participation on international HPC networks and projects: Gellato
                   Federation, PRAGMA, GISELA

               •   CMM’s technology partners: IBM, HP, Microsoft and NTT
The NLHPC
        Supercomputing Infrastructure
UCN                                    USM                                   PUC                                  UCHILE
 Requested                              Requested                             Requested                            Requested


                                                                                                                                     Storage (600 TB)
                                                                              X86-64 (64 cores) Storage (48 TB)
                                                                                                                   X86-64 SSI (256 cores)

        Visualization Cluster            X86-64 (64 cores) Storage (20 TB)

                                                                              Photonic Switch Infiniband Switch
                                                                                                                     X86-64 (2000 cores) + 64 GPUs

        Counterpart                          Counterpart                            Counterpart                            Counterpart




           X86-64 (26 cores)                     X86-64 (44 cores)                    X86-64 (62 cores)                      X86-64 (600 cores)


USACH                                  UTALCA                                UFRO                                 REUNA
 Requested                              Requested                             Requested                            Requested


                     Photonic Switch

                                                                                                                       Photonic Router / Switch
 X86-64 (64 cores)                              GPU-CPU (64 units)                  X86-64 SSI (32 cores)




        Counterpart                          Counterpart                            Counterpart                            Counterpart


                                                                                                                             Interconnectivity
                                                                                                                                  services
           X86-64 (48 cores)                    X86-64 SSI (24 cores)               X86-64 SSI (24 cores)
Current CMM Technology:
An Advanced Computing Cluster Open to the
Chilean Scientific Community


IBM iDataplex machine (Levque)

•    66 computing nodes

•    600 cores, Intel Xeon X5550 (nehalem)

•    3 GB per core

•    Two IB ports 40 GB/s

•    100% non-blocking Infiniband interconnection
     Switch Qlogic 12800-180

•    Nodes for queuing, metadata storage, applications
     testing, development, grid access and webservices
     access




    • Data gathered during last month with only 20% of potential users
    • 75% of average CPU load
NLHPC Advanced Network
Technology:
Strengthening Academic Networks across the country




                                  0.25x = 2.5Gbps                              350M bps
                  REUNA                                   REUNA                                    REUNA
               (North of Chile)                          (Santiago)                             (South of Chile)




                                          1Gbps (Dark Fiber)

                                                                                     1Gbps (Dark Fiber)
                                                          CMM
                                                    HPC Infrastructure


                                                UChile Institutional Network


Additional impact of the network                                                          Current situation
enhancement:
   •   e-learning
   •   Video-conferencing
   •   Accessing e-infrastructures
   •   Distributing knowledge
NLHPC Advanced Network
Technology:
Strengthening Academic Networks across the country


                       USM                               UC                           USACH                  UTALCA


                                                               10Gbps x      (Dark Fiber)                 1Gbps
                                          1Gbps



                          REUNA
                                           0.25x = 2.5Gbps          REUNA               1Gbps       REUNA
                       (North of Chile)                            (Santiago)                    (South of Chile)



                                                                                                          1Gbps
                    1Gbps                     10Gbps x   (Dark Fiber)
                                                                            1Gbps (Dark Fiber)


                                                                     CMM
                                                               HPC Infrastructure
                       UCN                                                                                      UFRO
                                                                  UCHILE
                                                              Institutional Network



Additional impact of the network                                                                     NLHPC situation
enhancement:
   •   e-learning
   •   Video-conferencing
   •   Accessing e-infrastructures
   •   Distributing knowledge
Educating the next generation of scientists and
engineers in HPC

 •   To consolidate undergraduate
     courses in HPC

 •   To offer advanced courses in HPC for
     Doctoral training

 •   To organize periodic seminars on
     HPC

 •   To organize the NLHPC Annual
     Symposium

 •   To organize Industrial Workshops to
     promote the adoption of HPC by the
     industry
Outreach: Increasing the social awareness of the role of HPC
in contemporary society and technological development

 •   Open Innovation program in HPC

 •   High-school guided visits

 •   HPC installation at MIM (Interactive
     Science Museum)

 •   Explora Projects

 •   HPC Cup

 •   General public lectures on the HPC
     impact in Mining Industry, Astronomy,
     Biotechnology, Climate Modeling,
     Early Alerts in Critical Events

National Laboratory for High Performance Computing (NLHPC)

  • 1.
    National Laboratory forHigh Performance Computing (NLHPC) Eduardo'Vera Execu&ve(Director(.(NLHPC(.(www.nlhpc.cl Center(for(Mathema&cal(Modeling((CMM) ! ! ! ! ! !
  • 2.
    Mission & Vision To consolidate a national facility for HPC by offering top quality services and advanced training to answer the national demand for scientific computing, developing links between research groups, the industry and the public sector We envision the NLHPC as a competitive facility of world-class quality for research services in HPC
  • 3.
    Objectives CRITICAL IT PARTNER TO LARGE-SCALE AND DATA INTENSIVE RESEARCH PROJECTS BASED ON HPC 1. To develop and support 3. To use and explore powerful and reliable innovative architectures and computing and network techniques to accelerate resources enabling national scientific computing. researchers to have access to HPC capacity to solve 4. To trigger new industrial computing- and data- initiatives in HPC. intensive scientific 5. To help educate the next problems. generation of scientists and 2. To stimulate and participate engineers in HPC. in the creation of a national 6. To increase social high-speed network for the awareness of the role of transmission of research HPC in contemporary data. society and technological development.
  • 4.
    Estimated Scientific Demandfor HPC: A Key Issue for improving Chilean competitiveness • Near to 50 Chilean research groups (aprox. 300 researchers) are actually demanding HPC resources • The expansion of Chilean research in data-driven sciences such as Omics, Bioinformatics and Astronomy, requires a national facility for HPC services • Scientific contributions in areas such Molecular Simulations, Quantum chemistry and Astrophysics are highly dependent on the availability of HPC capacities • Astronomy will become a highly demanding research field for HPC: LSST and AURA will produce more than 40TB of raw data per night
  • 5.
    Associative Model: An OpenModel NLHPC Associated Institutions Universidad Católica del Norte (UCN) Chile Universidad Santa María (USM) Universidad de Chile (UChile) Sponsoring Institution Universidad Católica (UC) REUNA Connectivity Universidad de Santiago (USACH) N Universidad de Talca (UTalca) Universidad de la Frontera (UFRO) Other Chilean 200 miles institutions to be added ...
  • 6.
    NLHPC International Network: GlobalOutlook • Access to advanced training • Technological support network • Collaboration agreements and joint research projects • Participation on international HPC networks and projects: Gellato Federation, PRAGMA, GISELA • CMM’s technology partners: IBM, HP, Microsoft and NTT
  • 7.
    The NLHPC Supercomputing Infrastructure UCN USM PUC UCHILE Requested Requested Requested Requested Storage (600 TB) X86-64 (64 cores) Storage (48 TB) X86-64 SSI (256 cores) Visualization Cluster X86-64 (64 cores) Storage (20 TB) Photonic Switch Infiniband Switch X86-64 (2000 cores) + 64 GPUs Counterpart Counterpart Counterpart Counterpart X86-64 (26 cores) X86-64 (44 cores) X86-64 (62 cores) X86-64 (600 cores) USACH UTALCA UFRO REUNA Requested Requested Requested Requested Photonic Switch Photonic Router / Switch X86-64 (64 cores) GPU-CPU (64 units) X86-64 SSI (32 cores) Counterpart Counterpart Counterpart Counterpart Interconnectivity services X86-64 (48 cores) X86-64 SSI (24 cores) X86-64 SSI (24 cores)
  • 8.
    Current CMM Technology: AnAdvanced Computing Cluster Open to the Chilean Scientific Community IBM iDataplex machine (Levque) • 66 computing nodes • 600 cores, Intel Xeon X5550 (nehalem) • 3 GB per core • Two IB ports 40 GB/s • 100% non-blocking Infiniband interconnection Switch Qlogic 12800-180 • Nodes for queuing, metadata storage, applications testing, development, grid access and webservices access • Data gathered during last month with only 20% of potential users • 75% of average CPU load
  • 9.
    NLHPC Advanced Network Technology: StrengtheningAcademic Networks across the country 0.25x = 2.5Gbps 350M bps REUNA REUNA REUNA (North of Chile) (Santiago) (South of Chile) 1Gbps (Dark Fiber) 1Gbps (Dark Fiber) CMM HPC Infrastructure UChile Institutional Network Additional impact of the network Current situation enhancement: • e-learning • Video-conferencing • Accessing e-infrastructures • Distributing knowledge
  • 10.
    NLHPC Advanced Network Technology: StrengtheningAcademic Networks across the country USM UC USACH UTALCA 10Gbps x (Dark Fiber) 1Gbps 1Gbps REUNA 0.25x = 2.5Gbps REUNA 1Gbps REUNA (North of Chile) (Santiago) (South of Chile) 1Gbps 1Gbps 10Gbps x (Dark Fiber) 1Gbps (Dark Fiber) CMM HPC Infrastructure UCN UFRO UCHILE Institutional Network Additional impact of the network NLHPC situation enhancement: • e-learning • Video-conferencing • Accessing e-infrastructures • Distributing knowledge
  • 11.
    Educating the nextgeneration of scientists and engineers in HPC • To consolidate undergraduate courses in HPC • To offer advanced courses in HPC for Doctoral training • To organize periodic seminars on HPC • To organize the NLHPC Annual Symposium • To organize Industrial Workshops to promote the adoption of HPC by the industry
  • 12.
    Outreach: Increasing thesocial awareness of the role of HPC in contemporary society and technological development • Open Innovation program in HPC • High-school guided visits • HPC installation at MIM (Interactive Science Museum) • Explora Projects • HPC Cup • General public lectures on the HPC impact in Mining Industry, Astronomy, Biotechnology, Climate Modeling, Early Alerts in Critical Events