• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
Bringing HPC to tackle your business problems
 

Bringing HPC to tackle your business problems

on

  • 713 views

A short overview on how HPC can help tackle your business problems and where ICHEC can help you enhance your competitiveness by utilising high-performance computing.

A short overview on how HPC can help tackle your business problems and where ICHEC can help you enhance your competitiveness by utilising high-performance computing.

Statistics

Views

Total Views
713
Views on SlideShare
710
Embed Views
3

Actions

Likes
0
Downloads
0
Comments
0

1 Embed 3

http://www.linkedin.com 3

Accessibility

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • Standard linux, SUSE or Redhat with vendor specific addons for performance or managementLogin nodes interactive compute nodes scheduledFewer services less to go wrong, improves security and reduces OS jitter across the compute nodesModules keeps development and production simple and documentedSSH: simple secure cross platform reliableBatch Scheduling Maui, Torque. Machines oversubscribed typically delivers fairness and utilisationNo virtualization, no shared nodes provides isolation and & performance matters.
  • Both Techniques long established\\Aimed at technical/scientific computingShared memory – a good & bad thingGood compiler support: ICC, XLC, Viz Studio, GCCNot as flexible as pthreadsCompiler directives == pragmasCan be addressed through native methods from Java – ref commercial client
  • MPI is a standard not a producte.g. MVAPICH, OpenMPI, Intel MPI, SGI MPTExploits cheap cluster hardware but adds a network layerWorks on > 300k coresDistributed memory means somewhat of an all or nothing implementation is required
  • Western Union for your mobile phone.

Bringing HPC to tackle your business problems Bringing HPC to tackle your business problems Presentation Transcript

  • High Performance Computing in Ireland: Introducing ICHEC for tackling your business problems
    Irish Centre for High End Computing
    Dr. Eoin Brazil, Technology Transfer
  • Outline of Presentation
    Who / What is ICHEC ?
    HPC Software Landscape
    Consultancy Review – case studies in analytics
    Q&A – Let’s talk about your problems and where HPC / Parallel computing may address them
    ICHEC Technology Transfer 2011
    2
    • National support for HPC
    • GPGPU
    • Analytics / Data mining
    • Novel software
    • Cloud application migration
    • Met Éireann op forecast
    3
    ICHEC Technology Transfer 2011
  • Linux Hardware for High End Computing
    41.01 TFlop / 36.56 TFlop
    Stokes
    SUSE Linux Enterprise 11
    PanFS (write @ 3GB/s)
    SGI Altix ICE 8200EX
    320 compute nodes (2 Xeon E5650 hex-core and 24GB RAM)
    3840 cores and 7680GB RAM
    ConnectXInfiniband (DDR)
    4
    ICHEC Technology Transfer 2011
  • HPC Hardware & Software Landscape
    Operating Environment:
    • Linux dominated
    • Login node(s) & compute nodes
    • Minimal background services
    • Modules based environment
    • Remote SSH access
    • Batch Scheduling
    • No virtualisation
    ICHEC Technology Transfer 2011
    5
  • HPC Hardware & Software Landscape
    Development Environment:
    Two main techniques, OpenMP & MPI
    OpenMP
    Relatively simple
    Thread based
    Shared memory
    Moderate scalability
    Can be implemented incrementally
    Compiler directives plus a handful of calls
    Fortran, C/C++
    Widely supported & cross platform
    1 day course available
    ICHEC Technology Transfer 2011
    6
  • HPC Hardware & Software Landscape
    Development Environment:
    MPI (Message Passing Interface)
    Network and hardware agnostic
    Process based
    Can be highly scalable
    Difficult to implement incrementally
    Very many calls, a handful usually sufficient
    Distributed memory & explicit communications
    Fortran, C/C++ & various ‘lookalikes’ for other languages
    Numerous implementations & cross platform (in theory)
    2 day introductory and advanced courses available
    ICHEC Technology Transfer 2011
    7
  • Scaling & Optimising <~> Capacity Planning
    ICHEC Technology Transfer 2011
    8
    Benchmark real runs against Amdahl's Law and Neil J. Gunther’s Universal Scalability Law (USL) to give insight into future planning for system and/or infrastructure.
  • ICHEC Technology Transfer 2011
    9
    Red-Shift / Blue-shift
    Rapidly growing compute and / or data demand beyond Moore’s Law
  • Characteristics of a Red-shift Company
    ICHEC Technology Transfer 2011
    10
    Rapidly growing compute and / or data demand beyond Moore’s Law
    Not just Google or YouTube
    You are not alone with these problems
    Irish examples include Paddy Power, Tullow Oil, MET Éireann, NewBay and many more!
  • ICHEC Technology Transfer 2011
    11
  • Typical SME / Academic Datamining
    12
    ICHEC Technology Transfer 2011
  • (www.ezetop.com)
    Transfer money via a mobile phone
    €80 million Revenue, 70 Staff, 95+ countries
    Issue: Fraud & Automation
    Reduce fraud
    Improve productivity with automation
    13
    ICHEC Technology Transfer 2011
  • (www.cartrawler.com)
    Aggregating booking engine for car hire
    550+ car suppliers, 175+ countries
    Issue: Customer Patterns and Forecasting
    Online analytics
    Improved forecasting based on real-time data
    14
    ICHEC Technology Transfer 2011
  • Training
    ICHEC Technology Transfer 2011
    15
    For Academics:
    FREE, HPC, MPI, OpenMP and CUDA
    For Businesses:
    COMMERICAL RATES, all the same courses plus custom tailoring
    Consultancy
    Professional - NVIDIA Approved Courses
    3rd Level – NUIG
  • Acknowledgements
    Supported by Science Foundation Ireland under grant 08/HEC/I1450 and by HEA’s PRTLI-C4.