Bringing HPC to tackle your business problems

740 views

Published on

A short overview on how HPC can help tackle your business problems and where ICHEC can help you enhance your competitiveness by utilising high-performance computing.

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
740
On SlideShare
0
From Embeds
0
Number of Embeds
4
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • Standard linux, SUSE or Redhat with vendor specific addons for performance or managementLogin nodes interactive compute nodes scheduledFewer services less to go wrong, improves security and reduces OS jitter across the compute nodesModules keeps development and production simple and documentedSSH: simple secure cross platform reliableBatch Scheduling Maui, Torque. Machines oversubscribed typically delivers fairness and utilisationNo virtualization, no shared nodes provides isolation and & performance matters.
  • Both Techniques long established\\Aimed at technical/scientific computingShared memory – a good & bad thingGood compiler support: ICC, XLC, Viz Studio, GCCNot as flexible as pthreadsCompiler directives == pragmasCan be addressed through native methods from Java – ref commercial client
  • MPI is a standard not a producte.g. MVAPICH, OpenMPI, Intel MPI, SGI MPTExploits cheap cluster hardware but adds a network layerWorks on > 300k coresDistributed memory means somewhat of an all or nothing implementation is required
  • Western Union for your mobile phone.
  • Bringing HPC to tackle your business problems

    1. 1. High Performance Computing in Ireland: Introducing ICHEC for tackling your business problems<br />Irish Centre for High End Computing<br />Dr. Eoin Brazil, Technology Transfer<br />
    2. 2. Outline of Presentation<br />Who / What is ICHEC ?<br />HPC Software Landscape<br />Consultancy Review – case studies in analytics<br />Q&A – Let’s talk about your problems and where HPC / Parallel computing may address them<br />ICHEC Technology Transfer 2011<br />2<br />
    3. 3. <ul><li>National support for HPC
    4. 4. GPGPU
    5. 5. Analytics / Data mining
    6. 6. Novel software
    7. 7. Cloud application migration
    8. 8. Met Éireann op forecast</li></ul>3<br />ICHEC Technology Transfer 2011<br />
    9. 9. Linux Hardware for High End Computing<br />41.01 TFlop / 36.56 TFlop<br />Stokes<br />SUSE Linux Enterprise 11<br />PanFS (write @ 3GB/s)<br />SGI Altix ICE 8200EX<br />320 compute nodes (2 Xeon E5650 hex-core and 24GB RAM)<br />3840 cores and 7680GB RAM<br />ConnectXInfiniband (DDR)<br />4<br />ICHEC Technology Transfer 2011<br />
    10. 10. HPC Hardware & Software Landscape<br />Operating Environment:<br /><ul><li>Linux dominated
    11. 11. Login node(s) & compute nodes
    12. 12. Minimal background services
    13. 13. Modules based environment
    14. 14. Remote SSH access
    15. 15. Batch Scheduling
    16. 16. No virtualisation</li></ul>ICHEC Technology Transfer 2011<br />5<br />
    17. 17. HPC Hardware & Software Landscape<br />Development Environment:<br />Two main techniques, OpenMP & MPI<br />OpenMP<br />Relatively simple<br />Thread based<br />Shared memory<br />Moderate scalability<br />Can be implemented incrementally<br />Compiler directives plus a handful of calls<br />Fortran, C/C++<br />Widely supported & cross platform<br />1 day course available<br />ICHEC Technology Transfer 2011<br />6<br />
    18. 18. HPC Hardware & Software Landscape<br />Development Environment:<br />MPI (Message Passing Interface)<br />Network and hardware agnostic<br />Process based<br />Can be highly scalable<br />Difficult to implement incrementally<br />Very many calls, a handful usually sufficient<br />Distributed memory & explicit communications<br />Fortran, C/C++ & various ‘lookalikes’ for other languages<br />Numerous implementations & cross platform (in theory)<br />2 day introductory and advanced courses available<br />ICHEC Technology Transfer 2011<br />7<br />
    19. 19. Scaling & Optimising <~> Capacity Planning<br />ICHEC Technology Transfer 2011<br />8<br />Benchmark real runs against Amdahl's Law and Neil J. Gunther’s Universal Scalability Law (USL) to give insight into future planning for system and/or infrastructure.<br />
    20. 20. ICHEC Technology Transfer 2011<br />9<br />Red-Shift / Blue-shift<br />Rapidly growing compute and / or data demand beyond Moore’s Law<br />
    21. 21. Characteristics of a Red-shift Company<br />ICHEC Technology Transfer 2011<br />10<br />Rapidly growing compute and / or data demand beyond Moore’s Law<br />Not just Google or YouTube<br />You are not alone with these problems<br />Irish examples include Paddy Power, Tullow Oil, MET Éireann, NewBay and many more!<br />
    22. 22. ICHEC Technology Transfer 2011<br />11<br />
    23. 23. Typical SME / Academic Datamining<br />12<br />ICHEC Technology Transfer 2011<br />
    24. 24. (www.ezetop.com)<br />Transfer money via a mobile phone<br />€80 million Revenue, 70 Staff, 95+ countries<br />Issue: Fraud & Automation<br />Reduce fraud<br />Improve productivity with automation<br />13<br />ICHEC Technology Transfer 2011<br />
    25. 25. (www.cartrawler.com)<br />Aggregating booking engine for car hire<br />550+ car suppliers, 175+ countries<br />Issue: Customer Patterns and Forecasting<br />Online analytics<br />Improved forecasting based on real-time data<br />14<br />ICHEC Technology Transfer 2011<br />
    26. 26. Training<br />ICHEC Technology Transfer 2011<br />15<br />For Academics:<br />FREE, HPC, MPI, OpenMP and CUDA<br />For Businesses:<br />COMMERICAL RATES, all the same courses plus custom tailoring<br />Consultancy<br />Professional - NVIDIA Approved Courses<br />3rd Level – NUIG <br />
    27. 27. Acknowledgements<br />Supported by Science Foundation Ireland under grant 08/HEC/I1450 and by HEA’s PRTLI-C4.<br />

    ×