Dissertation Overview

•

1 like•228 views

Si Beaumont

DISTRIBUTED PARALLEL
ROUTE-FINDING
Simon Beaumont
University of Cambridge

PROJECT AIMS

• Simulated computing architecture based on message passing

• Various topologies of processor networks

• Parallel route-ﬁnding algorithm based on matrix multiplication

• Investigate
effect of topology type on algorithm performance
both theoretically and empirically

• Many metrics (based on messages)

PROJECT EXTENSIONS

• Optimise algorithm using Fox’s matrix multiplication

• Compression techniques for sparse graphs

• Port core algorithm to GPU using NVIDIA®’s CUDA™ library

Hypercube Ring Star Tree-4 Random-4 Torus Complete

200K

150K

100K

50K

0K
1 16 49 100 169 256

PRELIMINARY RESULTS

What's hot

HPC Cloud: Clouds on supercomputers for HPCRyousei Takano

themidgame-tube-slidesPedro Moy

The Intersection of Game Engines & GPUs: Current & Future (Graphics Hardware ...Johan Andersson

GPU ComputingKhan Mostafa

2017 04-13-google-tpu-04Brahim HAMADICHAREF

Frostbite Rendering Architecture and Real-time Procedural Shading & Texturing...Johan Andersson

GPU Computing: A brief overviewRajiv Kumar

MEW22 22nd Machine Evaluation Workshop MicrosoftLee Stott

Advanced Real-time Post-Processing using GPGPU techniquesJohan Andersson

Hybrid Hardware/Software Floating-Point Implementations for Optimized Area an...JAYAPRAKASH JPINFOTECH

CPU vs. GPU presentationVishal Singh

GPU ProgrammingWilliam Cunningham

Social Media Mining using GAE Map ReduceJ Singh

HC-4012, Complex Network Clustering Using GPU-based Parallel Non-negative Mat...AMD Developer Central

Machine Learning with New Hardware ChallegensOscar Law

"Using the OpenCL C Kernel Language for Embedded Vision Processors," a Presen...Edge AI and Vision Alliance

Hadoop analytics provisioning based on a virtual infrastructureCESGA Centro de Supercomputación de Galicia

What's hot (17)

HPC Cloud: Clouds on supercomputers for HPC

themidgame-tube-slides

The Intersection of Game Engines & GPUs: Current & Future (Graphics Hardware ...

GPU Computing

2017 04-13-google-tpu-04

Frostbite Rendering Architecture and Real-time Procedural Shading & Texturing...

GPU Computing: A brief overview

MEW22 22nd Machine Evaluation Workshop Microsoft

Advanced Real-time Post-Processing using GPGPU techniques

Hybrid Hardware/Software Floating-Point Implementations for Optimized Area an...

CPU vs. GPU presentation

GPU Programming

Social Media Mining using GAE Map Reduce

HC-4012, Complex Network Clustering Using GPU-based Parallel Non-negative Mat...

Machine Learning with New Hardware Challegens

"Using the OpenCL C Kernel Language for Embedded Vision Processors," a Presen...

Hadoop analytics provisioning based on a virtual infrastructure

Similar to Dissertation Overview

Performance Analysis of Lattice QCD with APGAS Programming ModelKoichi Shirahata

CONDOR @ NGCLE@e-Novia 15.11.2017NECST Lab @ Politecnico di Milano

2018 03 25 system ml ai and openpower meetupGanesan Narayanasamy

IS-ENES COMP Superscalar tutorialRoger Rafanell Mas

Query Optimizer Improvements for Apache DerbyNadeeshani Hewage

pps MattersBangladesh Network Operators Group

Performance Analysis of Lattice QCD on GPUs in APGAS Programming ModelKoichi Shirahata

Performance Optimization of Deep Learning Frameworks Caffe* and Tensorflow* f...Intel® Software

CUG2011 Introduction to GPU ComputingJeff Larkin

Invited Lecture on GPUs and Distributed Deep Learning at Uppsala UniversityJim Dowling

Realizing Robust and Scalable Evolutionary Algorithms toward Exascale EraMasaharu Munetomo

High performace network of Cloud Native Taiwan User GroupHungWei Chiu

Choose Your Weapon: Comparing Spark on FPGAs vs GPUsDatabricks

Microsoft Project Olympus AI Accelerator Chassis (HGX-1)inside-BigData.com

PgopenclTim Child

PostgreSQL with OpenCLMuhaza Liebenlito

Extending Hadoop for Fun & ProfitMilind Bhandarkar

Current Trends in HPCPutchong Uthayopas

DOE Magellan OpenStack user storylaurabeckcahoon

Assisting User’s Transition to Titan’s Accelerated Architectureinside-BigData.com

Similar to Dissertation Overview (20)

Performance Analysis of Lattice QCD with APGAS Programming Model

CONDOR @ NGCLE@e-Novia 15.11.2017

2018 03 25 system ml ai and openpower meetup

IS-ENES COMP Superscalar tutorial

Query Optimizer Improvements for Apache Derby

pps Matters

Performance Analysis of Lattice QCD on GPUs in APGAS Programming Model

Performance Optimization of Deep Learning Frameworks Caffe* and Tensorflow* f...

CUG2011 Introduction to GPU Computing

Invited Lecture on GPUs and Distributed Deep Learning at Uppsala University

Realizing Robust and Scalable Evolutionary Algorithms toward Exascale Era

High performace network of Cloud Native Taiwan User Group

Choose Your Weapon: Comparing Spark on FPGAs vs GPUs

Microsoft Project Olympus AI Accelerator Chassis (HGX-1)

Pgopencl

PostgreSQL with OpenCL

Extending Hadoop for Fun & Profit

Current Trends in HPC

DOE Magellan OpenStack user story

Assisting User’s Transition to Titan’s Accelerated Architecture

Dissertation Overview

1. DISTRIBUTED PARALLEL ROUTE-FINDING Simon Beaumont University of Cambridge

2. PROJECT AIMS • Simulated computing architecture based on message passing • Various topologies of processor networks • Parallel route-ﬁnding algorithm based on matrix multiplication • Investigate effect of topology type on algorithm performance both theoretically and empirically • Many metrics (based on messages)

3. PROJECT EXTENSIONS • Optimise algorithm using Fox’s matrix multiplication • Compression techniques for sparse graphs • Port core algorithm to GPU using NVIDIA®’s CUDA™ library

4. MANAGER-WORKER MODEL

5. GRAPH COMPRESSION

6. Hypercube Ring Star Tree-4 Random-4 Torus Complete 200K 150K 100K 50K 0K 1 16 49 100 169 256 PRELIMINARY RESULTS

7. WHY THE DIPS?

8. WORK DISTRIBUTION

9. WORK DISTRIBUTION

10. WORK DISTRIBUTION

11. OPTIMAL WORK LAYOUT IS NP-COMPLETE

12. GPU IMPLEMENTATION

13. THANKS FOR LISTENING