SlideShare a Scribd company logo
1 of 22
OpenPOWER and AI
Workshop
Ganesan Narayanasamy
IBM
Welcome you all for the AI and OpenPOWER Bootcamp
6/2
0/2
2
OpenPOWER & AI Workshop at BSC ,Barcelona
By OpenPOWER Academia
Day 1 is meant as an introduction for everyone interested in using AI.
Day 2 is meant to go deeper with those who have especially challenging projects.
on 18th and 19th June 2018
Agenda
Day 1 - June 18th 2018
9:00 a.m to 9.30 a.m.
9.30 a.m to 10.15 am
10.15 am to 10.30 am
10.30 am to 11.15 am
11.15 am to 12.00 Noon
12.00 Noon to 1.00 pm
Welcome and OpenPOWER ADG features
Introduction to Power 9 and PowerAI
Break
Large Model Support and Distributed Deep Learning
Use Case Demonstration with PowerAI
Lunch
1.00pm to 1.45 pm
1.45 pm to 2.45 pm
2.45 pm to 3.00 pm
3.00.pm to 3.45pm
3.45 pm to 4.45 pm
4.45 pm to 5.00 pm
Mellanox Feature Updates
CFD Simulation on Power
Break
Introduction to Snap Machine Learning
Snap Machine Learning Demos , Q&A
Wrap up and Q & A
Agenda
Day 2 - June 19th 2018
9.00 am to 9.30 am
9.30 am to 12.00 pm
12.00 pm to 1.00 pm
01.00 pm to 04.30 pm
Quick review about Day I
Deep Learning Exercise II using Nimbix /Other Infra
Industry specific use cases ( LMS )
Lunch
Deep Learning Exercise II using Nimbix/Other infra
Industry specific Use cases using P9 features ( LMS
and DDL )
Founding Members
in 2013
Ecosystem
Chip / SOC
This is What A Revolution Looks Like © 2018 OpenPOWER
Foundation
I/O / Storage / Acceleration
Boards /
Systems
Software
System / Integration
Implementation / HPC / Research
Software
Boards /
Systems
System / Integration
I/O / Storage / Acceleration
Implementation / HPC / Research
Chip / SOC
This is What A Revolution Looks Like © 2017 OpenPOWER
Foundation
328+
Members
33
Countri
es
70+
ISVs
Chip / SOC
This is What A Revolution Looks Like © 2017 OpenPOWER
Foundation
I/O / Storage / Acceleration
Implementation / HPC / Research
Boards /
Systems
System / Integration
Software
328+
Members
33
Countri
es
70+
ISVs
Active Membership
From All
Layers of the
Stack
100k+ Linux Applications
Running on Power
2300 ISVs Written Code
on Linux
Partners
Bring
Systems
to Market
150+ OpenPOWER Ready
Certified Products
20+ Systems Manufacturers
40+ POWER-based systems
shipping or in development
100+ Collaborative innovations
under way
OpenPOWER in Action
6/2
0/2
12
What is CORAL?
The program through which Summit & Sierra are procured.
 Several DOE labs have strong supercomputing programs and facilities.
 To bring the next generation of leading supercomputers to these labs, DOE
created CORAL (the Collaboration of Oak Ridge, Argonne, and Livermore) to
jointly procure these systems, and in so doing, align strategy and resources
across the DOE enterprise.
 Collaboration grouping of DOE labs was done based on common acquisition
timings. Collaboration is a win-win for all parties.
“Summit” System “Sierra” System
OpenPOWER Technologies: IBM POWER CPUs, NVIDIA Tesla GPUs, Mellanox EDR
100Gb/s InfiniBand
Paving The Road to Exascale Performance
Academic Membership
 Currently about 100+ academic members in OPF
14
A*STAR ASU ASTRI Moscow State
University
Carnegie Mellon Univ.
CDAC Colorado School of
Mines
CINECA CFMS Coimbatore Institute of
Technology
Dalian University of
Technology
GSIC Hartree Centre ICM IIIT Bangalore
IIT Bombay Indian Institute for
Technology Roorkee
ICCS INAF FZ Jülich
LSU BSC Nanyang
Technological
University
National University of
Singapore
NIT Mangalore
NIT Warangal Northeastern
University in China
ORNL OSU RICE
Rome HPC Center LLNL SANDIA SASTRA University Seoul National
University
Shanghai Shao Tong
University
SICSR TEES Tohoku University Tsinghua University
University of Arkansas SDSC Unicamp University of Central
Florida
University of Florida
University of Hawai University of
Hyderabad
University of Illinois University of Michigan University of Oregon
University of Patras University of Southern
California
TACC Waseda University IISc ,Loyola,IIT
Roorkee
Goals of the Academia Discussion Group
 Provide training and exchange of experience and know-how
 Provide platform for networking among academic members
 Work on engagement of HPC community
 Enable co-design/development activities
15
6/2
0/2
Conclusions
 Growing number of academic organizations have become member of the
OpenPOWER Foundation
 The Academia Discussion Groups provides a platform for training,
networking, engagement and enablement of co-design
 Those who have not yet joined:
You are welcome to join
https://members.openpowerfoundation.org/wg/AcademiaDG/mail/index
 OpenPOWER AI virtual University's focus on bringing together industry,
government and academic expertise to connect and help shape the AI
future .
 https://www.youtube.com/channel/UCYLtbUp0AH0ZAv5mNut1Kcg
16
6/2
0/2
Power 9 Advantages ( AC922)
1. CPU
- POWER9 NZ gzip, has a potential when working with compressed-full
workload to reduced memory foot print and I/O bottlenecks in pre-processing
stage; is not today available but hopefully we will get this soon;
- CPU has direct access to GPU memory without need for migration; not
explored today in TF or Caffe part of PowerAI
- VSX3 can accelerate the media processing/pre-processing for computer
vision
http://www.eecg.utoronto.ca/~moshovos/ACA06/readings/altivec.pdf
2. System’s Memory
- 8x DDR4 memory channels will always give more performance and prevent
memory contention in AI workloads
- Managed memory is cache-coherent between CPU & GPU; not explored
today in TF or Caffe part of PowerAI
3. GPU
- NVLINK 2.0 with the CPU allows faster data movement from the CPU to the
GPU when datasets are larger in range of TB's
- GPUDirect RDMA to unified memory; don't think is explored today in TF or
Caffe part of PowerAI
- technology such LMS are best feet for large models like deep residual
networks / ResNet-152
https://arxiv.org/pdf/1803.06333
4. InfiniBand
- MPI / DDL / Horovod have the potential to explore this unique multi-host
socket direct adapter and provide lowest possible latency between many
learners when training. This will lead to lower training times. Posible
improvements in training efficiency over exiting research paper:
https://arxiv.org/pdf/1708.02188
5. I/O:
- PCIe Gen4 offers for NVMe adapters more bandwidth used for caching
datasets into compute nodes more closer to the GPUs (13.5GB/s vs 6.8GB/s
in PCIe Gen3); this is helping very much in pre-fetching the data into the
system memory
- OpenCAPI provides more bandwidth for other type of accelerators such
FPGA's give then option of fast inference processes; possible other kinds of
DRAM in the feature.
6. Others:
- Water cooled systems available for 4x GPUs and 6x GPUs are making the
AI solutions much more efficient at scale taken into consideration 300W/GPU
power consumption.
THANK YOU!

More Related Content

What's hot

OpenCAPI-based Image Analysis Pipeline for 18 GB/s kilohertz-framerate X-ray ...
OpenCAPI-based Image Analysis Pipeline for 18 GB/s kilohertz-framerate X-ray ...OpenCAPI-based Image Analysis Pipeline for 18 GB/s kilohertz-framerate X-ray ...
OpenCAPI-based Image Analysis Pipeline for 18 GB/s kilohertz-framerate X-ray ...Ganesan Narayanasamy
 
MIT's experience on OpenPOWER/POWER 9 platform
MIT's experience on OpenPOWER/POWER 9 platformMIT's experience on OpenPOWER/POWER 9 platform
MIT's experience on OpenPOWER/POWER 9 platformGanesan Narayanasamy
 
OpenPOWER Webinar on Machine Learning for Academic Research
OpenPOWER Webinar on Machine Learning for Academic Research OpenPOWER Webinar on Machine Learning for Academic Research
OpenPOWER Webinar on Machine Learning for Academic Research Ganesan Narayanasamy
 
OpenPOWER/POWER9 Webinar from MIT and IBM
OpenPOWER/POWER9 Webinar from MIT and IBM OpenPOWER/POWER9 Webinar from MIT and IBM
OpenPOWER/POWER9 Webinar from MIT and IBM Ganesan Narayanasamy
 
Xilinx Edge Compute using Power 9 /OpenPOWER systems
Xilinx Edge Compute using Power 9 /OpenPOWER systemsXilinx Edge Compute using Power 9 /OpenPOWER systems
Xilinx Edge Compute using Power 9 /OpenPOWER systemsGanesan Narayanasamy
 
SCFE 2020 OpenCAPI presentation as part of OpenPWOER Tutorial
SCFE 2020 OpenCAPI presentation as part of OpenPWOER TutorialSCFE 2020 OpenCAPI presentation as part of OpenPWOER Tutorial
SCFE 2020 OpenCAPI presentation as part of OpenPWOER TutorialGanesan Narayanasamy
 
CUDA-Python and RAPIDS for blazing fast scientific computing
CUDA-Python and RAPIDS for blazing fast scientific computingCUDA-Python and RAPIDS for blazing fast scientific computing
CUDA-Python and RAPIDS for blazing fast scientific computinginside-BigData.com
 
A Primer on FPGAs - Field Programmable Gate Arrays
A Primer on FPGAs - Field Programmable Gate ArraysA Primer on FPGAs - Field Programmable Gate Arrays
A Primer on FPGAs - Field Programmable Gate ArraysTaylor Riggan
 
How to Achieve High-Performance, Scalable and Distributed DNN Training on Mod...
How to Achieve High-Performance, Scalable and Distributed DNN Training on Mod...How to Achieve High-Performance, Scalable and Distributed DNN Training on Mod...
How to Achieve High-Performance, Scalable and Distributed DNN Training on Mod...inside-BigData.com
 
Introducing HPC with a Raspberry Pi Cluster
Introducing HPC with a Raspberry Pi ClusterIntroducing HPC with a Raspberry Pi Cluster
Introducing HPC with a Raspberry Pi Clusterinside-BigData.com
 

What's hot (20)

OpenPOWER Latest Updates
OpenPOWER Latest UpdatesOpenPOWER Latest Updates
OpenPOWER Latest Updates
 
IBM HPC Transformation with AI
IBM HPC Transformation with AI IBM HPC Transformation with AI
IBM HPC Transformation with AI
 
OpenCAPI-based Image Analysis Pipeline for 18 GB/s kilohertz-framerate X-ray ...
OpenCAPI-based Image Analysis Pipeline for 18 GB/s kilohertz-framerate X-ray ...OpenCAPI-based Image Analysis Pipeline for 18 GB/s kilohertz-framerate X-ray ...
OpenCAPI-based Image Analysis Pipeline for 18 GB/s kilohertz-framerate X-ray ...
 
IBM BOA for POWER
IBM BOA for POWER IBM BOA for POWER
IBM BOA for POWER
 
Deeplearningusingcloudpakfordata
DeeplearningusingcloudpakfordataDeeplearningusingcloudpakfordata
Deeplearningusingcloudpakfordata
 
MIT's experience on OpenPOWER/POWER 9 platform
MIT's experience on OpenPOWER/POWER 9 platformMIT's experience on OpenPOWER/POWER 9 platform
MIT's experience on OpenPOWER/POWER 9 platform
 
OpenPOWER Webinar on Machine Learning for Academic Research
OpenPOWER Webinar on Machine Learning for Academic Research OpenPOWER Webinar on Machine Learning for Academic Research
OpenPOWER Webinar on Machine Learning for Academic Research
 
OpenPOWER/POWER9 Webinar from MIT and IBM
OpenPOWER/POWER9 Webinar from MIT and IBM OpenPOWER/POWER9 Webinar from MIT and IBM
OpenPOWER/POWER9 Webinar from MIT and IBM
 
Xilinx Edge Compute using Power 9 /OpenPOWER systems
Xilinx Edge Compute using Power 9 /OpenPOWER systemsXilinx Edge Compute using Power 9 /OpenPOWER systems
Xilinx Edge Compute using Power 9 /OpenPOWER systems
 
WML OpenPOWER presentation
WML OpenPOWER presentationWML OpenPOWER presentation
WML OpenPOWER presentation
 
SCFE 2020 OpenCAPI presentation as part of OpenPWOER Tutorial
SCFE 2020 OpenCAPI presentation as part of OpenPWOER TutorialSCFE 2020 OpenCAPI presentation as part of OpenPWOER Tutorial
SCFE 2020 OpenCAPI presentation as part of OpenPWOER Tutorial
 
CUDA-Python and RAPIDS for blazing fast scientific computing
CUDA-Python and RAPIDS for blazing fast scientific computingCUDA-Python and RAPIDS for blazing fast scientific computing
CUDA-Python and RAPIDS for blazing fast scientific computing
 
A Primer on FPGAs - Field Programmable Gate Arrays
A Primer on FPGAs - Field Programmable Gate ArraysA Primer on FPGAs - Field Programmable Gate Arrays
A Primer on FPGAs - Field Programmable Gate Arrays
 
PowerAI Deep dive
PowerAI Deep divePowerAI Deep dive
PowerAI Deep dive
 
How to Achieve High-Performance, Scalable and Distributed DNN Training on Mod...
How to Achieve High-Performance, Scalable and Distributed DNN Training on Mod...How to Achieve High-Performance, Scalable and Distributed DNN Training on Mod...
How to Achieve High-Performance, Scalable and Distributed DNN Training on Mod...
 
State of ARM-based HPC
State of ARM-based HPCState of ARM-based HPC
State of ARM-based HPC
 
Introducing HPC with a Raspberry Pi Cluster
Introducing HPC with a Raspberry Pi ClusterIntroducing HPC with a Raspberry Pi Cluster
Introducing HPC with a Raspberry Pi Cluster
 
Summit workshop thompto
Summit workshop thomptoSummit workshop thompto
Summit workshop thompto
 
OpenPOWER System Marconi100
OpenPOWER System Marconi100OpenPOWER System Marconi100
OpenPOWER System Marconi100
 
OpenPOWER foundation
OpenPOWER foundationOpenPOWER foundation
OpenPOWER foundation
 

Similar to OpenPOWER and AI Workshop Highlights Power9 and Deep Learning Projects

OpenPOWER and AI workshop at Brazil
OpenPOWER and AI workshop at BrazilOpenPOWER and AI workshop at Brazil
OpenPOWER and AI workshop at BrazilGanesan Narayanasamy
 
Ibm open poweraiworkshopaug16siliconvalley
Ibm open poweraiworkshopaug16siliconvalleyIbm open poweraiworkshopaug16siliconvalley
Ibm open poweraiworkshopaug16siliconvalleyGanesan Narayanasamy
 
OpenACC Monthly Highlights: January 2024
OpenACC Monthly Highlights: January 2024OpenACC Monthly Highlights: January 2024
OpenACC Monthly Highlights: January 2024OpenACC
 
OpenPOWER Processor Industry Partnership
OpenPOWER Processor Industry PartnershipOpenPOWER Processor Industry Partnership
OpenPOWER Processor Industry PartnershipGanesan Narayanasamy
 
Special Purpose IBM Center of excellence lab
Special Purpose IBM Center of excellence lab Special Purpose IBM Center of excellence lab
Special Purpose IBM Center of excellence lab Ganesan Narayanasamy
 
OpenPOWER and AI workshop at Barcelona Supercomputing Center
OpenPOWER and AI workshop at Barcelona Supercomputing CenterOpenPOWER and AI workshop at Barcelona Supercomputing Center
OpenPOWER and AI workshop at Barcelona Supercomputing CenterGanesan Narayanasamy
 
1 open power foundation_japan meetup - v1
1 open power foundation_japan meetup - v11 open power foundation_japan meetup - v1
1 open power foundation_japan meetup - v1Yutaka Kawai
 
OpenPOWER Foundation Overview
OpenPOWER Foundation OverviewOpenPOWER Foundation Overview
OpenPOWER Foundation OverviewNVIDIA Taiwan
 
2018 open power presentation japan meetup
2018 open power presentation japan meetup2018 open power presentation japan meetup
2018 open power presentation japan meetupYutaka Kawai
 
OpenACC and Hackathons Monthly Highlights
OpenACC and Hackathons Monthly HighlightsOpenACC and Hackathons Monthly Highlights
OpenACC and Hackathons Monthly HighlightsOpenACC
 
OpenACC Monthly Highlights: August 2021
OpenACC Monthly Highlights: August 2021OpenACC Monthly Highlights: August 2021
OpenACC Monthly Highlights: August 2021OpenACC
 
Power9 aihpc bigdataeducationserver
Power9 aihpc bigdataeducationserverPower9 aihpc bigdataeducationserver
Power9 aihpc bigdataeducationserverGanesan Narayanasamy
 
IESL Talk Series: Apache System Projects in the Real World
IESL Talk Series: Apache System Projects in the Real WorldIESL Talk Series: Apache System Projects in the Real World
IESL Talk Series: Apache System Projects in the Real WorldSrinath Perera
 
Introduction to the OpenPOWER Foundation - Open Source Days event
Introduction to the OpenPOWER Foundation - Open Source Days eventIntroduction to the OpenPOWER Foundation - Open Source Days event
Introduction to the OpenPOWER Foundation - Open Source Days eventMandie Quartly
 
Six Principles of Software Design to Empower Scientists
Six Principles of Software Design to Empower ScientistsSix Principles of Software Design to Empower Scientists
Six Principles of Software Design to Empower ScientistsDavid De Roure
 

Similar to OpenPOWER and AI Workshop Highlights Power9 and Deep Learning Projects (20)

OpenPOWER ADG key note
OpenPOWER ADG key note OpenPOWER ADG key note
OpenPOWER ADG key note
 
OpenPOWER and AI workshop at Brazil
OpenPOWER and AI workshop at BrazilOpenPOWER and AI workshop at Brazil
OpenPOWER and AI workshop at Brazil
 
Ibm open poweraiworkshopaug16siliconvalley
Ibm open poweraiworkshopaug16siliconvalleyIbm open poweraiworkshopaug16siliconvalley
Ibm open poweraiworkshopaug16siliconvalley
 
OpenACC Monthly Highlights: January 2024
OpenACC Monthly Highlights: January 2024OpenACC Monthly Highlights: January 2024
OpenACC Monthly Highlights: January 2024
 
OpenPOWER Processor Industry Partnership
OpenPOWER Processor Industry PartnershipOpenPOWER Processor Industry Partnership
OpenPOWER Processor Industry Partnership
 
OA centre of excellence
OA centre of excellenceOA centre of excellence
OA centre of excellence
 
Special Purpose IBM Center of excellence lab
Special Purpose IBM Center of excellence lab Special Purpose IBM Center of excellence lab
Special Purpose IBM Center of excellence lab
 
OpenPOWER and AI workshop at Barcelona Supercomputing Center
OpenPOWER and AI workshop at Barcelona Supercomputing CenterOpenPOWER and AI workshop at Barcelona Supercomputing Center
OpenPOWER and AI workshop at Barcelona Supercomputing Center
 
1 open power foundation_japan meetup - v1
1 open power foundation_japan meetup - v11 open power foundation_japan meetup - v1
1 open power foundation_japan meetup - v1
 
OpenPOWER Foundation Overview
OpenPOWER Foundation OverviewOpenPOWER Foundation Overview
OpenPOWER Foundation Overview
 
2018 open power presentation japan meetup
2018 open power presentation japan meetup2018 open power presentation japan meetup
2018 open power presentation japan meetup
 
OpenACC and Hackathons Monthly Highlights
OpenACC and Hackathons Monthly HighlightsOpenACC and Hackathons Monthly Highlights
OpenACC and Hackathons Monthly Highlights
 
OpenACC Monthly Highlights: August 2021
OpenACC Monthly Highlights: August 2021OpenACC Monthly Highlights: August 2021
OpenACC Monthly Highlights: August 2021
 
Power9 aihpc bigdataeducationserver
Power9 aihpc bigdataeducationserverPower9 aihpc bigdataeducationserver
Power9 aihpc bigdataeducationserver
 
IESL Talk Series: Apache System Projects in the Real World
IESL Talk Series: Apache System Projects in the Real WorldIESL Talk Series: Apache System Projects in the Real World
IESL Talk Series: Apache System Projects in the Real World
 
Ai open powermeetupmarch25
Ai open powermeetupmarch25Ai open powermeetupmarch25
Ai open powermeetupmarch25
 
Ai open powermeetupmarch25
Ai open powermeetupmarch25Ai open powermeetupmarch25
Ai open powermeetupmarch25
 
Ai OpenPOWER meetup
Ai OpenPOWER meetup Ai OpenPOWER meetup
Ai OpenPOWER meetup
 
Introduction to the OpenPOWER Foundation - Open Source Days event
Introduction to the OpenPOWER Foundation - Open Source Days eventIntroduction to the OpenPOWER Foundation - Open Source Days event
Introduction to the OpenPOWER Foundation - Open Source Days event
 
Six Principles of Software Design to Empower Scientists
Six Principles of Software Design to Empower ScientistsSix Principles of Software Design to Empower Scientists
Six Principles of Software Design to Empower Scientists
 

More from Ganesan Narayanasamy

Chip Design Curriculum development Residency program
Chip Design Curriculum development Residency programChip Design Curriculum development Residency program
Chip Design Curriculum development Residency programGanesan Narayanasamy
 
Basics of Digital Design and Verilog
Basics of Digital Design and VerilogBasics of Digital Design and Verilog
Basics of Digital Design and VerilogGanesan Narayanasamy
 
180 nm Tape out experience using Open POWER ISA
180 nm Tape out experience using Open POWER ISA180 nm Tape out experience using Open POWER ISA
180 nm Tape out experience using Open POWER ISAGanesan Narayanasamy
 
Workload Transformation and Innovations in POWER Architecture
Workload Transformation and Innovations in POWER Architecture Workload Transformation and Innovations in POWER Architecture
Workload Transformation and Innovations in POWER Architecture Ganesan Narayanasamy
 
Deep Learning Use Cases using OpenPOWER systems
Deep Learning Use Cases using OpenPOWER systemsDeep Learning Use Cases using OpenPOWER systems
Deep Learning Use Cases using OpenPOWER systemsGanesan Narayanasamy
 
AI in healthcare and Automobile Industry using OpenPOWER/IBM POWER9 systems
AI in healthcare and Automobile Industry using OpenPOWER/IBM POWER9 systemsAI in healthcare and Automobile Industry using OpenPOWER/IBM POWER9 systems
AI in healthcare and Automobile Industry using OpenPOWER/IBM POWER9 systemsGanesan Narayanasamy
 
AI in Health Care using IBM Systems/OpenPOWER systems
AI in Health Care using IBM Systems/OpenPOWER systemsAI in Health Care using IBM Systems/OpenPOWER systems
AI in Health Care using IBM Systems/OpenPOWER systemsGanesan Narayanasamy
 
AI in Healh Care using IBM POWER systems
AI in Healh Care using IBM POWER systems AI in Healh Care using IBM POWER systems
AI in Healh Care using IBM POWER systems Ganesan Narayanasamy
 
Graphical Structure Learning accelerated with POWER9
Graphical Structure Learning accelerated with POWER9Graphical Structure Learning accelerated with POWER9
Graphical Structure Learning accelerated with POWER9Ganesan Narayanasamy
 
OpenPOWER Foundation Introduction
OpenPOWER Foundation Introduction OpenPOWER Foundation Introduction
OpenPOWER Foundation Introduction Ganesan Narayanasamy
 
Open Hardware and Future Computing
Open Hardware and Future ComputingOpen Hardware and Future Computing
Open Hardware and Future ComputingGanesan Narayanasamy
 

More from Ganesan Narayanasamy (20)

Chip Design Curriculum development Residency program
Chip Design Curriculum development Residency programChip Design Curriculum development Residency program
Chip Design Curriculum development Residency program
 
Basics of Digital Design and Verilog
Basics of Digital Design and VerilogBasics of Digital Design and Verilog
Basics of Digital Design and Verilog
 
180 nm Tape out experience using Open POWER ISA
180 nm Tape out experience using Open POWER ISA180 nm Tape out experience using Open POWER ISA
180 nm Tape out experience using Open POWER ISA
 
Workload Transformation and Innovations in POWER Architecture
Workload Transformation and Innovations in POWER Architecture Workload Transformation and Innovations in POWER Architecture
Workload Transformation and Innovations in POWER Architecture
 
OpenPOWER Workshop at IIT Roorkee
OpenPOWER Workshop at IIT RoorkeeOpenPOWER Workshop at IIT Roorkee
OpenPOWER Workshop at IIT Roorkee
 
Deep Learning Use Cases using OpenPOWER systems
Deep Learning Use Cases using OpenPOWER systemsDeep Learning Use Cases using OpenPOWER systems
Deep Learning Use Cases using OpenPOWER systems
 
POWER10 innovations for HPC
POWER10 innovations for HPCPOWER10 innovations for HPC
POWER10 innovations for HPC
 
AI in healthcare and Automobile Industry using OpenPOWER/IBM POWER9 systems
AI in healthcare and Automobile Industry using OpenPOWER/IBM POWER9 systemsAI in healthcare and Automobile Industry using OpenPOWER/IBM POWER9 systems
AI in healthcare and Automobile Industry using OpenPOWER/IBM POWER9 systems
 
AI in healthcare - Use Cases
AI in healthcare - Use Cases AI in healthcare - Use Cases
AI in healthcare - Use Cases
 
AI in Health Care using IBM Systems/OpenPOWER systems
AI in Health Care using IBM Systems/OpenPOWER systemsAI in Health Care using IBM Systems/OpenPOWER systems
AI in Health Care using IBM Systems/OpenPOWER systems
 
AI in Healh Care using IBM POWER systems
AI in Healh Care using IBM POWER systems AI in Healh Care using IBM POWER systems
AI in Healh Care using IBM POWER systems
 
Poster from NUS
Poster from NUSPoster from NUS
Poster from NUS
 
SAP HANA on POWER9 systems
SAP HANA on POWER9 systemsSAP HANA on POWER9 systems
SAP HANA on POWER9 systems
 
Graphical Structure Learning accelerated with POWER9
Graphical Structure Learning accelerated with POWER9Graphical Structure Learning accelerated with POWER9
Graphical Structure Learning accelerated with POWER9
 
AI in the enterprise
AI in the enterprise AI in the enterprise
AI in the enterprise
 
Robustness in deep learning
Robustness in deep learningRobustness in deep learning
Robustness in deep learning
 
Perspectives of Frond end Design
Perspectives of Frond end DesignPerspectives of Frond end Design
Perspectives of Frond end Design
 
A2O Core implementation on FPGA
A2O Core implementation on FPGAA2O Core implementation on FPGA
A2O Core implementation on FPGA
 
OpenPOWER Foundation Introduction
OpenPOWER Foundation Introduction OpenPOWER Foundation Introduction
OpenPOWER Foundation Introduction
 
Open Hardware and Future Computing
Open Hardware and Future ComputingOpen Hardware and Future Computing
Open Hardware and Future Computing
 

Recently uploaded

Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS:  6 Ways to Automate Your Data IntegrationBridging Between CAD & GIS:  6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integrationmarketing932765
 
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentEmixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentPim van der Noll
 
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical InfrastructureVarsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructureitnewsafrica
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxLoriGlavin3
 
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesMuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesManik S Magar
 
Decarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityDecarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityIES VE
 
React Native vs Ionic - The Best Mobile App Framework
React Native vs Ionic - The Best Mobile App FrameworkReact Native vs Ionic - The Best Mobile App Framework
React Native vs Ionic - The Best Mobile App FrameworkPixlogix Infotech
 
QCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architecturesQCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architecturesBernd Ruecker
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersNicole Novielli
 
Scale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterScale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterMydbops
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsNathaniel Shimoni
 
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxGenerative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxfnnc6jmgwh
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsRavi Sanghani
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesThousandEyes
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Farhan Tariq
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxLoriGlavin3
 
Data governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationData governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationKnoldus Inc.
 

Recently uploaded (20)

Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS:  6 Ways to Automate Your Data IntegrationBridging Between CAD & GIS:  6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
 
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentEmixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
 
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical InfrastructureVarsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
 
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotesMuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
MuleSoft Online Meetup Group - B2B Crash Course: Release SparkNotes
 
Decarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a realityDecarbonising Buildings: Making a net-zero built environment a reality
Decarbonising Buildings: Making a net-zero built environment a reality
 
React Native vs Ionic - The Best Mobile App Framework
React Native vs Ionic - The Best Mobile App FrameworkReact Native vs Ionic - The Best Mobile App Framework
React Native vs Ionic - The Best Mobile App Framework
 
QCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architecturesQCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architectures
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software Developers
 
Scale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterScale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL Router
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directions
 
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptxGenerative AI - Gitex v1Generative AI - Gitex v1.pptx
Generative AI - Gitex v1Generative AI - Gitex v1.pptx
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and Insights
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...
 
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
 
Data governance with Unity Catalog Presentation
Data governance with Unity Catalog PresentationData governance with Unity Catalog Presentation
Data governance with Unity Catalog Presentation
 

OpenPOWER and AI Workshop Highlights Power9 and Deep Learning Projects

  • 2. Welcome you all for the AI and OpenPOWER Bootcamp 6/2 0/2 2
  • 3. OpenPOWER & AI Workshop at BSC ,Barcelona By OpenPOWER Academia Day 1 is meant as an introduction for everyone interested in using AI. Day 2 is meant to go deeper with those who have especially challenging projects. on 18th and 19th June 2018
  • 4. Agenda Day 1 - June 18th 2018 9:00 a.m to 9.30 a.m. 9.30 a.m to 10.15 am 10.15 am to 10.30 am 10.30 am to 11.15 am 11.15 am to 12.00 Noon 12.00 Noon to 1.00 pm Welcome and OpenPOWER ADG features Introduction to Power 9 and PowerAI Break Large Model Support and Distributed Deep Learning Use Case Demonstration with PowerAI Lunch 1.00pm to 1.45 pm 1.45 pm to 2.45 pm 2.45 pm to 3.00 pm 3.00.pm to 3.45pm 3.45 pm to 4.45 pm 4.45 pm to 5.00 pm Mellanox Feature Updates CFD Simulation on Power Break Introduction to Snap Machine Learning Snap Machine Learning Demos , Q&A Wrap up and Q & A
  • 5. Agenda Day 2 - June 19th 2018 9.00 am to 9.30 am 9.30 am to 12.00 pm 12.00 pm to 1.00 pm 01.00 pm to 04.30 pm Quick review about Day I Deep Learning Exercise II using Nimbix /Other Infra Industry specific use cases ( LMS ) Lunch Deep Learning Exercise II using Nimbix/Other infra Industry specific Use cases using P9 features ( LMS and DDL )
  • 8. Chip / SOC This is What A Revolution Looks Like © 2018 OpenPOWER Foundation I/O / Storage / Acceleration Boards / Systems Software System / Integration Implementation / HPC / Research
  • 9. Software Boards / Systems System / Integration I/O / Storage / Acceleration Implementation / HPC / Research Chip / SOC This is What A Revolution Looks Like © 2017 OpenPOWER Foundation 328+ Members 33 Countri es 70+ ISVs
  • 10. Chip / SOC This is What A Revolution Looks Like © 2017 OpenPOWER Foundation I/O / Storage / Acceleration Implementation / HPC / Research Boards / Systems System / Integration Software 328+ Members 33 Countri es 70+ ISVs Active Membership From All Layers of the Stack 100k+ Linux Applications Running on Power 2300 ISVs Written Code on Linux Partners Bring Systems to Market 150+ OpenPOWER Ready Certified Products 20+ Systems Manufacturers 40+ POWER-based systems shipping or in development 100+ Collaborative innovations under way
  • 11.
  • 13. What is CORAL? The program through which Summit & Sierra are procured.  Several DOE labs have strong supercomputing programs and facilities.  To bring the next generation of leading supercomputers to these labs, DOE created CORAL (the Collaboration of Oak Ridge, Argonne, and Livermore) to jointly procure these systems, and in so doing, align strategy and resources across the DOE enterprise.  Collaboration grouping of DOE labs was done based on common acquisition timings. Collaboration is a win-win for all parties. “Summit” System “Sierra” System OpenPOWER Technologies: IBM POWER CPUs, NVIDIA Tesla GPUs, Mellanox EDR 100Gb/s InfiniBand Paving The Road to Exascale Performance
  • 14. Academic Membership  Currently about 100+ academic members in OPF 14 A*STAR ASU ASTRI Moscow State University Carnegie Mellon Univ. CDAC Colorado School of Mines CINECA CFMS Coimbatore Institute of Technology Dalian University of Technology GSIC Hartree Centre ICM IIIT Bangalore IIT Bombay Indian Institute for Technology Roorkee ICCS INAF FZ Jülich LSU BSC Nanyang Technological University National University of Singapore NIT Mangalore NIT Warangal Northeastern University in China ORNL OSU RICE Rome HPC Center LLNL SANDIA SASTRA University Seoul National University Shanghai Shao Tong University SICSR TEES Tohoku University Tsinghua University University of Arkansas SDSC Unicamp University of Central Florida University of Florida University of Hawai University of Hyderabad University of Illinois University of Michigan University of Oregon University of Patras University of Southern California TACC Waseda University IISc ,Loyola,IIT Roorkee
  • 15. Goals of the Academia Discussion Group  Provide training and exchange of experience and know-how  Provide platform for networking among academic members  Work on engagement of HPC community  Enable co-design/development activities 15 6/2 0/2
  • 16. Conclusions  Growing number of academic organizations have become member of the OpenPOWER Foundation  The Academia Discussion Groups provides a platform for training, networking, engagement and enablement of co-design  Those who have not yet joined: You are welcome to join https://members.openpowerfoundation.org/wg/AcademiaDG/mail/index  OpenPOWER AI virtual University's focus on bringing together industry, government and academic expertise to connect and help shape the AI future .  https://www.youtube.com/channel/UCYLtbUp0AH0ZAv5mNut1Kcg 16 6/2 0/2
  • 17. Power 9 Advantages ( AC922)
  • 18.
  • 19. 1. CPU - POWER9 NZ gzip, has a potential when working with compressed-full workload to reduced memory foot print and I/O bottlenecks in pre-processing stage; is not today available but hopefully we will get this soon; - CPU has direct access to GPU memory without need for migration; not explored today in TF or Caffe part of PowerAI - VSX3 can accelerate the media processing/pre-processing for computer vision http://www.eecg.utoronto.ca/~moshovos/ACA06/readings/altivec.pdf 2. System’s Memory - 8x DDR4 memory channels will always give more performance and prevent memory contention in AI workloads - Managed memory is cache-coherent between CPU & GPU; not explored today in TF or Caffe part of PowerAI
  • 20. 3. GPU - NVLINK 2.0 with the CPU allows faster data movement from the CPU to the GPU when datasets are larger in range of TB's - GPUDirect RDMA to unified memory; don't think is explored today in TF or Caffe part of PowerAI - technology such LMS are best feet for large models like deep residual networks / ResNet-152 https://arxiv.org/pdf/1803.06333 4. InfiniBand - MPI / DDL / Horovod have the potential to explore this unique multi-host socket direct adapter and provide lowest possible latency between many learners when training. This will lead to lower training times. Posible improvements in training efficiency over exiting research paper: https://arxiv.org/pdf/1708.02188
  • 21. 5. I/O: - PCIe Gen4 offers for NVMe adapters more bandwidth used for caching datasets into compute nodes more closer to the GPUs (13.5GB/s vs 6.8GB/s in PCIe Gen3); this is helping very much in pre-fetching the data into the system memory - OpenCAPI provides more bandwidth for other type of accelerators such FPGA's give then option of fast inference processes; possible other kinds of DRAM in the feature. 6. Others: - Water cooled systems available for 4x GPUs and 6x GPUs are making the AI solutions much more efficient at scale taken into consideration 300W/GPU power consumption.