SlideShare a Scribd company logo
1 of 13
Download to read offline
Experts in numerical software and
High Performance Computing
Cloud Task Execution at Scale
with an example from Quant Finance
Microsoft SC18 Theater presentation
November 2018
John HOLDEN
Mick PONT
2High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
3High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
4High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
► Manage Distribution (CPU/GPU)
► Manage dependencies
► Manage synchronization
► Manage control
► Manage ad-hoc Grid (during Development)
► Manage Cloud(s) (during Testing / Production)
5High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
Client
Client
Client
Server
Client-Server
Client
Client
Client
Client-Worker
worker
worker
worker
synchronisation
worker
worker
worker
Master
Master-Worker
6High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
7High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
8High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
• Origami supports DAGs
including: data transfers,
metrics, recovery from
task failure.
• Can run on dev
machines, in-house grid,
production cloud, CPU,
CPU / GPU – mixture.
9High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
10High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
Description Elapsed Time
Single core ~ 14 hours
Origami / Grid / Azure Minutes
11High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
12High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
Experts in High Performance Computing,
Algorithms and Numerical Software Engineering
www.nag.com | blog.nag.com | @NAGtalk
13High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
Experts in High Performance Computing,
Algorithms and Numerical Software Engineering
www.nag.com | blog.nag.com | @NAGtalk

More Related Content

What's hot

Appronto Appstore Mendix Meetup 8 dec 2014
Appronto Appstore Mendix Meetup 8 dec 2014Appronto Appstore Mendix Meetup 8 dec 2014
Appronto Appstore Mendix Meetup 8 dec 2014Pim van der Noll
 
AllbeSmart - E robotic midih-presentation-oc2_demo_day
AllbeSmart - E robotic midih-presentation-oc2_demo_dayAllbeSmart - E robotic midih-presentation-oc2_demo_day
AllbeSmart - E robotic midih-presentation-oc2_demo_dayMIDIH_EU
 
IBM Planning Analytics - esittely ja demo
IBM Planning Analytics - esittely ja demoIBM Planning Analytics - esittely ja demo
IBM Planning Analytics - esittely ja demoAffecto
 
Streamlining Feature Engineering Pipelines with Open Source
Streamlining Feature Engineering Pipelines with Open SourceStreamlining Feature Engineering Pipelines with Open Source
Streamlining Feature Engineering Pipelines with Open SourceSoledad Galli
 
COMIT Community Day - Summer 2017 Plangrid slides
COMIT Community Day - Summer 2017 Plangrid slidesCOMIT Community Day - Summer 2017 Plangrid slides
COMIT Community Day - Summer 2017 Plangrid slidesComit Projects Ltd
 
Flink Forward Berlin 2018: Olga Slenders, Gijsbert van Vliet - "Exploiting Ap...
Flink Forward Berlin 2018: Olga Slenders, Gijsbert van Vliet - "Exploiting Ap...Flink Forward Berlin 2018: Olga Slenders, Gijsbert van Vliet - "Exploiting Ap...
Flink Forward Berlin 2018: Olga Slenders, Gijsbert van Vliet - "Exploiting Ap...Flink Forward
 
Key2Print - Web to Print Software with an online Designer.
Key2Print - Web to Print Software with an online Designer.Key2Print - Web to Print Software with an online Designer.
Key2Print - Web to Print Software with an online Designer.Danny Moloney (DBA IP), (PhD IP)
 
Grafixoft solutions
Grafixoft solutionsGrafixoft solutions
Grafixoft solutionsGrafixoft
 
2018/11/1 Architecture of AI-CON
2018/11/1 Architecture of AI-CON2018/11/1 Architecture of AI-CON
2018/11/1 Architecture of AI-CONKatsuhiro Honda
 
Strusoft Impact Precast Software - Malmo Congress Concert and Hotel
Strusoft Impact Precast Software - Malmo Congress Concert and HotelStrusoft Impact Precast Software - Malmo Congress Concert and Hotel
Strusoft Impact Precast Software - Malmo Congress Concert and Hotelactint
 
E-commerce Berlin Expo 2017 - Step up your B2B game – a case study with trans...
E-commerce Berlin Expo 2017 - Step up your B2B game – a case study with trans...E-commerce Berlin Expo 2017 - Step up your B2B game – a case study with trans...
E-commerce Berlin Expo 2017 - Step up your B2B game – a case study with trans...E-Commerce Berlin EXPO
 
Webinar of IN Data Manager (EN) 18th June 2020
Webinar of IN Data Manager (EN) 18th June 2020Webinar of IN Data Manager (EN) 18th June 2020
Webinar of IN Data Manager (EN) 18th June 2020Innova Advanced Consulting
 
Intro to the Data Grid
Intro to the Data GridIntro to the Data Grid
Intro to the Data GridOutSystems
 

What's hot (17)

Appronto Appstore Mendix Meetup 8 dec 2014
Appronto Appstore Mendix Meetup 8 dec 2014Appronto Appstore Mendix Meetup 8 dec 2014
Appronto Appstore Mendix Meetup 8 dec 2014
 
AllbeSmart - E robotic midih-presentation-oc2_demo_day
AllbeSmart - E robotic midih-presentation-oc2_demo_dayAllbeSmart - E robotic midih-presentation-oc2_demo_day
AllbeSmart - E robotic midih-presentation-oc2_demo_day
 
IBM Planning Analytics - esittely ja demo
IBM Planning Analytics - esittely ja demoIBM Planning Analytics - esittely ja demo
IBM Planning Analytics - esittely ja demo
 
BIM Al Fouzan
BIM Al FouzanBIM Al Fouzan
BIM Al Fouzan
 
Streamlining Feature Engineering Pipelines with Open Source
Streamlining Feature Engineering Pipelines with Open SourceStreamlining Feature Engineering Pipelines with Open Source
Streamlining Feature Engineering Pipelines with Open Source
 
COMIT Community Day - Summer 2017 Plangrid slides
COMIT Community Day - Summer 2017 Plangrid slidesCOMIT Community Day - Summer 2017 Plangrid slides
COMIT Community Day - Summer 2017 Plangrid slides
 
Flink Forward Berlin 2018: Olga Slenders, Gijsbert van Vliet - "Exploiting Ap...
Flink Forward Berlin 2018: Olga Slenders, Gijsbert van Vliet - "Exploiting Ap...Flink Forward Berlin 2018: Olga Slenders, Gijsbert van Vliet - "Exploiting Ap...
Flink Forward Berlin 2018: Olga Slenders, Gijsbert van Vliet - "Exploiting Ap...
 
Key2Print - Web to Print Software with an online Designer.
Key2Print - Web to Print Software with an online Designer.Key2Print - Web to Print Software with an online Designer.
Key2Print - Web to Print Software with an online Designer.
 
Grafixoft solutions
Grafixoft solutionsGrafixoft solutions
Grafixoft solutions
 
pCon - Empower your sales force
pCon - Empower your sales forcepCon - Empower your sales force
pCon - Empower your sales force
 
2018/11/1 Architecture of AI-CON
2018/11/1 Architecture of AI-CON2018/11/1 Architecture of AI-CON
2018/11/1 Architecture of AI-CON
 
Programas softwares
Programas  softwares   Programas  softwares
Programas softwares
 
Data science @ scale
Data science @ scaleData science @ scale
Data science @ scale
 
Strusoft Impact Precast Software - Malmo Congress Concert and Hotel
Strusoft Impact Precast Software - Malmo Congress Concert and HotelStrusoft Impact Precast Software - Malmo Congress Concert and Hotel
Strusoft Impact Precast Software - Malmo Congress Concert and Hotel
 
E-commerce Berlin Expo 2017 - Step up your B2B game – a case study with trans...
E-commerce Berlin Expo 2017 - Step up your B2B game – a case study with trans...E-commerce Berlin Expo 2017 - Step up your B2B game – a case study with trans...
E-commerce Berlin Expo 2017 - Step up your B2B game – a case study with trans...
 
Webinar of IN Data Manager (EN) 18th June 2020
Webinar of IN Data Manager (EN) 18th June 2020Webinar of IN Data Manager (EN) 18th June 2020
Webinar of IN Data Manager (EN) 18th June 2020
 
Intro to the Data Grid
Intro to the Data GridIntro to the Data Grid
Intro to the Data Grid
 

Similar to Cloud Task Execution at Scale with example from quant finance

Introduction to Big Data using AWS Services
Introduction to Big Data using AWS ServicesIntroduction to Big Data using AWS Services
Introduction to Big Data using AWS ServicesAnjani Phuyal
 
Engage with...Romax | Driving the Electric Revolution Webinar
Engage with...Romax | Driving the Electric Revolution WebinarEngage with...Romax | Driving the Electric Revolution Webinar
Engage with...Romax | Driving the Electric Revolution WebinarKTN
 
Measuring HPC: Performance, Cost, & Value
Measuring HPC: Performance, Cost, & ValueMeasuring HPC: Performance, Cost, & Value
Measuring HPC: Performance, Cost, & Valueinside-BigData.com
 
Fast Data at ING – the why, what and how of the streaming analytics platform ...
Fast Data at ING – the why, what and how of the streaming analytics platform ...Fast Data at ING – the why, what and how of the streaming analytics platform ...
Fast Data at ING – the why, what and how of the streaming analytics platform ...Bas Geerdink
 
Jakob Freund: Camunda for IT Executives - Camunda Days
Jakob Freund: Camunda for IT Executives - Camunda DaysJakob Freund: Camunda for IT Executives - Camunda Days
Jakob Freund: Camunda for IT Executives - Camunda Dayscamunda services GmbH
 
Mindsphere: an open cloud-based IoT operating system for Industry
Mindsphere: an open cloud-based IoT operating system for IndustryMindsphere: an open cloud-based IoT operating system for Industry
Mindsphere: an open cloud-based IoT operating system for IndustryIIoTWorld
 
The Rise Of Event Streaming – Why Apache Kafka Changes Everything
The Rise Of Event Streaming – Why Apache Kafka Changes EverythingThe Rise Of Event Streaming – Why Apache Kafka Changes Everything
The Rise Of Event Streaming – Why Apache Kafka Changes EverythingKai Wähner
 
Apache kafka event_streaming___kai_waehner
Apache kafka event_streaming___kai_waehnerApache kafka event_streaming___kai_waehner
Apache kafka event_streaming___kai_waehnerconfluent
 
Conquering the Lambda architecture in LinkedIn metrics platform with Apache C...
Conquering the Lambda architecture in LinkedIn metrics platform with Apache C...Conquering the Lambda architecture in LinkedIn metrics platform with Apache C...
Conquering the Lambda architecture in LinkedIn metrics platform with Apache C...Khai Tran
 
Transformacion del Negocio Financiero por medio de Tecnologias Cloud
Transformacion del Negocio Financiero por medio de Tecnologias CloudTransformacion del Negocio Financiero por medio de Tecnologias Cloud
Transformacion del Negocio Financiero por medio de Tecnologias CloudRaul Goycoolea Seoane
 
IoT's impact on products design and innovation - LibreCon 2016
IoT's impact on products design and innovation - LibreCon 2016IoT's impact on products design and innovation - LibreCon 2016
IoT's impact on products design and innovation - LibreCon 2016LibreCon
 
ITCamp 2019 - Andrea Saltarello - Modernise your app. The Cloud Story
ITCamp 2019 - Andrea Saltarello - Modernise your app. The Cloud StoryITCamp 2019 - Andrea Saltarello - Modernise your app. The Cloud Story
ITCamp 2019 - Andrea Saltarello - Modernise your app. The Cloud StoryITCamp
 
Pivoting event streaming, from PROJECTS to a PLATFORM
Pivoting event streaming, from PROJECTS to a PLATFORMPivoting event streaming, from PROJECTS to a PLATFORM
Pivoting event streaming, from PROJECTS to a PLATFORMconfluent
 
ITMAGINATION - competences, facts, technologies, clients
ITMAGINATION - competences, facts, technologies, clientsITMAGINATION - competences, facts, technologies, clients
ITMAGINATION - competences, facts, technologies, clientsITMAGINATION
 
ScaleFocus DACH Expertise
ScaleFocus DACH ExpertiseScaleFocus DACH Expertise
ScaleFocus DACH ExpertiseScaleFocus
 
HKNOG 6.0 Next Generation Networks - will automation put us out of jobs?
HKNOG 6.0 Next Generation Networks - will automation put us out of jobs?HKNOG 6.0 Next Generation Networks - will automation put us out of jobs?
HKNOG 6.0 Next Generation Networks - will automation put us out of jobs?Tom Paseka
 
Neev Application Performance Management Services
Neev Application Performance Management ServicesNeev Application Performance Management Services
Neev Application Performance Management ServicesNeev Technologies
 
How Cloud Accounting Software Enables Growth
How Cloud Accounting Software Enables GrowthHow Cloud Accounting Software Enables Growth
How Cloud Accounting Software Enables Growthndhsshare1
 

Similar to Cloud Task Execution at Scale with example from quant finance (20)

Introduction to Big Data using AWS Services
Introduction to Big Data using AWS ServicesIntroduction to Big Data using AWS Services
Introduction to Big Data using AWS Services
 
Engage with...Romax | Driving the Electric Revolution Webinar
Engage with...Romax | Driving the Electric Revolution WebinarEngage with...Romax | Driving the Electric Revolution Webinar
Engage with...Romax | Driving the Electric Revolution Webinar
 
Measuring HPC: Performance, Cost, & Value
Measuring HPC: Performance, Cost, & ValueMeasuring HPC: Performance, Cost, & Value
Measuring HPC: Performance, Cost, & Value
 
Fast Data at ING – the why, what and how of the streaming analytics platform ...
Fast Data at ING – the why, what and how of the streaming analytics platform ...Fast Data at ING – the why, what and how of the streaming analytics platform ...
Fast Data at ING – the why, what and how of the streaming analytics platform ...
 
Jakob Freund: Camunda for IT Executives - Camunda Days
Jakob Freund: Camunda for IT Executives - Camunda DaysJakob Freund: Camunda for IT Executives - Camunda Days
Jakob Freund: Camunda for IT Executives - Camunda Days
 
Mindsphere: an open cloud-based IoT operating system for Industry
Mindsphere: an open cloud-based IoT operating system for IndustryMindsphere: an open cloud-based IoT operating system for Industry
Mindsphere: an open cloud-based IoT operating system for Industry
 
The Rise Of Event Streaming – Why Apache Kafka Changes Everything
The Rise Of Event Streaming – Why Apache Kafka Changes EverythingThe Rise Of Event Streaming – Why Apache Kafka Changes Everything
The Rise Of Event Streaming – Why Apache Kafka Changes Everything
 
Apache kafka event_streaming___kai_waehner
Apache kafka event_streaming___kai_waehnerApache kafka event_streaming___kai_waehner
Apache kafka event_streaming___kai_waehner
 
Conquering the Lambda architecture in LinkedIn metrics platform with Apache C...
Conquering the Lambda architecture in LinkedIn metrics platform with Apache C...Conquering the Lambda architecture in LinkedIn metrics platform with Apache C...
Conquering the Lambda architecture in LinkedIn metrics platform with Apache C...
 
Transformacion del Negocio Financiero por medio de Tecnologias Cloud
Transformacion del Negocio Financiero por medio de Tecnologias CloudTransformacion del Negocio Financiero por medio de Tecnologias Cloud
Transformacion del Negocio Financiero por medio de Tecnologias Cloud
 
IoT's impact on products design and innovation - LibreCon 2016
IoT's impact on products design and innovation - LibreCon 2016IoT's impact on products design and innovation - LibreCon 2016
IoT's impact on products design and innovation - LibreCon 2016
 
ITCamp 2019 - Andrea Saltarello - Modernise your app. The Cloud Story
ITCamp 2019 - Andrea Saltarello - Modernise your app. The Cloud StoryITCamp 2019 - Andrea Saltarello - Modernise your app. The Cloud Story
ITCamp 2019 - Andrea Saltarello - Modernise your app. The Cloud Story
 
Pivoting event streaming, from PROJECTS to a PLATFORM
Pivoting event streaming, from PROJECTS to a PLATFORMPivoting event streaming, from PROJECTS to a PLATFORM
Pivoting event streaming, from PROJECTS to a PLATFORM
 
Interactive Image Processing Demos for the Web
Interactive Image Processing Demos for the WebInteractive Image Processing Demos for the Web
Interactive Image Processing Demos for the Web
 
ITMAGINATION - competences, facts, technologies, clients
ITMAGINATION - competences, facts, technologies, clientsITMAGINATION - competences, facts, technologies, clients
ITMAGINATION - competences, facts, technologies, clients
 
ScaleFocus DACH Expertise
ScaleFocus DACH ExpertiseScaleFocus DACH Expertise
ScaleFocus DACH Expertise
 
Resume
ResumeResume
Resume
 
HKNOG 6.0 Next Generation Networks - will automation put us out of jobs?
HKNOG 6.0 Next Generation Networks - will automation put us out of jobs?HKNOG 6.0 Next Generation Networks - will automation put us out of jobs?
HKNOG 6.0 Next Generation Networks - will automation put us out of jobs?
 
Neev Application Performance Management Services
Neev Application Performance Management ServicesNeev Application Performance Management Services
Neev Application Performance Management Services
 
How Cloud Accounting Software Enables Growth
How Cloud Accounting Software Enables GrowthHow Cloud Accounting Software Enables Growth
How Cloud Accounting Software Enables Growth
 

More from John Holden

ISC Frankfurt 2015: Good, bad and ugly of accelerators and a complementary path
ISC Frankfurt 2015: Good, bad and ugly of accelerators and a complementary pathISC Frankfurt 2015: Good, bad and ugly of accelerators and a complementary path
ISC Frankfurt 2015: Good, bad and ugly of accelerators and a complementary pathJohn Holden
 
NAG software for the Actuarial Community (Sep. 2012)
NAG software for the Actuarial Community (Sep. 2012)NAG software for the Actuarial Community (Sep. 2012)
NAG software for the Actuarial Community (Sep. 2012)John Holden
 
Wilmott Nyc Jul2012 Nag Talk John Holden
Wilmott Nyc Jul2012 Nag Talk John HoldenWilmott Nyc Jul2012 Nag Talk John Holden
Wilmott Nyc Jul2012 Nag Talk John HoldenJohn Holden
 
Numerical Excellence In Finance N A G Jan2010
Numerical Excellence In Finance N A G Jan2010Numerical Excellence In Finance N A G Jan2010
Numerical Excellence In Finance N A G Jan2010John Holden
 
Monte Carlo G P U Jan2010
Monte  Carlo  G P U  Jan2010Monte  Carlo  G P U  Jan2010
Monte Carlo G P U Jan2010John Holden
 
N A G P A R I S280101
N A G P A R I S280101N A G P A R I S280101
N A G P A R I S280101John Holden
 

More from John Holden (6)

ISC Frankfurt 2015: Good, bad and ugly of accelerators and a complementary path
ISC Frankfurt 2015: Good, bad and ugly of accelerators and a complementary pathISC Frankfurt 2015: Good, bad and ugly of accelerators and a complementary path
ISC Frankfurt 2015: Good, bad and ugly of accelerators and a complementary path
 
NAG software for the Actuarial Community (Sep. 2012)
NAG software for the Actuarial Community (Sep. 2012)NAG software for the Actuarial Community (Sep. 2012)
NAG software for the Actuarial Community (Sep. 2012)
 
Wilmott Nyc Jul2012 Nag Talk John Holden
Wilmott Nyc Jul2012 Nag Talk John HoldenWilmott Nyc Jul2012 Nag Talk John Holden
Wilmott Nyc Jul2012 Nag Talk John Holden
 
Numerical Excellence In Finance N A G Jan2010
Numerical Excellence In Finance N A G Jan2010Numerical Excellence In Finance N A G Jan2010
Numerical Excellence In Finance N A G Jan2010
 
Monte Carlo G P U Jan2010
Monte  Carlo  G P U  Jan2010Monte  Carlo  G P U  Jan2010
Monte Carlo G P U Jan2010
 
N A G P A R I S280101
N A G P A R I S280101N A G P A R I S280101
N A G P A R I S280101
 

Recently uploaded

Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
Bluetooth Controlled Car with Arduino.pdf
Bluetooth Controlled Car with Arduino.pdfBluetooth Controlled Car with Arduino.pdf
Bluetooth Controlled Car with Arduino.pdfngoud9212
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
APIForce Zurich 5 April Automation LPDG
APIForce Zurich 5 April  Automation LPDGAPIForce Zurich 5 April  Automation LPDG
APIForce Zurich 5 April Automation LPDGMarianaLemus7
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksSoftradix Technologies
 
Science&tech:THE INFORMATION AGE STS.pdf
Science&tech:THE INFORMATION AGE STS.pdfScience&tech:THE INFORMATION AGE STS.pdf
Science&tech:THE INFORMATION AGE STS.pdfjimielynbastida
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
costume and set research powerpoint presentation
costume and set research powerpoint presentationcostume and set research powerpoint presentation
costume and set research powerpoint presentationphoebematthew05
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersThousandEyes
 
Unlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsUnlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsPrecisely
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsAndrey Dotsenko
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 

Recently uploaded (20)

Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
Bluetooth Controlled Car with Arduino.pdf
Bluetooth Controlled Car with Arduino.pdfBluetooth Controlled Car with Arduino.pdf
Bluetooth Controlled Car with Arduino.pdf
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
APIForce Zurich 5 April Automation LPDG
APIForce Zurich 5 April  Automation LPDGAPIForce Zurich 5 April  Automation LPDG
APIForce Zurich 5 April Automation LPDG
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other Frameworks
 
Science&tech:THE INFORMATION AGE STS.pdf
Science&tech:THE INFORMATION AGE STS.pdfScience&tech:THE INFORMATION AGE STS.pdf
Science&tech:THE INFORMATION AGE STS.pdf
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
The transition to renewables in India.pdf
The transition to renewables in India.pdfThe transition to renewables in India.pdf
The transition to renewables in India.pdf
 
costume and set research powerpoint presentation
costume and set research powerpoint presentationcostume and set research powerpoint presentation
costume and set research powerpoint presentation
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
 
Unlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsUnlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power Systems
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 

Cloud Task Execution at Scale with example from quant finance

  • 1. Experts in numerical software and High Performance Computing Cloud Task Execution at Scale with an example from Quant Finance Microsoft SC18 Theater presentation November 2018 John HOLDEN Mick PONT
  • 2. 2High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
  • 3. 3High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
  • 4. 4High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com ► Manage Distribution (CPU/GPU) ► Manage dependencies ► Manage synchronization ► Manage control ► Manage ad-hoc Grid (during Development) ► Manage Cloud(s) (during Testing / Production)
  • 5. 5High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com Client Client Client Server Client-Server Client Client Client Client-Worker worker worker worker synchronisation worker worker worker Master Master-Worker
  • 6. 6High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
  • 7. 7High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
  • 8. 8High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com • Origami supports DAGs including: data transfers, metrics, recovery from task failure. • Can run on dev machines, in-house grid, production cloud, CPU, CPU / GPU – mixture.
  • 9. 9High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
  • 10. 10High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com Description Elapsed Time Single core ~ 14 hours Origami / Grid / Azure Minutes
  • 11. 11High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com
  • 12. 12High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com Experts in High Performance Computing, Algorithms and Numerical Software Engineering www.nag.com | blog.nag.com | @NAGtalk
  • 13. 13High Performance Computing Consulting | Numerical Algorithms | Software Engineering Services | www.nag.com Experts in High Performance Computing, Algorithms and Numerical Software Engineering www.nag.com | blog.nag.com | @NAGtalk