SlideShare a Scribd company logo
WP3 Tools: distributed molecular
simulations and remote submission
interface
Toni Giorgino
Computational Biochemistry and Biophysics Lab / GRIB-IMIM
www.multiscalelab.org
22-23 jan 2009
VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 13
MD at the microsecond scale
Full-atom MD is computationally expensive
All solvation water molecules modeled
Non-bonded interactions
All degrees of freedom in a protein
z
VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 14
MD at the microsecond scale
Full-atom MD is computationally expensive
All solvation water molecules modeled
Non-bonded interactions
All degrees of freedom in a protein
z
VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 15
Tackled at several scales
Combine advances of large-scale
infrastructures ⇒ distributed computing
...with those in commodity computing
architectures ⇒ GPU
One node
(CPU)
0.4 ns/day
1
VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 16
Tackled at several scales
Combine advances of large-scale
infrastructures ⇒ distributed computing
...with those in commodity computing
architectures ⇒ GPU
One node
(CPU)
0.4 ns/day
Within-node 1
VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 17
Tackled at several scales
Combine advances of large-scale
infrastructures ⇒ distributed computing
...with those in commodity computing
architectures ⇒ GPU
One node
(CPU)
0.4 ns/day
One node,
accelerated
4.5 ns/day
Within-node 1
VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 18
Tackled at several scales
Combine advances of large-scale
infrastructures ⇒ distributed computing
...with those in commodity computing
architectures ⇒ GPU
One node
(CPU)
0.4 ns/day
One node,
accelerated
4.5 ns/day
Within-node Among-nodes1
VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 19
Tackled at several scales
Combine advances of large-scale
infrastructures ⇒ distributed computing
...with those in commodity computing
architectures ⇒ GPU
One node
(CPU)
0.4 ns/day
One node,
accelerated
4.5 ns/day
Distributed
computing
X 1,700, growing
Within-node Among-nodes1
VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 20
Tools
One node
(CPU)
0.25 ns/day
One node,
accelerated
4.6 ns/day
Distributed
computing
X 1,700, growing
Within-node Among-nodes1
VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 21
Tools
One node
(CPU)
0.25 ns/day
One node,
accelerated
4.6 ns/day
Distributed
computing
X 1,700, growing
Within-node Among-nodes1
AceMD
VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 22
Tools
One node
(CPU)
0.25 ns/day
One node,
accelerated
4.6 ns/day
Distributed
computing
X 1,700, growing
Within-node Among-nodes1
AceMD Boinc
VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 23
Tools
One node
(CPU)
0.25 ns/day
One node,
accelerated
4.6 ns/day
Distributed
computing
X 1,700, growing
Within-node Among-nodes1
AceMD Boinc
VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 24
Computing architecture
Based on BOINC (Berkeley Open
Infrastructure for Network Computing)
Allows (loosely-coupled) computations to
be distributed over the Internet
Volunteers contribute CPU cycles
Not MD-specific
Public statistics at www.boincstats.com
VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 25
Using computing power
• The infrastructure becomes useful for the
community with a distributed submission
system
One node
(CPU)
0.25 ns/day
One node,
accelerated
4.6 ns/day
Distributed
computing
× 2,000, growing
Within-node Among-nodes1
VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 26
Using computing power
• The infrastructure becomes useful for the
community with a distributed submission
system
One node
(CPU)
0.25 ns/day
One node,
accelerated
4.6 ns/day
Distributed
computing
× 2,000, growing
Within-node Among-nodes1
Sim.entry
point
VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 27
Using computing power
• The infrastructure becomes useful for the
community with a distributed submission
system
One node
(CPU)
0.25 ns/day
One node,
accelerated
4.6 ns/day
Distributed
computing
× 2,000, growing
Within-node Among-nodes1
Sim.entry
point
Research team 1 – hERG
Scientist 2 – gA
…
Research team N – protN
VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 28
Remote simulation submission
• Pre-defined “best practice” submission
protocols
• Researchers stage in/out files
– They are taken in charge by Boinc
• Accounting:
– Given the scale of deployment, increasing
“trustedness” associated to each simulation
– FLOPS consumed
VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 29
Example: submission
1. Client parses local files and prepares a description of
the simulation (may contain user-supplied metadata)
2. Inputs are uploaded to a staging area
3. Execution
• Consis check
• Move to execution area
• Launch simulation
4. Results continuously produced; “work units” spanned
until the protocol ends (# of ns × bins)
5. Clients periodically retrieve & delete results
VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 30
Technically
boinc_submit
− Uploads local input files
− Creates config, launches WUs, etc
− Returns immediately
boinc_stat
boinc_retrieve
[boinc_cancel et al]
VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 31
Common traits
All client commands have a notion of
username and password to send for
authentication
Authentication checked with Boinc protocol
Server remembers uploaded files for later
deletion (server-side “RemoteWU” entity)
A RemoteWU has an ID for the clients to
retrieve
− ideally equal to the usual WU id
VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 32
Outlook
• Expose remote submission interfaces
• Identify ontologies for inclusion of relevant
annotations
• Introduce metadata at least for annotating
inputs (to be carried out in outputs)

More Related Content

Similar to Rboinc 22jan Vph R2

Iot development from prototype to production
Iot development from prototype to productionIot development from prototype to production
Iot development from prototype to production
Mender.io
 
Uop ntc 405 week 1 individual hands
Uop ntc 405 week 1 individual handsUop ntc 405 week 1 individual hands
Uop ntc 405 week 1 individual hands
uopassignment
 
ON.LAB Mininet
ON.LAB MininetON.LAB Mininet
ON.LAB Mininet
Isabelle Guis
 
Applying the Unix Philosophy to Django projects: a report from the real world
Applying the Unix Philosophy to Django projects: a report from the real worldApplying the Unix Philosophy to Django projects: a report from the real world
Applying the Unix Philosophy to Django projects: a report from the real world
Federico Capoano
 
IoT Prototyping using BBB and Debian
IoT Prototyping using BBB and DebianIoT Prototyping using BBB and Debian
IoT Prototyping using BBB and Debian
Mender.io
 
FFMUC presents #ffmeet - #virtualUKNOF
FFMUC presents #ffmeet - #virtualUKNOFFFMUC presents #ffmeet - #virtualUKNOF
FFMUC presents #ffmeet - #virtualUKNOF
Annika Wickert
 
OpenChain Monthly Meeting - North America / Asia - 2023-03-21
OpenChain Monthly Meeting - North America / Asia - 2023-03-21OpenChain Monthly Meeting - North America / Asia - 2023-03-21
OpenChain Monthly Meeting - North America / Asia - 2023-03-21
Shane Coughlan
 
BCOP BoF
BCOP BoFBCOP BoF
BCOP BoF
APNIC
 
An open-source testbed for IoT systems
An open-source testbed for IoT systemsAn open-source testbed for IoT systems
An open-source testbed for IoT systems
Augusto Ciuffoletti
 
Automated Podcasting System for Universities
Automated Podcasting System for UniversitiesAutomated Podcasting System for Universities
Automated Podcasting System for Universities
Educational Technology
 
Gridforum Juergen Knobloch Grids For Science 20080402
Gridforum Juergen Knobloch Grids For Science 20080402Gridforum Juergen Knobloch Grids For Science 20080402
Gridforum Juergen Knobloch Grids For Science 20080402
vrij
 
20140114_Infoday regional H2020_Energía_Enrique Daroqui
20140114_Infoday regional H2020_Energía_Enrique Daroqui20140114_Infoday regional H2020_Energía_Enrique Daroqui
20140114_Infoday regional H2020_Energía_Enrique Daroqui
Redit
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
Alpen-Adria-Universität
 
The Best of two Worlds Project (Bo2W) - Summary project achievements
The Best of two Worlds Project (Bo2W) - Summary project achievementsThe Best of two Worlds Project (Bo2W) - Summary project achievements
The Best of two Worlds Project (Bo2W) - Summary project achievements
Oeko-Institut
 
Why the yocto project for my io t project elc_edinburgh_2018
Why the yocto project for my io t project elc_edinburgh_2018Why the yocto project for my io t project elc_edinburgh_2018
Why the yocto project for my io t project elc_edinburgh_2018
Mender.io
 
Slides
SlidesSlides
Slides
Nick Efford
 
Slimfast
SlimfastSlimfast
Slimfast
Luc Lesoil
 
Crsm 3 2009 Chris Van Diepenbeek Ra Cognitive Radio In The Wrc
Crsm 3 2009   Chris Van Diepenbeek Ra   Cognitive Radio In The WrcCrsm 3 2009   Chris Van Diepenbeek Ra   Cognitive Radio In The Wrc
Crsm 3 2009 Chris Van Diepenbeek Ra Cognitive Radio In The Wrc
imec.archive
 
C08 – Updated planning and commissioning guidelines for Profinet - Xaver Sch...
C08 – Updated planning and commissioning guidelines for Profinet -  Xaver Sch...C08 – Updated planning and commissioning guidelines for Profinet -  Xaver Sch...
C08 – Updated planning and commissioning guidelines for Profinet - Xaver Sch...
PROFIBUS and PROFINET InternationaI - PI UK
 
[Dec./2017] My Personal/Professional Journey after Graduate Univ.
[Dec./2017] My Personal/Professional Journey after Graduate Univ.[Dec./2017] My Personal/Professional Journey after Graduate Univ.
[Dec./2017] My Personal/Professional Journey after Graduate Univ.
Hayoung Yoon
 

Similar to Rboinc 22jan Vph R2 (20)

Iot development from prototype to production
Iot development from prototype to productionIot development from prototype to production
Iot development from prototype to production
 
Uop ntc 405 week 1 individual hands
Uop ntc 405 week 1 individual handsUop ntc 405 week 1 individual hands
Uop ntc 405 week 1 individual hands
 
ON.LAB Mininet
ON.LAB MininetON.LAB Mininet
ON.LAB Mininet
 
Applying the Unix Philosophy to Django projects: a report from the real world
Applying the Unix Philosophy to Django projects: a report from the real worldApplying the Unix Philosophy to Django projects: a report from the real world
Applying the Unix Philosophy to Django projects: a report from the real world
 
IoT Prototyping using BBB and Debian
IoT Prototyping using BBB and DebianIoT Prototyping using BBB and Debian
IoT Prototyping using BBB and Debian
 
FFMUC presents #ffmeet - #virtualUKNOF
FFMUC presents #ffmeet - #virtualUKNOFFFMUC presents #ffmeet - #virtualUKNOF
FFMUC presents #ffmeet - #virtualUKNOF
 
OpenChain Monthly Meeting - North America / Asia - 2023-03-21
OpenChain Monthly Meeting - North America / Asia - 2023-03-21OpenChain Monthly Meeting - North America / Asia - 2023-03-21
OpenChain Monthly Meeting - North America / Asia - 2023-03-21
 
BCOP BoF
BCOP BoFBCOP BoF
BCOP BoF
 
An open-source testbed for IoT systems
An open-source testbed for IoT systemsAn open-source testbed for IoT systems
An open-source testbed for IoT systems
 
Automated Podcasting System for Universities
Automated Podcasting System for UniversitiesAutomated Podcasting System for Universities
Automated Podcasting System for Universities
 
Gridforum Juergen Knobloch Grids For Science 20080402
Gridforum Juergen Knobloch Grids For Science 20080402Gridforum Juergen Knobloch Grids For Science 20080402
Gridforum Juergen Knobloch Grids For Science 20080402
 
20140114_Infoday regional H2020_Energía_Enrique Daroqui
20140114_Infoday regional H2020_Energía_Enrique Daroqui20140114_Infoday regional H2020_Energía_Enrique Daroqui
20140114_Infoday regional H2020_Energía_Enrique Daroqui
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
 
The Best of two Worlds Project (Bo2W) - Summary project achievements
The Best of two Worlds Project (Bo2W) - Summary project achievementsThe Best of two Worlds Project (Bo2W) - Summary project achievements
The Best of two Worlds Project (Bo2W) - Summary project achievements
 
Why the yocto project for my io t project elc_edinburgh_2018
Why the yocto project for my io t project elc_edinburgh_2018Why the yocto project for my io t project elc_edinburgh_2018
Why the yocto project for my io t project elc_edinburgh_2018
 
Slides
SlidesSlides
Slides
 
Slimfast
SlimfastSlimfast
Slimfast
 
Crsm 3 2009 Chris Van Diepenbeek Ra Cognitive Radio In The Wrc
Crsm 3 2009   Chris Van Diepenbeek Ra   Cognitive Radio In The WrcCrsm 3 2009   Chris Van Diepenbeek Ra   Cognitive Radio In The Wrc
Crsm 3 2009 Chris Van Diepenbeek Ra Cognitive Radio In The Wrc
 
C08 – Updated planning and commissioning guidelines for Profinet - Xaver Sch...
C08 – Updated planning and commissioning guidelines for Profinet -  Xaver Sch...C08 – Updated planning and commissioning guidelines for Profinet -  Xaver Sch...
C08 – Updated planning and commissioning guidelines for Profinet - Xaver Sch...
 
[Dec./2017] My Personal/Professional Journey after Graduate Univ.
[Dec./2017] My Personal/Professional Journey after Graduate Univ.[Dec./2017] My Personal/Professional Journey after Graduate Univ.
[Dec./2017] My Personal/Professional Journey after Graduate Univ.
 

Rboinc 22jan Vph R2

  • 1. WP3 Tools: distributed molecular simulations and remote submission interface Toni Giorgino Computational Biochemistry and Biophysics Lab / GRIB-IMIM www.multiscalelab.org 22-23 jan 2009
  • 2. VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 13 MD at the microsecond scale Full-atom MD is computationally expensive All solvation water molecules modeled Non-bonded interactions All degrees of freedom in a protein z
  • 3. VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 14 MD at the microsecond scale Full-atom MD is computationally expensive All solvation water molecules modeled Non-bonded interactions All degrees of freedom in a protein z
  • 4. VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 15 Tackled at several scales Combine advances of large-scale infrastructures ⇒ distributed computing ...with those in commodity computing architectures ⇒ GPU One node (CPU) 0.4 ns/day 1
  • 5. VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 16 Tackled at several scales Combine advances of large-scale infrastructures ⇒ distributed computing ...with those in commodity computing architectures ⇒ GPU One node (CPU) 0.4 ns/day Within-node 1
  • 6. VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 17 Tackled at several scales Combine advances of large-scale infrastructures ⇒ distributed computing ...with those in commodity computing architectures ⇒ GPU One node (CPU) 0.4 ns/day One node, accelerated 4.5 ns/day Within-node 1
  • 7. VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 18 Tackled at several scales Combine advances of large-scale infrastructures ⇒ distributed computing ...with those in commodity computing architectures ⇒ GPU One node (CPU) 0.4 ns/day One node, accelerated 4.5 ns/day Within-node Among-nodes1
  • 8. VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 19 Tackled at several scales Combine advances of large-scale infrastructures ⇒ distributed computing ...with those in commodity computing architectures ⇒ GPU One node (CPU) 0.4 ns/day One node, accelerated 4.5 ns/day Distributed computing X 1,700, growing Within-node Among-nodes1
  • 9. VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 20 Tools One node (CPU) 0.25 ns/day One node, accelerated 4.6 ns/day Distributed computing X 1,700, growing Within-node Among-nodes1
  • 10. VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 21 Tools One node (CPU) 0.25 ns/day One node, accelerated 4.6 ns/day Distributed computing X 1,700, growing Within-node Among-nodes1 AceMD
  • 11. VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 22 Tools One node (CPU) 0.25 ns/day One node, accelerated 4.6 ns/day Distributed computing X 1,700, growing Within-node Among-nodes1 AceMD Boinc
  • 12. VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 23 Tools One node (CPU) 0.25 ns/day One node, accelerated 4.6 ns/day Distributed computing X 1,700, growing Within-node Among-nodes1 AceMD Boinc
  • 13. VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 24 Computing architecture Based on BOINC (Berkeley Open Infrastructure for Network Computing) Allows (loosely-coupled) computations to be distributed over the Internet Volunteers contribute CPU cycles Not MD-specific Public statistics at www.boincstats.com
  • 14. VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 25 Using computing power • The infrastructure becomes useful for the community with a distributed submission system One node (CPU) 0.25 ns/day One node, accelerated 4.6 ns/day Distributed computing × 2,000, growing Within-node Among-nodes1
  • 15. VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 26 Using computing power • The infrastructure becomes useful for the community with a distributed submission system One node (CPU) 0.25 ns/day One node, accelerated 4.6 ns/day Distributed computing × 2,000, growing Within-node Among-nodes1 Sim.entry point
  • 16. VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 27 Using computing power • The infrastructure becomes useful for the community with a distributed submission system One node (CPU) 0.25 ns/day One node, accelerated 4.6 ns/day Distributed computing × 2,000, growing Within-node Among-nodes1 Sim.entry point Research team 1 – hERG Scientist 2 – gA … Research team N – protN
  • 17. VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 28 Remote simulation submission • Pre-defined “best practice” submission protocols • Researchers stage in/out files – They are taken in charge by Boinc • Accounting: – Given the scale of deployment, increasing “trustedness” associated to each simulation – FLOPS consumed
  • 18. VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 29 Example: submission 1. Client parses local files and prepares a description of the simulation (may contain user-supplied metadata) 2. Inputs are uploaded to a staging area 3. Execution • Consis check • Move to execution area • Launch simulation 4. Results continuously produced; “work units” spanned until the protocol ends (# of ns × bins) 5. Clients periodically retrieve & delete results
  • 19. VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 30 Technically boinc_submit − Uploads local input files − Creates config, launches WUs, etc − Returns immediately boinc_stat boinc_retrieve [boinc_cancel et al]
  • 20. VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 31 Common traits All client commands have a notion of username and password to send for authentication Authentication checked with Boinc protocol Server remembers uploaded files for later deletion (server-side “RemoteWU” entity) A RemoteWU has an ID for the clients to retrieve − ideally equal to the usual WU id
  • 21. VPH NoE Meeting - Oxford Thursday, January 22, 2009 Toni Giorgino 32 Outlook • Expose remote submission interfaces • Identify ontologies for inclusion of relevant annotations • Introduce metadata at least for annotating inputs (to be carried out in outputs)