Introduction to LAVA Workload Scheduler

•

4 likes•2,116 views

Nopparat Nopkuat

Training slide for workshop "Introduction to LAVA Workload Scheduler" @NCSEC2009 BKK THILAND

Technology

Introduction to LAVA workload scheduler High Performance Computing and Networking Center (HPCNC) Kasetsart University In collaboration with Innovative Extremist (INOX) Co.,Ltd. and Platform Computing Inc.

Introduction to HPC, Cluster and Workload Scheduler

Parallel Programming Systems which is portable and efficient

Software library that ease the application development e.g. Scalapack, Plapack, PetSc

PC mass market nature drive the price down while performance increase rapidly

Cluster nature make it easy to capitalize on PC new technology right away

Automobile Design ( Crash Simulation) ,[object Object],[object Object]

(Google use more than 10000 node servers) ,[object Object],[object Object]

Molecular Dynamic Simulation ,[object Object]

Graphics Rendering and Special Effect ,[object Object]

Massive number of rendering job needed to be done to create a movie

Cluster Software Architecture HTC HPC HPTC

High Throughput Computing ,[object Object]

High Throughput Computing (con) ,[object Object]

Excellence for many type of applications such as ,[object Object]

Distributed application such as massive rendering in animation industry ,[object Object],[object Object]

High Performance Computing ,[object Object]

Use of specialised codes, libraries ,[object Object]

Parallel Maths Libraries (ScaLapack) ,[object Object]

Speedup for a single instance of problem is needed

Advantages and Challenges ,[object Object]

Plenty of free software ,[object Object],[object Object]

No powerful software development environment

Low compatibility with many enterprise computing environment

Parallel Application Development ,[object Object]

Message passing – data is exchanged by sending/receiving messages between processors

Allow users to share computing resources and time sharing ,[object Object]

Control shared resource usage for multiple users ,[object Object]

Hide the complexity of using cluster's computing resources by submitting job to the scheduler

What's hot

Effective testing for spark programs Strata NY 2015Holden Karau

Adding replication protocol support for psycopg2Alexander Shulgin

Virtualizing Java in Java (jug.ru)aragozin

High Performance Distributed TensorFlow with GPUs - Nvidia GPU Tech Conferenc...Chris Fregly

Inside the JVM - Follow the white rabbit! / Breizh JUGSylvain Wallez

High Performance Distributed TensorFlow with GPUs - NYC Workshop - July 9 2017Chris Fregly

High Performance Distributed TensorFlow in Production with GPUs - NIPS 2017 -...Chris Fregly

Optimize + Deploy Distributed Tensorflow, Spark, and Scikit-Learn Models on G...Chris Fregly

High Performance TensorFlow in Production - Big Data Spain - Madrid - Nov 15 ...Chris Fregly

Optimize + Deploy Distributed Tensorflow, Spark, and Scikit-Learn Models on GPUsChris Fregly

whats new in java 8 Dori Waldman

Optimizing, Profiling, and Deploying TensorFlow AI Models in Production with ...Chris Fregly

Spark stream - Kafka Dori Waldman

High Performance TensorFlow in Production -- Sydney ML / AI Train Workshop @ ...Chris Fregly

PipelineAI Optimizes Your Enterprise AI Pipeline from Distributed Training to...Chris Fregly

Building Google Cloud ML Engine From Scratch on AWS with PipelineAI - ODSC Lo...Chris Fregly

PipelineAI + TensorFlow AI + Spark ML + Kuberenetes + Istio + AWS SageMaker +...Chris Fregly

Cassandra - lesson learnedAndrzej Ludwikowski

Monitoring with PrometheusShiao-An Yuan

Optimizing, Profiling, and Deploying TensorFlow AI Models with GPUs - San Fra...Chris Fregly

What's hot (20)

Effective testing for spark programs Strata NY 2015

Adding replication protocol support for psycopg2

Virtualizing Java in Java (jug.ru)

High Performance Distributed TensorFlow with GPUs - Nvidia GPU Tech Conferenc...

Inside the JVM - Follow the white rabbit! / Breizh JUG

High Performance Distributed TensorFlow with GPUs - NYC Workshop - July 9 2017

High Performance Distributed TensorFlow in Production with GPUs - NIPS 2017 -...

Optimize + Deploy Distributed Tensorflow, Spark, and Scikit-Learn Models on G...

High Performance TensorFlow in Production - Big Data Spain - Madrid - Nov 15 ...

Optimize + Deploy Distributed Tensorflow, Spark, and Scikit-Learn Models on GPUs

whats new in java 8

Optimizing, Profiling, and Deploying TensorFlow AI Models in Production with ...

Spark stream - Kafka

High Performance TensorFlow in Production -- Sydney ML / AI Train Workshop @ ...

PipelineAI Optimizes Your Enterprise AI Pipeline from Distributed Training to...

Building Google Cloud ML Engine From Scratch on AWS with PipelineAI - ODSC Lo...

PipelineAI + TensorFlow AI + Spark ML + Kuberenetes + Istio + AWS SageMaker +...

Cassandra - lesson learned

Monitoring with Prometheus

Optimizing, Profiling, and Deploying TensorFlow AI Models with GPUs - San Fra...

Similar to Introduction to LAVA Workload Scheduler

Power-Efficient Programming Using Qualcomm Multicore Asynchronous Runtime Env...Qualcomm Developer Network

OS for AI: Elastic Microservices & the Next Gen of MLNordic APIs

Apache Cassandra 2.0Joe Stein

Container orchestration from theory to practiceDocker, Inc.

Kubernetes for the PHP developerPaul Czarkowski

Introduction To Apache MesosJoe Stein

Quantifying Container Runtime Performance: OSCON 2017 Open Container DayPhil Estes

Building Continuous Application with Structured Streaming and Real-Time Data ...Databricks

Capistrano, Puppet, and ChefDavid Benjamin

A DevOps guide to KubernetesPaul Czarkowski

Configuring Your First Hadoop Cluster On EC2benjaminwootton

Docker Swarm secrets for creating great FIWARE platformsFederico Michele Facca

LibOS as a regression test framework for Linux networking #netdev1.1Hajime Tazaki

A Fabric/Puppet Build/Deploy Systemadrian_nye

zLAMPAbdul Jaleel Kavungal

Using R on High Performance ComputersDave Hiltbrand

Copper: A high performance workflow enginedmoebius

AutoScaling and DrupalPromet Source

(ARC402) Deployment Automation: From Developers' Keyboards to End Users' Scre...Amazon Web Services

NodeJS guide for beginnersEnoch Joshua

Similar to Introduction to LAVA Workload Scheduler (20)

Power-Efficient Programming Using Qualcomm Multicore Asynchronous Runtime Env...

OS for AI: Elastic Microservices & the Next Gen of ML

Apache Cassandra 2.0

Container orchestration from theory to practice

Kubernetes for the PHP developer

Introduction To Apache Mesos

Quantifying Container Runtime Performance: OSCON 2017 Open Container Day

Building Continuous Application with Structured Streaming and Real-Time Data ...

Capistrano, Puppet, and Chef

A DevOps guide to Kubernetes

Configuring Your First Hadoop Cluster On EC2

Docker Swarm secrets for creating great FIWARE platforms

LibOS as a regression test framework for Linux networking #netdev1.1

A Fabric/Puppet Build/Deploy System

zLAMP

Using R on High Performance Computers

Copper: A high performance workflow engine

AutoScaling and Drupal

(ARC402) Deployment Automation: From Developers' Keyboards to End Users' Scre...

NodeJS guide for beginners

Recently uploaded

🐬 The future of MySQL is Postgres 🐘RTylerCroy

Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun

IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge

Tata AIG General Insurance Company - Insurer Innovation Award 2024The Digital Insurer

How to convert PDF to text with Nanonetsnaman860154

Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK

Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j

Scaling API-first – The story of a global engineering organizationRadu Cotescu

2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong

Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC

Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer

Slack Application Development 101 Slidespraypatel2

04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG

08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls

Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsRoshan Dwivedi

Histor y of HAM Radio presentation slidevu2urc

CNv6 Instructor Chapter 6 Quality of Servicegiselly40

WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEarley Information Science

GenCyber Cyber Security Day PresentationMichael W. Hawkins

Recently uploaded (20)

🐬 The future of MySQL is Postgres 🐘

Data Cloud, More than a CDP by Matt Robison

IAC 2024 - IA Fast Track to Search Focused AI Solutions

Tata AIG General Insurance Company - Insurer Innovation Award 2024

How to convert PDF to text with Nanonets

Unblocking The Main Thread Solving ANRs and Frozen Frames

Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...

Scaling API-first – The story of a global engineering organization

2024: Domino Containers - The Next Step. News from the Domino Container commu...

Breaking the Kubernetes Kill Chain: Host Path Mount

Axa Assurance Maroc - Insurer Innovation Award 2024

Slack Application Development 101 Slides

04-2024-HHUG-Sales-and-Marketing-Alignment.pptx

08448380779 Call Girls In Friends Colony Women Seeking Men

Top 5 Benefits OF Using Muvi Live Paywall For Live Streams

Histor y of HAM Radio presentation slide

CNv6 Instructor Chapter 6 Quality of Service

WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx

GenCyber Cyber Security Day Presentation

Introduction to LAVA Workload Scheduler

1. Introduction to LAVA workload scheduler High Performance Computing and Networking Center (HPCNC) Kasetsart University In collaboration with Innovative Extremist (INOX) Co.,Ltd. and Platform Computing Inc.

3. LAVA workload scheduler

4. Installing and configuring LAVA Cluster

5. Workshop : Using LAVA

6. Introduction to HPC, Cluster and Workload Scheduler

9. Parallel Programming Systems which is portable and efficient

10. MPI (LAM, MPICH)

11. Software library that ease the application development e.g. Scalapack, Plapack, PetSc

12.

13. PC mass market nature drive the price down while performance increase rapidly

14. Cluster nature make it easy to capitalize on PC new technology right away

15. Why? Price Performance!

16.

17.

18.

19. Bioinformatics

20. Large scale financial analysis

21. Simulation

22. Drug Design

23.

24.

25.

26.

27.

28. Massive number of rendering job needed to be done to create a movie

29. Cluster Software Architecture HTC HPC HPTC

30.

31.

32.

33.

34.

35.

36.

37.

38.

39. Speedup for a single instance of problem is needed

40.

41.

42. No powerful software development environment

43. Low compatibility with many enterprise computing environment

44.

45. Message passing – data is exchanged by sending/receiving messages between processors

46.

47. Main role of distributed computing

48.

49.

50.

51. Hide the complexity of using cluster's computing resources by submitting job to the scheduler

52.

53. How many we can use?

54.

55.

56.

57. Platform LSF / Platform LAVA

58. PBS / PBS Pro

59. Torque

60. Maui

61. MS Job scheduler

62. LAVA Workload Scheduler

63.

64. Designed to meet a wide range of workload scheduling needs for clusters up to 512-nodes

65.

66. Reliability

67. Parallel Job Scheduling

68. Complete Job History

69. Interactive Jobs

70. Job Arrays

71. Job Dependency

72. Job Migration

73. Components (mbatchd) (sbatchd) (sbatchd) (sbatchd) LAVA Base LIM (Load Information Manager) RES (Remote Execution Service) Computer LSBATCH

74. Installing and Configuring

75.

76.

77.

78.

79. ./configure

80. make && make install

81.

82.

83. Can scale nodes without editing config files

84.

85. LAVA Base (lsf)

86. Batch scheduler (lsbatch)

87.

88.

89. LSF_TOP=/usr

90. LSF_BINDIR=/usr/bin

91. LSF_SERVERDIR=/usr/sbin

92. LSF_LIBDIR=/usr/lib

93. LSF_ENVDIR=/etc/lava/conf

94.

95. Config file usually located at $LSF_ENVDIR = /etc/lava/conf/

96.

97. lsf.cluster.lava * (general configuration, nodes, parameters)

98. lsf.task (type of tasks)

99. lsf.shared (default parameters)

100.

101.

102. Config file usually located at $LSF_ENVDIR/lsbatch/lava/configdir/

103.

104. lsb.modules (list of plugin modules)

105. lsb.params (batch scheduler parameters)

106. lsb.queues (job queue name & properties)

107. lsb.users (list of allowed users)

108.

109.

110.

111. Copy another queue definition from this file as a starting point and change the QUEUE_NAME of the copied queue.

112. Save the changes to lsb.queues.

113. Run badmin reconfig to reconfigure mbatchd.

114. Adding a queue does not affect pending or running jobs.

115.

116. Move all pending and running jobs into another queue using command bswitch -q Q_FROM Q_TO 0

117. Edit lsb.queues and remove or comment out the definition for the queue you want to remove.

118. Save the changes to lsb.queues.

119. Run badmin reconfig to reconfigure mbatchd.

120. Using LAVA

121.

122. bbot

123. bchkpnt

124. bhist

125. bhosts

126. bjobs

127. bkill

128. bmgroup

129. bmig

130. bmod

131.

132. lsacct

133. lseligible

134. lshosts

135. lsid

136. lsinfo

137. lsload

138. lsloadadj

139. lsmon

140. lsplace

141.

142. bqueues

143. brequeue

144. brestart

145. bresume

146. brun

147. bstop

148. bsub

149. bswitch

150. btop

151. bugroup

152. busers

153.

154. badmin

155.

156. bqueues / bqueues -l

157. bparams / bparams -l

158. bmgroup

159. bugroup

160.

161. lsinfo

162. lshosts

163. lsload

164. lsmon

165. lsacct

166.

167. bjobs <job id>

168.

169.

170.

171.

172.

173.

174.

175. Create file myscript

176. chmod u+x myscript

177. bsub < myscript #!bin/sh #BSUB -q test #BSUB -o outfile -R "mem>10" myjob arg1 arg2 #BSUB -J myjob

178.

179.

180.

181.

182.

183.

184.

185. By default, bkill sends SIGINT, SIGTERM and then SIGKILL signal to running jobs

186.

187.

188.

189.

190.

191. Job <3421> is being resumed

192.

193.

194.

195.

196.

197. END OF SESSION Thank you

198.

Introduction to LAVA Workload Scheduler

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Introduction to LAVA Workload Scheduler

Similar to Introduction to LAVA Workload Scheduler (20)

Recently uploaded

Recently uploaded (20)

Introduction to LAVA Workload Scheduler