SlideShare a Scribd company logo
1 of 28
Download to read offline
Parallel and
distributed computing
OUTLINE
Scheduling in Multiprocessing
Load Balancing
MULTIPLE PROCESSOR SCHEDULING
Multiprocessors is a system that has more than one
processor
With multiprocessors load sharing becomes feasible but
it makes scheduling more complex.
no such policy that can declared best scheduling
algorithm for single processor similarly there is no best
scheduling solution for multiprocessor systems
Best scheduling algorithm depends on the different
scenario.
MULTIPLE PROCESSOR SCHEDULING
The scheduling process of a multi-processor is more complex
than that of a single processor system because of the following
reasons.
• Load balancing is a problem since more than one processors
are present.
• Processes executing simultaneously may require access to
shared data.
• Cache affinity should be considered in scheduling.
Characteristics of a Good Scheduling
Algorithm:
must be flexible enough to process migration
decisions when there is a change in the system
load
A good scheduling algorithm has the property of
being scalable. It is flexible for scaling when the
number of nodes increases in a system
algorithm should not be affected by the failure of
one or more nodes of the system
Categories of Multiprocessors
Loosely coupled / Distributed multiprocessors: processors
are independent of each other. Each processor has its own
memory and I/O Channels.
Functionally specialized processor: there is a master/main
processor which is general purpose process. It controls
other processors in the system and provides services to
them
Tightly Couple Multiprocessors: all processors shares
common memory. Also termed as homogeneous
Techniques for multiprocessor Scheduling
Multi processor scheduling can be done in two ways
Asymmetric Scheduling
Symmetric Scheduling
Symmetric multiprocessor
 Processors are self schedule
 Each processor check ready queue and select process to execute.
 If one processor goes down rest of the system keeps working.
 There are two variants of symmetric multiprocessor
 Symmetrical Scheduling with global queues.
 Symmetrical Scheduling with private global queues.
Symmetrical Scheduling with global queues:
if processes are executing in common / global queue scheduler for
each processor checks this global queue and select process to
execute.
Symmetrical Scheduling with private queues
 if processors in the system have their own private ready queue, then processor will
check their own private ready queue to select process.
 Mostly symmetric multiprocessing is used most modern operating system i.e. LINUX,
WINDOWS, MAC OS.
Asymmetric Multiprocessor
one processor (master processor) handles all operations and other system
activities
master processor runs operating system code and other slave processors
only executed user code.
If master processor fails, whole system comes to a halt, if slave goes down,
rest of the system keeps working.
Processor Affinity
A process has an affinity (‫)تعلق‬ for the processor on which it is
currently running.
When a process runs on a specific processor, It has effects on
the cache memory.
The data most recently accessed by the process populate the
cache for the processor
Processor Affinity
when process migrates to another processor, now contents
of cache memory becomes invalidated for the first processor.
Cache for second processor must be repopulated
Because of high cost of invalidating and repopulating
caches, mostly SMP try to avoid migrating processes from
one processor to another.
This is known as
processor affinity.
Soft AFFINITY
When an operating system has a policy of keeping a
process running on the same processor but not
guaranteeing it will do so, this situation is called soft
affinity.
Hard AFFINITY
◦When an operating system has a policy of
attempting to keep a process running on the
same processor with guarantee that it will do
so, we have a situation known as hard affinity.
◦Some Linux systems implement soft affinity and
provide system calls
like sched_setaffinity() that also support hard
affinity.
Assignment
a processor can access its own local memory faster than non-local memory (memory
local to another processor or memory shared between processors
(NUMA) is a computer memory design used in multiprocessing, where the memory
access time depends on the memory location relative to the processor
Write a short note on Purpose and need of NUMA Architecture
Load BALANCING
balancing of load among Processors of distributed
computing.
Excess load of one CPU is distributed to other that
have less load according to defined limits i.e. neither
it gets overloaded nor idle.
Load balancing can help to maximize the
performance and throughput which is ultimate goal
of distributed computing.
Static load balancing
While distributing load current state of the system is not
taken into account.
These algorithms are simpler
Two types
1. Deterministic
2. Probabilistic
Static load balancing
1. Deterministic: Properties of nodes and
processes are taken into account for the
allocation of processes to nodes
E.g. if tasks are independent, execution
time is known.
Difficult to achieve better results
Static load balancing
2. Probabilistic: Algorithm, statistical
attributes of the CPU are taken into account
to make process placement rules
It also doesn’t give better performance.
*Statistical attributes: idle time, busy time
Dynamic load balancing
While distributing load, current state of the
system is taken into account.
Dynamically redistributing workloads away from
overloaded nodes toward underloaded nodes.
Difficult to design however better performance.
Dynamic load balancing
Types of dynamic load balancing
1. Centralized
2. Distributed
Dynamic load balancing
1. Centralized: task of handling requests for
process scheduling is carried out by centralized
server node.
Benefit is performance, as all information is held
at a single node, but suffers from reliability
problem
Another problem with increasing number of
requests
Dynamic load balancing
2. Distributed: task of handling requests for
process scheduling is carried out by individual
node of the system.
Unlike centralized, there is no need to hold
information.
Hence speed is fast.
Dynamic load balancing
Two types of Distributed load balancing
◦A. Cooperative: Scheduling is done with the
cooperation of nodes in a system. However
drawback is its complexity overhead
◦B. Non-Cooperative: Scheduling is done by
individual node in the system as they act as
autonomous entities.
Issues in load balancing
Load Estimation Policies: Determination of load of a node
Process transfer Policies: decides for the execution of process,
local or remote
State information Exchange: exchange of information among
nodes
Location Policy: selection of nodes for migration of the process
Priority Assignment: priority making algorithm
Migration limit Policy: Determines the limit value for migration
of process.

More Related Content

Similar to Parallel and Distributed Computing Chapter 7

Similar to Parallel and Distributed Computing Chapter 7 (20)

Chapter 10
Chapter 10Chapter 10
Chapter 10
 
CS9222 ADVANCED OPERATING SYSTEMS
CS9222 ADVANCED OPERATING SYSTEMSCS9222 ADVANCED OPERATING SYSTEMS
CS9222 ADVANCED OPERATING SYSTEMS
 
Real time operating systems
Real time operating systemsReal time operating systems
Real time operating systems
 
Operating system (OS) itself is a process, what approaches are there.pdf
Operating system (OS) itself is a process, what approaches are there.pdfOperating system (OS) itself is a process, what approaches are there.pdf
Operating system (OS) itself is a process, what approaches are there.pdf
 
Components of Computer PARALLEL-PROCESSING.pptx
Components of Computer PARALLEL-PROCESSING.pptxComponents of Computer PARALLEL-PROCESSING.pptx
Components of Computer PARALLEL-PROCESSING.pptx
 
CS197OSTYPES.pdf
CS197OSTYPES.pdfCS197OSTYPES.pdf
CS197OSTYPES.pdf
 
OS ppt.pdf
OS ppt.pdfOS ppt.pdf
OS ppt.pdf
 
EMBEDDED OS
EMBEDDED OSEMBEDDED OS
EMBEDDED OS
 
Multiprocessor
MultiprocessorMultiprocessor
Multiprocessor
 
4-Process control block.pptx
4-Process control block.pptx4-Process control block.pptx
4-Process control block.pptx
 
4-Process control block.pptx
4-Process control block.pptx4-Process control block.pptx
4-Process control block.pptx
 
CS8603_Notes_003-1_edubuzz360.pdf
CS8603_Notes_003-1_edubuzz360.pdfCS8603_Notes_003-1_edubuzz360.pdf
CS8603_Notes_003-1_edubuzz360.pdf
 
Resource management
Resource managementResource management
Resource management
 
LM9 - OPERATIONS, SCHEDULING, Inter process xommuncation
LM9 - OPERATIONS, SCHEDULING, Inter process xommuncationLM9 - OPERATIONS, SCHEDULING, Inter process xommuncation
LM9 - OPERATIONS, SCHEDULING, Inter process xommuncation
 
Parallel Processing Presentation2
Parallel Processing Presentation2Parallel Processing Presentation2
Parallel Processing Presentation2
 
6.distributed shared memory
6.distributed shared memory6.distributed shared memory
6.distributed shared memory
 
OS UNIT1.pptx
OS UNIT1.pptxOS UNIT1.pptx
OS UNIT1.pptx
 
Distributed Systems
Distributed SystemsDistributed Systems
Distributed Systems
 
Process scheduling
Process schedulingProcess scheduling
Process scheduling
 
Operating system
Operating systemOperating system
Operating system
 

More from AbdullahMunir32

Mobile Application Development-Lecture 15 & 16.pdf
Mobile Application Development-Lecture 15 & 16.pdfMobile Application Development-Lecture 15 & 16.pdf
Mobile Application Development-Lecture 15 & 16.pdfAbdullahMunir32
 
Mobile Application Development-Lecture 13 & 14.pdf
Mobile Application Development-Lecture 13 & 14.pdfMobile Application Development-Lecture 13 & 14.pdf
Mobile Application Development-Lecture 13 & 14.pdfAbdullahMunir32
 
Mobile Application Development -Lecture 11 & 12.pdf
Mobile Application Development -Lecture 11 & 12.pdfMobile Application Development -Lecture 11 & 12.pdf
Mobile Application Development -Lecture 11 & 12.pdfAbdullahMunir32
 
Mobile Application Development -Lecture 09 & 10.pdf
Mobile Application Development -Lecture 09 & 10.pdfMobile Application Development -Lecture 09 & 10.pdf
Mobile Application Development -Lecture 09 & 10.pdfAbdullahMunir32
 
Mobile Application Development -Lecture 07 & 08.pdf
Mobile Application Development -Lecture 07 & 08.pdfMobile Application Development -Lecture 07 & 08.pdf
Mobile Application Development -Lecture 07 & 08.pdfAbdullahMunir32
 
Mobile Application Development Lecture 05 & 06.pdf
Mobile Application Development Lecture 05 & 06.pdfMobile Application Development Lecture 05 & 06.pdf
Mobile Application Development Lecture 05 & 06.pdfAbdullahMunir32
 
Mobile Application Development-Lecture 03 & 04.pdf
Mobile Application Development-Lecture 03 & 04.pdfMobile Application Development-Lecture 03 & 04.pdf
Mobile Application Development-Lecture 03 & 04.pdfAbdullahMunir32
 
Mobile Application Development-Lecture 01 & 02.pdf
Mobile Application Development-Lecture 01 & 02.pdfMobile Application Development-Lecture 01 & 02.pdf
Mobile Application Development-Lecture 01 & 02.pdfAbdullahMunir32
 
Parallel and Distributed Computing Chapter 13
Parallel and Distributed Computing Chapter 13Parallel and Distributed Computing Chapter 13
Parallel and Distributed Computing Chapter 13AbdullahMunir32
 
Parallel and Distributed Computing Chapter 12
Parallel and Distributed Computing Chapter 12Parallel and Distributed Computing Chapter 12
Parallel and Distributed Computing Chapter 12AbdullahMunir32
 
Parallel and Distributed Computing Chapter 11
Parallel and Distributed Computing Chapter 11Parallel and Distributed Computing Chapter 11
Parallel and Distributed Computing Chapter 11AbdullahMunir32
 
Parallel and Distributed Computing Chapter 10
Parallel and Distributed Computing Chapter 10Parallel and Distributed Computing Chapter 10
Parallel and Distributed Computing Chapter 10AbdullahMunir32
 
Parallel and Distributed Computing Chapter 9
Parallel and Distributed Computing Chapter 9Parallel and Distributed Computing Chapter 9
Parallel and Distributed Computing Chapter 9AbdullahMunir32
 
Parallel and Distributed Computing Chapter 8
Parallel and Distributed Computing Chapter 8Parallel and Distributed Computing Chapter 8
Parallel and Distributed Computing Chapter 8AbdullahMunir32
 
Parallel and Distributed Computing Chapter 6
Parallel and Distributed Computing Chapter 6Parallel and Distributed Computing Chapter 6
Parallel and Distributed Computing Chapter 6AbdullahMunir32
 
Parallel and Distributed Computing Chapter 5
Parallel and Distributed Computing Chapter 5Parallel and Distributed Computing Chapter 5
Parallel and Distributed Computing Chapter 5AbdullahMunir32
 
Parallel and Distributed Computing Chapter 4
Parallel and Distributed Computing Chapter 4Parallel and Distributed Computing Chapter 4
Parallel and Distributed Computing Chapter 4AbdullahMunir32
 
Parallel and Distributed Computing chapter 3
Parallel and Distributed Computing chapter 3Parallel and Distributed Computing chapter 3
Parallel and Distributed Computing chapter 3AbdullahMunir32
 
Parallel and Distributed Computing Chapter 2
Parallel and Distributed Computing Chapter 2Parallel and Distributed Computing Chapter 2
Parallel and Distributed Computing Chapter 2AbdullahMunir32
 
Parallel and Distributed Computing chapter 1
Parallel and Distributed Computing chapter 1Parallel and Distributed Computing chapter 1
Parallel and Distributed Computing chapter 1AbdullahMunir32
 

More from AbdullahMunir32 (20)

Mobile Application Development-Lecture 15 & 16.pdf
Mobile Application Development-Lecture 15 & 16.pdfMobile Application Development-Lecture 15 & 16.pdf
Mobile Application Development-Lecture 15 & 16.pdf
 
Mobile Application Development-Lecture 13 & 14.pdf
Mobile Application Development-Lecture 13 & 14.pdfMobile Application Development-Lecture 13 & 14.pdf
Mobile Application Development-Lecture 13 & 14.pdf
 
Mobile Application Development -Lecture 11 & 12.pdf
Mobile Application Development -Lecture 11 & 12.pdfMobile Application Development -Lecture 11 & 12.pdf
Mobile Application Development -Lecture 11 & 12.pdf
 
Mobile Application Development -Lecture 09 & 10.pdf
Mobile Application Development -Lecture 09 & 10.pdfMobile Application Development -Lecture 09 & 10.pdf
Mobile Application Development -Lecture 09 & 10.pdf
 
Mobile Application Development -Lecture 07 & 08.pdf
Mobile Application Development -Lecture 07 & 08.pdfMobile Application Development -Lecture 07 & 08.pdf
Mobile Application Development -Lecture 07 & 08.pdf
 
Mobile Application Development Lecture 05 & 06.pdf
Mobile Application Development Lecture 05 & 06.pdfMobile Application Development Lecture 05 & 06.pdf
Mobile Application Development Lecture 05 & 06.pdf
 
Mobile Application Development-Lecture 03 & 04.pdf
Mobile Application Development-Lecture 03 & 04.pdfMobile Application Development-Lecture 03 & 04.pdf
Mobile Application Development-Lecture 03 & 04.pdf
 
Mobile Application Development-Lecture 01 & 02.pdf
Mobile Application Development-Lecture 01 & 02.pdfMobile Application Development-Lecture 01 & 02.pdf
Mobile Application Development-Lecture 01 & 02.pdf
 
Parallel and Distributed Computing Chapter 13
Parallel and Distributed Computing Chapter 13Parallel and Distributed Computing Chapter 13
Parallel and Distributed Computing Chapter 13
 
Parallel and Distributed Computing Chapter 12
Parallel and Distributed Computing Chapter 12Parallel and Distributed Computing Chapter 12
Parallel and Distributed Computing Chapter 12
 
Parallel and Distributed Computing Chapter 11
Parallel and Distributed Computing Chapter 11Parallel and Distributed Computing Chapter 11
Parallel and Distributed Computing Chapter 11
 
Parallel and Distributed Computing Chapter 10
Parallel and Distributed Computing Chapter 10Parallel and Distributed Computing Chapter 10
Parallel and Distributed Computing Chapter 10
 
Parallel and Distributed Computing Chapter 9
Parallel and Distributed Computing Chapter 9Parallel and Distributed Computing Chapter 9
Parallel and Distributed Computing Chapter 9
 
Parallel and Distributed Computing Chapter 8
Parallel and Distributed Computing Chapter 8Parallel and Distributed Computing Chapter 8
Parallel and Distributed Computing Chapter 8
 
Parallel and Distributed Computing Chapter 6
Parallel and Distributed Computing Chapter 6Parallel and Distributed Computing Chapter 6
Parallel and Distributed Computing Chapter 6
 
Parallel and Distributed Computing Chapter 5
Parallel and Distributed Computing Chapter 5Parallel and Distributed Computing Chapter 5
Parallel and Distributed Computing Chapter 5
 
Parallel and Distributed Computing Chapter 4
Parallel and Distributed Computing Chapter 4Parallel and Distributed Computing Chapter 4
Parallel and Distributed Computing Chapter 4
 
Parallel and Distributed Computing chapter 3
Parallel and Distributed Computing chapter 3Parallel and Distributed Computing chapter 3
Parallel and Distributed Computing chapter 3
 
Parallel and Distributed Computing Chapter 2
Parallel and Distributed Computing Chapter 2Parallel and Distributed Computing Chapter 2
Parallel and Distributed Computing Chapter 2
 
Parallel and Distributed Computing chapter 1
Parallel and Distributed Computing chapter 1Parallel and Distributed Computing chapter 1
Parallel and Distributed Computing chapter 1
 

Recently uploaded

Proudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxProudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxthorishapillay1
 
How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17Celine George
 
CELL CYCLE Division Science 8 quarter IV.pptx
CELL CYCLE Division Science 8 quarter IV.pptxCELL CYCLE Division Science 8 quarter IV.pptx
CELL CYCLE Division Science 8 quarter IV.pptxJiesonDelaCerna
 
EPANDING THE CONTENT OF AN OUTLINE using notes.pptx
EPANDING THE CONTENT OF AN OUTLINE using notes.pptxEPANDING THE CONTENT OF AN OUTLINE using notes.pptx
EPANDING THE CONTENT OF AN OUTLINE using notes.pptxRaymartEstabillo3
 
Introduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxIntroduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxpboyjonauth
 
Hierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementHierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementmkooblal
 
KSHARA STURA .pptx---KSHARA KARMA THERAPY (CAUSTIC THERAPY)————IMP.OF KSHARA ...
KSHARA STURA .pptx---KSHARA KARMA THERAPY (CAUSTIC THERAPY)————IMP.OF KSHARA ...KSHARA STURA .pptx---KSHARA KARMA THERAPY (CAUSTIC THERAPY)————IMP.OF KSHARA ...
KSHARA STURA .pptx---KSHARA KARMA THERAPY (CAUSTIC THERAPY)————IMP.OF KSHARA ...M56BOOKSTORE PRODUCT/SERVICE
 
Pharmacognosy Flower 3. Compositae 2023.pdf
Pharmacognosy Flower 3. Compositae 2023.pdfPharmacognosy Flower 3. Compositae 2023.pdf
Pharmacognosy Flower 3. Compositae 2023.pdfMahmoud M. Sallam
 
Types of Journalistic Writing Grade 8.pptx
Types of Journalistic Writing Grade 8.pptxTypes of Journalistic Writing Grade 8.pptx
Types of Journalistic Writing Grade 8.pptxEyham Joco
 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxmanuelaromero2013
 
internship ppt on smartinternz platform as salesforce developer
internship ppt on smartinternz platform as salesforce developerinternship ppt on smartinternz platform as salesforce developer
internship ppt on smartinternz platform as salesforce developerunnathinaik
 
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTiammrhaywood
 
Roles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceRoles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceSamikshaHamane
 
DATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginnersDATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginnersSabitha Banu
 
Earth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatEarth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatYousafMalik24
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Educationpboyjonauth
 
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxPOINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxSayali Powar
 

Recently uploaded (20)

TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdfTataKelola dan KamSiber Kecerdasan Buatan v022.pdf
TataKelola dan KamSiber Kecerdasan Buatan v022.pdf
 
Proudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptxProudly South Africa powerpoint Thorisha.pptx
Proudly South Africa powerpoint Thorisha.pptx
 
How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17How to Configure Email Server in Odoo 17
How to Configure Email Server in Odoo 17
 
CELL CYCLE Division Science 8 quarter IV.pptx
CELL CYCLE Division Science 8 quarter IV.pptxCELL CYCLE Division Science 8 quarter IV.pptx
CELL CYCLE Division Science 8 quarter IV.pptx
 
EPANDING THE CONTENT OF AN OUTLINE using notes.pptx
EPANDING THE CONTENT OF AN OUTLINE using notes.pptxEPANDING THE CONTENT OF AN OUTLINE using notes.pptx
EPANDING THE CONTENT OF AN OUTLINE using notes.pptx
 
Introduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxIntroduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptx
 
Hierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementHierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of management
 
KSHARA STURA .pptx---KSHARA KARMA THERAPY (CAUSTIC THERAPY)————IMP.OF KSHARA ...
KSHARA STURA .pptx---KSHARA KARMA THERAPY (CAUSTIC THERAPY)————IMP.OF KSHARA ...KSHARA STURA .pptx---KSHARA KARMA THERAPY (CAUSTIC THERAPY)————IMP.OF KSHARA ...
KSHARA STURA .pptx---KSHARA KARMA THERAPY (CAUSTIC THERAPY)————IMP.OF KSHARA ...
 
Pharmacognosy Flower 3. Compositae 2023.pdf
Pharmacognosy Flower 3. Compositae 2023.pdfPharmacognosy Flower 3. Compositae 2023.pdf
Pharmacognosy Flower 3. Compositae 2023.pdf
 
Model Call Girl in Bikash Puri Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Bikash Puri  Delhi reach out to us at 🔝9953056974🔝Model Call Girl in Bikash Puri  Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Bikash Puri Delhi reach out to us at 🔝9953056974🔝
 
Types of Journalistic Writing Grade 8.pptx
Types of Journalistic Writing Grade 8.pptxTypes of Journalistic Writing Grade 8.pptx
Types of Journalistic Writing Grade 8.pptx
 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptx
 
internship ppt on smartinternz platform as salesforce developer
internship ppt on smartinternz platform as salesforce developerinternship ppt on smartinternz platform as salesforce developer
internship ppt on smartinternz platform as salesforce developer
 
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPTECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
ECONOMIC CONTEXT - LONG FORM TV DRAMA - PPT
 
Roles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceRoles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in Pharmacovigilance
 
DATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginnersDATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginners
 
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
 
Earth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatEarth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice great
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Education
 
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxPOINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
 

Parallel and Distributed Computing Chapter 7

  • 3. MULTIPLE PROCESSOR SCHEDULING Multiprocessors is a system that has more than one processor With multiprocessors load sharing becomes feasible but it makes scheduling more complex. no such policy that can declared best scheduling algorithm for single processor similarly there is no best scheduling solution for multiprocessor systems Best scheduling algorithm depends on the different scenario.
  • 4. MULTIPLE PROCESSOR SCHEDULING The scheduling process of a multi-processor is more complex than that of a single processor system because of the following reasons. • Load balancing is a problem since more than one processors are present. • Processes executing simultaneously may require access to shared data. • Cache affinity should be considered in scheduling.
  • 5. Characteristics of a Good Scheduling Algorithm: must be flexible enough to process migration decisions when there is a change in the system load A good scheduling algorithm has the property of being scalable. It is flexible for scaling when the number of nodes increases in a system algorithm should not be affected by the failure of one or more nodes of the system
  • 6. Categories of Multiprocessors Loosely coupled / Distributed multiprocessors: processors are independent of each other. Each processor has its own memory and I/O Channels. Functionally specialized processor: there is a master/main processor which is general purpose process. It controls other processors in the system and provides services to them Tightly Couple Multiprocessors: all processors shares common memory. Also termed as homogeneous
  • 7. Techniques for multiprocessor Scheduling Multi processor scheduling can be done in two ways Asymmetric Scheduling Symmetric Scheduling
  • 8. Symmetric multiprocessor  Processors are self schedule  Each processor check ready queue and select process to execute.  If one processor goes down rest of the system keeps working.  There are two variants of symmetric multiprocessor  Symmetrical Scheduling with global queues.  Symmetrical Scheduling with private global queues.
  • 9. Symmetrical Scheduling with global queues: if processes are executing in common / global queue scheduler for each processor checks this global queue and select process to execute.
  • 10. Symmetrical Scheduling with private queues  if processors in the system have their own private ready queue, then processor will check their own private ready queue to select process.  Mostly symmetric multiprocessing is used most modern operating system i.e. LINUX, WINDOWS, MAC OS.
  • 11. Asymmetric Multiprocessor one processor (master processor) handles all operations and other system activities master processor runs operating system code and other slave processors only executed user code. If master processor fails, whole system comes to a halt, if slave goes down, rest of the system keeps working.
  • 12. Processor Affinity A process has an affinity (‫)تعلق‬ for the processor on which it is currently running. When a process runs on a specific processor, It has effects on the cache memory. The data most recently accessed by the process populate the cache for the processor
  • 13. Processor Affinity when process migrates to another processor, now contents of cache memory becomes invalidated for the first processor. Cache for second processor must be repopulated Because of high cost of invalidating and repopulating caches, mostly SMP try to avoid migrating processes from one processor to another. This is known as processor affinity.
  • 14.
  • 15. Soft AFFINITY When an operating system has a policy of keeping a process running on the same processor but not guaranteeing it will do so, this situation is called soft affinity.
  • 16. Hard AFFINITY ◦When an operating system has a policy of attempting to keep a process running on the same processor with guarantee that it will do so, we have a situation known as hard affinity. ◦Some Linux systems implement soft affinity and provide system calls like sched_setaffinity() that also support hard affinity.
  • 17. Assignment a processor can access its own local memory faster than non-local memory (memory local to another processor or memory shared between processors (NUMA) is a computer memory design used in multiprocessing, where the memory access time depends on the memory location relative to the processor Write a short note on Purpose and need of NUMA Architecture
  • 18. Load BALANCING balancing of load among Processors of distributed computing. Excess load of one CPU is distributed to other that have less load according to defined limits i.e. neither it gets overloaded nor idle. Load balancing can help to maximize the performance and throughput which is ultimate goal of distributed computing.
  • 19.
  • 20. Static load balancing While distributing load current state of the system is not taken into account. These algorithms are simpler Two types 1. Deterministic 2. Probabilistic
  • 21. Static load balancing 1. Deterministic: Properties of nodes and processes are taken into account for the allocation of processes to nodes E.g. if tasks are independent, execution time is known. Difficult to achieve better results
  • 22. Static load balancing 2. Probabilistic: Algorithm, statistical attributes of the CPU are taken into account to make process placement rules It also doesn’t give better performance. *Statistical attributes: idle time, busy time
  • 23. Dynamic load balancing While distributing load, current state of the system is taken into account. Dynamically redistributing workloads away from overloaded nodes toward underloaded nodes. Difficult to design however better performance.
  • 24. Dynamic load balancing Types of dynamic load balancing 1. Centralized 2. Distributed
  • 25. Dynamic load balancing 1. Centralized: task of handling requests for process scheduling is carried out by centralized server node. Benefit is performance, as all information is held at a single node, but suffers from reliability problem Another problem with increasing number of requests
  • 26. Dynamic load balancing 2. Distributed: task of handling requests for process scheduling is carried out by individual node of the system. Unlike centralized, there is no need to hold information. Hence speed is fast.
  • 27. Dynamic load balancing Two types of Distributed load balancing ◦A. Cooperative: Scheduling is done with the cooperation of nodes in a system. However drawback is its complexity overhead ◦B. Non-Cooperative: Scheduling is done by individual node in the system as they act as autonomous entities.
  • 28. Issues in load balancing Load Estimation Policies: Determination of load of a node Process transfer Policies: decides for the execution of process, local or remote State information Exchange: exchange of information among nodes Location Policy: selection of nodes for migration of the process Priority Assignment: priority making algorithm Migration limit Policy: Determines the limit value for migration of process.