SlideShare a Scribd company logo
1 of 28
Download to read offline
Parallel Computing
Mohamed Zahran (aka Z)
mzahran@cs.nyu.edu
http://www.mzahran.com
CSCI-UA.0480-003
Lecture 2: Parallel Hardware: Basics
Computer History
Eckert and Mauchly
• 1st working electronic
computer (1946)
• To reprogram it you
need to re-arrange the
cords
• 18,000 Vacuum tubes
• 1,800 instructions/sec
• 3,000 ft3
Computer History
Programming the ENIAC!
Computer History
• Von Neumann
presented his idea of
stored program
concept.
• Maurice Wilkes built it.
1st stored program
computer
650 instructions/sec
1,400 ft3http://www.cl.cam.ac.uk/UoCCL/misc/EDSAC99/
EDSAC 1 (1949)
Computer History
• After the vacuum tubes, transistors
were invented (1947)  2nd generations
of computers
• UNIVAC (UNIversal Automatic Computer)
• Introduced in the 50s
Computer History
• From transistors to integrated
circuits(IC)  3rd generation of
computers
• One IC can host hundreds (then
thousands, then millions) of transistors
 computers are getting smaller
Intel 4004 Die Photo
• Introduced in 1970
– First
microprocessor
• 2,250 transistors
• 12 mm2
• 108 KHz
Intel 8086 Die Scan
• 29,000 transistors
• 33 mm2
• 5 MHz
• Introduced in 1979
– Basic architecture
of the IA32 PC
Intel 80486 Die Scan
• 1,200,000
transistors
• 81 mm2
• 25 MHz
• Introduced in 1989
– 1st pipelined
implementation of
IA32
– 1st processor with
on-chip cache
Pentium Die Photo
• 3,100,000
transistors
• 296 mm2
• 60 MHz
• Introduced in 1993
– 1st superscalar
implementation of
IA32
Pentium 4
• 55,000,000
transistors
• 146 mm2
• 3 GHz
• Introduced in 2000
http://www.chip-architect.com
Pentium 4
IBM Power 9 (24 cores)
Core 2 Duo (2 cores)
AMD RyZen(8 cores to 32 cores)
Intel Core i9 (22 cores )
How did the hardware evolve like
that?
Let’s look at different waves (generations of architectures)
First Generation (1970s)
Single Cycle Implementation
Copyright © 2010, Elsevier Inc. All rights
Reserved
The Von Neumann Architecture
Second Generation (1980s)
DF CI E
•Pipelinining:
•the hardware divided into stages
•temporal parallelism
•Number of stages increases with each generation
•Maximum CPI (Cycles Per Instruction) = 1
•Due to dependencies
(i.e. an instruction must wait
for the result of another instruction)
Fetch ExecuteIssueDecode Commit
Some Enhancements
Cache Memory Virtual Memory
TLBMulti-level caches
Third Generation (1990s)
DF CI
E
E
E
•ILP (Instruction Level Parallelism)
•Spatial parallelism
•Executing several instructions at the same
time is called superscalar capability.
•performance = instructions per cycle (IPC)
•Speculative Execution (prediction of branch direction) is
introduced to make the best use of superscalar capability 
This can make some instructions execute out-of-order!!
Fourth Generation (2000s)
DF CI
E
E
E
DF CI
E
E
E
Simultaneous Multithreading (SMT)
(aka Hyperthreading Technology)
Some definitions before we proceed
An operating system “process”
• An instance of a computer program that
is being executed.
• Components of a process:
– The executable machine language program
– A block of memory
– Descriptors of resources the OS has
allocated to the process
– Security information
– Information about the state of the process
Copyright © 2010, Elsevier Inc.
All rights Reserved
Multitasking
• Gives the illusion that a single processor
system is running multiple programs
simultaneously.
• Each process takes turns running time
slice
• After its time is up, it waits until it has
a turn again.
Copyright © 2010, Elsevier Inc.
All rights Reserved
Threading
• Threads are contained within processes.
• They allow programmers to divide their
programs into (more or less) independent
tasks.
• The hope is that when one thread blocks
because it is waiting on a resource,
another thread will have work to do and
can run.
Copyright © 2010, Elsevier Inc.
All rights Reserved
As you can see …
We can have several processes, executed
in a multitasking fashion, and each
process can consist of several threads.
The Status-Quo
• We moved from single core to multicore to
manycore:
– for technological reasons, as we saw last lecture.
• Free lunch is over for software folks
– The software will not become faster with every
new generation of processors
• Not enough experience in parallel programming
– Parallel programs of old days were restricted to
some elite applications -> very few programmers
– Now we need parallel programs for many different
applications
How Did These Advances Happen?
Computer
Architecture
Software
Community
Process
Technology
Wishes
• Performance
• Restrictions
• Restrictions
• Capabilities
Design
Conclusions
• The hardware evolution, driven by
Moore’s law, was geared toward two
things:
– Exploiting parallelism
– Dealing with memory (latency, capacity)
Powered by TCPDF (www.tcpdf.org)Powered by TCPDF (www.tcpdf.org)

More Related Content

Similar to Parallel Computing - Lec 2

Similar to Parallel Computing - Lec 2 (20)

Computer Generations
Computer GenerationsComputer Generations
Computer Generations
 
ICT assignment.pptx
ICT assignment.pptxICT assignment.pptx
ICT assignment.pptx
 
Computer generations
Computer generationsComputer generations
Computer generations
 
L4 Microkernel :: Design Overview
L4 Microkernel :: Design OverviewL4 Microkernel :: Design Overview
L4 Microkernel :: Design Overview
 
1.1 Introduction to Operating System .pptx
1.1 Introduction to Operating System .pptx1.1 Introduction to Operating System .pptx
1.1 Introduction to Operating System .pptx
 
Unit i
Unit  iUnit  i
Unit i
 
computer application in hospitality Industry, periyar university unit 1
computer application in hospitality Industry, periyar university  unit 1computer application in hospitality Industry, periyar university  unit 1
computer application in hospitality Industry, periyar university unit 1
 
Unit i
Unit  iUnit  i
Unit i
 
computer applicationin hospitality Industry1 periyar university unit1
computer applicationin hospitality Industry1 periyar university  unit1computer applicationin hospitality Industry1 periyar university  unit1
computer applicationin hospitality Industry1 periyar university unit1
 
Unit I
Unit  IUnit  I
Unit I
 
Construct an Efficient and Secure Microkernel for IoT
Construct an Efficient and Secure Microkernel for IoTConstruct an Efficient and Secure Microkernel for IoT
Construct an Efficient and Secure Microkernel for IoT
 
Chap1 computer basics
Chap1 computer basicsChap1 computer basics
Chap1 computer basics
 
Operating system
Operating systemOperating system
Operating system
 
Computer Architecture
Computer ArchitectureComputer Architecture
Computer Architecture
 
Moore’s law change drives OS change
Moore’s law change drives OS changeMoore’s law change drives OS change
Moore’s law change drives OS change
 
B.sc i cs u 1 operating system concept & computer generation
B.sc i cs u 1 operating system concept & computer generationB.sc i cs u 1 operating system concept & computer generation
B.sc i cs u 1 operating system concept & computer generation
 
B.sc i bio chem u 1 operating system concept & computer generation
B.sc i bio chem u 1 operating system concept & computer generationB.sc i bio chem u 1 operating system concept & computer generation
B.sc i bio chem u 1 operating system concept & computer generation
 
B.sc i agri u 1 operating system concept & computer generation
B.sc i agri u 1 operating system concept & computer generationB.sc i agri u 1 operating system concept & computer generation
B.sc i agri u 1 operating system concept & computer generation
 
B.sc i bio tech u 1 operating system concept & computer generation
B.sc i bio tech u 1 operating system concept & computer generationB.sc i bio tech u 1 operating system concept & computer generation
B.sc i bio tech u 1 operating system concept & computer generation
 
B.sc i micro bio u 1 operating system concept & computer generation
B.sc i micro bio u 1 operating system concept & computer generationB.sc i micro bio u 1 operating system concept & computer generation
B.sc i micro bio u 1 operating system concept & computer generation
 

More from Shah Zaib (9)

Parallel Programming for Multi- Core and Cluster Systems - Performance Analysis
Parallel Programming for Multi- Core and Cluster Systems - Performance AnalysisParallel Programming for Multi- Core and Cluster Systems - Performance Analysis
Parallel Programming for Multi- Core and Cluster Systems - Performance Analysis
 
MPI - 4
MPI - 4MPI - 4
MPI - 4
 
MPI - 3
MPI - 3MPI - 3
MPI - 3
 
MPI - 2
MPI - 2MPI - 2
MPI - 2
 
MPI - 1
MPI - 1MPI - 1
MPI - 1
 
Parallel Computing - Lec 6
Parallel Computing - Lec 6Parallel Computing - Lec 6
Parallel Computing - Lec 6
 
Parallel Computing - Lec 5
Parallel Computing - Lec 5Parallel Computing - Lec 5
Parallel Computing - Lec 5
 
Parallel Computing - Lec 4
Parallel Computing - Lec 4Parallel Computing - Lec 4
Parallel Computing - Lec 4
 
Mpi collective communication operations
Mpi collective communication operationsMpi collective communication operations
Mpi collective communication operations
 

Recently uploaded

怎样办理圣芭芭拉分校毕业证(UCSB毕业证书)成绩单留信认证
怎样办理圣芭芭拉分校毕业证(UCSB毕业证书)成绩单留信认证怎样办理圣芭芭拉分校毕业证(UCSB毕业证书)成绩单留信认证
怎样办理圣芭芭拉分校毕业证(UCSB毕业证书)成绩单留信认证
ehyxf
 
怎样办理斯威本科技大学毕业证(SUT毕业证书)成绩单留信认证
怎样办理斯威本科技大学毕业证(SUT毕业证书)成绩单留信认证怎样办理斯威本科技大学毕业证(SUT毕业证书)成绩单留信认证
怎样办理斯威本科技大学毕业证(SUT毕业证书)成绩单留信认证
tufbav
 
Jual Obat Aborsi Samarinda ( No.1 ) 088980685493 Obat Penggugur Kandungan Cy...
Jual Obat Aborsi Samarinda (  No.1 ) 088980685493 Obat Penggugur Kandungan Cy...Jual Obat Aborsi Samarinda (  No.1 ) 088980685493 Obat Penggugur Kandungan Cy...
Jual Obat Aborsi Samarinda ( No.1 ) 088980685493 Obat Penggugur Kandungan Cy...
Obat Aborsi 088980685493 Jual Obat Aborsi
 
Abortion pills in Dammam +966572737505 Buy Cytotec
Abortion pills in Dammam +966572737505 Buy CytotecAbortion pills in Dammam +966572737505 Buy Cytotec
Abortion pills in Dammam +966572737505 Buy Cytotec
Abortion pills in Riyadh +966572737505 get cytotec
 
在线办理(scu毕业证)南十字星大学毕业证电子版学位证书注册证明信
在线办理(scu毕业证)南十字星大学毕业证电子版学位证书注册证明信在线办理(scu毕业证)南十字星大学毕业证电子版学位证书注册证明信
在线办理(scu毕业证)南十字星大学毕业证电子版学位证书注册证明信
oopacde
 
In Riyadh Saudi Arabia |+966572737505 | Buy Cytotec| Get Abortion pills
In Riyadh Saudi Arabia |+966572737505 | Buy Cytotec| Get Abortion pillsIn Riyadh Saudi Arabia |+966572737505 | Buy Cytotec| Get Abortion pills
In Riyadh Saudi Arabia |+966572737505 | Buy Cytotec| Get Abortion pills
Abortion pills in Riyadh +966572737505 get cytotec
 
Abortion pills in Jeddah |+966572737505 | Get Cytotec
Abortion pills in Jeddah |+966572737505 | Get CytotecAbortion pills in Jeddah |+966572737505 | Get Cytotec
Abortion pills in Jeddah |+966572737505 | Get Cytotec
Abortion pills in Riyadh +966572737505 get cytotec
 
在线制作(UQ毕业证书)昆士兰大学毕业证成绩单原版一比一
在线制作(UQ毕业证书)昆士兰大学毕业证成绩单原版一比一在线制作(UQ毕业证书)昆士兰大学毕业证成绩单原版一比一
在线制作(UQ毕业证书)昆士兰大学毕业证成绩单原版一比一
uodye
 
Abortion Pill for sale in Riyadh ((+918761049707) Get Cytotec in Dammam
Abortion Pill for sale in Riyadh ((+918761049707) Get Cytotec in DammamAbortion Pill for sale in Riyadh ((+918761049707) Get Cytotec in Dammam
Abortion Pill for sale in Riyadh ((+918761049707) Get Cytotec in Dammam
ahmedjiabur940
 
一比一原版(USYD毕业证书)澳洲悉尼大学毕业证如何办理
一比一原版(USYD毕业证书)澳洲悉尼大学毕业证如何办理一比一原版(USYD毕业证书)澳洲悉尼大学毕业证如何办理
一比一原版(USYD毕业证书)澳洲悉尼大学毕业证如何办理
uodye
 
一比一定(购)新西兰林肯大学毕业证(Lincoln毕业证)成绩单学位证
一比一定(购)新西兰林肯大学毕业证(Lincoln毕业证)成绩单学位证一比一定(购)新西兰林肯大学毕业证(Lincoln毕业证)成绩单学位证
一比一定(购)新西兰林肯大学毕业证(Lincoln毕业证)成绩单学位证
wpkuukw
 
Abort pregnancy in research centre+966_505195917 abortion pills in Kuwait cyt...
Abort pregnancy in research centre+966_505195917 abortion pills in Kuwait cyt...Abort pregnancy in research centre+966_505195917 abortion pills in Kuwait cyt...
Abort pregnancy in research centre+966_505195917 abortion pills in Kuwait cyt...
drmarathore
 
Top profile Call Girls In Palghar [ 7014168258 ] Call Me For Genuine Models W...
Top profile Call Girls In Palghar [ 7014168258 ] Call Me For Genuine Models W...Top profile Call Girls In Palghar [ 7014168258 ] Call Me For Genuine Models W...
Top profile Call Girls In Palghar [ 7014168258 ] Call Me For Genuine Models W...
gajnagarg
 
在线制作(ANU毕业证书)澳大利亚国立大学毕业证成绩单原版一比一
在线制作(ANU毕业证书)澳大利亚国立大学毕业证成绩单原版一比一在线制作(ANU毕业证书)澳大利亚国立大学毕业证成绩单原版一比一
在线制作(ANU毕业证书)澳大利亚国立大学毕业证成绩单原版一比一
ougvy
 
Top profile Call Girls In Ratlam [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Ratlam [ 7014168258 ] Call Me For Genuine Models We...Top profile Call Girls In Ratlam [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Ratlam [ 7014168258 ] Call Me For Genuine Models We...
nirzagarg
 

Recently uploaded (20)

怎样办理圣芭芭拉分校毕业证(UCSB毕业证书)成绩单留信认证
怎样办理圣芭芭拉分校毕业证(UCSB毕业证书)成绩单留信认证怎样办理圣芭芭拉分校毕业证(UCSB毕业证书)成绩单留信认证
怎样办理圣芭芭拉分校毕业证(UCSB毕业证书)成绩单留信认证
 
怎样办理斯威本科技大学毕业证(SUT毕业证书)成绩单留信认证
怎样办理斯威本科技大学毕业证(SUT毕业证书)成绩单留信认证怎样办理斯威本科技大学毕业证(SUT毕业证书)成绩单留信认证
怎样办理斯威本科技大学毕业证(SUT毕业证书)成绩单留信认证
 
Jual Obat Aborsi Samarinda ( No.1 ) 088980685493 Obat Penggugur Kandungan Cy...
Jual Obat Aborsi Samarinda (  No.1 ) 088980685493 Obat Penggugur Kandungan Cy...Jual Obat Aborsi Samarinda (  No.1 ) 088980685493 Obat Penggugur Kandungan Cy...
Jual Obat Aborsi Samarinda ( No.1 ) 088980685493 Obat Penggugur Kandungan Cy...
 
Mass storage systems presentation operating systems
Mass storage systems presentation operating systemsMass storage systems presentation operating systems
Mass storage systems presentation operating systems
 
Abortion pills in Dammam +966572737505 Buy Cytotec
Abortion pills in Dammam +966572737505 Buy CytotecAbortion pills in Dammam +966572737505 Buy Cytotec
Abortion pills in Dammam +966572737505 Buy Cytotec
 
在线办理(scu毕业证)南十字星大学毕业证电子版学位证书注册证明信
在线办理(scu毕业证)南十字星大学毕业证电子版学位证书注册证明信在线办理(scu毕业证)南十字星大学毕业证电子版学位证书注册证明信
在线办理(scu毕业证)南十字星大学毕业证电子版学位证书注册证明信
 
In Riyadh Saudi Arabia |+966572737505 | Buy Cytotec| Get Abortion pills
In Riyadh Saudi Arabia |+966572737505 | Buy Cytotec| Get Abortion pillsIn Riyadh Saudi Arabia |+966572737505 | Buy Cytotec| Get Abortion pills
In Riyadh Saudi Arabia |+966572737505 | Buy Cytotec| Get Abortion pills
 
Abortion pills in Jeddah |+966572737505 | Get Cytotec
Abortion pills in Jeddah |+966572737505 | Get CytotecAbortion pills in Jeddah |+966572737505 | Get Cytotec
Abortion pills in Jeddah |+966572737505 | Get Cytotec
 
Vashi Affordable Call Girls ,07506202331,Vasai Virar Charming Call Girl
Vashi Affordable Call Girls ,07506202331,Vasai Virar Charming Call GirlVashi Affordable Call Girls ,07506202331,Vasai Virar Charming Call Girl
Vashi Affordable Call Girls ,07506202331,Vasai Virar Charming Call Girl
 
在线制作(UQ毕业证书)昆士兰大学毕业证成绩单原版一比一
在线制作(UQ毕业证书)昆士兰大学毕业证成绩单原版一比一在线制作(UQ毕业证书)昆士兰大学毕业证成绩单原版一比一
在线制作(UQ毕业证书)昆士兰大学毕业证成绩单原版一比一
 
Abortion Pill for sale in Riyadh ((+918761049707) Get Cytotec in Dammam
Abortion Pill for sale in Riyadh ((+918761049707) Get Cytotec in DammamAbortion Pill for sale in Riyadh ((+918761049707) Get Cytotec in Dammam
Abortion Pill for sale in Riyadh ((+918761049707) Get Cytotec in Dammam
 
一比一原版(USYD毕业证书)澳洲悉尼大学毕业证如何办理
一比一原版(USYD毕业证书)澳洲悉尼大学毕业证如何办理一比一原版(USYD毕业证书)澳洲悉尼大学毕业证如何办理
一比一原版(USYD毕业证书)澳洲悉尼大学毕业证如何办理
 
一比一定(购)新西兰林肯大学毕业证(Lincoln毕业证)成绩单学位证
一比一定(购)新西兰林肯大学毕业证(Lincoln毕业证)成绩单学位证一比一定(购)新西兰林肯大学毕业证(Lincoln毕业证)成绩单学位证
一比一定(购)新西兰林肯大学毕业证(Lincoln毕业证)成绩单学位证
 
Abort pregnancy in research centre+966_505195917 abortion pills in Kuwait cyt...
Abort pregnancy in research centre+966_505195917 abortion pills in Kuwait cyt...Abort pregnancy in research centre+966_505195917 abortion pills in Kuwait cyt...
Abort pregnancy in research centre+966_505195917 abortion pills in Kuwait cyt...
 
Point of Care Testing in clinical laboratory
Point of Care Testing in clinical laboratoryPoint of Care Testing in clinical laboratory
Point of Care Testing in clinical laboratory
 
Top profile Call Girls In Palghar [ 7014168258 ] Call Me For Genuine Models W...
Top profile Call Girls In Palghar [ 7014168258 ] Call Me For Genuine Models W...Top profile Call Girls In Palghar [ 7014168258 ] Call Me For Genuine Models W...
Top profile Call Girls In Palghar [ 7014168258 ] Call Me For Genuine Models W...
 
Guwahati Escorts Service Girl ^ 9332606886, WhatsApp Anytime Guwahati
Guwahati Escorts Service Girl ^ 9332606886, WhatsApp Anytime GuwahatiGuwahati Escorts Service Girl ^ 9332606886, WhatsApp Anytime Guwahati
Guwahati Escorts Service Girl ^ 9332606886, WhatsApp Anytime Guwahati
 
在线制作(ANU毕业证书)澳大利亚国立大学毕业证成绩单原版一比一
在线制作(ANU毕业证书)澳大利亚国立大学毕业证成绩单原版一比一在线制作(ANU毕业证书)澳大利亚国立大学毕业证成绩单原版一比一
在线制作(ANU毕业证书)澳大利亚国立大学毕业证成绩单原版一比一
 
LANDSLIDE MONITORING AND ALERT SYSTEM FINAL YEAR PROJECT BROCHURE
LANDSLIDE MONITORING AND ALERT SYSTEM FINAL YEAR PROJECT BROCHURELANDSLIDE MONITORING AND ALERT SYSTEM FINAL YEAR PROJECT BROCHURE
LANDSLIDE MONITORING AND ALERT SYSTEM FINAL YEAR PROJECT BROCHURE
 
Top profile Call Girls In Ratlam [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Ratlam [ 7014168258 ] Call Me For Genuine Models We...Top profile Call Girls In Ratlam [ 7014168258 ] Call Me For Genuine Models We...
Top profile Call Girls In Ratlam [ 7014168258 ] Call Me For Genuine Models We...
 

Parallel Computing - Lec 2

  • 1. Parallel Computing Mohamed Zahran (aka Z) mzahran@cs.nyu.edu http://www.mzahran.com CSCI-UA.0480-003 Lecture 2: Parallel Hardware: Basics
  • 2. Computer History Eckert and Mauchly • 1st working electronic computer (1946) • To reprogram it you need to re-arrange the cords • 18,000 Vacuum tubes • 1,800 instructions/sec • 3,000 ft3
  • 4. Computer History • Von Neumann presented his idea of stored program concept. • Maurice Wilkes built it. 1st stored program computer 650 instructions/sec 1,400 ft3http://www.cl.cam.ac.uk/UoCCL/misc/EDSAC99/ EDSAC 1 (1949)
  • 5. Computer History • After the vacuum tubes, transistors were invented (1947)  2nd generations of computers • UNIVAC (UNIversal Automatic Computer) • Introduced in the 50s
  • 6. Computer History • From transistors to integrated circuits(IC)  3rd generation of computers • One IC can host hundreds (then thousands, then millions) of transistors  computers are getting smaller
  • 7. Intel 4004 Die Photo • Introduced in 1970 – First microprocessor • 2,250 transistors • 12 mm2 • 108 KHz
  • 8. Intel 8086 Die Scan • 29,000 transistors • 33 mm2 • 5 MHz • Introduced in 1979 – Basic architecture of the IA32 PC
  • 9. Intel 80486 Die Scan • 1,200,000 transistors • 81 mm2 • 25 MHz • Introduced in 1989 – 1st pipelined implementation of IA32 – 1st processor with on-chip cache
  • 10. Pentium Die Photo • 3,100,000 transistors • 296 mm2 • 60 MHz • Introduced in 1993 – 1st superscalar implementation of IA32
  • 11. Pentium 4 • 55,000,000 transistors • 146 mm2 • 3 GHz • Introduced in 2000 http://www.chip-architect.com
  • 12. Pentium 4 IBM Power 9 (24 cores) Core 2 Duo (2 cores) AMD RyZen(8 cores to 32 cores) Intel Core i9 (22 cores )
  • 13. How did the hardware evolve like that? Let’s look at different waves (generations of architectures)
  • 14. First Generation (1970s) Single Cycle Implementation
  • 15. Copyright © 2010, Elsevier Inc. All rights Reserved The Von Neumann Architecture
  • 16. Second Generation (1980s) DF CI E •Pipelinining: •the hardware divided into stages •temporal parallelism •Number of stages increases with each generation •Maximum CPI (Cycles Per Instruction) = 1 •Due to dependencies (i.e. an instruction must wait for the result of another instruction) Fetch ExecuteIssueDecode Commit
  • 17. Some Enhancements Cache Memory Virtual Memory TLBMulti-level caches
  • 18. Third Generation (1990s) DF CI E E E •ILP (Instruction Level Parallelism) •Spatial parallelism •Executing several instructions at the same time is called superscalar capability. •performance = instructions per cycle (IPC) •Speculative Execution (prediction of branch direction) is introduced to make the best use of superscalar capability  This can make some instructions execute out-of-order!!
  • 19. Fourth Generation (2000s) DF CI E E E DF CI E E E Simultaneous Multithreading (SMT) (aka Hyperthreading Technology)
  • 21. An operating system “process” • An instance of a computer program that is being executed. • Components of a process: – The executable machine language program – A block of memory – Descriptors of resources the OS has allocated to the process – Security information – Information about the state of the process Copyright © 2010, Elsevier Inc. All rights Reserved
  • 22. Multitasking • Gives the illusion that a single processor system is running multiple programs simultaneously. • Each process takes turns running time slice • After its time is up, it waits until it has a turn again. Copyright © 2010, Elsevier Inc. All rights Reserved
  • 23. Threading • Threads are contained within processes. • They allow programmers to divide their programs into (more or less) independent tasks. • The hope is that when one thread blocks because it is waiting on a resource, another thread will have work to do and can run. Copyright © 2010, Elsevier Inc. All rights Reserved
  • 24. As you can see … We can have several processes, executed in a multitasking fashion, and each process can consist of several threads.
  • 25. The Status-Quo • We moved from single core to multicore to manycore: – for technological reasons, as we saw last lecture. • Free lunch is over for software folks – The software will not become faster with every new generation of processors • Not enough experience in parallel programming – Parallel programs of old days were restricted to some elite applications -> very few programmers – Now we need parallel programs for many different applications
  • 26. How Did These Advances Happen? Computer Architecture Software Community Process Technology Wishes • Performance • Restrictions • Restrictions • Capabilities Design
  • 27.
  • 28. Conclusions • The hardware evolution, driven by Moore’s law, was geared toward two things: – Exploiting parallelism – Dealing with memory (latency, capacity) Powered by TCPDF (www.tcpdf.org)Powered by TCPDF (www.tcpdf.org)