Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Parallel and Distributed Computing.pdf
1. Systolic Architecture
What Is a Systolic Array?
Asystolic amay is an arangement of processors in an array
where data flows synchronously across the aray between
nerphbors, usually with different data flowing in diferent directions
Each processor at each step takes in data from one or more
neighbors(eg. North and West), processes it and, in the next
step, outputs results in the opposite direction (South and East).
2. Click to add title
What Is a Systolic Array?
A specialized form of parallel computing.
Multiple processors connected by short
wires.
Unlike many forms of parallelism which
lose specd through their connection.
Cells(processors), compute data and store it
independently of cach other.
3. Click to add title
Systolic Unit(cell)
Each unit is an independent processor.
Every processor has some registers and an
ALU.
The cells share information with their
ncighbors, after performing the necded
operations on the data.
4. Click to add title
Some simple examples ofsystolic aray models
H
Notes Comments
5. Example
Matrix Multiplication
aii az a3 bu bizbu Cu c2 Ci
azi a2 a bu ba b» Cz1 C2Cz
ai azas bs ba bss CI C2 C
Conventional Method: N
For11 toN
ForJ 1 to N
For K 1 toN
C[LJ-C[LJ)+A[JK]°B[KJ;
6. Systolic Method
This wll run in O(n) time!
Torun in N time we necd NxN processing units, inthiscase
we need 9.
P P2 P3
P4 P5 P6
P7 PS P9