The document contains graphs and charts comparing the performance of different techniques for dynamically allocating threads (CTAs) to cores on a GPU. It shows that dynamically allocating CTAs (DYNCTA) achieves higher performance than static thread allocation, while using less power and energy than alternative dynamic allocation methods that do not leverage power gating of unused cores.

1. 1.6
Minimum TLP Optimal TLP
Normalized IPC
1.2
0.8
0.4

2. C C C C C C
L1 L1 L1 L1 L1 L1
On Chip Network
L2 L2 L2 L2
DRAM DRAM DRAM DRAM

3. Application
Kernel ... Kernel ... Kernel
CTA
… CTA
… CTA
Warp Warp
Thread
…

4. Active Time
Ratio (RACT)
0%
100%
20%
40%
80%
60%

5. IPC lat_rt util
1.4
1.2 AES
1
0.8
0.6
0.4
0.2
0
1 2 3 4

6. IPC lat_rt util
1.4
1.2 CP
1
0.8
0.6
0.4
0.2
0
1 2 3 4 5 6 7 8

7. IPC lat_rt util
1.4
1.2 JPEG
1
0.8
0.6
0.4
0.2
0
1 2 3 4 5 6 7 8

8. 1.05
IPC lat_rt util
MM
1
0.95
0.9
0.85
0.8
0.75
0.7
1 2 3 4 5 6 7 8

9. 1.4
Normalized IPC 1.2
1
0.8
0.6
0.4
0.2 AES MM
0 JPEG CP
1 2 3 4 5 6 7 8
Number of CTAs

10. 1.4
Normalized latency 1.2
1
0.8
0.6
0.4
0.2 AES MM
0 JPEG CP
1 2 3 4 5 6 7 8
Number of CTAs

11. 1.4
Normalized core 1.2
utilization 1
0.8
0.6
0.4
0.2 AES MM
0 JPEG CP
1 2 3 4 5 6 7 8
Number of CTAs

12. CTA 1
CTA 2
Core 1
CTA 3 Idle
CTA 4
CTA 5
CTA 6
Core 2
CTA 7
CTA 8

13. Core 1
CTA 1 CTA 6
CTA 2 CTA 7
I
Core 2
CTA 3 CTA 8 d
CTA 4 CTA 5
l
e

14. C_idle C_mem
H L L M H
L
- -
C_stall
M
- -
H
-
: Increment n
: Decrement n

15. 1
Relative performance
0.9
0.8
0.7 Type1
0.6 Type2
0.5
0 4 8 12 16
Number of cores turned off

16. 1
Relative performance
0.9
0.8
0.7 Type1
0.6 Type2
0.5
0 4 8 12 16
Number of cores turned off

17. 1.6
DYNCTA Optimal TLP
Normalized IPC
1.4
1.2
1
0.8

18. 1.6
TL DYNCTA Optimal TLP
Normalized IPC
1.4
1.2
1
0.8

19. 1.6
Round Trip Fetch Latency Core Utilization
Normalized Value
1.2
0.8
0.4
0

20. Average n N opt RACT
4.5 1
Active time ratio (RACT)
4 0.9
Number of CTAs
3.5 0.8
3 0.7
0.6
2.5
0.5
2
0.4
1.5 0.3
1 0.2
0.5 0.1
0 0

21. Average n N opt RACT
9 1
Active time ratio (RACT)
8 0.9
Number of CTAs
7 0.8
6 0.7
0.6
5
0.5
4
0.4
3 0.3
2 0.2
1 0.1
0 0

22. Average n N opt RACT
7 1
Active time ratio (RACT)
0.9
6
Number of CTAs
0.8
5 0.7
4 0.6
0.5
3 0.4
2 0.3
0.2
1
0.1
0 0

23. Average n N opt RACT
9 1
Active time ratio (RACT)
8 0.9
Number of CTAs
7 0.8
6 0.7
0.6
5
0.5
4
0.4
3 0.3
2 0.2
1 0.1
0 0

24. Average number of
CTAs
0
2
4
6
8
N
DYNCTA
Optimal

25. 1.4
DYNCTA DYNCORE with power gating DYNCORE without power gating
Normalized Power
1.2
1
0.8
0.6
0.4

26. 3
DYNCTA DYNCORE with power gating DYNCORE without power gating
2.9
Normalized Energy
2.6
2.6
2.2
Efficiency
1.8
1.4
1
0.6

27. IPC power energy
2
Normalized Value
1.5
1
0.5
0
4 8 12 16
Number of Cores Turned Off

28. IPC power energy
2
Normalized Value
1.5
1
0.5
0
64 121
Number of Nodes in the System